Popular repositories Loading

1. LLMCompiler LLMCompiler Public

   [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

   Python 1.7k 124

2. SqueezeLLM SqueezeLLM Public

   [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

   Python 690 45

3. TinyAgent TinyAgent Public

   [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!

   Python 408 63

4. KVQuant KVQuant Public

   [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

   Python 355 31

5. LLM2LLM LLM2LLM Public

   [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement

   Python 183 13

6. SqueezedAttention SqueezedAttention Public

   SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference

   Python 46 6