Minimalist ML framework for Rust

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

Repository for the QUIK project, enabling the use of 4bit kernels for generative inference

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

4 bits quantization of PULSE models using GPTQ

OmniQuant is a simple and powerful quantization technique for LLMs.

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

LMDeploy is a toolkit for compressing, deploying, and serving LLM

OpenMMLab Pose Estimation Toolbox and Benchmark.

OpenMMLab YOLO series toolbox and benchmark

Awesome video understanding toolkits based on PaddlePaddle. It supports video data annotation tools, lightweight RGB and skeleton based action recognition model, practical applications for video ta…

OpenMMLab Image and Video Restoration, Editing and Generation Toolbox

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

OpenMMLab Image Classification Toolbox and Benchmark

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

OpenMMLab Detection Toolbox and Benchmark