A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a fast serving framework for large language models and vision language models.

MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。

LLMPerf is a library for validating and benchmarking LLMs

毒奶自用，懒人配置文件（Quantumult X）：去广告分流规则、Tiktok解锁重写、VSCO解锁、神机分流、blackmatrix7分流规则。

分流规则、重写写规则及脚本。

Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)

12 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

LlamaIndex (formerly GPT Index) is a data framework for your LLM applications

A Pythonic framework to simplify AI service building

multimodal document analysis

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Large Language Model Text Generation Inference

Deep Learning System core principles introduction.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Inference code for LLaMA models

Latency and Memory Analysis of Transformer Models for Training and Inference

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

Transformers 库快速入门教程

Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment