SGLang is a fast serving framework for large language models and vision language models.

Ongoing research training transformer models at scale

A PyTorch Native LLM Training Framework

Tensors and Dynamic neural networks in Python with strong GPU acceleration

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2023)

Python package built to ease deep learning on graph, on top of existing DL frameworks.

Large scale graph learning on a single machine.

[ICLR 2022] "PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication" by Cheng Wan, Youjie Li, Cameron R. Wolfe, Anastasios Kyrillidis, Nam Sung …

📊 A simple command-line utility for querying and monitoring GPU status

Geometric Deep Learning Extension Library for PyTorch

Pytorch reimplementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)