Train transformer language models with reinforcement learning.

A high-throughput and memory-efficient inference and serving engine for LLMs

ROCm Communication Collectives Library (RCCL)

Matrix-free linear algebra in JAX.

PraisonAI application combines AutoGen and CrewAI or similar frameworks into a low-code solution for building and managing multi-agent LLM systems, focusing on simplicity, customisation, and effici…

A machine learning compiler for GPUs, CPUs, and ML accelerators

Test suite for probing the numerical behavior of NVIDIA tensor cores

Deep Learning model for protein and ligand complex structure prediction from sequences and SMILES

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

NumPy & SciPy for GPU

Tensors and Dynamic neural networks in Python with strong GPU acceleration

ROCm SMI LIB

🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.

NeMo: a toolkit for conversational AI

TensorFlow ROCm port

GroqFlow provides an automated tool flow for compiling machine learning and linear algebra workloads into Groq programs and executing those programs on GroqChip™ processors.

Common utilities for ONNX converters

Fast and Easy Infinite Neural Networks in Python

Molecular dynamics and Monte Carlo soft matter simulation on GPUs.

Tracking DE Shaw Research's random123 library

HIP : Convert CUDA to Portable C++ Code

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

Multilingual Sentence & Image Embeddings with BERT

Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch

torch-optimizer -- collection of optimizers for Pytorch

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning

Utilities for Dask and CUDA interactions