TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

A machine learning compiler for GPUs, CPUs, and ML accelerators

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

MLX: An array framework for Apple silicon

🚀 Efficient implementations of state-of-the-art linear attention models in Torch and Triton

DOOM's fire algo, in zig, for 256 color terminals w/no dependencies

Fast and memory-efficient exact attention

Universal Tensor Operations in Einstein-Inspired Notation for Python.

Reference implementations of MLPerf™ training benchmarks

Callable PyTrees and filtered JIT/grad transformations => neural networks in JAX.

Flax is a neural network library for JAX that is designed for flexibility.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Safe Rust wrapper for the NVIDIA Management Library

🌊 The ultimate Fish prompt.

Practical assignments for CS349H - Software Techniques for Emerging Hardware Platforms

Advanced Python Mastery (course by @dabeaz)