Skip to content

Issues: karpathy/llm.c

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
118 Open 479 Closed
118 Open 479 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Speedup attention_forward_kernel2 by implementing Flash Attention 2 kernel
#60 opened Apr 11, 2024 by leloykun Loading…
2
Tied and untied weights for LLama3
#803 opened Apr 14, 2025 by ngc92 Loading…
add llama 3 support to llm.c
#754 opened Sep 13, 2024 by karpathy • Draft
cuDNN for llama3
#808 opened May 1, 2025 by ngc92 Loading…
A CS 231n-style port of this project, implementing LLMs solely with NumPy
#784 opened Nov 18, 2024 by davidtag Loading…
Mapping "py" gpt2 functionalities to match "c"
#783 opened Oct 31, 2024 by omarswelam Loading…
[layernorm.cuh] Minor fix with 32 replaced by WARP_SIZE
#544 opened Jun 4, 2024 by lancerts Loading…
3
[attension.cuh] Move assert outside of attn kernel to launcher
#545 opened Jun 4, 2024 by lancerts Loading…
Make ceil_div constexpr and inline
#404 opened May 12, 2024 by lancerts Loading…
float4 with better vectorization for adamw.cu
#268 opened Apr 27, 2024 by lancerts Loading…
Rewrite the encoder_forward float4 kernel with pack128
#302 opened Apr 30, 2024 by lancerts Loading…
Use the command 'brew --prefix libomp' to retrieve the location where libomp would be installed on macOS.
#87 opened Apr 12, 2024 by linmajia Loading…
1
convert all float to floatX for layernorm_forward
#319 opened May 1, 2024 by JaneIllario Loading…
[dev/cuda] Added warpsize as a constant expr for dev/cuda files
#438 opened May 20, 2024 by lancerts Loading…
1
[dev/cuda] Include a matmul_backward_bias kernel based on PMPP CoarsenedSumReduction kernel in 10.15
#419 opened May 16, 2024 by lancerts Loading…
5
add http status check for download_file
#638 opened Jun 25, 2024 by BilyZ98 Loading…
2
Micro optimization for softmax_forward_kernel5
#762 opened Sep 20, 2024 by insop Loading…
6
Add repkv_backward_kernel2 and repkv_kernel2 (llama3 branch)
#771 opened Sep 28, 2024 by insop Loading…
2
Adds dev container to speed up project onboarding
#577 opened Jun 11, 2024 by nibzard Loading…
2
Fix MSVC compilation error with openMP
#460 opened May 25, 2024 by avflyer Loading…
7
Optionally specify root location of CUDNN
#634 opened Jun 24, 2024 by koparasy Loading…
Check for the existence of CUDNN_FRONTEND_PATH before looking in default directories. If it exists, skip additional checks.
#628 opened Jun 21, 2024 by koparasy Loading…
8
Add cmake and fix OMP
#452 opened May 23, 2024 by avflyer Loading…
3
only save missing bits to reconstruct fp32 master weights
#432 opened May 19, 2024 by ngc92 Loading…
9
feat(attention_forward.cu): Gentle introduction to CuTe(cutlass)
#233 opened Apr 23, 2024 by FeSens Loading…
9
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.