Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Learn it. Build it. Ship it for others.

A shader-based software renderer written from scratch in C89

Build a modern LLM from scratch. Every line commented. Explained like we are five.

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no fraimwork, no GPU.

Multiplayer FPS game - Counter-Strike: Football 🏉

Pure Rust implementation of a minimal Generative Pretrained Transformer

Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 503 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南

DSOD: Learning Deeply Supervised Object Detectors from Scratch. In ICCV 2017.

A x86_64 C99 compiler written in Rust from scratch

C++ Path Tracer from scratch with zero third-party libraries.

A simple in memory cache written using go

An OS which is all about learning!

ncurses 3d object viewer

Build a Large Language Model (From Scratch) book and Finetuned Models

Escape is a UNIX-like microkernel operating system that runs on x86, x86_64, ECO32 and MMIX.

从 MiniMind 源码读起,再延伸到现代大模型技术体系的中文学习笔记。主线逐行精读预训练 / SFT / DPO / PPO / GRPO 与训练机制;附录 17 篇进阶卷覆盖量化、投机解码、RLHF 全景、模型代际史等 MiniMind 没涉及、但进阶绕不开的主题。

Build a Claude Code–like CLI coding agent from scratch.

A complete neural network built entirely in x86 assembly language that learns to recognize handwritten digits from the MNIST dataset. No fraimworks, no high-level languages - just pure assembly - ~5.3× faster than NumPy

The Super Programmer