Building GPT from First Principles: Code and Intuition
Enjoy Reading This Article?
Here are some more articles you might like to read next:
- Lessons I Learnt from Building vLLM Internals
- Context in LLMs: What Determines It, What It Costs, and What Actually Works
- Serving LLMs with vLLM on RunPod: A Complete Guide
- GPU Fundamentals & LLM Inference Mental Models
- ML Training Optimization: FLOPs, Profiling, and Learning Strategies
- From Quantization to Inference: Beginner’s Guide for Practical Finetuning
- A Guide to Fine-tuning Methods in LLMs (Part 1)
- Understanding Quantization in Deep Learning
- From Scratch Implementation of ResShift Paper for Image Super-Resolution
- From Scratch Implementation of RNN, LSTM and BiLSTM: What I Learned