Blog

GPT-2 from scratch using PyTorch in single file : architecture, training loop, checkpointing, inference.