Blog

I occasionally write about what I’m learning and also post on Medium.

GPT-2 from scratch using PyTorch in single file : architecture, training loop, checkpointing, inference.