Blog

QLoRA + SFT on a 1B model, from baseline 40% to 84% exact match.

The math and intuition behind fine-tuning large models with a fraction of the parameters.

GPT-2 from scratch using PyTorch in single file : architecture, training loop, checkpointing, inference.

Email Working and types