A collection of interesting links, tools, articles, and resources I've found across the web.
Deep learning at the speed of light.
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Training LLMs often feels like alchemy, but understanding and optimizing the performance of your models doesn't have to. This book aims to demystify the science of scaling language models.