Hi all
I wrote this "blog" Google colab notebook for friends and family who have little technical know-how or do not yet have an understanding of language models. It's based on nanoGPT (a minimal GPT implementation from Andrej Karpathy, ex-OpenAI - not sure whether there is a need to state this here).
However, I rewrote the code from scratch, made it more explicit, and have lots of textual information such that everyone should be able to follow what is happening when, and train their own little GPT :)
Hope it helps some people and let me know if you have any questions/feedback.
Tl;dr: Blog about how LLMs work & train a mini model without prior knowledge.
