Categories
from token to chatbot
3 articles
-
From Token to Chatbot · Episode 1 July 12, 2026 · 36 minHow an LLM Builds a Word
An LLM does only one thing: predict the next word, over and over. Part one of the series 'From Token to Chatbot' — tokens, embeddings, logits and softmax, with hands-on Python to watch GPT-2 hesitate and then pick 'Paris'.
Read more ↗ -
From Token to Chatbot · Episode 2 July 16, 2026 · 32 minAttention: How Words Talk to Each Other
Part 2 of the series 'From Token to Chatbot'. The attention mechanism explained with zero math background required: dot product, softmax and the Query/Key/Value trio, with hands-on Python to watch a model link 'it' to 'cat'.
Read more ↗ -
From Token to Chatbot · Episode 3 August 24, 2026 · 24 minRandomness Under Control: Temperature, Top-k, Top-p
Part 3 of the series 'From Token to Chatbot'. How an LLM actually picks the next word: greedy, sampling, and the three dials temperature / top-k / top-p, with hands-on Python to feel the balance between reliability and creativity.
Read more ↗