How Do LLMs Work? Tokens, Context Windows and Next-Word Prediction

A large language model (LLM) works by predicting the next small piece of text, again and again, until it has written a full answer. It does not look up...