AI Interview Series #1: Explain Some LLM Text Generation Strategies Used in LLMs
Every time you immediate an LLM, it doesn’t generate an entire reply — it builds the response one phrase (or token) at a time. At every step, the mannequin predicts the chance of what the subsequent token could possibly be based mostly on every part written to this point. But realizing possibilities alone isn’t sufficient…