AI field guide
INTERMEDIATE · GO DEEPER · 16 MIN

Inside a language model

Tokens, training, attention and why answers vary.

LESSON 1 / 4

Training is not the same as using

During training, a model’s parameters — billions of numbers — are adjusted to reduce errors on a task such as predicting the next token. Inference uses those fixed parameters to produce outputs. A normal conversation does not change the model itself; whether chats are later used for training depends on the provider’s policy.

MAKE IT CONCRETE

Learning to play piano is training. Playing a piece is closer to inference.

Conversation context and permanent learning are different things.

CHECK YOURSELF

What happens during inference?