AI Glossary

Large Language Model

A large language model (LLM) is a neural network trained on a very large amount of text to predict the next token, which lets it write, summarize, translate and answer questions. It is the engine inside chat assistants and most AI agents.

Also known as: LLM, LLMs, large language models

· Chain of Thought

Model Architecture

A large language model reads text as tokens and, given everything so far, predicts the next one. Repeat that a few hundred times and you get a paragraph. The “large” refers to the size of the neural network, measured in parameters, and to the amount of text it learns from in pre-training. Post-training then teaches it to follow instructions and hold a conversation.

Because the model is built to produce plausible text, it can be fluent and wrong at the same time, which is why LLMs hallucinate. On its own it also doesn’t know about events after its knowledge cutoff or about your private data. Most useful AI products wrap the model in more: retrieved documents, tools, memory and checks. How large language models actually work walks through the whole process.

Go deeper

From the conversation