Skip to content

A plain-English guide for business leaders

AI vocabulary in plain English: 14 terms

You do not need to be an engineer to take part in an AI decision. You do need a shared vocabulary for what a system does, what information it uses, and who stays in control.

  • 14 terms
  • 5 groups
  • 7 guest moments
  • 13 explainers

This guide explains 14 terms business and industry leaders keep hearing. Start with generative AI, then work through models, company data, agents, and infrastructure. The business examples are illustrative.

Read straight through or jump to a group below. Each term includes a question or implication to take into your next conversation, with glossary definitions, deeper explainers, and selected guest discussions to follow.

Practice these 14 terms

Explain the term in your own words, then open its definition to compare.

GenAI: generative artificial intelligence

Definition

Generative AI produces content, such as text, images, audio, or code, from patterns learned during training. For example, an operations manager could use it to draft a supplier email from delivery notes, then check the dates and commitments before sending it.

Read this term in the guide

LLMs: large language models

Definition

A large language model is a type of AI trained on large amounts of text that generates language by predicting the next token, or piece of text. It can help a finance team turn a long report into a short briefing, but a fluent summary can still contain mistakes.

Read this term in the guide

Tokens

Definition

Tokens are the units of text a model processes: a whole word, part of a word, or punctuation. When a team asks an assistant to summarize a long incident report, both the supplied text and generated response use tokens; token counts affect request limits and, for token-priced services, cost.

Read this term in the guide

Context

Definition

Context is the information available to a model for the task at hand, including instructions, conversation history, documents, and tool results. For an assistant answering a clinical-trial operations question, that might mean the relevant protocol section and an approved site procedure. The context window is the limited space available, not permanent memory of every document your organization holds.

Read this term in the guide

Prompts

Definition

A prompt is the input you give a model to guide its response, often combining a request, instructions, and examples. A procurement manager might ask: “Compare these three proposals on price, delivery dates, and exclusions; flag any missing information.” That is more specific than simply asking which proposal is best.

Read this term in the guide

Hybrid reasoning

Definition

In model descriptions, hybrid reasoning can mean one model that supports both quick responses and extended reasoning before it answers. For example, a finance team could use a quick mode to rephrase an email and a reasoning mode to work through conflicting assumptions in a budget plan. Extra reasoning takes time and computing resources; it does not guarantee a correct result.

Read this term in the guide

RAG: retrieval-augmented generation

Definition

RAG means finding relevant information and supplying it to a model when it writes an answer. A support assistant could retrieve the applicable warranty policy before explaining whether a repair is covered. This can bring company information into an answer without retraining the model, but the search or the answer can still be wrong.

Read this term in the guide

Vector databases

Definition

A vector database stores numerical representations of data, called embeddings, and searches for similar ones. That can help an operations team find maintenance notes about an overheating motor even when the question uses different wording. Similarity is a search signal, not proof that a result is the right document.

Read this term in the guide

Agents

Definition

In language-model applications, an agent uses a model to choose actions toward a goal, use tools, and decide what to do next from the results. For example, an operations agent could investigate a late shipment by checking an order, reading a carrier update, and drafting a response. The application controls which tools and permissions it has.

Read this term in the guide

Autonomous

Definition

Autonomous describes how much work a system can do without a person directing or approving each step. An invoice assistant might collect records and prepare a reconciliation on its own while still needing approval to release a payment. Autonomy has a scope; it does not mean unlimited authority.

Read this term in the guide

HITL: human in the loop

Definition

Human in the loop means a person takes part at a defined point in an AI process, such as reviewing an output or approving an action. For example, a trial coordinator could review an AI-drafted site communication before it is sent. A person who only monitors completed actions has a different role from someone whose approval is required first.

Read this term in the guide

MCP: Model Context Protocol

Definition

MCP is an open protocol: a shared way for AI applications to connect to tools and data. For example, an internal assistant could use an MCP connection to search an approved document library. The connection still needs compatible software and access controls; the protocol itself does not grant permission to read every file.

Read this term in the guide

GPUs: graphics processing units

Definition

A GPU is a chip designed to perform many calculations in parallel, which helps with training and running AI models. For example, an operations team could rent GPU-backed computing to process a large batch of scanned invoices with an AI model.

Read this term in the guide

Hyperscalers

Definition

In cloud discussions, hyperscalers are providers of computing, storage, and other services at very large scale, such as Amazon Web Services, Microsoft Azure, and Google Cloud. A manufacturer could rent capacity from one to run an internal maintenance assistant instead of building its own server facility.

Read this term in the guide

Part 1 · 1 term

Start with the umbrella: GenAI

GenAI: generative artificial intelligence

Generative AI produces content, such as text, images, audio, or code, from patterns learned during training. For example, an operations manager could use it to draft a supplier email from delivery notes, then check the dates and commitments before sending it.

Why it matters to you: Separate creating a useful draft from confirming that its contents are correct.

Part 2 · 5 terms

How the models work

LLMs: large language models

A large language model is a type of AI trained on large amounts of text that generates language by predicting the next token, or piece of text. It can help a finance team turn a long report into a short briefing, but a fluent summary can still contain mistakes.

Why it matters to you: Ask how important claims will be checked, even when the writing sounds confident.

Tokens

Tokens are the units of text a model processes: a whole word, part of a word, or punctuation. When a team asks an assistant to summarize a long incident report, both the supplied text and generated response use tokens; token counts affect request limits and, for token-priced services, cost.

Why it matters to you: Budget for the documents going in and the work coming out, not just the length of the answer you see.

Context

Context is the information available to a model for the task at hand, including instructions, conversation history, documents, and tool results. For an assistant answering a clinical-trial operations question, that might mean the relevant protocol section and an approved site procedure. The context window is the limited space available, not permanent memory of every document your organization holds.

Why it matters to you: Ask which records the assistant actually received, whether they are relevant, and whether they are up to date.

Prompts

A prompt is the input you give a model to guide its response, often combining a request, instructions, and examples. A procurement manager might ask: “Compare these three proposals on price, delivery dates, and exclusions; flag any missing information.” That is more specific than simply asking which proposal is best.

Why it matters to you: State the task, evidence, and output you need; wording alone cannot supply facts the model has not been given.

Hybrid reasoning

In model descriptions, hybrid reasoning can mean one model that supports both quick responses and extended reasoning before it answers. For example, a finance team could use a quick mode to rephrase an email and a reasoning mode to work through conflicting assumptions in a budget plan. Extra reasoning takes time and computing resources; it does not guarantee a correct result.

Why it matters to you: Ask what the vendor means by “hybrid,” then compare speed, cost, and accuracy on your own tasks.

Part 3 · 2 terms

Building on your own data

RAG: retrieval-augmented generation

RAG means finding relevant information and supplying it to a model when it writes an answer. A support assistant could retrieve the applicable warranty policy before explaining whether a repair is covered. This can bring company information into an answer without retraining the model, but the search or the answer can still be wrong.

Why it matters to you: Check both the retrieved evidence and whether the answer follows from it.

Vector databases

A vector database stores numerical representations of data, called embeddings, and searches for similar ones. That can help an operations team find maintenance notes about an overheating motor even when the question uses different wording. Similarity is a search signal, not proof that a result is the right document.

Why it matters to you: Ask whether search also respects access permissions, dates, and the equipment or customer the question concerns.

Part 4 · 4 terms

Agents and oversight

Agents

In language-model applications, an agent uses a model to choose actions toward a goal, use tools, and decide what to do next from the results. For example, an operations agent could investigate a late shipment by checking an order, reading a carrier update, and drafting a response. The application controls which tools and permissions it has.

Why it matters to you: Evaluate the steps and actions, as well as the final answer.

Autonomous

Autonomous describes how much work a system can do without a person directing or approving each step. An invoice assistant might collect records and prepare a reconciliation on its own while still needing approval to release a payment. Autonomy has a scope; it does not mean unlimited authority.

Why it matters to you: Define exactly which actions can happen without approval, and how a person can stop or correct them.

HITL: human in the loop

Human in the loop means a person takes part at a defined point in an AI process, such as reviewing an output or approving an action. For example, a trial coordinator could review an AI-drafted site communication before it is sent. A person who only monitors completed actions has a different role from someone whose approval is required first.

Why it matters to you: Specify who reviews what, when they can intervene, and what evidence they see.

MCP: Model Context Protocol

MCP is an open protocol: a shared way for AI applications to connect to tools and data. For example, an internal assistant could use an MCP connection to search an approved document library. The connection still needs compatible software and access controls; the protocol itself does not grant permission to read every file.

Why it matters to you: Ask which systems are connected and what each connection allows the assistant to do.

Part 5 · 2 terms

The hardware and the cloud

GPUs: graphics processing units

A GPU is a chip designed to perform many calculations in parallel, which helps with training and running AI models. For example, an operations team could rent GPU-backed computing to process a large batch of scanned invoices with an AI model.

Why it matters to you: Ask what the proposed hardware delivers on your workload and what each completed task costs.

Hyperscalers

In cloud discussions, hyperscalers are providers of computing, storage, and other services at very large scale, such as Amazon Web Services, Microsoft Azure, and Google Cloud. A manufacturer could rent capacity from one to run an internal maintenance assistant instead of building its own server facility.

Why it matters to you: Identify the provider behind the service, where your data goes, and which responsibilities remain with your team.

A learning path from basics to technical

Ready for more than 14 terms? Work through these five stages in order. Each one builds on the stage before it, moving from everyday vocabulary to how models work, how teams build with them and how they check the results. Start with each stage’s core terms, listed first. The headed groups after them add detail when you want it.

  1. Stage 1 · 23 terms

    The basics

    What AI is, how machine learning differs from rules, and where generative AI fits.

  2. Stage 2 · 23 terms

    Inside a language model

    How text becomes tokens and vectors, and how a transformer learns to predict the next token.

  3. Stage 3 · 29 terms

    Using models

    What shapes an answer at request time, and why a fluent answer can still be wrong.

  4. Stage 4 · 34 terms

    Building with AI

    Connecting models to tools and data, adapting them, and running them as a system.

  5. Stage 5 · 28 terms

    Evaluation, safety and governance

    Measuring whether the system works, testing how it fails, and deciding who is accountable.

Go deeper

Bring one real task to your next AI conversation. Ask what information the system needs, what it may do, and how you will check the result. Use these resources to work through the details.

A shorter alternative: ten terms

Prefer a shorter route after the 14 essentials? Use this optional ten-term shortlist instead of the five-stage learning path. It covers how models are built, steered and checked.

  1. Inference
  2. Training Data
  3. Model Parameters
  4. Temperature
  5. System Prompt
  6. Knowledge Cutoff
  7. AI Hallucination
  8. Embeddings
  9. Fine-Tuning
  10. AI Evaluation

The newsletter

Keep the vocabulary current

New episodes and Conor Bronsdon’s essays on what they add up to. 1,300+ subscribers. Up to once a week, no spam, unsubscribe anytime.