Generative AI: how it creates content
Understand how generative AI produces text and images through probability-based predictions, and why it can generate incorrect information.
Prerequisites
Everyday explanation
Traditional AI classifies: is it an invoice or a receipt? Generative AI creates: a new email, an image, or a code snippet.
How does it do this? It has processed vast amounts of data and learned patterns in language. If you type “Dear customer, we regret that …”, it guesses “the delivery is delayed” or “an error has occurred” — phrases that often follow. It builds a complete text one word at a time.
It guesses; it does not verify. Therefore, the text can be fluent and professional — yet factually incorrect.
Intuition
Image generation works on the same logic, but with pixels: from random noise, it builds an image step by step that matches your description. Six fingers on a hand? The model has not learned that hands have exactly five fingers — it has only learned how hands often look in images.
Three key points to remember:
- It generates new content; it does not copy (though it builds on what it was trained on).
- It can be incorrect even if the text or image looks credible.
- It has no understanding of truth or falsehood; it optimises for probability.
Mastery means
- Explains that generative AI creates new content by predicting the next element based on patterns
- Can provide examples of when generative AI delivers incorrect facts despite the text sounding credible
Sign in to do the exercises and build your mastery up.
Sources
- Wikipedia — Generativ artificiell intelligens (CC BY-SA 4.0) — CC BY-SA 4.0
- Skolverket — About AI in school (in Swedish) — Skolverket's open terms
Leads to
Part of the goals (13)
- AI, ethics and society
- Computers that see and hear
- Discoverer — build a game and train a machine
- An AI service in operation
- Language models in practice
- Build an agent you can trust
- Understand how generative AI works
- Build a RAG system you can trust
- Fine-tune and run your own models
- Build a memory system for an agent
- Builder — collect data, train a model and test AI critically
- Statistics for experiments
- Run models more cheaply: quantisation