The goal E University
An AI service in operation
Observability, prompts as code, agent loops and tool use — how an AI feature is run once it actually has users.
- Knowledge nodes
- 87
- From zero
- about 60 h
- Labs
- 6
See what you already know — no account
The diagnostic removes what you already know, so your path is usually much shorter.
What you can do afterwards
- BReinforcement learning: learning from feedback
- CRetraining the model with your own examples
- CAI that uses tools: the calculator
- ECost, quotas and pricing
- EUX for AI features
- EPrompts as code: versioning and testing
- EObservability for ML systems
- EProduct metrics for AI features
- EThe ReAct loop: think, act, observe
- BFrom idea to app
- DDesigning for the AI being wrong
Labs along the way
You write the code. Tests you cannot see decide whether it holds up.
Lab: an agent loop with tools, a budget and a traceEa sandbox · about 60 minLab: build an eval harnessEa sandbox · about 60 minLab: a neural network in pure NumPy — forward, backprop, gradient checkDa sandbox · about 75 minLab: dot product, norm and cosine similarityDin the browser · about 40 minLab: gradient descent from scratchDin the browser · about 50 minLab: matrix multiplication and one layer of a neural networkDin the browser · about 45 min
The whole path
Everything the goal builds on, grouped by level and in the order it builds on itself. Show on the map
AExplorer5 knowledge nodes
BInvestigator16 knowledge nodes
- Data in everyday life
- Algorithmic thinking
- Debugging: finding the error in the code
- Rule-based systems and machine learning
- Source criticism and responsibility in AI use
- Reinforcement learning: learning from feedback
- Training data, features and labels
- Classification: how a model sorts information
- Generative AI: how it creates content
- Language models and probabilities
- AI's invented answers
- Conditions in code: if–else
- Variables: named storage locations
- Identifying and fixing bugs
- Build a simple scoring system in code
- From idea to app
CBuilder17 knowledge nodes
- Functions and coordinate systems
- Programming logic — variables, conditions, loops
- Python — the basics
- Python — lists, loops and dictionaries
- Python — strings and text processing
- Python — files, CSV and JSON
- Statistics — mean, median and spread
- Probability — the basics
- Manual data labelling
- Linear regression: fitting a straight line to data
- Neural networks — the intuition
- Prompting — steering a language model
- Experiment: biased training data and its consequences
- Project: train an image classifier in the browser
- Retraining the model with your own examples
- AI that uses tools: the calculator
- Does my app need AI?
DAI developer26 knowledge nodes
- Derivatives and optimisation
- Python — functions, scope and exceptions
- Python — classes and objects
- APIs and HTTP
- Probability distributions
- Loss functions
- The normal distribution and standardisation
- Samples and uncertainty
- Testing with pytest
- Tokenisation
- Gradient descent
- The context window, system prompts and few-shot
- Vectors
- Matrices and matrix multiplication
- Linear regression with several features
- Neural networks — the forward pass with matrices
- Backpropagation
- Embeddings — words as vectors
- Attention
- Overfitting and generalisation
- PyTorch — tensors and autograd
- Retrieval — finding the right text
- Training, validation and test
- Train a neural network in PyTorch
- Transformers — the architecture
- Designing for the AI being wrong
EUniversity23 knowledge nodes
- Asynchronous programming
- Building an API with FastAPI
- Confidence intervals
- Hypothesis testing and p-values
- A/B tests and experiment design
- Multi-head attention in detail
- The KV cache
- Latency, throughput and batching in inference
- Cost modelling for LLM systems
- Cost, quotas and pricing
- Language models — training and generation
- Hallucinations — causes and countermeasures
- UX for AI features
- Model evaluation
- Build an eval harness
- Prompts as code: versioning and testing
- From prototype to product
- Observability for ML systems
- Product metrics for AI features
- RAG — retrieval-augmented generation
- Tool use
- Agents — plan, act, observe
- The ReAct loop: think, act, observe