Orientation: relearning math
Why exam math did not stick, the three-pass method, and a cold diagnostic that finds your real holes before you waste time on things you already know.
You already met all of this once — for an exam, on a deadline, with a formula sheet. This is the second pass: same ideas, but built around why they exist, what they mean geometrically, and where they show up inside the models you actually train.
Learning math to pass a test produces a very specific kind of knowledge: you can recognise a problem, recall the recipe, and get the mark — and then it evaporates, because it was stored as procedure with no purpose attached. Machine learning punishes that hard. In ML, math is not an entrance exam; it is the working language. A matrix is your dataset, a gradient is your training signal, a probability is your model's confidence, an entropy is your loss function.
So this notebook is organised the other way around: every topic starts from the problem it solves, moves to the picture in your head, and ends with the line of code where it becomes real. Goal: reach machine-learning fluency — and be genuinely ready for deep learning and agentic models afterwards, where this same math is used at larger scale.
Find your holes with a cold diagnostic, then learn the three-pass method the whole site runs on.
The two languages of ML: space (vectors, matrices, eigen, SVD) and change (derivatives, gradients, chain rule). This track is the heaviest — and the highest leverage.
Data is noisy and samples are small. This track is how you make honest claims: Bayes, distributions, estimators, tests, entropy and why losses use log.
Where the previous tracks combine: how a model actually learns (gradient descent, regularization, Lagrange) and how classic algorithms are assembled from the math you now own.
A checklist, an 8-week schedule, and the map of how every idea here reappears inside neural networks, transformers and agent loops.
Why exam math did not stick, the three-pass method, and a cold diagnostic that finds your real holes before you waste time on things you already know.
Notation as a compression language: functions, parameters, summations, vectors, and the single equation f(x; θ) that every machine learning model is an instance of.
Vectors are data, matrices are transformations. Dot products, projections, norms, eigen and SVD — and why PCA, embeddings, recommendations and attention are all this one subject.
Derivatives as sensitivity, gradients as direction, the chain rule as backpropagation, Jacobians and Hessians — the machinery that makes "learning" a computable thing.
Conditional probability, Bayes, the distributions that keep reappearing, expectation and variance — ML as a machine for making well-calibrated bets on noisy data.
Estimators, bias–variance, confidence intervals, hypothesis tests, A/B tests and cross-validation — the discipline that separates "the model scored 0.93" from "the model is better".
Surprise, entropy, cross-entropy and KL divergence — derived from first principles, so that cross-entropy loss stops being a memorised formula and becomes an obvious one.
Loss surfaces, convexity, gradient descent and its variants, momentum and Adam, regularization, and Lagrange multipliers — the engine room behind every trained model.
Rebuild ordinary least squares, logistic regression, ridge/lasso, k-means, Naive Bayes, decision trees and SVM from the pieces you already own — and implement several from scratch.
The mastery checklist, an 8-week schedule with spaced review, and the explicit map of how this math reappears in neural networks, transformers, diffusion and agent loops.
Progress and quiz scores sync across all your devices through your own server — no account —
with localStorage keeping an offline copy on each device.
Each module has a Mark done toggle; only tick it when you can explain the topic aloud without notes.
This site teaches the math. Your practice with actual models lives in the ML notebook next door: Machine Learning Relearn — from first principles to production. Modules here link across when an idea becomes an algorithm over there (for example, calculus → ML module 05 · Regression & gradient descent).
Fast lookup when you are coding: the notation & formula reference — common symbols, matrix identities, derivative rules, the distributions that show up in ML, and every loss function written out with the math that justifies it.