TwiddleLab / Courses / Artificial Intelligence
How a Neural Network Thinks
Teach a tiny network, one example at a time, and see how it learns.
Lessons
- Learning from Examples (5 min): AI learns from labeled examples, not from rules someone typed in.
- Features as Coordinates (7 min): A feature is a number measured from a thing, like weight or redness.
- A Line Separates the Classes (7 min): A line that splits the feature space into classes is a decision boundary.
- Measuring Wrongness (6 min): The gap between a point and the line is an error.
- Rolling Down the Loss (7 min): Feel the slope, step downhill, repeat: that's gradient descent.
- The Learning Loop (7 min): One training step is predict, measure, adjust, always in that order.
- A Neuron Is a Weighted Vote (7 min): A neuron adds up its inputs, each times its weight, and fires when the sum reaches the threshold.
- Networks Solve XOR (7 min): One neuron draws one straight line, so it can't solve XOR.
- Why Networks Get Fooled (7 min): A model that learns its training data too closely, noise and all, is overfitting: perfect on old data, bad on new.
- Project: Train Your Own (8 min): Accuracy is the share of points a network gets right. The test set gives the honest one.
Lessons are interactive and need JavaScript. Turn it on to play them.