TwiddleLab / Artificial Intelligence / AI and Us: Using AI Well
Learning with AI, Not from It
What you will learn
- Cognitive offloading: when a tool does the thinking, your work looks better but you learn less.
- Used as a tutor, with hints, checks and quizzes, a chatbot helps you learn: you still do the thinking.
- In a 2024 study, students with open access to GPT-4 did 48% better on practice but 17% worse on the exam than students without it. A tutor version with hints mostly removed that harm.
- Chatbots make mistakes in checks too. Check their steps like you'd check your own.
How the lesson goes
Two friends study for the same test with the same chatbot. Who does better on the test?
Tap your bet, then Check.
Run their week.
Watch practice, then the Friday test without AI.
Find a way to use the chatbot that lifts both bars above 80.
Pick what the chatbot gives you, then slide how much you lean on it. Check when both bars pass the line.
How much you use AI matters less than how. Finished answers replace your thinking; hints and checks make you think more. The numbers here are a toy model, but the pattern matches real studies.
What you just found has a name.
Cognitive offloading: handing your thinking to a tool. Fine for things you don't need to learn, costly for things you do.
AI as a tutor: ask for hints, checks and quizzes instead of answers.
A real study (Bastani and others, 2024, about 1,000 high school students): open access to GPT-4 raised practice scores by 48% but lowered exam scores by 17%. A tutor version that gave hints mostly removed the harm.
Helps you learn, or does it for you?
Drag each request into a lane.
The same chatbot can be a tutor or a ghostwriter. The request decides which.
Turn "solve this" into a learning loop.
Put the five moves in order.
Each move keeps you doing the thinking, and the AI only steps in where you're stuck.
Math: you asked a chatbot to check your equation. It says x = -1. Find its mistake.
Tap the first wrong line, then Check.
Line 3 moved -6 across the equals sign without changing its sign. 3x - 6 = 2x + 5 gives x = 5 + 6 = 11. Chatbots can make slips like this, so check their checks too.
Ali and Bea both got x = 5. Which chat taught something?
Press Quiz me on both chats, then pick the one that taught.
Same answer on the page, different result in the head. A quiz on something new shows which one learned.
Your school allows AI for homework. Which use is most likely to help you on the test?
Allowed and helpful are different questions. Checking your own work keeps the practice yours.
Study sprint: five messages to your tutor bot before Friday.
Pick one message a turn. Get "ready for the test" to 80 in 5 turns.
Previous lesson: Privacy: What You Give Away · Next lesson: Prompting as Clear Thinking · Part of the course: AI and Us: Using AI Well
Lessons are interactive and need JavaScript. Turn it on to play them.
