Reasoning when nothing is clear
How to build and take apart arguments, weigh odds, keep score of your forecasts, not give in to a machine out of habit.
Machines will offer ready-made decisions more and more often, and our aim is that people stay able to judge and dispute them: that is an aim, not a forecast. You will learn to take arguments apart, work out odds in plain words, keep score of your forecasts and decisions, and see which famous biases held up and which did not. This course is about your own decisions; other people’s claims and data belong to the courses next door, and why a model agrees with you to the course on dialogue.
So far there is only this table of contents. Lessons appear one at a time, and we promise no dates. Feed of new lessons (Atom)
16 lessons, 5 parts
Part 1 An argument as work
Before you agree or object, you need to see what an argument is built from and where it is weak.
- coming soon
What reasoning is for
The disputed hypothesis of Mercier and Sperber: reason evolved for arguing, so alone we look for support and together we find each other’s errors.
- coming soon
What an argument is made of
Premise, conclusion and hidden assumption: how to write out an argument, yours or someone else’s, so that it shows what needs checking.
- coming soon
Fallacies in a real argument
Why naming a fallacy does not refute it, and why in life the same move can be an error or a reasonable point.
Part 2 Odds in plain words
Most decisions need three ideas about probability and no formulas.
- coming soon
Where to start: the base rate
How to start your own estimate from the base rate when a vivid story tempts you to forget it; the idea itself is in the course on numbers.
- coming soon
Bayes without the formula
What a new fact changes in what you already believe, and how to work it out with imagined people in place of percentages.
- coming soon
The outside view
Kahneman’s point: your own plan feels special, so ask how similar ones ended, and imagine it has already failed.
Part 3 Forecasts and keeping score
The accuracy of your estimates can be measured and improved, but only if you write them down before the outcome is known.
- coming soon
Experts, the chimp and superforecasters
How Tetlock tested famous experts, and what the strongest forecasters do: they split up a question and often revise.
- coming soon
Calibrating yourself
What “70 percent sure” means, and how to keep score of your estimates so you can see whether to trust them.
- coming soon
A decision journal
What to write before the outcome so you can later judge the decision, not the luck: sensible practice, not a proven method.
Part 4 Biases: what held up
The list of biases in popular books turned out to be uneven, and knowing which are real is more useful than knowing them all.
- coming soon
What survived replication
Which famous effects stood up to large replications, anchoring among them, and why you can lean on them.
- coming soon
What fell apart
Social priming, where Kahneman himself admitted too much faith in weak studies, and what that says about popular books.
- coming soon
What is still argued over
Nudging and loss aversion: why some find a clear effect and others almost none, and how to decide while the argument stays open.
Part 5 The last word
Our aim is that the last word stays with a person who can justify it,, not one who merely clicks “agree.”
- coming soon
Automation bias
People follow a system’s prompt and miss its errors, novices and specialists alike: how to catch yourself doing it.
- coming soon
The opposite mistake
A formula often beats a specialist’s judgment, yet people abandon an algorithm once they see it err: how not to mistake stubbornness for vigilance.
- coming soon
How to test a model’s argument
Write your decision down before the talk, ask the model to break it, note what changed and why: you borrow a mind and still decide for yourself.
- coming soon
A look ahead: machines that forecast
Models are already being tried as forecasters beside people: what is left for a person if this goes on is, to us, this course’s central question.