The Most Common Cognitive Bias
Why Hacker News recommends it
Recommended as a clear demonstration of confirmation bias and the value of trying to break your own hypothesis.
What it is
A Veritasium video that runs the 2-4-8 rule-guessing puzzle on people to show how they test only examples that confirm their hypothesis. It uses this to illustrate confirmation bias and falsification.
Recommended by 3 HN commenters across 3 different months, 2015 to 2023.
What Hacker News said
Recommends drhdylan88 · 2015-07 · on “A Quick Puzzle to Test Your Problem Solving”
Veritasium, a pretty interesting youtube channel, posted a video on this experiment a while back. I found the discussion afterwards to be more thought-provoking than this article. [this video]
Recommends nightcracker · 2021-09 · on “Dogs distinguish human intentional and unintentional action”
Experimental science is all based around ruling out the null hypothesis. For that it needs to be falsifiable . The hypothesis 'the dog can differentiate between A and B' is very hard to falsify. Because the dog could differentiate, but choose to not act. You would need a fairly complete understanding of the dogs mental workings, and scanners to study them. On the other hand, 'the dog can't differentiate between A and B' is much easier to falsify. If you repeat an experiment a sufficient amount of times and the dog consistently has different behavior between A and B, you can rule this null hypothesis out. That is the real reason we always 'assume the worst'. Because 'assume the worst' is the
Recommends avianlyric · 2023-12 · on “Let me repeat that back to you”
Veritasium has a great video[1] about people’s cognitive bias towards using examples that prove their mental model, rather than using examples that disprove their mental model. But if you want to actually confirm you have accurate understanding of something, testing examples that don't fit your metal model is the workable methodology (i.e. use a null hypothesis). Testing examples that do match your mental model only proves your model partially matches the actual model, but it does very little to actually identify misunderstandings, or improve your understanding. [1] [this video]
Cites m4r71n · 2015-07 · on “A Quick Puzzle to Test Your Problem Solving”
Derek Muller of Veritasium has done this test over a year ago on people in one of his videos: [this video] I've given the test to various people since then and never once came across someone who'd guess it right away, or within a short period of time. The breaking time came usually after a few minutes when they gave up and started throwing out random numbers that coincidentally did not meet the rule. Once you hit the first "No", it took a very short time to figure out the rule for almost everyone.
Cites jerf · 2015-07 · on “A Quick Puzzle to Test Your Problem Solving”
This is now the fourth time I've seen this exact rule. Another example: [this video] It's probably not "fair" to say I got it in zero... but I did. :) Now that the NYT has done it, this puzzle has probably attained enough popularity now that you really ought to change it up a bit now if you're going to run it yourself. Granted, the space of hypotheses as simple as "increasing/decreasing" is pretty small, but your ability to fool people with the first sample run is almost unbounded, so that helps.
Cites Strilanc · 2015-07 · on “Steam hit by major security breach”
They were thinking about how to make it work instead of how to make it break. Classic mistake (e.g. [1]). 1: [this video]
Cites oneofthefirst · 2021-11 · on “In ‘learning trap’ experiment, adults leap to conclusions while children explore”
Very interesting! This reminds me of a Veritasium video I watched years ago, called “The most common cognitive bias” [1]. People don’t explore solution spaces as effectively as they think they do. [1] [this video]
Cites adverbly · 2023-06 · on “Intelligent people take longer to solve hard problems”
Related: [this video] TL;DW: I have a rule and you need to figure it out. The rule relates to a sequence of three numbers. You can propose a sequence and I’ll tell you yes/no if it meets the rule. I’ll give you the first sequence to get you started: sequence: 2,4,8 passes: Yes