📊Understand P-Values Without the Common Myths
Lock in the one-sentence correct definition of a p-value and spot the three misreadings that trip up even published scientists. Leave with a shareable mental model you can defend in any stats conversation.
Phase 1P-Value Intuition from Scratch
Build p-value intuition from a rigged coin-flip demo
A p-value is a surprise meter, not a verdict
6 minA p-value is a surprise meter, not a verdict
The null hypothesis is the boring world you're testing against
6 minThe null hypothesis is the boring world you're testing against
0.05 is a convention, not a law of nature
6 min0.05 is a convention, not a law of nature
Phase 2Spotting the Three Big Myths
Spot the three most common p-value myths on sight
A p-value is not the probability your hypothesis is false
6 minA p-value is not the probability your hypothesis is false
A small p-value does not mean a big effect
6 minA small p-value does not mean a big effect
P greater than 0.05 does not prove the null is true
6 minP greater than 0.05 does not prove the null is true
Phase 3P-Values in the Wild
Trace p-hacking, peer review, and the replication crisis
The stats dashboard shows p = 0.049. Ship it?
7 minThe stats dashboard shows p = 0.049. Ship it?
A reviewer says your p-values are 'fine.' Are they?
7 minA reviewer says your p-values are 'fine.' Are they?
A celebrated finding fails to replicate. What does that mean?
7 minA celebrated finding fails to replicate. What does that mean?
Phase 4Owning the Definition
Write and defend your own one-sentence definition
Draft your one-sentence p-value definition
8 minDraft your one-sentence p-value definition
Stress-test your definition against the three myths
8 minStress-test your definition against the three myths
Teach your definition out loud and defend it
8 minTeach your definition out loud and defend it
Frequently asked questions
- What does a p-value actually measure?
- This is covered in the “Understand P-Values Without the Common Myths” learning path. Start with daily 5-minute micro-lessons that build from fundamentals to hands-on application.
- Why isn't a p-value the probability that the null hypothesis is true?
- This is covered in the “Understand P-Values Without the Common Myths” learning path. Start with daily 5-minute micro-lessons that build from fundamentals to hands-on application.
- Does p less than 0.05 mean a result is true?
- This is covered in the “Understand P-Values Without the Common Myths” learning path. Start with daily 5-minute micro-lessons that build from fundamentals to hands-on application.
- How does p-hacking distort published research?
- This is covered in the “Understand P-Values Without the Common Myths” learning path. Start with daily 5-minute micro-lessons that build from fundamentals to hands-on application.
- What's the difference between statistical and practical significance?
- This is covered in the “Understand P-Values Without the Common Myths” learning path. Start with daily 5-minute micro-lessons that build from fundamentals to hands-on application.
Related paths
∫Understand the Fundamental Theorem of Calculus
Build the Fundamental Theorem of Calculus from accumulation first — feel why differentiation undoes integration before you ever see the formal statement. You'll finish by pulling a real dataset and verifying the theorem numerically with your own code.
🧮Understand Vector Spaces: The Rulebook Behind Linear Algebra
See why polynomials, pixel images, and 3D arrows all live in the same mathematical world — then design your own vector space of polynomials up to degree two and compute its dimension from scratch.
🔗Understand Correlation vs Causation With Real Examples
Go beyond 'correlation is not causation' — learn to spot confounders, recognize when randomization or natural experiments are doing the real work, and leave with a 30-second rule of thumb you'll actually use on tomorrow's headline.
🔵Learn Set Theory Basics: The Language Every Math Class Assumes
Stop squinting at ∪, ∩, and ∁ — shade Venn diagrams first, then translate them into clean notation, until you can model anything from music genres to probability events as sets you can actually picture.