Skip to content

Learning How to Learn: Auditing the Course 4.17 Million People Took — What Holds Up, What's Just a Metaphor

Aug 4, 2026 1 min
TL;DR Dunlosky's 2013 review rated 10 study techniques; only self-testing and distributed practice earned 'high utility'. But a 2026 systematic review puts the effect at 0.22–0.46, and Pan & Rickard's transfer meta-analysis finds 'no positive transfer' once publication bias is corrected — making the premise in the framework's own name the piece that tests worst.
Table of Contents
  1. Its actual proposition: fluency lies
  2. The verdicts at a glance
  3. Self-testing ✅
  4. Spacing ✅
  5. Interleaving ⚠️
  6. Chunking 🔶
  7. Focused/diffuse mode 🔶
  8. Pomodoro 🔶
  9. Four components out of scope
  10. A. The assumption in the course's name doesn't hold
  11. B. The effect sizes are being revised downward
  12. Appendix: the full numbers, and my reservations
  13. Changelog
  14. References
    1. The course and its core concepts
    2. Effect sizes for study techniques
    3. Transfer
    4. Myths, reversals and disputes

🌏 中文版

This is part 1 of "Learning How to Learn", covering the evidence on learning science itself. Part 2 covers the AI era: what generative AI does to learning, and why the most-cited piece of evidence in the field was retracted.

There is a course on Coursera whose official page currently shows 4,175,377 enrollments and a 4.8 rating. It is called Learning How to Learn, taught by engineering professor Barbara Oakley and neuroscientist Terrence Sejnowski, and it launched in August 2014. By the New York Times' December 2015 report it was the largest MOOC in the world, narrowly ahead of Andrew Ng's Machine Learning.

This is an audit: take each component the course teaches, check it against the evidence, and return a verdict.

1. What the course is

Four modules, one to two hours each:

  1. What is learning — switching between focused and diffuse mode, a first pass at chunking, and how sleep clears metabolic waste and consolidates memory.
  2. Chunking and the illusion of competence — how to compress scattered steps into a single callable unit; and illusion of competence: highlighting, rereading, and following along with a worked solution all leave you feeling like you've learned it.
  3. Procrastination and memory — procrastination framed as a habit loop (cue → routine → reward → belief), to be changed at the cue and the reward rather than by willpower. The Pomodoro Technique appears here, with the emphasis on process over product. The memory half covers working-memory limits, spaced repetition, and the memory palace.
  4. Renaissance learning — exercise and neurogenesis, metaphor as a tool for abstraction, deliberate practice, impostor syndrome, and one very concrete exam tactic: hard start–jump to easy (open with the hardest problem, and bail the moment you stall).

The narrative deserves some credit for the reach. Oakley describes herself as bad at math as a child, a linguistics major, a former army signals technician who went back to mathematics and engineering at twenty-six. "I'm not a genius, I just got the method right" persuades adult self-learners far more than any citation does.

Its actual proposition: fluency lies

One claim runs through all four weeks: when you feel like you're learning, you usually aren't.

In 2009, researchers asked 177 college students how they study. 84% said they reread; 55% named rereading their number one strategy. Only 11% tested themselves, and only 1% did so because they believed retrieval itself helps.

Rereading is exactly what gets rated low utility below. Students are not lazy — they are putting in the hours and systematically choosing wrong. The reason is clear enough: rereading feels effective. The second pass goes down more smoothly than the first, and the brain misreads that fluency as mastery.

Hence the field's core proposition: the subjective fluency of learning is inversely related to long-term retention. Nearly every evidence-backed technique amounts to making the present moment harder.

The verdicts at a glance

ComponentVerdictIn one line
Self-testing✅ Do itOne of the two best-rated of ten techniques
Spacing✅ Do itThe other one; coming back in a few days beats reviewing twice today
Interleaving⚠️ DependsMath problem types and visual materials yes; expository text and vocabulary no
Chunking🔶 Concept holdsBut the "7±2" attached to it is outdated; modern consensus is 4±1
Focused/diffuse mode🔶 MetaphorKeep the behaviour; the neural story doesn't match
Pomodoro🔶 MetaphorImproves the experience and efficiency, not the amount learned
That learning skills transfer❌ Doesn't holdYou get better at what you practised, and not much else

Some effect sizes appear below (numbers like 0.3, 0.5). Two things up front: 0.2 is not small in education research (by Kraft's benchmarks), and the same study can be both 0.51 and 0.93 — the only difference is whether the control group reread or did nothing. Secondary write-ups pick the bigger one and don't tell you. Full reconciliation in the appendix.

2. Component by component

In 2013, Dunlosky and four co-authors picked 10 techniques students can use on their own without supervision, and assessed whether each one's benefits generalize across students, materials, and test formats. The result is a fairly brutal tiering:

UtilityTechnique
Highpractice testing (self-testing), distributed practice (spacing)
Moderateelaborative interrogation, self-explanation, interleaved practice
Lowsummarization, highlighting, keyword mnemonic, imagery, rereading

Only two made the top tier, on the grounds that they help learners of all ages and abilities and hold up in real classrooms. Taking them one at a time.

Self-testing ✅

What the course teaches: the assignments are literally named "Retrieval Practice".

What to do: finish a section, close the book, write down what you remember on a blank sheet, then go back and check. The parts you couldn't write are the parts you only thought you knew. Don't substitute "glance at the heading and run through it mentally" — writing and not-writing are different activities.

The evidence: one of the two best-rated of ten techniques. Against rereading, the benefit is about +0.51.

Three counterintuitive details (source):

  • One practice test before the real one beats several. More is not better.
  • A gap of one to six days between practice and the real test clearly beats same-day.
  • Multiple-choice practice outperformed short-answer — which cuts against this field's usual advice that free recall beats recognition. Treat it as an unreconciled disagreement, not a settled finding.

Spacing ✅

What the course teaches: spaced repetition; don't cram.

What to do: leave at least a day before you touch the same material again. Reviewing on the day you first studied buys roughly two-thirds of what coming back a few days later would.

The evidence: the other high-utility entry, and the only one validated against real-world data at scale — Kim et al. reproduced it outside the lab.

Interleaving ⚠️

What the course teaches: don't do twenty of the same problem type in a row; mix them.

What to do: mix in exactly two situations — math-style problems where the skill is "work out which method this one needs", and visual material where you have to tell styles apart. Don't mix while reading expository text or learning vocabulary.

The evidence: rated moderate. Brunmair and Richter's review says it in the title — Similarity matters: it helps for visual materials like paintings and for mathematical problem types, shows no advantage for expository text, and may actively hurt when learning words across conceptual categories. Treating "interleave everything" as general advice misreads the paper.

Chunking 🔶

What the course teaches: compress scattered steps into one callable unit — usually paired with "working memory holds 7±2 items".

What to do: use the concept, but don't size your workload off 7±2. You can juggle fewer independent units than you think, which makes chunking a precondition rather than a bonus.

The evidence: the concept is fine, the number is outdated. Miller's 1956 seven-plus-or-minus-two measured capacity after chunking was possible; Cowan's 4±1 measures the number of chunks themselves, and modern consensus favours the latter (the two reconcile once you notice they depend on whether the task lets you chunk).

Focused/diffuse mode 🔶

What the course teaches: the brain alternates between two modes, so a problem you cannot crack should be left alone for the diffuse mode to work on in the background. Sites like Farnam Street have spread it widely, usually prefaced with "neuroscience shows".

What to do: stuck? Go for a walk. Keep that. Just don't argue the neuroscience version with anyone.

The evidence: the trouble is on the neuroscience side. The standard description of the default mode network is that its activity is suppressed while you're concentrating on a task, and higher when you're idling, daydreaming or recalling. So "both modes running at once" does not match how the DMN behaves. It is not working overtime in the background; it goes quiet when you concentrate.

Oakley appears to have addressed this tension herself. The passage below circulates widely, attributed to an endnote in A Mind for Numbersbut the only place I can find it is a transcription on Psychology Stack Exchange, with no second independent source anywhere. Verify against the book before citing it:

Astute readers will notice my mention that the diffuse mode seems to sometimes work in the background while the focused mode is active. However, research findings show that the default-mode network for example seems to go quiet when the focused mode is active. So which is it? … In some sense, then, my use of the term diffuse mode might be thought of as "nonfocused mode activities directed toward learning" rather than simply "default-mode network."

Strip the quote out entirely and the conclusion survives on the DMN literature alone.

Pomodoro 🔶

What the course teaches: 25 minutes of focus, 5 minutes off — and focus on the process, not the product, because product anxiety is what drives procrastination.

What to do: use it. It makes you less tired and less likely to stall. Just don't expect it to make you learn more.

The evidence: a 2023 controlled study compared fixed breaks (24 minutes on, 6 off) against letting people break whenever they wanted. The fixed-break groups reported more concentration and motivation, less fatigue, and finished sooner — but the two conditions put in the same mental effort and completed the same amount of work.

Four components out of scope

The procrastination habit loop, sleep and memory consolidation, memory palaces and mnemonics, and the hard start–jump to easy exam tactic get no verdict here. Not because anything is wrong with them, but because they lack the large-scale evidence base this piece needs to say anything stronger than "probably useful".

3. Two problems that cut across everything

The verdicts above are per component. Two things cut across all of them, and both matter more than any single verdict.

A. The assumption in the course's name doesn't hold

"Learning how to learn" presupposes that once you have the skills, they carry over. That assumption has been tested. It does not test well.

Pan and Rickard's 2018 review was the first comprehensive look at transfer in test-enhanced learning, spanning forty years and over a hundred experiments. The headline number looks fine (d = 0.40), but unpack it and one thing is holding it up: whether the practice questions and the test questions share answers. When they do, the effect appears. When they don't, correcting for publication bias takes it to roughly zero.

In other words, a lot of what gets called "transfer" is really question overlap.

Agarwal's 2019 study puts it more bluntly. Students did retrieval practice with fact questions, higher-order questions, or a mix, then sat a higher-order test:

Critically, higher order and mixed quizzes improved higher order test performance, but fact quizzes did not. Contrary to popular intuition about higher order learning and Bloom's taxonomy, building a foundation of knowledge via fact-based retrieval practice may be less potent than engaging in higher order retrieval practice.

And the failure runs both ways: practising with higher-order questions didn't help on the delayed fact test either. Both mismatches collapse back to roughly the restudy baseline.

The same pattern shows up one level up. Donker et al. reviewed 95 interventions that taught students how to study. The effects were solid (largest for writing, smallest for reading comprehension), but the conclusion was the same sentence: instruction aimed at near transfer works better than instruction aimed at far transfer.

So what: every technique marked ✅ above is bound to what you practised far more tightly than you'd like. If you want transfer, you have to deliberately shape the practice to resemble the thing you actually want to do — which incidentally explains why "grinding LeetCode" and "designing systems" are two different skills.

B. The effect sizes are being revised downward

That tiering table now gets cited everywhere. The ground under it has shifted three times in the past decade, and almost nobody writing about this has kept up.

One, the mean is not what you'll get. Most of the variation between studies isn't sampling error — it's real situational difference. The same technique behaves very differently across people, subjects, and test formats.

Two, tighter new estimates cut the number roughly in half. In March 2026 a large systematic review put self-testing at 0.22–0.46, down from 0.64–0.83 in earlier reviews. But "lower" is not "overturned": the authors note that inclusion criteria differ across reviews, making magnitudes hard to compare directly, and by Kraft's benchmarks anything above 0.2 is large in education research.

Three, the more complex the material, the weaker the effect. This is an unfinished fight. van Gog and Sweller's 2015 title is the argument — "the testing effect decreases or even disappears as the complexity of learning materials increases"; Karpicke and Aue answered the same year, and Rawson joined in. The dispute is stuck on the fact that "complexity" resists operationalization. Anyone declaring a winner should raise your suspicion.

So what: not "stop", but revise your expected effect downward — and the harder the material, the less you can lean on self-testing alone.

4. Three dead claims in this field

They are not in the course, but they show up in the same articles and the same training days.

The learning pyramid (read 10%, hear 20%, do 90%) — the numbers are fabricated. The full trace was done in 2014: Edgar Dale's Cone of Experience contained no percentages at all, and Dale intended it as a descriptive classification, not a prescriptive guide — the numbers were grafted on by persons unknown around 1970. When pressed for a source, the NTL Institute replied that they believed the figures were accurate but could no longer find the original research. A memory researcher at the University of Strathclyde put it more directly: he has never seen a properly controlled experiment showing one study technique to be nine times as effective as another.

Learning styles — the evidence isn't zero, but it's nowhere near enough to redesign teaching around. The mainstream verdict comes from a 2008 review that examined 70-plus studies and found no support. But in 2024 someone ran it again, restricted to studies that actually compared matched against unmatched instruction — and this time found a small but statistically significant benefit.

The thing to notice is that the authors still don't recommend adopting it: the benefit is far smaller than simply changing the medium of presentation, the studies disagree with each other enormously, and only about a quarter of the measures showed the crossover pattern the hypothesis actually requires — visual learners doing better with visual teaching and auditory learners doing better with auditory teaching. Add the teacher time it costs and the risk of pigeonholing students, and it doesn't pay.

Growth mindset — the effect is small enough that it takes a meta-analysis to see. Sisk et al.'s two 2018 reviews remain the most thorough test: mindset accounts for about 1% of the variance in achievement, and mindset interventions move achievement by d = 0.08. More awkwardly, the interventions that demonstrably changed students' mindsets showed no significant effect on achievement. Dweck and Yeager responded in 2020, arguing the effects are real but heavily person- and context-dependent, and that low-SES and academically at-risk students do benefit (a point Sisk et al. concede). Both sides agree the effect is small and unstable; they disagree about whether that makes it important.

The shared structure is worth memorizing: too intuitively plausible, spreading far faster than it was verified, and small enough that you need statistical machinery to see it at all. Discount the next educational claim that fits all three.

5. An adjacent fight: 10,000 hours

Macnamara et al.'s 2014 review is routinely used to dismiss the 10,000-hour rule. Deliberate practice explained 26% of performance differences in games, 21% in music, 18% in sports, 4% in education, and under 1% in professional work.

The Ericsson camp's rebuttal carries weight too: on a re-screened set they get roughly 29%, and argue many included studies never used the original definition of deliberate practice — one counted hours nursing students spent in lectures and seminars as practice. Another group adds that the average across all of social and personality psychology is only 3–4%, so treating "under 50%" as failure is an unreasonable bar.

The two sets of numbers are not comparable because they measure different things. The takeaway that survives: practice volume matters but is far from everything, and the more structured and predictable the domain (instrument, running), the more practice explains; the more open-ended the domain (professional work), the less. The uncomfortable implication for engineers is that software work sits in that last column.

6. Overall

If you take one thing: the course's value is not its neuroscience, it is that it turns "don't trust your own sense of fluency" into a repeatable daily process. The assignments are literally named "Retrieval Practice" — that matters more than any neuroscience in it.

One limitation worth carrying: this field's research almost all uses "how much you remember" as the outcome, with far thinner evidence for creativity, judgment, or transfer.

What happens to these principles once LLMs arrive — and why the most-cited piece of evidence in AI education was retracted in April 2026 — is part 2.

Appendix and sources

Appendix: the full numbers, and my reservations

The body keeps one figure per claim to stay readable. This section carries the full ledger, because this article's whole thesis is "don't take secondary write-ups as fact".

Self-testing has several commonly quoted effect sizes. Most are correct; they differ in the control group.

FigureWhat it actually is
+0.51weighted mean effect vs restudy
+0.93vs filler activity or nothing at all
g = 0.61pooled across all comparison conditions
0.64 / 0.83primary / secondary school figures
+0.70 vs +0.48multiple-choice vs short-answer practice formats
g = 0.50Rowland (2014), an independent estimate, I² = 84.35
0.22 / 0.46Dietrichson et al. 2026, between- / within-subject designs, 95% CI [0.09, 0.34] and [0.29, 0.62]. That review screened 102,451 records, found 87 eligible studies, and synthesized 59

Format, number and timing of practice tests (the source for the three bullets in the body):

Practice tests with a multiple-choice option have a larger weighted mean effect size (+0.70) than short-answer tests (+0.48). A single practice test prior to the final test is more effective than when students take several practice tests. However, the timing should be carefully considered. A gap of less than a day between the practice and final tests showed a smaller weighted effect size than when there is a gap of one to six days (+0.56 and +0.82, respectively).

Adesope's meta-analysis used Fail-safe N to test for publication bias, and that statistic has long been known to badly overstate robustness. Two independent readers of the original flagged it separately — Yana Weinstein at the Learning Scientists says to take it "with a grain of salt", and the discussion under De Bruyckere's post cites Fergusson & Heene (2012). Treat the numbers above as bias-prone estimates, not fixed values.

The role of feedback is unreconciled. Rowland found feedback amplifies the testing effect; Adesope found retrieval with feedback only slightly better than without. Confirmed independently by the Learning Scientists and by Dietrichson et al.'s systematic review.

Heterogeneity, in numbers: Rowland's g = 0.50 sits on I² = 84.35; the learning-styles meta-analysis on I² = 91.17; the growth-mindset one on I² = 96.29. All three mean the average is a poor summary.

The transfer section in full (Pan & Rickard 2018: 192 transfer effect sizes, 122 experiments, 67 articles, N = 10,382). Overall d = 0.40 (95% CI [0.31, 0.50]). On the moderators:

That transfer of learning is greatest across test formats, to application and inference questions, to problems involving medical diagnoses, and to mediator and related word cues; it is weakest to rearranged stimulus-response items, to untested materials seen during initial study, and to problems involving worked examples. Moderator analyses further indicated that response congruency and elaborated retrieval practice, as well as initial test performance, strongly influence the likelihood of positive transfer.

Two sets of numbers come from different analyses — don't mix them. Random-effects model: d = 0.28 with no response congruency, plus 0.30 when present, for 0.58. After publication-bias correction (PEESE, test significant at p < .0001): the intercept is effectively zero, congruency adds 0.36 and elaborated retrieval practice adds 0.18.

Donker et al. by subject: writing g = 1.25, science 0.73, mathematics 0.66, reading comprehension 0.36 (95 interventions, 180 effect sizes).

The 2024 learning-styles meta-analysis in numbers: 21 studies, 101 effect sizes, 1,712 participants; g = 0.31, SE = 0.12, 95% CI [0.05, 0.57], p = 0.02; only 26% of learning outcome measures showed the crossover interaction the matching hypothesis requires; the modality effect it is benchmarked against is g = 0.70.

Growth mindset in numbers: correlation with achievement r ≈ 0.10 (129 studies, N = 365,915); intervention effect d = 0.08 (43 studies, N = 57,155).

The 10,000-hours meta-analysis carries a 2018 corrigendum: the main model's average correlation was revised from r = .35 (95% CI [.30, .39]) to .38 ([.33, .42]). The authors are explicit that the reanalysis had "no practical effect on the results" and "no impact whatsoever on the substance of our findings and conclusions". Worth knowing so you cite the corrected figures — the per-domain percentages in the body come from the article text, not the corrigendum table. The professions figure was r = .05, p = .62, not statistically significant.

Dietrichson et al. 2026 has not been peer reviewed (EdWorkingPaper). Say so when you cite it.

Changelog

  • 2026-08-20: Register rewrite. The body was packed with sample sizes, confidence intervals, I² values and screening counts, plus nine block quotations of academic abstracts — it read like a literature review. Now the body keeps at most one figure per claim, with everything else moved to the appendix; block quotations are down from nine to three (keeping only the passages where the author's own words land harder than my paraphrase); and every technique has a concrete "what to do". Nothing was removed, only relocated and rephrased.
  • 2026-08-19 (2): Rebuilt on a single spine. The article previously ran three competing organizing principles at once, producing interruptions and orphan sections. The transfer section moved from ninth position to a part of its own.
  • 2026-08-19 (1): Added a description of the course itself — the original never described the object it was auditing — plus an explicit statement of which components this piece audits.
  • 2026-08-18: Restructured for readability: actionable conclusions moved up, sections led by claims rather than researcher names, and the full effect-size ledger and methodological disputes moved to an appendix.

References

Each entry is tagged with how I actually accessed it, because this article's subject is precisely not treating secondhand summaries as fact:

  • [primary] read the original paper in full, or an official notice/page
  • [abstract] used only the official abstract or publisher page
  • [secondhand] taken from another paper or a reliable secondary source; original not obtained
  • [unverified] no independent source found — verify before citing

DOIs I could not confirm myself are omitted rather than guessed.

The course and its core concepts

Effect sizes for study techniques

Transfer

Myths, reversals and disputes

FAQ

Does rereading your notes actually work?

Poorly — and it is what students do most. Dunlosky et al. (2013) rated 10 study techniques and placed rereading in the low-utility tier. Separately, Karpicke, Butler and Roediger's 2009 survey of 177 college students found 84% reported rereading and 55% named it their number one strategy. The trap is that rereading feels effective: the second pass goes down more smoothly, and that fluency gets misread as mastery. Self-testing instead is worth roughly +0.51 over rereading.

How large is the self-testing effect really?

It depends what you compare it against. Roughly +0.51 versus restudying, +0.93 versus doing nothing, and about g = 0.61 pooled across all comparison conditions. A stricter 2026 systematic review reports lower figures: 0.22 for between-subject designs and 0.46 for within-subject designs. Always state the control condition — the same study can be cited at wildly different strengths without it.

Are learning styles a myth?

The mainstream verdict is still that they are not worth redesigning teaching around, but the evidence is not zero. Pashler et al. (2008) found no support across 70-plus studies. In 2024, Clinton-Lisell and Litzinger restricted their analysis to studies that actually compared matched versus unmatched instruction and found g = 0.31, statistically significant. Even so, those authors do not recommend adoption: only 26% of outcome measures showed the crossover interaction the hypothesis requires, and heterogeneity was I² = 91.17.

Do learning skills transfer to other subjects?

Less than the name suggests. Pan and Rickard's 2018 transfer meta-analysis found an overall d = 0.40, but after correcting for publication bias it showed no positive transfer when the key moderators were absent. The strongest moderator is response congruency — overlap between practice answers and test answers. Agarwal (2019) is blunter still: practising factual questions and then sitting a higher-order test performed no better than simply restudying. If you want transfer, design practice to resemble the real task.