Evidence of Educative Game Design
A familiar claim is made for this field: that games make people learn better. It does not survive contact with the evidence. The honest version is narrower, and considerably more useful: a well-designed game produces measurable learning gains, and a poorly designed one produces very little. The difference is the design, not the medium.
This is the hub of a five-part series. It gives the whole argument in about two minutes. Each section below links to a longer piece that goes into the evidence properly, with its own references.
The gist
Games teach modestly on average and strongly when well designed. The spread between those two is the entire finding this series is built on, and it is good news: it means the outcome is a matter of decisions a designer actually makes, not a property of the medium.
What the numbers say
| Finding | Effect | Status |
|---|---|---|
| Educational games vs. conventional teaching | ~0.3 — a modest, real edge | Verified |
| Simulation-based training | 0.85–1.06 — roughly four in five learners do better | Verified |
| Motivation effect of games | None significant | Verified |
| Structured debriefing after an exercise | +20 to 25% performance | Verified |
The seven pillars
Everything the evidence supports reduces to seven design decisions.
The learning is the progression mechanic
What a learner must do to advance is the single highest-leverage decision in the whole design. Argued in Four principles that make a game teach.
Feedback carries the loop
The content of feedback, not its presence, decides whether it works. Same article as above, and connects directly to what happens after the game, since a debrief is feedback at a larger scale.
Difficulty must be desirable, and matched to the learner
Difficulty that slows acquisition can improve retention. Difficulty that defeats the learner helps nobody. Also in Four principles that make a game teach.
Practice must be distributed
Of all common study techniques, only two are reliably effective: testing yourself, and spacing practice over time. Games do both natively. Same article again.
Format follows the task
Neither hardware nor game elements predict whether training works. Task fit does. Set out in full, format by format, in Choosing a format for the task.
Discussion consolidates it
Structured debriefing adds a substantial performance gain on its own. Covered in What happens after the game.
Testing decides, during development
Playtesting is formative evaluation under a different name, and it has to run while the design can still change. The full case is in How to tell whether a game teaches.
What the evidence does not support
Worth stating plainly, because these are the claims that get people caught.
- That games are motivating. The null result is real, and it sits in the same review as the positive learning effect.
- That one format beats another. Nothing in the evidence supports it, and the moderator analyses argue against it directly.
- That headsets beat desktop. Explicitly not a significant moderator of training outcomes.
- That findings from school studies transfer to adults. Populations differ, and two citations in this series were corrected during fact-checking for exactly this kind of overreach.
- Any "muscle memory" or automaticity claim. Not established in the evidence base this series draws on.
Where this leaves us
Games teach under conditions that can be named, tested, and built for on purpose. None of them follow from the decision to make a game. All of them follow from the design.
References
The full list for this series. Individual articles cite only what they use; this page carries all of it.
- Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe & A. Shimamura (Eds.), Metacognition: Knowing about knowing. MIT Press.
- Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132(3), 354–380.
- Chernikova, O., Heitzmann, N., Stadler, M., Holzberger, D., Seidel, T., & Fischer, F. (2020). Simulation-based learning in higher education: A meta-analysis. Review of Educational Research, 90(4), 499–541.
- Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122.
- Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8.
- Dunleavy, G., Nikolaou, C. K., Nifakos, S., Atun, R., Law, G. C. Y., & Tudor Car, L. (2019). Mobile digital education for health professions. Journal of Medical Internet Research, 21(2), e12937.
- Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students' learning with effective learning techniques. Psychological Science in the Public Interest, 14(1), 4–58.
- Fullerton, T. (2024). Game design workshop (5th ed.). CRC Press / Routledge.
- Gauthier, A., Kato, P. M., Bul, K. C. M., Dunwell, I., Walker-Clarke, A., & Lameras, P. (2019). Board games for health: A systematic literature review and meta-analysis. Games for Health Journal, 8(2), 85–100.
- Habgood, M. P. J., & Ainsworth, S. E. (2011). Motivating children to learn effectively: Exploring the value of intrinsic integration in educational games. Journal of the Learning Sciences, 20(2), 169–206.
- Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.
- Howard, M. C., Gutworth, M. B., & Jacobs, R. R. (2021). A meta-analysis of virtual reality training programs. Computers in Human Behavior, 121, 106808.
- Jongbloed, J., Chaker, R., & Lavoué, E. (2024). Immersive procedural training in virtual reality: A systematic literature review. Computers & Education, 221, 105124.
- Kaplan, A. D., Cruit, J., Endsley, M., Beers, S. M., Sawyer, B. D., & Hancock, P. A. (2021). The effects of virtual reality, augmented reality, and mixed reality as training enhancement methods: A meta-analysis. Human Factors, 63(4), 706–726.
- Lei, H., Chiu, M. M., Wang, D., Wang, C., & Xie, T. (2022). Effects of game-based learning on students' achievement in science: A meta-analysis. Journal of Educational Computing Research, 60(6), 1373–1398.
- Makransky, G., Terkildsen, T. S., & Mayer, R. E. (2019). Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learning and Instruction, 60, 225–236.
- Man, S. S., Wen, H., & So, B. C. L. (2024). Are virtual reality applications effective for construction safety training and education? Journal of Safety Research, 88, 230–243.
- Roediger, H. L., & Karpicke, J. D. (2006). Test-enhanced learning. Psychological Science, 17(3), 249–255.
- Roseth, C. J., Johnson, D. W., & Johnson, R. T. (2008). Promoting early adolescents' achievement and peer relationships. Psychological Bulletin, 134(2), 223–246.
- Sailer, M., Hense, J. U., Mayr, S. K., & Mandl, H. (2017). How gamification motivates. Computers in Human Behavior, 69, 371–380.
- Sung, Y.-T., Chang, K.-E., & Liu, T.-C. (2016). The effects of integrating mobile devices with teaching and learning on students' learning performance. Computers & Education, 94, 252–275.
- Tannenbaum, S. I., & Cerasoli, C. P. (2013). Do team and individual debriefs enhance performance? A meta-analysis. Human Factors, 55(1), 231–245.
- Tessmer, M. (1993). Planning and conducting formative evaluations. Kogan Page.
- Weston, C., Le Maistre, C., McAlpine, L., & Bordonaro, T. (1997). The influence of participants in formative evaluation on the improvement of learning from instructional materials. Instructional Science, 25, 369–386.
- Wisniewski, B., Zierer, K., & Hattie, J. (2020). The power of feedback revisited. Frontiers in Psychology, 10, 3087.
- Wouters, P., van Nimwegen, C., van Oostendorp, H., & van der Spek, E. D. (2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105(2), 249–265.