Examining the Impacts of a Gamified Media Literacy Intervention in Indonesia

Authors

  • Michael H. Becker University of Nebraska - Omaha
  • Michael J. Williams The Science of P/CVE
  • Alexa Hassan Moonshot

Keywords:

Disinformation, Misinformation, Inoculation, Theory of Planned Behavior, Gamification

Abstract

Integrating popular messaging applications and gamified approaches is an emerging strategy to deploy media literacy interventions at-scale. The present study examines the impacts of a WhatsApp-styled intervention in prebunking mis- and dis-information among an age and gender stratified sample of 504 Indonesian adults. Guided by the Theory of Planned Behavior, the intervention aimed to inoculate participants to common disinformation tactics and arguments through interactive elements simulating group chats with loved ones around three major topic areas (health, news and finance). Data were collected on participants' attitudes, subjective norms, self-efficacy, intentions, and ability to detect disinformation before and after the intervention. Following the intervention, participants reported a statistically significant increase in motivation to detect fake information, perception that it is normal to identify disinformation online, and greater motivation to combat misinformation. These impacts were sustained two weeks after the intervention. While self-efficacy increased immediately after the intervention, it returned to baseline levels at the two-week follow-up, despite this initial increase. Findings provide valuable insights into the potential of gamified interventions to effectively influence key behavioral determinants related to disinformation consumption and sharing, particularly motivation and perceived norms.

References

Ajzen, I. (1991). The Theory of Planned Behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. https://doi.org/0749-5978/91

Akbar, S. Z., Panda, A., & Pal, J. (2022). Political hazard: Misinformation in the 2019 Indian general election campaign. South Asian History and Culture, 13(3), 399–417. https://doi.org/10.1080/19472498.2022.2095596

Albee, J. J., Smith, M. L., Arnold, J. M., & Dennis, L. B. (2019). Digging Struggling Students Out of the Summer Reading Slump. The Reading Teacher, 73(3), 291–299. https://doi.org/10.1002/trtr.1847

Altman, D. G., & Bland, J. M. (1994). Diagnostic tests. 1: Sensitivity and specificity. BMJ : British Medical Journal, 308(6943), 1552.

Alwreikat, A. (2022). Sharing of Misinformation during COVID-19 Pandemic: Applying the Theory of Planned Behavior with the Integration of Perceived Severity. Science & Technology Libraries, 41(2), 133–151. https://doi.org/10.1080/0194262X.2021.1960241

American Psychological Association. (2023, November). Using psychological science to understand and fight health misinformation. Https://Www.Apa.Org. https://www.apa.org/pubs/reports/health-misinformation

Anderson, J., & Rainie, L. (2017, October 19). The Future of Truth and Misinformation Online. Pew Research Center. https://www.pewresearch.org/internet/2017/10/19/the-future-of-truth-and-misinformation-online/

Anderson, K. (2019). Truth, Lies, and Likes: Why Human Nature Makes Online Misinformation a Serious Threat (and What We Can Do about It). Law & Psychology Review, 44, 209.

Angeline, M., Safitri, Y., & Luthfia, A. (2020). Can the Damage be Undone? Analyzing Misinformation during COVID-19 Outbreak in Indonesia. 2020 International Conference on Information Management and Technology (ICIMTech), 360–364. https://doi.org/10.1109/ICIMTech50083.2020.9211124

Badrinathan, S., & Chauchard, S. (2024). Researching and countering misinformation in the Global South. Current Opinion in Psychology, 55, 101733. https://doi.org/10.1016/j.copsyc.2023.101733

Bairoliya, N., & McKiernan, K. (2024). The welfare costs of misinformation. Journal of Economic Dynamics and Control, 169, 104959. https://doi.org/10.1016/j.jedc.2024.104959

Basol, M., Roozenbeek, J., Berriche, M., Uenal, F., McClanahan, W. P., & Linden, S. van der. (2021). Towards psychological herd immunity: Cross-cultural evidence for two prebunking interventions against COVID-19 misinformation. Big Data & Society, 8(1), 20539517211013868. https://doi.org/10.1177/20539517211013868

Basol, M., Roozenbeek, J., & van der Linden, S. (2020). Good News about Bad News: Gamified Inoculation Boosts Confidence and Cognitive Immunity Against Fake News. Journal of Cognition, 3(1), 2. https://doi.org/10.5334/joc.91

Batomen, B., & Benmarhnia, T. (2024). Staggered interventions with no control groups. International Journal of Epidemiology, 53(6), dyae137. https://doi.org/10.1093/ije/dyae137

Baulch, E., Matamoros-Fernández, A., & Suwana, F. (2024). Memetic persuasion and WhatsAppification in Indonesia’s 2019 presidential election. New Media & Society, 26(5), 2473–2491. https://doi.org/10.1177/14614448221088274

BBC News. (2019, May 23). Indonesia post-election riots: Six dead in Jakarta as protesters clash with police. https://www.bbc.com/news/world-asia-48361782

Bernal, J. L., Cummins, S., & Gasparrini, A. (2017). Interrupted time series regression for the evaluation of public health interventions: A tutorial. International Journal of Epidemiology, 46(1), 348–355. https://doi.org/10.1093/ije/dyw098

Braddock, K. (2022). Vaccinating Against Hate: Using Attitudinal Inoculation to Confer Resistance to Persuasion by Extremist Propaganda. Terrorism and Political Violence, 34(2), 240–262. https://doi.org/10.1080/09546553.2019.1693370

Brehmer, M. (2023). Perceived Moral Norms in an Extended Theory of Planned Behavior in Predicting University Students’ Bystander Intentions toward Relational Bullying. European Journal of Investigation in Health, Psychology and Education, 13(7), Article 7. https://doi.org/10.3390/ejihpe13070089

Carthy, S. L., & Sarma, K. M. (2021). Countering Terrorist Narratives: Assessing the Efficacy and Mechanisms of Change in Counter-narrative Strategies. Terrorism and Political Violence, 0(0), 1–25. https://doi.org/10.1080/09546553.2021.1962308

Chang, H.-C. H., Haider, S., & Ferrara, E. (2021). Digital Civic Participation and Misinformation during the 2020 Taiwanese Presidential Election. Media and Communication, 9(1), 144–157. https://doi.org/10.17645/mac.v9i1.3405

Chen, J. J., & Krieger, N. J. (2023). Learning gain rather than learning loss during COVID-19: A proposal for reframing the narrative. Contemporary Issues in Early Childhood, 24(1), 82–86. https://doi.org/10.1177/14639491211073144

Chen, L., & Fu, L. (2022). Let’s fight the infodemic: The third-person effect process of misinformation during public health emergencies. Internet Research, 32(4), 1357–1377. https://doi.org/10.1108/INTR-03-2021-0194

Cohen, J. (2013). Statistical Power Analysis for the Behavioral Sciences (2nd ed.). Routledge. https://doi.org/10.4324/9780203771587

Compton, J., Ivanov, B., & Hester, E. (2022). Inoculation Theory and Affect. International Journal of Communication, 16(0), Article 0.

Compton, J., Jackson, B., & Dimmock, J. A. (2016). Persuading Others to Avoid Persuasion: Inoculation Theory and Resistant Health Attitudes. Frontiers in Psychology, 7. https://doi.org/10.3389/fpsyg.2016.00122

Compton, J., van der Linden, S., Cook, J., & Basol, M. (2021). Inoculation theory in the post-truth era: Extant findings and new frontiers for contested science, misinformation, and conspiracy theories. Social and Personality Psychology Compass, 15(6), e12602. https://doi.org/10.1111/spc3.12602

Cooke, R., Dahdah, M., Norman, P., & French, D. P. (2016). How well does the theory of planned behaviour predict alcohol consumption? A systematic review and meta-analysis. Health Psychology Review, 10(2), 148–167. https://doi.org/10.1080/17437199.2014.947547

Facciani, M. J., Apriliawati, D., & Weninger, T. (2024). Playing Gali Fakta inoculates Indonesian participants against false information. Harvard Kennedy School Misinformation Review. https://doi.org/10.37016/mr-2020-152

Geldhof, G. J., Warner, D. A., Finders, J. K., Thogmartin, A. A., Clark, A., & Longway, K. A. (2018). Revisiting the utility of retrospective pre-post designs: The need for mixed-method pilot data. Evaluation and Program Planning, 70, 83–89. https://doi.org/10.1016/j.evalprogplan.2018.05.002

Harjani, T., Basol, B., Melisa-Sinem, Roozenbeek, J., & van der Linden, S. (2023). Gamified Inoculation Against Misinformation in India: A Randomized Control Trial. Journal of Trial & Error, 3(1). https://doi.org/10.36850/i3.1

Henrich, J., Heine, S. J., & Norenzayan, A. (2010). Most people are not WEIRD. Nature, 466(7302), 29–29. https://doi.org/10.1038/466029a

Howard, G. S., & Dailey, P. R. (1979). Response-shift bias: A source of contamination of self-report measures. Journal of Applied Psychology, 64(2), 144–150. https://doi.org/10.1037/0021-9010.64.2.144

Huston, P., & Peterson, R. (2001). Withholding Proven Treatment in Clinical Research. New England Journal of Medicine, 345(12), 912–914. https://doi.org/10.1056/NEJM200109203451210

IREX. (n.d.). Learn to Discern: Media Literacy Trainer’s Manual | IREX. Retrieved February 17, 2025, from https://www.irex.org/resource/learn-discern-media-literacy-trainers-manual

Jeong, S.-H., Cho, H., & Hwang, Y. (2012). Media Literacy Interventions: A Meta-Analytic Review. Journal of Communication, 62(3), 454–472. https://doi.org/10.1111/j.1460-2466.2012.01643.x

Kemp, S. (2023, February 9). Digital 2023: Indonesia. DataReportal – Global Digital Insights. https://datareportal.com/reports/digital-2023-indonesia

Kroke, A. M., & Ruthig, J. C. (2024). Conspiracy beliefs predicting health behaviors: An integration of the theory of planned behavior and health belief model. Current Psychology, 43(9), 7959–7973. https://doi.org/10.1007/s12144-023-04953-y

Kruglanski, A. W. (with Bélanger, J. J., & Gunaratna, R.). (2019). The three pillars of radicalization: Needs, narratives, and networks / Arie Kruglanski, Jocelyn J. Bélanger, Rohan Gunaratna. Oxford University Press.

Kruglanski, A. W., Molinario, E., Ellenberg, M., & Di Cicco, G. (2022). Terrorism and conspiracy theories: A view from the 3N model of radicalization. Current Opinion in Psychology, 47, 101396. https://doi.org/10.1016/j.copsyc.2022.101396

Kuhn, M. (2008). Building Predictive Models in R Using the caret Package. Journal of Statistical Software, 28, 1–26. https://doi.org/10.18637/jss.v028.i05

Lewandowsky, S., & van der Linden, S. (2021). Countering Misinformation and Fake News Through Inoculation and Prebunking. European Review of Social Psychology, 32(2), 348–384. https://doi.org/10.1080/10463283.2021.1876983

Maertens, R., Roozenbeek, J., Basol, M., & van der Linden, S. (2021). Long-term effectiveness of inoculation against misinformation: Three longitudinal experiments. Journal of Experimental Psychology: Applied, 27(1), 1–16. https://doi.org/10.1037/xap0000315

Maniaci, M. R., & Rogge, R. D. (2014). Caring about carelessness: Participant inattention and its effects on research. Journal of Research in Personality, 48, 61–83. https://doi.org/10.1016/j.jrp.2013.09.008

McDonnell, I., & MacKinnon, T. (2020). Case Study: Misinformation in Indonesia. GeoPoll. https://www.geopoll.com/misinformation-indonesia/

McGuire, W. J. (1961). Resistance to persuasion conferred by active and passive prior refutation of the same and alternative counterarguments. The Journal of Abnormal and Social Psychology, 63(2), 326–332. https://doi.org/10.1037/h0048344

McGuire, W. J., & Papageorgis, D. (1961). The relative efficacy of various types of prior belief-defense in producing immunity against persuasion. The Journal of Abnormal and Social Psychology, 62(2), 327–337. https://doi.org/10.1037/h0042026

Moore, D., & Tananis, C. A. (2009). Measuring Change in a Short-Term Educational Program Using a Retrospective Pretest Design. American Journal of Evaluation, 30(2), 189–202. https://doi.org/10.1177/1098214009334506

Mujani, S., & Kuipers, N. (2020). Who Believed Misinformation during the 2019 Indonesian Election? Asian Survey, 60(6), 1029–1043. https://doi.org/10.1525/as.2020.60.6.1029

Nurhayati-Wolff, H. (2023). Indonesia: Share of male Instagram users by age 2024. Statista. https://www.statista.com/statistics/997029/share-of-male-instagram-users-by-age-indonesia/

Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009). Instructional manipulation checks: Detecting satisficing to increase statistical power. Journal of Experimental Social Psychology, 45(4), 867–872. https://doi.org/10.1016/j.jesp.2009.03.009

Piltch-Loeb, R., Su, M., Hughes, B., Testa, M., Goldberg, B., Braddock, K., Miller-Idriss, C., Maturo, V., & Savoia, E. (2022). Testing the Efficacy of Attitudinal Inoculation Videos to Enhance COVID-19 Vaccine Acceptance: Quasi-Experimental Intervention Trial. JMIR Public Health and Surveillance, 8(6), e34615. https://doi.org/10.2196/34615

Polarization & Extremism Research & Innovation Lab. (2025). Developing and Using Critical Comprehension (DUCC). PERIL Research. https://perilresearch.com/projects/ducc/

Prahassacitta, V., & Harkrisnowo, H. (2021). Criminal Disinformation in Relation to the Freedom of Expression in Indonesia: A Critical Study. Comparative Law Review, 27(1), 135–165.

Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000). Measuring Program Outcomes: Using Retrospective Pretest Methodology. American Journal of Evaluation, 21(3), 341–349. https://doi.org/10.1177/109821400002100305

Pundir, V., Devi, E. B., & Nath, V. (2021). Arresting fake news sharing on social media: A theory of planned behavior approach. Management Research Review, 44(8), 1108–1138. https://doi.org/10.1108/MRR-05-2020-0286

Quirk, S. (2021). Lawfare in the Disinformation Age: Chinese Interference in Taiwan’s 2020 Elections. Harvard International Law Journal, 62, 525.

Rahmawan, D., Garnesia, I., & Hartanto, R. (2024). Content analysis of MAFINDO’s verified WhatsApp-related misinformation in Indonesia (July 2015–July 2020). Jurnal Kajian Jurnalisme, 8(1), 99–114. https://doi.org/10.24198/jkj.v8i1.54463

Rascoe, A. (2024, October 13). Misinformation and conspiracy theories about Hurricane Helene are spreading online. NPR. https://www.npr.org/2024/10/13/nx-s1-5148893/misinformation-and-conspiracy-theories-about-hurricane-helene-are-spreading-online

Roberts-Ingleson, E. M., & McCann, W. S. (2023). The Link between Misinformation and Radicalisation: Current Knowledge and Areas for Future Inquiry. Perspectives on Terrorism, 17(1), 36–49.

Roozenbeek, J., van der Linden, S., Goldberg, B., Rathje, S., & Lewandowsky, S. (2022). Psychological inoculation improves resilience against misinformation on social media. Science Advances, 8(34), eabo6254. https://doi.org/10.1126/sciadv.abo6254

Rosner, B., Glynn, R. J., & Lee, M.-L. T. (2006). The Wilcoxon Signed Rank Test for Paired Comparisons of Clustered Data. Biometrics, 62(1), 185–192. https://doi.org/10.1111/j.1541-0420.2005.00389.x

Rulis, M. (2024). The Influences of Misinformation on Incidences of Politically Motivated Violence in Europe. The International Journal of Press/Politics, 19401612241257873. https://doi.org/10.1177/19401612241257873

Sailer, M., & Homner, L. (2020). The Gamification of Learning: A Meta-analysis. Educational Psychology Review, 32(1), 77–112. https://doi.org/10.1007/s10648-019-09498-w

Schumann, S., & Barton, M. (2024). Does Attitudinal Inoculation Confer Resistance to Violent Extremist Propaganda? Assessing Mechanisms, Long-Term Effects, and the Advantage of Visuals. Journal of Community & Applied Social Psychology, 34(6), e2898. https://doi.org/10.1002/casp.2898

Sharon, A. (2024, September 12). Indonesia’s Commitment to Inclusive Internet Access – OpenGov Asia. https://opengovasia.com/2024/09/12/indonesias-commitment-to-inclusive-internet-access/

Syam, H. M., & Nurrahmi, F. (2020). “I Don’t Know If It Is Fake or Real News” How Little Indonesian University Students Understand Social Media Literacy. Jurnal Komunikasi: Malaysian Journal of Communication, 36(2), Article 2. http://ejournal.ukm.my/mjc/article/view/36189

Theisen, W., Brogan, J., Thomas, P. B., Moreira, D., Phoa, P., Weninger, T., & Scheirer, W. (2021). Automatic Discovery of Political Meme Genres with Diverse Appearances. Proceedings of the International AAAI Conference on Web and Social Media, 15, 714–726. https://doi.org/10.1609/icwsm.v15i1.18097

Traberg, C. S., Roozenbeek, J., & van der Linden, S. (2022). Psychological Inoculation against Misinformation: Current Evidence and Future Directions. The ANNALS of the American Academy of Political and Social Science, 700(1), 136–151. https://doi.org/10.1177/00027162221087936

Tversky, A., & Kahneman, D. (1986). Rational Choice and the Framing of Decisions. The Journal of Business, 59(4), S251–S278.

Van der Wal, Z. (2015). “All quiet on the non-Western front?” A review of public service motivation scholarship in non-Western contexts. Asia Pacific Journal of Public Administration, 37(2), 69–86. https://doi.org/10.1080/23276665.2015.1041223

Wang, Y., McKee, M., Torbica, A., & Stuckler, D. (2019). Systematic Literature Review on the Spread of Health-related Misinformation on Social Media. Social Science & Medicine, 240, 112552. https://doi.org/10.1016/j.socscimed.2019.112552

Wardle, C., & Derakhshan, H. (2017). Information disorder: Toward an interdisciplinary framework for research and policy making (2017). https://policycommons.net/artifacts/421935/information-disorder/1392979/

World Economic Forum. (2024, January 16). Special Address by Ursula von der Leyen, President of the European Commission. World Economic Forum. https://www.weforum.org/meetings/world-economic-forum-annual-meeting-2024/sessions/special-address-by-ursula-von-der-leyen-president-of-the-european-commission-96293a5a9d/

Zhulfakar. (2024, September 12). Indonesia’s Internet Access Hits 79.5 Pct as Speed Rises Tenfold in a Decade. Jakarta Globe. https://jakartaglobe.id/tech/indonesias-internet-access-hits-795-pct-as-speed-rises-tenfold-in-a-decade

Downloads

Published

2025-06-27

Issue

No. 43: Summer 2025

Section

Articles

License

Copyright (c) 2025 Michael H. Becker, Michael J. Williams, Alexa Hassan

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

The JD Journal for Deradicalization uses a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND) Licence. You are free to share - copy and redistribute the material in any medium or format under the following conditions: