Crowdsourcing Knowledge Production of COVID-19 Information on Japanese Wikipedia in the Face of Uncertainty: Empirical Analysis - PubMed
- ️Sun Jan 01 2023
Crowdsourcing Knowledge Production of COVID-19 Information on Japanese Wikipedia in the Face of Uncertainty: Empirical Analysis
Kunhao Yang et al. J Med Internet Res. 2023.
Abstract
Background: A worldwide overabundance of information comprising misinformation, rumors, and propaganda concerning COVID-19 has been observed in addition to the pandemic. By addressing this data confusion, Wikipedia has become an important source of information.
Objective: This study aimed to investigate how the editors of Wikipedia have handled COVID-19-related information. Specifically, it focused on 2 questions: What were the knowledge preferences of the editors who participated in producing COVID-19-related information? and How did editors with different knowledge preferences collaborate?
Methods: This study used a large-scale data set, including >2 million edits in the histories of 1857 editors who edited 133 articles related to COVID-19 on Japanese Wikipedia. Machine learning methods, including graph neural network methods, Bayesian inference, and Granger causality analysis, were used to establish the editors' topic proclivity and collaboration patterns.
Results: Overall, 3 trends were observed. Two groups of editors were involved in the production of information on COVID-19. One group had a strong preference for sociopolitical topics (social-political group), and the other group strongly preferred scientific and medical topics (scientific-medical group). The social-political group played a central role (contributing 16,544,495/23,485,683, 70.04% of bits of content and 57,969/76,673, 75.61% of the references) in the information production part of the COVID-19 articles on Wikipedia, whereas the scientific-medical group played only a secondary role. The severity of the pandemic in Japan activated the editing behaviors of the social-political group, leading them to contribute more to COVID-19 information production on Wikipedia while simultaneously deactivating the editing behaviors of the scientific-medical group, resulting in their less contribution to COVID-19 information production on Wikipedia (Pearson correlation coefficient=0.231; P<.001).
Conclusions: The results of this study showed that lay experts (ie, Wikipedia editors) in the fields of science and medicine tended to remain silent when facing high scientific uncertainty related to the pandemic. Considering the high quality of the COVID-19-related articles on Japanese Wikipedia, this research also suggested that the sidelining of the science and medicine editors in discussions is not necessarily a problem. Instead, the social and political context of the issues with high scientific uncertainty is more important than the scientific discussions that support accuracy.
Keywords: COVID-19; Wikipedia; crowdsourcing information production; scientific uncertainty.
©Kunhao Yang, Mikihito Tanaka. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 29.06.2023.
Conflict of interest statement
Conflicts of Interest: None declared.
Figures

The entire process of identifying editors’ knowledge preferences. The upper half of the figure shows the relationships among the parts of the data set (Wikipedia article network, editing history data, focal editors, and key articles). The figure’s lower half shows the analysis process from creating a network of Wikipedia articles to identifying the preference of different groups of editors. TF-IDF: term frequency–inverse document frequency.

An illustration of the computation of the case variable, the contribution variable, and the Pearson correlation between the 2 time-series variables. The upper part presents a hypothetical case of the computation of the case variable. The lower part presents a hypothetical case of the computation of group g’s contribution variable. Colored rectangles represent the moving time windows used in the computation.

Summary of contributions of the social-political and scientific-medical groups to the information production of COVID-19 on Japanese Wikipedia. This figure presents (1) the ratio of editors participating in the COVID-19 information production on Wikipedia in the social-political group and the scientific-medical group, (2) the ratio of edits on COVID-19 articles implemented by the social-political and scientific-medical groups, (3) the ratio in the changes of bits on COVID-19 articles implemented by the social-political group and the scientific-medical group, and (4) the ratio of references in COVID-19 articles added by the social-political and the scientific-medical groups. The blue portion of the bars show the percentages contributed by the social-political group, whereas the orange bars show the percentage contributed by the scientific-medical group.
Similar articles
-
Wikipedia and medicine: quantifying readership, editors, and the significance of natural language.
Heilman JM, West AG. Heilman JM, et al. J Med Internet Res. 2015 Mar 4;17(3):e62. doi: 10.2196/jmir.4069. J Med Internet Res. 2015. PMID: 25739399 Free PMC article.
-
Chrzanowski J, Sołek J, Fendler W, Jemielniak D. Chrzanowski J, et al. J Med Internet Res. 2021 Apr 12;23(4):e26331. doi: 10.2196/26331. J Med Internet Res. 2021. PMID: 33667176 Free PMC article.
-
Effects of Contributor Experience on the Quality of Health-Related Wikipedia Articles.
Holtz P, Fetahu B, Kimmerle J. Holtz P, et al. J Med Internet Res. 2018 May 10;20(5):e171. doi: 10.2196/jmir.9683. J Med Internet Res. 2018. PMID: 29748161 Free PMC article.
-
Motivations for contributing to health-related articles on Wikipedia: an interview study.
Farič N, Potts HW. Farič N, et al. J Med Internet Res. 2014 Dec 3;16(12):e260. doi: 10.2196/jmir.3569. J Med Internet Res. 2014. PMID: 25498308 Free PMC article.
-
Maggio LA, Willinsky JM, Costello JA, Skinner NA, Martin PC, Dawson JE. Maggio LA, et al. Perspect Med Educ. 2020 Dec;9(6):333-342. doi: 10.1007/s40037-020-00620-1. Epub 2020 Oct 8. Perspect Med Educ. 2020. PMID: 33030643 Free PMC article. Review.
References
-
- Patwa P, Sharma S, Pykl S, Guptha V, Kumari G, Akhtar M, Ekbal A, Das A, Chakraborty T. Combating Online Hostile Posts in Regional Languages during Emergency Situation. Cham: Springer; 2021. Fighting an infodemic: COVID-19 fake news dataset.
-
- Patel MP, Kute VB, Agarwal SK, COVID-19 Working Group of Indian Society of Nephrology "Infodemic" COVID 19: more pandemic than the Virus. Indian J Nephrol. 2020 May;30(3):188–91. doi: 10.4103/ijn.IJN_216_20. https://europepmc.org/abstract/MED/33013069 IJN-30-188 - DOI - PMC - PubMed
-
- Zarocostas J. How to fight an infodemic. Lancet. 2020 Feb 29;395(10225):676. doi: 10.1016/S0140-6736(20)30461-X. https://europepmc.org/abstract/MED/32113495 S0140-6736(20)30461-X - DOI - PMC - PubMed
-
- Managing the COVID-19 infodemic: promoting healthy behaviours and mitigating the harm from misinformation and disinformation. World Health Organization. [2022-08-10]. https://tinyurl.com/3p5zads7 .
-
- Eysenbach G. How to fight an infodemic: the four pillars of infodemic management. J Med Internet Res. 2020 Jun 29;22(6):e21820. doi: 10.2196/21820. https://www.jmir.org/2020/6/e21820/ v22i6e21820 - DOI - PMC - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Medical