You Had Better Check the Facts: Reader Agency in the Identification of Machine-Generated Medical Fake News
DOI:
https://doi.org/10.31273/reinvention.v16i1.964Keywords:
Natural-language processing, detection of fake news, fact-checking of articles, machine-generated medical fake news, natural-language generation, manipulationAbstract
During the COVID-19 pandemic, much fake news emerged in the medical field (Naeem et al., 2020: 1). Nowadays, computers can generate text considered to be more trustworthy than text written by a person (Zellers et al., 2019). This means that laypeople are able to produce disinformation; however, they may not understand the implications. This study revealed the most reliable clues as guidance to spot machine writing. While natural-language processing (NLP) research focuses on L1 speakers, studies in second language acquisition demonstrate that L1 and L2 speakers attend to different aspects of English (Scarcella, 1984; Tsang, 2017). In this study, social media users completed a Turing-test style quiz, guessed whether news excerpts were machine generated or human written (Saygin et al., 2000) and identified errors that guided their decision. Quantitative analysis revealed that although both L1 and L2 speakers were equally able to defend themselves against machine-generated fake news, L2 participants were more sceptical, labelling more human-written texts as being machine generated. This is possibly due to concern about the stigma associated with being fooled by a machine due to lower language levels. However, factual errors and internal contradictions were the most reliable indicators of machine writing for both groups. This emphasises the importance of fact-checking when news articles prioritise exaggerated headlines, and NLP tools enable production of popular content in areas like medicine.
References
Published
Issue
Section
License
Copyright (c) 2023 Barbora Dankova
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors are responsible for obtaining permission from copyright holders for reproducing through any medium of communication those illustrations, tables, figures or lengthy quotations previously published elsewhere. Authors are also responsible for adding these permissions to the acknowledgement footnote that precedes all other notes or crediting the source and copyright of photographs or figures in the accompanying captions.
The journal's policy is to ask authors to grant us the licence to publish their work, which gives us the exclusive right both to reproduce and/or distribute their article (including the abstract) in printed, electronic or any other medium, and in turn to authorise others (including Reproduction Rights Organisations such as the Copyright Licensing Agency and the Copyright Clearance Center) to do the same. In return the author(s) assert their Moral Right to be identified as the author, and we promise that we will respect their rights as the author(s). That is, we will make sure that their name(s) is/are always clearly associated with the article and, while they do allow us to make necessary editorial changes, we will not make any substantial alteration to their article without consulting them.
Copyright remains with the author(s), however, the author(s) authorise us to act on their behalf to defend their copyright if anyone should infringe it, and to retain half of any damages awarded, after deducting our costs. The author(s) also retain the right to use their own article (provided they acknowledge the published original in standard bibliographic citation form) in the following ways, as long as they do not sell it or give it away in ways which would conflict directly with our interests. The author(s) is/are free to use their article for the internal educational or other purposes of their own institution or company; mounted on their own or their institution’s website; posted to free public servers of preprints and/or articles in their subject area; or in whole or in part, as the basis for their own further publications or spoken presentations.
If you have any queries about copyright please contact reinventionjournal@warwick.ac.uk
