Impact of social reference cues on misinformation sharing on social media: Series of experimental studies
Abstract
Background: Health-related misinformation on social media is a key challenge to effective and timely public health responses. Existing mitigation measures include flagging misinformation or providing links to correct information, but they have not yet targeted social processes. Current approaches focus on increasing scrutiny, providing corrections to misinformation (debunking), or alerting users prospectively about future misinformation (prebunking and inoculation). Here, we provide a test of a complementary strategy that focuses on the social processes inherent in social media use, in particular, social reinforcement, social identity, and injunctive norms. Objective: This study aimed to examine whether providing balanced social reference cues (ie, cues that provide information on users sharing and, more importantly, *not* sharing specific content) in addition to flagging COVID-19--related misinformation leads to reductions in sharing behavior and improvement in overall sharing quality. Methods: A total of 3 field experiments were conducted on Twitter's native social media feed (via a newly developed browser extension). Participants' feed was augmented to include misleading and control information, resulting in 4 groups: no-information control, Twitter's own misinformation warning (misinformation flag), social cue only, and combined misinformation flag and social cue. We tracked the content shared or liked by participants. Participants were provided with social information by referencing either their *personal* network on Twitter or all Twitter users. Results: A total of 1424 Twitter users participated in 3 studies (n=824, n=322, and n=278). Across all 3 studies, we found that social cues that reference users' personal network combined with a misinformation flag reduced the sharing of misleading but not control information and improved overall sharing quality. We show that this improvement could be driven by a change in injunctive social norms (study 2) but not social identity (study 3). Conclusions: Social reference cues combined with misinformation flags can significantly and meaningfully reduce the amount of COVID-19--related misinformation shared and improve overall sharing quality. They are a feasible and scalable way to effectively curb the sharing of COVID-19--related misinformation on social media.
Study specs
- Authors
- CM Jones,D Diethei,J Schöning,R Shrestha
- Discipline
- Social Science,Digital Health
- Year
- 2022
- Human Data Platform
- Prolific
- Source
- View Source DOI Google Scholar
Peer Review & Critical Discussion
Potential Selection Bias in 2023 Cohort
The participant pool shows a concerning overrepresentation of users from high-income demographics. Looking at Table 3, we can see that 78% of respondents had annual incomes above $75k, which significantly limits the generalizability of these findings to broader populations.
Non-naive Participants Issue
I've noticed a methodological concern regarding participant naivety. Given that Prolific users often complete multiple studies, there's a real risk that participants had prior exposure to similar experimental paradigms, which could confound the results.
RLHF Applicability to This Study Design
The implications for RLHF training pipelines are understated. If we accept the authors' conclusions about preference stability, this has direct consequences for how we should structure reward model training. The temporal decay effect described in Section 4.2 is particularly relevant.
Verify your expertise to join discussion
Create an account and verify your credentials to participate in peer discussions.