Authors: CS Kay
Year: 2025
Published in: Behavior Research Methods, 2025•Springer
Institution: Stanford University
Research Area: Behavior Research Methods
Discipline: Behavorial Science, Behavorial Research
Data collected on Amazon's Mechanical Turk (MTurk) shows substantial quality issues, with semantic antonym pairs being positively correlated instead of negatively, even after implementing data screening and using high-reputation participants.
Methods: 27 semantic antonym pairs were administered to participants from Connect (N=100), Prolific (N=100), and MTurk (N=400, N=600) to examine response quality and correlation patterns.
Key Findings: The correlation of responses to semantic antonym pairs as an indicator of data quality across different survey platforms.
Citations: 1
Sample Size: 1200