Discover 28 peer-reviewed studies in Research Methods (2022–2025). Explore research findings powered by Prolific's diverse participant panel.
This page lists 28 peer-reviewed papers in the research area of Research Methods in the Prolific Citations Library, a curated collection of research powered by high-quality human data from Prolific.
-
Authors: RG Rinderknecht, L Doan
Year: 2025
Published in: Sociological ..., 2025 - journals.sagepub.com
Institution: RAND
Research Area: Crowdsourcing Research Methods, Time Use Studies, Social Science
Discipline: Artificial Intelligence
Time use patterns of MTurk and Prolific respondents differ significantly from the general U.S. population (ATUS), including less housework and care work, more time at home and alone, even after accounting for demographic differences.
Methods: Time diaries were collected and analyzed for 136 MTurk and 156 Prolific respondents, then compared with 468 ATUS responses.
Key Findings: Daily time use patterns including work, housework, travel, leisure, and time spent alone or at home.
Citations: 6
Sample Size: 760
-
Authors: N Byrd
Year: 2025
Published in: Byrd, N. (2025). Reflection-Philosophy Order Effects and Correlations Across Samples. Analysis. DOI: 10.1093/analys/anaf015. https://osf.io/preprints/psyarxiv/y8sdm
Institution: Stevens Institute of Technology
Research Area: Behavioral Research Methods, Experimental Psychology, Crowdsourcing Platforms
Discipline: Psychology
Reflective reasoning correlates with certain philosophical decisions, and the study suggests bidirectional causal paths between reflection and philosophy, with test order effects influencing reflection test outcomes but not philosophical decisions.
Methods: Participants from four sources (Amazon Mechanical Turk, CloudResearch, Prolific, and a university) were tested on reflective reasoning and their decisions on 10 philosophical thought experiments.
Key Findings: Impact of reflective reasoning on philosophical decisions and the effect of test order on reflection and philosophy outcomes.
Citations: 4
-
Authors: JS Michel, G Sawhney, GP Watson
Year: 2025
Published in: How to Conduct and ..., 2025 - elgaronline.com
Institution: Auburn University
Research Area: Crowdsourcing, Research Methods, Social Science
Discipline: Social Science
Crowdsourcing is a versatile tool leveraging collective intelligence for efficient task completion and has applications across various fields including decentralized finance, blockchain technologies, and IO Psychology research and practice.
Methods: The paper discusses the theoretical and practical applications of crowdsourcing in various domains, referencing prior work and examples such as Wikipedia, crowdfunding platforms, and blockchain networks.
Key Findings: The applications and impact of crowdsourcing in different fields, particularly its role in Industrial-Organizational Psychology for data collection and analysis.
Citations: 1
-
Authors: M Brassil, É Duncan, C Greene, B Mac Síthigh
Year: 2025
Published in: 2025 - osf.io
Institution: University College Dublin
Research Area: Eyewitness Memory, Misinformation Effect, Behavioral Research Methods, Online Data Collection Platforms
Discipline: Psychology
The study found that data collection contexts significantly influence susceptibility to eyewitness misinformation, with Prolific participants being less accurate and more susceptible compared to Laboratory or general online participants.
Methods: Two studies were conducted comparing eyewitness misinformation susceptibility across Laboratory, Prolific, and General Online participant groups under varying visual perceptual load conditions.
Key Findings: Eyewitness misinformation susceptibility and recall accuracy across Laboratory, Prolific, and General Online participant groups; the effect of visual perceptual load on recall accuracy.
Citations: 1
-
Authors: N Schwitter
Year: 2025
Published in: Social Science Computer Review, 2025 - journals.sagepub.com
Institution: University of Lucerne
Research Area: Artificial Intelligence in Social Science Research Methods, Factorial Survey Experiments, Visual Vignettes Generation
Discipline: Social Science
This paper explores the use of generative AI for creating visual vignettes in factorial survey experiments, highlighting their potential to boost realism and engagement while addressing ethical and technical challenges.
Methods: Techniques for generating and selectively editing AI-generated images were demonstrated, and a pretest with human participants was conducted to evaluate perceptions and interpretations of the images.
Key Findings: Application of AI-generated visual vignettes in social science research and participant interpretation of these images.
Citations: 1
-
Authors: CS Kay
Year: 2025
Published in: Behavior Research Methods, 2025•Springer
Institution: Stanford University
Research Area: Behavior Research Methods
Discipline: Behavorial Science, Behavorial Research
Data collected on Amazon's Mechanical Turk (MTurk) shows substantial quality issues, with semantic antonym pairs being positively correlated instead of negatively, even after implementing data screening and using high-reputation participants.
Methods: 27 semantic antonym pairs were administered to participants from Connect (N=100), Prolific (N=100), and MTurk (N=400, N=600) to examine response quality and correlation patterns.
Key Findings: The correlation of responses to semantic antonym pairs as an indicator of data quality across different survey platforms.
Citations: 1
Sample Size: 1200
-
Authors: L Woodley, X Roberts-Gaal, R Calcott, F Cushman
Year: 2025
Published in: files.osf.io
Institution: Harvard University
Research Area: Experimental Psychology, Research Methods, Replication Studies
Discipline: Psychology, Social Science
Explicit demand cues do not alter participant behavior, judgments, or attitudes in online psychology experiments, despite participants adjusting their beliefs about study hypotheses.
Methods: Three preregistered experiments on Prolific tested the impact of explicit demand cues on participant behavior using a dictator game, a moral dilemma vignette, and a group attitude intervention. Participants were randomly assigned to receive information about the study hypothesis or no information.
Key Findings: Whether explicit demand cues influence behavior, judgments, or attitudes in online psychology studies.
Sample Size: 2254
-
Authors: DA Albert, D Smilek
Year: 2024
Published in: Scientific Reports, 2023 - nature.com
Institution: University of Waterloo, University of Waterloo
Research Area: Crowdsourcing Research Methods, Behavioral Science, Human-Computer Interaction (HCI)
Discipline: Psychological Science
Prolific participants exhibited lower levels of attentional disengagement compared to MTurk participants, with risk conditions and platform traits influencing task performance and disengagement.
Methods: Participants from Prolific and MTurk completed an attention task with varying error risk levels (high vs. low), and attentional disengagement was measured using task performance, self-reported mind wandering, and multitasking.
Key Findings: Attentional disengagement through task performance, mind wandering, and multitasking under different risk conditions across two recruitment platforms (Prolific and MTurk).
Citations: 150
Sample Size: 80
-
Authors: Z Cui, N Li, H Zhou
Year: 2024
Published in: A Large-Scale Replication of Psychological ..., 2024 - papers.ssrn.com
Institution: Harbin Institute of Technology at Weihai
Research Area: LLM replication of psychological experiments, Social Science Research Methods, Artificial Intelligence, Psychology
Discipline: Psychological Science
Large Language Models (LLMs) like GPT-4 successfully replicate 76% of main effects and 47% of interaction effects from 154 psychological experiments, but exhibit overestimation and potential false positives, highlighting their complementary role rather than full replacement of human subjects.
Methods: Replication of 154 psychological experiments from top social science journals using GPT-4 as a simulated participant to measure main effects and interaction effects.
Key Findings: The ability of GPT-4 to replicate human responses in psychological experiments and the extent to which it produces similar results in terms of effect direction, significance, and confidence intervals.
Citations: 29
Sample Size: 154
-
Authors: BA Mok, V Viswanathan, A Borjigin, R Singh
Year: 2024
Published in: Behavior Research ..., 2024 - Springer
Institution: Purdue University, University of Pittsburgh
Research Area: Psychoacoustics, Hearing Screening, Behavioral Research Methods
Discipline: Generating formulas is not supported. Please use the Gemini side panel instead.
The study demonstrates that web-based psychoacoustic experiments can produce results comparable to lab-based studies by addressing challenges like hearing screening and headphone standardization.
Methods: Web-based tests using jsPsych and Django for task implementation, Prolific for participant recruitment, hearing screening using a suprathreshold task and survey, and validation against lab-based data.
Key Findings: Classic psychoacoustic phenomena such as fundamental frequency discrimination, gap detection, interaural time delay and level difference sensitivity, word identification, consonant confusion patterns, and co-modulation masking release effect.
Citations: 28
-
Authors: Y Gao, D Lee, G Burtch, S Fazelpour
Year: 2024
Published in: arXiv preprint arXiv:2410.19599, 2024 - arxiv.org
Institution: Boston University, Northeastern University
Research Area: LLMs as Human Surrogates, Social Science Research Methods, Human Behavior Simulation
Discipline: Economics, Artificial Intelligence, Social Science
LLMs fail to accurately replicate human behavior in the 11-20 money request game, cautioning against their use as surrogates for human cognition in social science research.
Methods: The study evaluates the reasoning depth of various advanced LLMs through their performance on the 11-20 money request game, analyzing failure points related to input language, roles, and safeguarding.
Key Findings: The ability of LLMs to replicate human-like behavior and reasoning distribution in the context of social science simulations.
Citations: 25
-
Authors: AC Krendl, K Hugenberg, DP Kennedy
Year: 2024
Published in: Behavior research methods, 2024 - Springer
Institution: Indiana University
Research Area: Psychological Research Methods, Data Quality in Online Experiments, Theory of Mind Assessment
Discipline: Research Methodology, Cognitive Psychology
This study found that online samples can reliably complete dynamic, complex theory of mind tasks, though familiarity with task content can influence performance.
Methods: Compared in-lab and online participants' performance on two dynamic theory of mind tasks, using one familiar and one relatively novel TV-based paradigm and counterbalancing task order.
Key Findings: Performance on theory of mind tasks, including inferring beliefs, understanding motivations, detecting deception, identifying faux pas, and understanding emotions.
Citations: 13
Sample Size: 668
-
Authors: BD Douglas, PJ Ewell, M Brauer
Year: 2023
Published in: Plos one, 2023 - journals.plos.org
Institution: University of Alabama, University of Wisconsin-Madison, Florida Atlantic University
Research Area: Social Science Research Methods, Behavioral Research, Data Quality in Crowdsourcing
Discipline: Social Science Research Methods
Citations: 1598
-
Authors: K Uittenhove, S Jeanneret, E Vergauwe
Year: 2023
Published in: Journal of Cognition, 2023 - pmc.ncbi.nlm.nih.gov
Institution: University of Lausanne, University of Geneva, EPFL, University of Neuchâtel, NiH
Research Area: Cognitive Psychology, Research Methodology, Behavioral Research Methods, Web-based Behavioral Research
Discipline: Cognitive Research, Psychology
Citations: 83
-
Authors: N Gagné, L Franzen
Year: 2023
Published in: ... Open: the official journal of the ..., 2023 - swisspsychologyopen.com
Institution: Concordia University, University of Lübeck
Research Area: Cognitive Psychology, Neuroscience, Behavioral Research Methods
Discipline: Cognitive Psychology, Neuroscience
Citations: 75
-
Authors: E Peer, D Rothschild, A Gordon, E Damer
Year: 2022
Published in: Behavior Research Methods, 2022 - Springer
Institution: The Hebrew University of Jerusalem, Microsoft Research, Prolific
Research Area: Online Behavioral Research, Data Quality, Research Methods
Discipline: Computational Social Science, Behavioral Research
Citations: 2112
-
Authors: K Stanton, RW Carpenter, M Nance
Year: 2022
Published in: Experimental and ..., 2022 - psycnet.apa.org
Institution: University of Missouri-Columbia, University of Texas at Austin
Research Area: Psychometric Substance Use Research, Behavioral Research Methods
Discipline: Psychology
Citations: 111
-
Authors: NR Greene, M Naveh-Benjamin
Year: 2022
Published in: Psychology and Aging, 2022 - psycnet.apa.org
Institution: University of Kansas, University of Arkansas, University of California Riverside
Research Area: Cognitive Aging Research, Online Experimentation, Sampling Methods in Psychology
Discipline: Psychology, Cognitive Aging Research
Citations: 56
-
Authors: TXF Seow, TU Hauser
Year: 2022
Published in: Behavior research methods, 2022 - Springer
Institution: University College London, Max Planck University College London
Research Area: Behavioral Research Methods, Affective Computing, Web-based Experimentation
Discipline: Human-Computer Interaction (HCI)
Citations: 23
-
Authors: SX Li, R Halabi, R Selvarajan, M Woerner
Year: 2022
Published in: JMIR Formative ..., 2022 - formative.jmir.org
Institution: Massachusetts General Hospital, Harvard Medical School, Boston University, University of Waterloo
Research Area: Digital Health, Remote Research Methods, Recruitment and Retention Studies
Discipline: Digital Health, Research Methodology
Citations: 19