Discover 5 peer-reviewed studies in Social Science Research Methods (2020–2025). Explore research findings powered by Prolific's diverse participant panel.
This page lists 5 peer-reviewed papers in the research area of Social Science Research Methods in the Prolific Citations Library, a curated collection of research powered by high-quality human data from Prolific.
-
Authors: N Schwitter
Year: 2025
Published in: Social Science Computer Review, 2025 - journals.sagepub.com
Institution: University of Lucerne
Research Area: Artificial Intelligence in Social Science Research Methods, Factorial Survey Experiments, Visual Vignettes Generation
Discipline: Social Science
This paper explores the use of generative AI for creating visual vignettes in factorial survey experiments, highlighting their potential to boost realism and engagement while addressing ethical and technical challenges.
Methods: Techniques for generating and selectively editing AI-generated images were demonstrated, and a pretest with human participants was conducted to evaluate perceptions and interpretations of the images.
Key Findings: Application of AI-generated visual vignettes in social science research and participant interpretation of these images.
Citations: 1
-
Authors: Z Cui, N Li, H Zhou
Year: 2024
Published in: A Large-Scale Replication of Psychological ..., 2024 - papers.ssrn.com
Institution: Harbin Institute of Technology at Weihai
Research Area: LLM replication of psychological experiments, Social Science Research Methods, Artificial Intelligence, Psychology
Discipline: Psychological Science
Large Language Models (LLMs) like GPT-4 successfully replicate 76% of main effects and 47% of interaction effects from 154 psychological experiments, but exhibit overestimation and potential false positives, highlighting their complementary role rather than full replacement of human subjects.
Methods: Replication of 154 psychological experiments from top social science journals using GPT-4 as a simulated participant to measure main effects and interaction effects.
Key Findings: The ability of GPT-4 to replicate human responses in psychological experiments and the extent to which it produces similar results in terms of effect direction, significance, and confidence intervals.
Citations: 29
Sample Size: 154
-
Authors: Y Gao, D Lee, G Burtch, S Fazelpour
Year: 2024
Published in: arXiv preprint arXiv:2410.19599, 2024 - arxiv.org
Institution: Boston University, Northeastern University
Research Area: LLMs as Human Surrogates, Social Science Research Methods, Human Behavior Simulation
Discipline: Economics, Artificial Intelligence, Social Science
LLMs fail to accurately replicate human behavior in the 11-20 money request game, cautioning against their use as surrogates for human cognition in social science research.
Methods: The study evaluates the reasoning depth of various advanced LLMs through their performance on the 11-20 money request game, analyzing failure points related to input language, roles, and safeguarding.
Key Findings: The ability of LLMs to replicate human-like behavior and reasoning distribution in the context of social science simulations.
Citations: 25
-
Authors: BD Douglas, PJ Ewell, M Brauer
Year: 2023
Published in: Plos one, 2023 - journals.plos.org
Institution: University of Alabama, University of Wisconsin-Madison, Florida Atlantic University
Research Area: Social Science Research Methods, Behavioral Research, Data Quality in Crowdsourcing
Discipline: Social Science Research Methods
Citations: 1598
-
Authors: A Bergman, A Chinco, SM Hartzmark
Year: 2020
Published in: Start-Up Guide and ..., 2020 - papers.ssrn.com
Institution: Yale School of Management, University of Miami School of Business, New York University, Columbia University
Research Area: Survey Methodology, Experimental Design, Social Science Research Methods
Discipline: Social Science Research Methods
Citations: 34