0 papers in the Llm Replication Of Psychological Experiments research area.
Discover 1 peer-reviewed study in Llm Replication Of Psychological Experiments (2024). Explore research findings powered by Prolific's diverse participant panel.
This page lists 1 peer-reviewed paper in the research area of Llm Replication Of Psychological Experiments in the Prolific Citations Library, a curated collection of research powered by high-quality human data from Prolific.
Authors: Z Cui, N Li, H Zhou
Year: 2024
Published in: A Large-Scale Replication of Psychological ..., 2024 - papers.ssrn.com
Institution: Harbin Institute of Technology at Weihai
Research Area: LLM replication of psychological experiments, Social Science Research Methods, Artificial Intelligence, Psychology
Discipline: Psychological Science
Large Language Models (LLMs) like GPT-4 successfully replicate 76% of main effects and 47% of interaction effects from 154 psychological experiments, but exhibit overestimation and potential false positives, highlighting their complementary role rather than full replacement of human subjects.
Methods: Replication of 154 psychological experiments from top social science journals using GPT-4 as a simulated participant to measure main effects and interaction effects.
Key Findings: The ability of GPT-4 to replicate human responses in psychological experiments and the extent to which it produces similar results in terms of effect direction, significance, and confidence intervals.
Citations: 29
Sample Size: 154
Related Disciplines: Psychological Science
Related Institutions: Harbin Institute of Technology at Weihai
Researchers: Z Cui, N Li, H Zhou
Publication Years: 2024
Browse all papers in the Prolific Citations Library
