Llm Replication Of Psychological Experiments: Research Area — Prolific Citations Library

Discover 1 peer-reviewed study in Llm Replication Of Psychological Experiments (2024). Explore research findings powered by Prolific's diverse participant panel.

This page lists 1 peer-reviewed paper in the research area of Llm Replication Of Psychological Experiments in the Prolific Citations Library, a curated collection of research powered by high-quality human data from Prolific.

Papers (1 of 1)

Can AI replace human subjects? a large-scale replication of psychological experiments with LLMs

Authors: Z Cui, N Li, H Zhou

Year: 2024

Published in: A Large-Scale Replication of Psychological ..., 2024 - papers.ssrn.com

Institution: Harbin Institute of Technology at Weihai

Research Area: LLM replication of psychological experiments, Social Science Research Methods, Artificial Intelligence, Psychology

Discipline: Psychological Science

Large Language Models (LLMs) like GPT-4 successfully replicate 76% of main effects and 47% of interaction effects from 154 psychological experiments, but exhibit overestimation and potential false positives, highlighting their complementary role rather than full replacement of human subjects.

Methods: Replication of 154 psychological experiments from top social science journals using GPT-4 as a simulated participant to measure main effects and interaction effects.

Key Findings: The ability of GPT-4 to replicate human responses in psychological experiments and the extent to which it produces similar results in terms of effect direction, significance, and confidence intervals.

Citations: 29

Sample Size: 154