G Burtch: Researcher — Prolific Citations Library

Explore 1 peer-reviewed study by G Burtch in LLMs as Human Surrogates and Social Science Research Methods (2024). Discover research powered by Prolific's participant panel.

This page lists 1 peer-reviewed paper authored or co-authored by G Burtch in the Prolific Citations Library, a curated collection of research powered by high-quality human data from Prolific.

Papers (1 of 1)

Take caution in using LLMs as human surrogates: Scylla ex machina

Authors: Y Gao, D Lee, G Burtch, S Fazelpour

Year: 2024

Published in: arXiv preprint arXiv:2410.19599, 2024 - arxiv.org

Institution: Boston University, Northeastern University

Research Area: LLMs as Human Surrogates, Social Science Research Methods, Human Behavior Simulation

Discipline: Economics, Artificial Intelligence, Social Science

LLMs fail to accurately replicate human behavior in the 11-20 money request game, cautioning against their use as surrogates for human cognition in social science research.

Methods: The study evaluates the reasoning depth of various advanced LLMs through their performance on the 11-20 money request game, analyzing failure points related to input language, roles, and safeguarding.

Key Findings: The ability of LLMs to replicate human-like behavior and reasoning distribution in the context of social science simulations.

Citations: 25