Research Methodology: Research Area — Prolific Citations Library

Discover 15 peer-reviewed studies in Research Methodology (2021–2025). Explore research findings powered by Prolific's diverse participant panel.

This page lists 15 peer-reviewed papers in the research area of Research Methodology in the Prolific Citations Library, a curated collection of research powered by high-quality human data from Prolific.

Papers (15 of 15)

Can intelligent agents improve data quality in online questiosnnaires? A pilot study

Authors: A Söderström, A Shatte

Year: 2025

Published in: Behavior Research ..., 2021 - Springer

Institution: University of Helsinki

Research Area: Intelligent Agents, Health Research Methodology, Behavioral Research

Discipline: Research Methodology, Behavioral Science

The study found that chatbot-assisted surveys modestly improve data quality, with most users finding the chatbots helpful and widely using them.

Methods: Randomized participants into chatbot-supported and unassisted survey conditions; assessed chatbot use, user satisfaction, and data quality via validated and deliberately confusing challenge items.

Key Findings: Effects of chatbot assistance on data quality, user satisfaction, and usage patterns in online questionnaires.

DOI: https://doi.org/10.3758/s13428-021-01574-w

Citations: 7

Sample Size: 300
Participant Interactions with Artificial Intelligence: Using Large Language Models to Generate Research Materials for Surveys and Experiments

Authors: TS Behrend, RN Landers

Year: 2025

Published in: Journal of Business and Psychology, 2025 - Springer

Institution: University of Nebraska-Lincoln, University of Minnesota

Research Area: LLM in Behavioral Science Research, AI-Assisted Research Methodology

Discipline: Behavioral Science, Psychology, Artificial Intelligence

The paper proposes a framework with five use cases for integrating large language models into survey and experimental research, introduces the Qualtrics-AI Link (QUAIL) tool, and highlights technical and ethical considerations for using LLMs effectively and validly.

Methods: The paper outlines a decision-making framework for five potential uses of LLMs in survey and experimental design, introduces software (QUAIL) for integrating LLM knowledge into Qualtrics, and details technical steps such as prompt engineering, model testing, and validity monitoring.

Key Findings: Applications, implementation strategies, and ethical considerations of large language models in psychological research material development.

DOI: https://doi.org/10.1007/s10869-025-10035-6

Citations: 6
Caution when Crowdsourcing: Prolific as a Superior Platform Compared with MTurk

Authors: D OConnell, A Bautista

Year: 2025

Published in: ... Student Journal of ..., 2025 - journals.library.columbia.edu

Institution: University of Houston, Webster University

Research Area: Crowdsourcing Research Methodology, Human-Computer Interaction (HCI)

Discipline: Computational Social Science, Behavioral Research

Prolific outperforms MTurk in participant data quality and affordability for online survey-based research.

Methods: Data from participants recruited via MTurk and Prolific were analyzed for cost, attention measures, participation duration, and internal consistency.

Key Findings: Comparison of data quality and cost-effectiveness between MTurk and Prolific for online survey recruitment.

Citations: 1

Sample Size: 699
Repeated Measure Designs are Superior for (Most) Experimental Survey Research Applications

Authors: D Jordan, T Ollerenshaw, A Trexler

Year: 2025

Published in: 2025 - weekendu.uh.edu

Institution: University of Houston, Duke University

Research Area: Experimental Survey Research Methodology

Discipline: Social Science, Research Methodology

Repeated measure designs offer enhanced precision with minimal bias, suitable for various experiments despite slight attenuation of treatment effects.

Methods: Experimentally manipulated six classic political science experiments across three sample types, including extensions with proximity manipulation and sample-type variations.

Key Findings: Suitability and precision of repeated measure designs in survey experiments, including treatment effect estimations and design applicability across different sample types and methodologies.

Citations: 1

Sample Size: 13163
Detecting the corruption of online questionnaires by artificial intelligence

Authors: B Lebrun, S Temtsin, A Vonasch

Year: 2024

Published in: Frontiers in Robotics and ..., 2024 - frontiersin.org

Institution: University of Lausanne, University of California Berkeley, University of Massachusetts Amherst, Arizona State University

Research Area: AI in Social Science Research, Survey Methodology, Data Quality

Discipline: Artificial Intelligence

The study examines the integrity of online questionnaire responses and concludes that humans can identify AI-generated text with 76% accuracy, but current AI detection systems are ineffective, raising concerns about data quality in online surveys.

Methods: Human participants and automatic AI detection systems were tested on their ability to differentiate AI-generated text from human-generated text in the context of online questionnaires.

Key Findings: The study measured the ability of humans and AI detection tools to correctly identify whether text was generated by a human or an AI system for online questionnaire responses.

DOI: https://doi.org/10.3389/frobt.2023.1277635

Citations: 26
Crowdsourcing Academic Online Research on Prolific

Authors: Eyal Peer

Year: 2024

Published in: CAMBRIDGE

Institution: Hebrew University, University of Cambridge

Research Area: Crowdsourcing, Research Methodology in Behavioral and Social Sciences

Discipline: Social, Behavioral Sciences

Citations: 7
Conducting web-based experiments in L2 psycholinguistic research

Authors: S Fang, A Juffs

Year: 2024

Published in: Routledge Handbook of Technological Advances ..., 2024 - taylorfrancis.com

Institution: University of Pittsburgh, The University of Auckland

Research Area: Second Language Acquisition, Psycholinguistics, Research Methodology

Discipline: Psycholinguistics

Citations: 2
Motivation Matters: Challenges and Pit-Falls of Crowdsourced Online Studies

Authors: E Becks, V Matkovic, T Weis

Year: 2024

Published in: 2025 IEEE International Conference on ..., 2025 - computer.org

Institution: University of Stuttgart, University of Applied Sciences Offenburg, University of Hohenheim

Research Area: Crowdsourced Online Studies, Human-Computer Interaction (HCI) in AI Systems, Behavioral Research Methodology

Discipline: Human-Computer Interaction (HCI)
Inattentive responding can induce spurious associations between task behaviour and symptom measures

Authors: S Zorowitz, J Solis, Y Niv, D Bennett

Year: 2023

Published in: Nature human behaviour, 2023 - nature.com

Institution: Princeton University, Rutgers University, Monash University

Research Area: Research Methodology, Behavioral Research, Experimental Psychology (focus on data quality and spurious correlations)

Discipline: Behavioral Science

DOI: https://doi.org/10.1038/s41562-023-01640-7

Citations: 110
From lab-testing to web-testing in cognitive research: Who you test is more important than how you test

Authors: K Uittenhove, S Jeanneret, E Vergauwe

Year: 2023

Published in: Journal of Cognition, 2023 - pmc.ncbi.nlm.nih.gov

Institution: University of Lausanne, University of Geneva, EPFL, University of Neuchâtel, NiH

Research Area: Cognitive Psychology, Research Methodology, Behavioral Research Methods, Web-based Behavioral Research

Discipline: Cognitive Research, Psychology

Citations: 83
Crowdsourcing technology to support academic research

Authors: M Hirth, J Jacques, P Rodgers, O Scekic

Year: 2023

Published in: Evaluation in the Crowd ..., 2017 - Springer

Research Area: Crowdsourcing, Research Methodology, Human-Computer Interaction (HCI) in Academic Research

Discipline: Social Science (specifically Crowdsourcing, Human-Computer Interaction (HCI), Research Methodology)

Citations: 15
Stop agonising over informed consent when researchers use crowdsourcing platforms to conduct survey research

Authors: J Lewis, V Dranseika, S Holm

Year: 2023

Published in: Clinical Ethics, 2023 - journals.sagepub.com

Institution: University of Manchester, Jagiellonian University

Research Area: Research Ethics in Crowdsourcing, Survey Methodology

Discipline: Research Ethics
Data collection via online platforms: Challenges and recommendations for future research

Authors: A Newman, YL Bavik, M Mount, B Shao

Year: 2021

Published in: Applied Psychology, 2021 - Wiley Online Library

Institution: Griffith University, Macquarie University, Australian Catholic University, University of New South Wales

Research Area: Data Collection, Online Platforms, Research Methodology

Discipline: Applied Psychology

Citations: 449
The experimenters' dilemma: inferential preferences over populations

Authors: N Gupta, L Rigotti, A Wilson

Year: 2021

Published in: arXiv preprint arXiv:2107.05064, 2021 - arxiv.org

Institution: University of Cambridge, University of Verona, University of Oxford, University of Pittsburgh

Research Area: Experimental Design, Research Methodology, Inferential Statistics

Discipline: Social Science Research Methods

Citations: 104
Online data collection in auditory perception and cognition research: Recruitment, testing, data quality and ethical considerations

Authors: T Eerola, J Armitage, N Lavan

Year: 2021

Published in: Auditory Perception & ..., 2021 - Taylor & Francis

Institution: Durham University

Research Area: Auditory Perception and Cognition, Research Methodology, Data Quality, Ethics in Online Research

Discipline: Cognitive Psychology, Research Methodology

Citations: 54