Radboud University Nijmegen Papers

Browse 1 peer-reviewed paper from Radboud University Nijmegen spanning Applied Linguistics, Educational Assessment (2025). Research powered by Prolific's high-quality participant data.

This page lists 1 peer-reviewed paper from researchers at Radboud University Nijmegen in the Prolific Citations Library, a curated collection of research powered by high-quality human data from Prolific.

Papers (1 of 1)

Crowdsourced comparative judgement for evaluating learner texts: How reliable are judges recruited from an online crowdsourcing platform?

Authors: P Thwaites, N Vandeweerd, M Paquot

Year: 2025

Published in: Applied Linguistics, 2025 - academic.oup.com

Institution: University College Londonouvain, Radboud University Nijmegen, Fonds de la Recherche Scientifique – FNRS

Research Area: Applied Linguistics, Educational Assessment, Crowdsourcing

Discipline: Applied Linguistics

The study demonstrates that crowdsourcing platforms can recruit judges to evaluate learner texts with reliability and validity comparable to assessments conducted by trained linguists.

Methods: Judges recruited via an online crowdsourcing platform conducted comparative judgement assessments of learner texts to measure writing proficiency.

Key Findings: Reliability and concurrent validity of learner text evaluations performed via crowdsourced judges compared to linguist evaluations.

Citations: 10