Transforming data annotation with ai agents: A review of architectures, reasoning, applications, and impact
Authors: MM Karim, S Khan, DH Van, X Liu, C Wang, Q Qu
Published: 2025
Publication: Future Internet, 2025 - mdpi.com
The paper reviews the role of AI agents powered by large language models in addressing challenges in data annotation, focusing on architectures, workflows, real-world applications, and future research directions for improving efficiency, scalability, transparency, and bias mitigation.
Methods: Comprehensive review and analysis of AI agent architectures, workflows, applications, and evaluation methods in data annotation across multiple industries.
Key Findings: Capabilities of LLM-driven agents in reasoning, adaptive learning, collaborative annotation, and their impact on quality assurance, cost, scalability, and bias mitigation.
Limitations: Limited systematic understanding of challenges like federated learning, cross-modal reasoning, and responsible system design; does not include experimental validation or primary data collection.
Institution: Chinese Academy of Sciences, Zhejiang University, South-Central Minzu University
Research Area: Artificial Intelligence, Data Annotation, Multi-Agent Systems
Discipline: Artificial Intelligence
Citations: 10