LLM-Assisted Annotation

Ask about this topic

Momentum

17 papers in the last four weeks, up 143% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 124

All topics
CardsList

  1. Challenges in annotations by humans and LLMs: A case study of evaluative language

    Jul 30, 2026Mirela Imamovic, Aenne Cecilia Kristine Knierim, Khushi Pitroda +1LLM EvaluationLLM-Assisted Annotation

    University of Hildesheim, Institute of Translation Studies and Specialised Communication, Germany · University of Paris 8 Vincennes-Saint Denis, TransCrit, France · University of Hildesheim, Institute of Information Science and Language Technology, Germany

  2. A Human-in-the-Loop Corpus for LLM-Based Simplification of Scientific Summaries

    Jul 28, 2026Kyuri Im, Michael FärberLLM-Assisted AnnotationScientific Communication

    ScaDS.AI, Technische Universität Dresden, Dresden, Germany

  3. LLMs Can Annotate Attribution Graphs

    Jul 28, 2026Ameen Patel, Max Zhang, Nathan HuLLM InterpretabilityLLM-Assisted Annotation

    Stanford University

  4. Interpretable Column Annotation with LLM-Symbolized Decision Process Materialization

    Jul 28, 2026Mengqi Wang, Jianwei Wang, Qing Liu +5LLM-Assisted AnnotationInterpretable ML

    UNSW Sydney · University of New South Wales Sydney, NSW, Australia · Data61, CSIRO +4

  5. A Classifier That Teaches Itself: Self-Improving, Frozen-gate Training (SIFT) for Dynamic Document Classification

    Jul 20, 2026Bogdan Raduta, Horia Velicu, Alexandru Preda +1LLM-Assisted AnnotationText Classification

  6. Self-Evolving Human-Centered Framework for Explainable Depression Symptom Annotation

    Jul 16, 2026Hoang-Loc Cao, Van Pham, Truong Thanh Hung Nguyen +4Explainable Artificial IntelligenceLLM-Assisted Annotation

    University of Science, VNU-HCM, Vietnam · University of New Brunswick, Canada · Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany

  7. Quantifying the Sources of Instability in LLM-Based Stance Analysis of Public Discourse

    Jul 12, 2026Bo ChenStance DetectionLLM-Assisted Annotation

    Institute of Computing Technology, Chinese Academy of Sciences

  8. Demographic Prompting at Scale: When More Attributes Hurt LLM--Human Agreement

    Jul 12, 2026Mahammed Kamruzzaman, Shrabon Kumar Das, Gene Louis KimLLM PromptingLLM-Assisted Annotation

    Bellini College of AI, Cybersecurity and Computing · University of South Florida

  9. Validity of LLMs as data annotators: AMALIA on authority

    Jul 9, 2026Manuel PitaMultilingual Language Model EvaluationMoral Reasoning in Language Models

    Artificial Intelligence, Social Interaction and Complexity Laboratory · CICANT, Universidade Lusófona

  10. Scalable and Culturally Specific Stereotype Dataset Construction via Human-LLM Collaboration

    Jul 8, 2026Weicheng Ma, John Guerrerio, Soroush VosoughiMultilingual Language Model EvaluationSocial Bias in Language Models

    College of Computing, Georgia Institute of Technology · Computer Science Department, Dartmouth College

  11. SynthAVE: Scalable Synthetic Labeling for E-Commerce with LLM-Arena Validation

    Jul 8, 2026Andrea Scarinci, Virginia Negri, Brayan Impata +3LLM-as-a-JudgeLLM-Assisted Annotation

    Amazon

  12. Semantic-Guided Reading Order Reconstruction in Historical Armenian Newspapers with LLMs

    Jul 1, 2026Chahan Vidal-Gorène, Nadi Tomeh, Victoria KhurshudyanHistorical Document AnalysisLLM-Assisted Annotation

    CJM, LIPN · 1 École nationale des chartes-PSL · Laboratoire d’Informatique Paris Nord +4

  13. Unlocking the Visual Record of Materials Science: A Large-Scale Multimodal Dataset from Scientific Literature

    Jun 29, 2026Subham Ghosh, Shubham Tiwari, Mohammad Ibrahim +1LLM-Assisted AnnotationMaterials Science

    Mehta Family School of Data Science and Artificial Intelligence Indian Institute of Technology Roorkee, Uttarakhand, India-247667 · Department of Metallurgical and Materials Engineering Indian Institute of Technology Roorkee, Uttarakhand, India-247667

  14. A Hybrid Framework for Song Lyric Annotation Based on Human-LLM Alignment

    Jun 28, 2026Rashini Liyanarachchi, Frank Tran, Md Mahmudul Hasan +2Annotator DisagreementLLM-Assisted Annotation

    School of Computer Science and Engineering, University of New South Wales, Sydney, Australia

  15. Labeling Training Data for Entity Matching Using Large Language Models

    Jun 27, 2026Aaron Steiner, Christian BizerLLM-Assisted AnnotationKnowledge Distillation

    Data and Web Science Group University of Mannheim Mannheim, Germany

  16. From Clicks to Intent: Cross-Platform Session Embeddings with LLM-Distilled Taxonomy for Financial Services Recommendations

    Jun 24, 2026Dianjing Fan, Yao Li, Kyaw Hpone Myint +4Sequential RecommendationRepresentation Learning

    Capital One McLean, VA, USA

  17. The Model as One Rater Among Several: Measuring Political Positions in Data-Sparse Regions with a Language-Model Panel

    Jun 22, 2026Tarek GaraInter-Rater ReliabilityLLM-Assisted Annotation

    *Independent researcher.

  18. Large Language Model-Assisted Cleaning of Report-Derived Labels in a Large-Scale Chest CT Dataset

    Jun 21, 2026Yosuke Yamagishi, Atsushi Takamatsu, Mototsugu Sato +4Training Data CurationLLM-Assisted Annotation

    Division of Radiology and Biomedical Engineering, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan · Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, Tokyo, Japan · Department of Radiology, Kanazawa University Hospital, Ishikawa, Japan +3

  19. Scaling Performance and Low-Resource Annotation with Many-Shot In-Context Learning for Named Entity Recognition

    Jun 20, 2026Qi Zhang, Fangping Lan, Cornelia Caragea +2Named Entity RecognitionLLM-Assisted Annotation

    Temple University · University of Illinois Chicago

  20. CNnotator: LLM-Guided Memory Safety Annotation Synthesis

    Jun 20, 2026Twain Byrnes, Mike DoddsLLM-Assisted AnnotationProgram Synthesis

    Carnegie Mellon University Pittsburgh, PA, USA · Galois, Inc. Portland, OR, USA

  21. TACO: Task-Aware Column Description Generation Using LLMs

    Jun 19, 2026Ting Cai, Rakesh R. Menon, Yiru Chen +8LLM-Assisted Annotation

    University of Wisconsin-Madison · Adobe · Purdue University

  22. What sentiment analysis can't see: Measuring whether customers were helped, and what went wrong, across 70,000 support conversations

    Jun 18, 2026Jason PotteigerLLM-Assisted AnnotationSentiment Analysis

    Dimension Labs

  23. LLM-Assisted Stance Detection in Scientific Discourse: A Test Case in Bayesian Cognitive Science

    Jun 14, 2026Eyup Engin Kucuk, Tarik Kelestemur, Ömer Dağlar TanrikuluStance DetectionLLM-Assisted Annotation

    University of New Hampshire · Department of Psychology · Independent Researcher

  24. LLM-Based Synthetic Ground Truth Generation for Audio-Based Emotion Classification via In-Context Learning

    Jun 10, 2026Qing Huang, Pooja Pol, Jianing ZhangLLM-Assisted AnnotationEmotion Recognition in Conversations

    School of Business, Technical University of Applied Sciences Augsburg, Friedberger Str. 4, 86161 Augsburg, Germany · Data Science und Autonome Systeme Technologietransferzentrum (TTZ), An der Schmiede 19, 86899 Landsberg am Lech, Germany

  25. Extracting Semantics: LLM-Guided Automatic Population of Robot Ontology from URDF

    Jun 10, 2026Bastien Dussard, Guillaume SarthouLLM-Assisted AnnotationRobotics

    LAAS-RIS, LAAS · LAAS-CNRS, Department of Robotics, Toulouse, France

  26. Measuring Human Value Expression in Social Media Texts: Calibrated LLM Annotation and Encoder Transfer

    Jun 9, 2026Maria Milkova, Maksim RudnevSoft-Label LearningLLM-Assisted Annotation

    Independent researcher, Lisbon, Portugal · University of Waterloo, ON, Canada

  27. Scribby: A Multi-Level LLM Framework for Semantic Video Analysis

    Jun 8, 2026Julian Abelarde, Hugo Garrido-Lestache BelinchonVideo SummarizationLLM-Assisted Annotation

    Department of Computer Science and Software Engineering Milwaukee School of Engineering Milwaukee, WI US

  28. When Better Codebooks Are Not Enough: Predictive Performance and Behavioral Reliability in LLM Political Event Coding

    Jun 4, 2026Zixian He, Bharath Raahul Murugesan, Patrick Brandt +1LLM EvaluationLLM-Assisted Annotation

    Independent Researcher · Illinois Institute of Technology · The University of Texas at Dallas

  29. Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articles

    Jun 4, 2026Upasana ChatterjeeLLM-Assisted AnnotationPolitical Bias in Language Models

    Department of Computer Science Columbia University

  30. From Self to Other: Evaluating Demographic Perspective-Taking in LLM Hate Speech Annotation

    Jun 4, 2026Paloma Piot, Javier ParaparLLM-Assisted AnnotationHate Speech Detection

    Information Retrieval Lab CITIC Research Centre Universidade da Coruña