Human Annotators

Ask about this topic

Recent momentum

+27%

14 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Annotations

Neighbouring directions

AnnotationsHuman Annotations

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

4 new papers

A weekly snapshot of new work published in Human Annotators.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Human Annotators.

Period ending 2026-09-07

5 new papers

A weekly snapshot of new work published in Human Annotators.

104 papers

Latest in Human Annotators

Browse all topics →
CardsList

  1. Detecting GPT-Assisted Writing Using Interpretable Stylometric Features

    Sep 22, 2026Rajesh Kumar, Nabeel Siddiqui, Alexander FuchsbergerMachine-Generated Text DetectionHuman Annotators

  2. Evaluating Decision Models for Text Annotation in Computational Social Science

    Sep 21, 2026Hazem Ibrahim, Yasir ZakiHuman AnnotatorsLarge Language Model Decision-Making

  3. Vroom-Vroom at SHROOM-Visions: A Multi-Judge Committee for Detecting Hallucinated Spans in Vision-Language Outputs

    Sep 15, 2026Toqeer Ehsan, Nico Penttilä, Richard Schmidt +2Robust Hallucination DetectionVision-Language

  4. Through the Eyes of the Beholder: Biometric and Demographic Conditioning for Multimodal Sexism Detection

    Sep 14, 2026Ana-Maria Luisa Mocanu, Sebastian Mocanu, Ciprian-Octavian Truică +1Human AnnotatorsMultimodal Deep Learning

  5. Option-Aware Retrieval and Task-Specific VLM Adaptation for Medical VQA

    Sep 14, 2026Tristan Kirscher, Niklas C. Koser, Soren PirkMedical Visual Question AnsweringMultiple-Choice Questions

  6. I Am No One: Style-Aware Paraphrasing for Text Anonymization

    Sep 14, 2026Ahmed Sohair Khan, Estrid He, Monica Wachowicz +1AnonymizationStylometric

  7. How broad is that claim? Mapping Generalisation in NLP Research

    Sep 13, 2026Chenxin Diao, Nataliya Stepanova, Emily AllawayScientific DiscoveryGeneralisation

  8. Same Day, Same Story; One Day Ahead, a Different Signal: The Dual Validity of Financial Sentiment

    Sep 12, 2026AS Aravinthkakshan, Laven Srivastava, Harsh NandwaniFinancial Sentiment AnalysisSentiment Analysis

  9. Social Intuition vs. Machine Reasoning: Anticipating Human-Robot Interaction from multiple modalities

    Sep 7, 2026Raphael Lorenzo-Louis, Bertrand Luvison, Serena IvaldiHuman-Robot InteractionIntuition

  10. Beyond Majority Vote: Multi-Perspective Adjudication for Medical Hallucination Detection

    Sep 3, 2026Joe Cecil, Marjorie FreedmanHallucination DetectionHallucinations

  11. Does task decomposition improve automatic NLG evaluation?

    Sep 1, 2026Sebastian Steindl, Nikos Voskarides, Alberto Gasparin +1Llm-As-A-JudgeHuman Annotators

  12. Human-Anchored Factuality Evaluation with Strategic Annotation

    Aug 31, 2026Yu Wang, Craig Erickson, Kevin SmallMultilingual Fact-CheckingHuman Annotators

  13. LLM-as-a-Demographic: Whom Sociodemographic Prompting Helps, and Whom It Hurts

    Aug 31, 2026Daniela Occhipinti, Andrea Piergentili, Marco GueriniDemographicsLarge Language Model Bias

  14. Co-Annotator: Expert-Distilled ViT and VLM for Visual and Documentation Guidance in Age-Related Macular Degeneration

    Aug 31, 2026Ziheng "Leo" Li, Benjamin Freeman, Akshay Raman +5OphthalmologyMultimodal Clinical Data

  15. Ideation Arena: Evaluating LLM Generated Research Ideas with Battle-style Human Expert Assessment

    Aug 30, 2026Zhiyu Chen, Keyu Zhao, Jigao Fu +8IdeasHuman Annotators

  16. Definitional Sensitivity in Media Bias Detection: A Multi-Definition Dataset and Benchmark

    Aug 24, 2026Martin Wessel, Timo Spinde, Jürgen Pfeffer +1Large Language Model BiasHuman Annotators

  17. Designing a Robust LLM-Based Evaluation System for Agentic AI in Drug Discovery Through Human Alignment

    Aug 21, 2026Emma Granqvist, Rocío Mercado, Samuel GenhedenLlm-As-A-JudgeLlm-Based Agent

  18. Toward a Theory of Value in AI Alignment

    Aug 10, 2026Andrew Smart, Shazeda Ahmed, Jackie Kay +3Artificial Intelligence AlignmentHuman Values

  19. Conformal Coverage Guarantees for Any Video Temporal Grounder

    Aug 7, 2026Aseel Mohamed, Rasul Khanbayov, Erchin Serpedin +1Temporal GroundingVideos

  20. ArtAnno: Annotating Implicit Semantics in Artworks through LLM Agent-Driven Bidirectional Human-AI Augmentation

    Aug 5, 2026Xiaoyan Gu, Yifang Wang, Wenqing Zheng +6Human-Ai CollaborationHuman Annotators

  21. VIBE: A VAD-Informed Benchmark for Entity-Centered Affective Profiling of Large Language Model Outputs

    Aug 4, 2026Andrei Chetvergov, Alexander Evseev, Timofei Sivoraksha +4Valence-Arousal EstimationSentiment Analysis

  22. Learning Sexism Detection Using Multi-Agent Perspectivist Preference Optimization

    Aug 4, 2026Hadi Mohammadi, Tina Shahedi, Robert A. Bagheri +2Human AnnotatorsGender Bias

  23. Oh Deer, How Should I Handle This? Seasonal Priors for Selective Wildlife Annotation and Classification

    Aug 3, 2026Hugo Markoff, Christoph Praschl, Anton Hjalte Jørgensen +5Animal Re-IdentificationAerial Imagery

  24. Challenges in annotations by humans and LLMs: A case study of evaluative language

    Jul 30, 2026Mirela Imamovic, Aenne Cecilia Kristine Knierim, Khushi Pitroda +1Human AnnotatorsHuman Annotations

  25. DODA: A Database of Datasets for Aesthetics Research

    Jul 30, 2026Lisa Koßmann, Ralf Bartho, Christoph Redies +1AestheticsLarge Image Datasets

  26. FunnelAL: Retrieve-then-Rank Active Learning for Single-Class Discovery

    Jul 28, 2026Reihaneh Rostami, Brian GoodwinActive LearningHuman Annotators

  27. A Model for Imbalanced Label Aggregation: A Focus on Minority-Class Detection

    Jul 27, 2026Gabriel Singer, Samuel Gruffaz, Olivier Vo Van +2Extreme Class ImbalanceMinority

  28. CHiPS: Character Histograms and Positional Signals for Lightweight Authorship Attribution in Romanian Texts

    Jul 24, 2026Sanda-Maria Avram, George C. ŢurcaşAuthorshipHuman Annotators

  29. AHEAD: Advancing Multi-Class Label Aggregation with Interpretable Cross-Annotator Modeling

    Jul 20, 2026Ju Chen, Sijia Xu, Jun Feng +2Multi-Label ClassificationHuman Annotators

  30. The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric

    Jul 20, 2026Sheng-Yu Wang, Yotam Nitzan, Aaron Hertzmann +4Semantic Similarity MetricsPerceptual Quality

  31. AI_LectureNote: A Retrospective Pilot Study of a Post-ASR Workflow for English-Script Rendering and Semantic Drift in Korean-English Medical Lectures

    Jul 19, 2026Kyeongeon Lee, Donghoon Chang, Seungryeol Baek +2KoreanHuman Annotators

  32. Demographic Prompting at Scale: When More Attributes Hurt LLM--Human Agreement

    Jul 12, 2026Mahammed Kamruzzaman, Shrabon Kumar Das, Gene Louis KimDemographicsLarge Language Model Alignment

  33. Validity of LLMs as data annotators: AMALIA on authority

    Jul 9, 2026Manuel PitaHuman AnnotatorsValidity

  34. Evaluating RAG Metrics in Applied Contexts: An Experiment, Its Findings and Its Limitations

    Jul 8, 2026Quentin BrabantInformation Retrieval MetricsEvaluation Metrics

  35. Who's Behind It? Annotating and Extracting Conspiratorial Actors from German Telegram Posts

    Jul 6, 2026Helena Mihaljević, Jolanda Beer, Mareike Lisker +1Human AnnotatorsText Corpora

  36. AI Wizards at EXIST 2026: Hierarchical Soft-Label Learning for Multimodal Sexism Identification in Memes

    Jul 5, 2026Matteo Fasulo, Antonio Gravina, Luca Tedeschini +1Soft-LabelMemes

  37. Who Determines the Meaning of an Emotion? Affective Sovereignty as an Epistemic Consequence of Measurement Limits

    Jun 30, 2026Keito InoshitaArtificial Intelligence GovernanceInterpretive Openness

  38. Multi-Agentic System Leveraging Open-Source LLMs to Mitigate Disinformation Threats

    Jun 29, 2026Sebastian Kula, Martin TamajkaMisinformation DetectionMulti-Agent Systems

  39. Majority Vote Silences Minority Values: Annotator Disagreement at the Hate/Offensive Boundary in HateXplain

    Jun 27, 2026Joshua Muhumuza, Joab Ezra Agaba, Mercy AmiyoHate SpeechHuman Annotators

  40. Correct codes for the wrong reasons? validating LLMs as measurement instruments for theoretical constructs

    Jun 26, 2026Manuel PitaLarge Language Model ReliabilityCorrectness

  41. Learning from Annotation Uncertainty: Entropy-Aware Curriculum for Speech Emotion Recognition

    Jun 25, 2026Zahra Omidi, John H. L. HansenEmotion RecognitionHuman Annotators

  42. Interpretable Probabilistic Medical Image Segmentation via Gaussian Process with Explicit Modelling of Annotation Bias and Variability

    Jun 22, 2026Qi Li, Yuliang Huang, Shaheer U. Saeed +7Medical Image SegmentationMedical Imaging Datasets

  43. Learning Moral Diversity: Modelling Individual Perspectives in Moral Classification of Texts

    Jun 22, 2026Yi Ren, Lewis Mitchell, Matthew RoughanMoral ReasoningHuman Annotators

  44. Counsel: A Meta-Evaluation Dataset for Agentic Tasks

    Jun 19, 2026Sashank Pisupati, Henry Broomfield, Eujeong Choi +5Agentic BenchmarksLlm-As-A-Judge

  45. Quality and Agreement in Multilabel Emotion Annotation: A Case Study and Evaluation Framework

    Jun 19, 2026Emily Öhman, Anna KoufakouEmotion RecognitionHuman Annotators

  46. Attention-Based Prototype Calibration for Multi-Rater Few-Shot Medical Image Segmentation

    Jun 15, 2026Truong Vu, Minh Khoi Ho, Yutong XieFew-Shot Medical Image SegmentationFew-Shot Segmentation

  47. RaLMPH: Reliability-aware Learning for Multi-Pathologist Harmonization in Whole-Slide Image Classification

    Jun 14, 2026Sungrae Hong, Jiwon Jeong, Soeun Cheon +5Multiple Instance LearningWhole-Slide Images

  48. Findings of the MAGMaR 2026 Shared Task

    Jun 10, 2026Alexander Martin, Dengjia Zhang, Joel Brogan +7Multimodal RetrievalMultimodal Generation

  49. A Resource for Enthymeme Detection in Controversial Political Discourse

    Jun 10, 2026Martial Pastor, Nelleke OostdijkDiscourseHuman Annotators

  50. Measuring Human Value Expression in Social Media Texts: Calibrated LLM Annotation and Encoder Transfer

    Jun 9, 2026Maria Milkova, Maksim RudnevHuman ValuesHuman Annotators

  51. Robust Active Learning for Few-Shot Example Selection in Text-to-SQL

    Jun 8, 2026Arash PourhabibText-To-SqlActive Learning

  52. From Genes to Tokens: a GWAS-inspired Approach for Interpretable Stylometric Analysis

    Jun 8, 2026Dmitry Pronin, Evgeny KazartsevStylometricAuthorship

  53. Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articles

    Jun 4, 2026Upasana ChatterjeeIdeologyPolitical Discourse

  54. From Self to Other: Evaluating Demographic Perspective-Taking in LLM Hate Speech Annotation

    Jun 4, 2026Paloma Piot, Javier ParaparHate SpeechLarge Language Model Bias

  55. Epistemic Injustice in Language Models: An Audit of Pretraining Filters and Guardrails

    Jun 4, 2026Marco Antonio Stranisci, A Pranav, Rossana Damiano +2Large Language Model BiasLarge Language Model Safety

  56. SHALA-LLM: Smartly Handling Ambiguous Labels in Aligning LLMs

    Jun 3, 2026Jingyao Wu, Ashley Wang, Keane Ong +2Large Language Model AlignmentNatural Language Inference

  57. SynCred-Bench: Benchmarking Synthetic Credibility in AI-Generated Visual Misinformation

    Jun 2, 2026Junxiao Yang, Minghao Zhang, Xiaoce Wang +4Human AnnotatorsGenerative Models

  58. The Ghost Annotator: a Framework to Explore Human Label Variation in Content Moderation through Conformal Prediction

    Jun 1, 2026Mirko Lai, Alessandra Urbinati, Simona Frenda +2Human AnnotatorsLarge Language Model Uncertainty

  59. Who Annotates in NLP? A Large-scale Assessment of Human Annotation Reporting between 2018 and 2025

    Jun 1, 2026Maria Kunilovskaya, Gagan Bhatia, Lisa Sophie Albertelli +10Human AnnotatorsHuman Annotations

  60. Machine Learning for Coding Retail Product Names to Consumer-Price Categories: A Rule-plus-Bag-of-Words Pipeline with Reliability-Weighted Human-in-the-Loop Labeling

    Jun 1, 2026Vladimir BeskorovainyiProductsHuman Annotators