cs.AIOct 30, 2026

TRIDENT and SHAKTI: A Framework and Benchmark for Hindi AI-Text Detection

Authors: Shifali Agrahari, Sujit Kumar, Sanasam Ranbir Singh

Organizations: Department of CSE, Indian Institute of Technology Guwahati, Assam, India · Institute of Advanced Intelligence and Computing (IAIC), A*STAR, Singapore

Abstract

As Large Language Models (LLMs) become increasingly multilingual, distinguishing human-written from AI-generated text is essential for maintaining information integrity. However, research remains English-centric, with limited benchmarks for low-resource languages such as Hindi. To address this gap, we introduce SHAKTI, a large-scale Hindi benchmark covering four genres, eight LLM families, multiple prompting strategies, and adversarial transformations. We evaluate its quality through human annotation and analyze linguistic, grammatical, and sentiment-based differences between human- and AI-generated texts. Building on these findings, we propose TRIDENT, a round-trip translation-based detection framework with three variants: TRIDENT-S (static threshold), TRIDENT-D (dynamic threshold), and TRIDENT-C (logistic regression using multi-distance RTT features). TRIDENT leverages semantic consistency between original and round-trip translated texts to identify AI-generated content. Extensive experiments show that TRIDENT outperforms conventional and supervised baselines, with TRIDENT-S achieving the best overall performance. Further evaluations across seven languages, adversarial settings, and unseen LLMs demonstrate its multilingual applicability and robustness, while highlighting sensitivity to the translation model.

Figures & tables

Explore similar work

CardsList
  1. IndicDetect: Evaluating Cross-Lingual LLM-Generated Text Detection for Hindi, Telugu, and Tamil

    Aug 30, 2026Bhaskar Ganesh Devalla, Junchao Wu, Nilesh Dokuparthi +4AI-Generated Text DetectionLanguage Model Generation Evaluation

  2. Detecting the Machine: A Comprehensive Benchmark of AI-Generated Text Detectors Across Architectures, Domains, and Adversarial Conditions

    Mar 18, 2026Madhav S. Baidya, S. S. Baidya, Chirag ChawlaAI-Generated Text DetectionRobustness of Machine-Generated Text Detection

  3. C-ReD: A Comprehensive Chinese Benchmark for AI-Generated Text Detection Derived from Real-World Prompts

    Apr 13, 2026Chenxi Qing, Junxi Wu, Zheng Liu +5AI-Generated Text DetectionRobustness of Machine-Generated Text Detection