Search research

Topics & fields

361–390 of 410

Papers

TransBERT: A Framework for Synthetic Translation in Domain-Specific Language Modeling
Sep 22, 2026Julien Knafou, Luc Mottin, Anaïs Mottaz +2
AmchiBias: Measuring Stereotypical Bias in Goan Identity Groups with a Minimal Pair Dataset in English and Konkani
Jun 13, 2026Michelle Barbosa, Sebastian Padó, Franziska WeeberStereotype Mitigation Legal Natural Language Processing Benchmarks
SAMA: Semantic Anchor-aligned Augmentation for Unified Low-Resource Multimodal Information Extraction
Jun 17, 2026Quanjiang Guo, Chong Mu, Jiazhou Pan +4Augmentation Multi-Modal Large Language Models
Automated IEP Generation from Traditional Chinese Parent-Teacher Interviews via Corpus-Grounded Feature Diffusion
Jun 8, 2026Kuanlin Chen, Cheng-En OuTutors Generative Artificial Intelligence
A Komi-Yazva--Russian Parallel Corpus and Evaluation Protocol for Zero- and Few-Shot LLM Translation
Jun 4, 2026Petr ParshakovText Corpora Evaluation Protocols
Forgotten Words: Benchmarking NeoBERT for Dementia Detection in Low-Resource Conversational Filipino and English Speech
May 25, 2026Rez Samantha Z. Floresca, Edric Castel C. Hao, Hannah Grachiella Buñales +3Mild Cognitive Impairment Alzheimer
Efficient Financial Language Understanding via Distillation with Synthetic Data
Jun 17, 2026Wen-Fong, Huang, Edwin SimpsonFinancial Sentiment Analysis Synthetic Data
Distilling Reasoning Traces into Advisory Prompts for Software Engineering Tasks
Aug 1, 2026Faizan Faisal, Prem Devanbu, Toufique AhmedSoftware Engineering Text Corpora
SPARCLE: SPeaker-aware Aligned Representations via Contrastive Language Embeddings
May 1, 2026Priyam Mazumdar, Yurii Halychanskyi, Steven Guo +2Phoneme-Level Analysis Discrete Speech Representations
Deploying DeepSeek 175B Locally on a Single Consumer-Grade RTX 4060 Laptop with 32GB RAM for 200k-Scale Protein-Ligand Virtual Screening
Aug 31, 2026Rui Xiao, Yili XuStructure-Based Drug Design Deepseek
CoDA: Towards Effective Cross-domain Knowledge Transfer via CoT-guided Domain Adaptation
Apr 21, 2026Jianzhi Yan, Le Liu, Buzhou Tang +3Large Language Model Adaptation Efficient Latent Reasoning
Semantics of Subterfuge: Benchmarking Legal Deception Detection Against General-domain State-of-the-Art
Jul 31, 2026Theekshana Samaradiwakara, Nisansa de Silva, George C. LobbDeception Natural Language Processing
Mitigating Data Scarcity in Psychological Defense Classification with Context-Aware Synthetic Augmentation
May 14, 2026Hoang-Thuy-Duong Vu, Quoc-Cuong Pham, Huy-Hieu PhamPseudo-Labeling Augmentation
Structural Pruning of Large Vision Language Models: A Comprehensive Study on Pruning Dynamics, Recovery, and Data Efficiency
Apr 27, 2026Yiran Huang, Lukas Thede, Massimiliano Mancini +2Large Language Model Compression Large Vision Language Models
Does Synthetic Data Help? Empirical Evidence from Deep Learning Time Series Forecasters
May 7, 2026Hugo Cazaux, Eyjólfur Ingi Ásgeirsson, Hlynur StefánssonSynthetic Time Series Synthetic Data
MultiSense-Pneumo: A Multimodal Learning Framework for Pneumonia Screening in Resource-Constrained Settings
May 4, 2026Dineth Jayakody, Pasindu Thenahandi, Chameli DommanigeRespiratory Sound Classification Multimodal Clinical Data
Equity with Efficiency: An Empirical Study of Tokenizers for Multilingual Large Language Models
Jun 13, 2026Kieron Seven Jun Wei Lee, Muhammad Reza Qorib, Andrew Ivan Soegeng +1Multilingual Large Language Models Multilingual Language Models
ChronoSC: Task-Oriented Semantic Communication via Temporal-to-Color Encoding
May 11, 2026Phuc H. Nguyen, Trung T. Nguyen, Quy N. Duong +1Neural Video Codecs Video Question Answering
From Automation to Collaboration: Human-in-the-Loop Methods for Safe and Trustworthy NLP
May 24, 2026Most. Sharmin Sultana Samu, MD. Tanvir Ahmed Seum, Md. Rakibul IslamTrustworthy Artificial Intelligence Natural Language Processing
PAST-TIDE: Prototype-Anchored Statement Tuning with Topic-Invariant Normalization for Stance Detection
Jul 6, 2026Md. Shakhoyat Rahman Shujon, MD Jahid Hasan Jim, Md. Milon Islam +2Tweet-Level Stance Detection Tuning
AfriVoices-KE: A Multilingual Speech Dataset for Kenyan Languages
Apr 9, 2026Lilian Wanzare, Cynthia Amol, Ezekiel Maina +14African Languages
Toward a Cross-Lingual Romanization Ecosystem for Sinitic Languages: A Paired Mandarin-Cantonese Case Study
Date pendingZijie Zhang, Tan Lee, Yong Cao +1Phonological Understanding Multilingual Automatic Speech Recognition
FAD-SA-GRU: Enhancing Hate Speech Detection in Algerian Dialect Through Feature-Augmented Self-Attention GRU Networks
Jul 13, 2026Sara Yakoubi, Ikram Khalfallah, Kenza Khelkhal +1Hate Speech Arabic
Foundation Model-driven Key Anatomy Frame Selection for Blind-sweep Ultrasound Fetal Birth Weight Estimation
Jul 1, 2026Le Ou, Xiliang Zhu, Huanwen Liang +8Prenatal Ultrasound Ultrasound
BaltiVoice: A Speech Corpus and Fine-tuned Whisper ASR System for the Balti Language
Date pendingMuhammad AliLibrispeech Speech Large Language Models
BioGraphletQA: Knowledge-Anchored Generation of Complex QA Datasets
Apr 28, 2026Richard A. A. Jonker, Bárbara Maria Ribeiro de Abreu Martins, Sérgio MatosBiomedical Knowledge Graph Knowledge Graphs
Error-Supervised Synthetic Learner Writing for Automated Essay Scoring
Sep 20, 2026Duy Anh NguyenAutomated Essay Scoring
Generative Large Language Models in Automated Fact-Checking: A Survey
Jul 2, 2024Ivan Vykopal, Matúš Pikuliak, Simon Ostermann +1Fact-Checking Survey
A Human-in-the-Loop Framework for Efficient Prompt Selection in Microscopy Vision-Language Models
May 19, 2026Abhiram Kandiyana, Ankur Mali, Lawrence O. Hall +2Large Vision Language Models Microscopy
LKValues: Aligning Large Language Models with Sri Lankan Societal Values
Jul 22, 2026Nethmi Muthugala, Supryadi, Surangika Ranathunga +7Large Language Model Alignment Multilingual Large Language Models

Sep 22, 2026 · cs.CLJ/K move · Enter open · S save

TransBERT: A Framework for Synthetic Translation in Domain-Specific Language Modeling

Julien Knafou, Luc Mottin, Anaïs Mottaz, Alexandre Flament+1

The scarcity of non-English language data in specialized domains significantly limits the development of effective Natural Language Processing (NLP) tools. We present TransBERT, a novel framework for pre-training language models using exclusively synthetically translated text, and introduce TransCorpus, a scalable translation toolkit. Focusing on the life sciences domain in French, our approach demonstrates that state-of-the-art performance on various downstream tasks can be achieved solely by leveraging synthetically translated data. We release the TransCorpus toolkit, the TransCorpus-bio-fr corpus (36.4GB of French life sciences text), TransBERT-bio-fr, its associated pre-trained language model and reproducible code for both pre-training and fine-tuning. Our results highlight the viability of synthetic translation in a high-resource translation direction for building high-quality NLP resources in low-resource language/domain pairs.

Open paper Ask about it PDF