In-Domain Accuracy

Follow this topic Ask about this topic

Momentum

3 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 6Week of Sep 21

Latest papers 23

All topics

MLToolBench: Learning Tool-Augmented Agents for Machine Learning Development
Sep 29, 2026Xin Yu, Lizhu Zhang, Jiamu Bai +7Synthetic Task Diagnosis
Losing the name before the box: measuring and repairing what narrow fine-tuning costs a detector outside its deployment vocabulary
Sep 29, 2026Trung Minh Bui, Jongsul Moon, YoungOuk Kim +2Detection Performance In-Domain Accuracy
Intelligent Robotics Research Center, Korea Electronics Technology Institute, Seongnam, 13449, Republic of Korea.
What Makes an Efficient VLA? Navigating Action-Head Design, Scaling, and Latency
Sep 12, 2026Luoyang Sun, Guoyang Xia, Fengfa Li +9Vision Encoders Scaling
Institute of Automation, Chinese Academy of Sciences · University of Chinese Academy of Sciences · AI Lab, The Yangtze River Delta +4
Nonmaximal sums of maximally monotone operators under Rockafellar's constraint qualification
Sep 9, 2026Weifeng YangMonotone Variational Inequalities Monotonicity
A Benchmark for Vehicle Attribute Classification in Cross-Domain Surveillance Scenarios
Sep 1, 2026Sergio M. Silva, Otavio T. Remer, Gabriel E. Lima +3Automotive Detection Video Surveillance
Department of Informatics, Federal University of Paraná, Curitiba, Brazil · Graduate Program in Informatics, Pontifical Catholic University of Paraná, Curitiba, Brazil
MathShikkha: A Controlled Study of Answer-Only and Chain-of-Thought Supervision for Bangla Mathematical Reasoning in Small Language Models
Aug 9, 2026Rahma Simin Ali, Jawad HossainBangla Process-Level Supervision
Independent Researcher · University at Albany
The Order Is the Guarantee: Verifier-Budgeted Code Deletion with Static-First Learned Proposals
Aug 5, 2026Ruitong Li, Binjie Guo, Aisheng Mo +4Code Quality Verification Framework
University of Hong Kong · Zhejiang University · Dalian University of Technology +1
Level, Sharpness, and Corpus: Why Zero-Shot OOD Detector Rankings Do Not Transfer
Jul 29, 2026Ignacio M. De la Jara, Cristian Rodriguez-Opazo, Stephen Gould +1Out-Of-Distribution Detection In-Distribution
University of Adelaide · 3Naval Group Pacific · 2Australian National University
Multi-Expert Routing for Multi-Domain Low-Resource OCR: A Manchu Case Study
Jul 15, 2026Zhan Chen, Jiqiao Ma, Chih-wen KuoOptical Character Recognition Handwritten Text Recognition
Institute of Advanced Studies, Beijing Normal University, Zhuhai, China · Faculty of Humanities and Social Sciences, Beijing Normal University–Hong Kong Baptist University United International College (UIC), Zhuhai, China · Independent Scholar +1
MED-DSLC: Multi-Expert-Domain Classification via Domain Supervision and Logit Calibration
Jul 13, 2026Zheng Zeng, Deepak Sridhar, Nuno VasconcelosVision-Language Model Adaptation In-Domain Accuracy
University of California, San Diego, USA
The Complexity Ceiling Benchmark: A Multi-Domain Evaluation of Sequential Reasoning Under Depth Scaling
Jun 28, 2026Shubh Chapra, Dhruv Kumar, Murari Mandal +1LLM Reasoning Strategies In-Domain Accuracy
BITS Pilani, Pilani Campus · KIIT Bhubaneswar
When EER Hides Deployment Failure: Auditing Threshold Transfer and Unlabeled Score Calibration for Speech Deepfake Detectors
Jun 19, 2026Jingwen Zhou, Mingzhe WangEqual Error Rate In-Domain Accuracy
Xidian University, Xi’an, China
Aligning Implied Statements for Implicit Hate Speech Generalizability with Context-Bounded Semi-hard Negative Mining
Jun 17, 2026Wicaksono Leksono Muhamad, Yunita SariHate Speech Detection Hate Speech
Mantera Studio · Universitas Gadjah Mada
In-Domain Supervised Pathology Report Classification: A Reproducible Pipeline from Data Curation to Production-Matched Evaluation
Jun 14, 2026Isaac Hands, Bin Huang, Adam Spannaus +4False-Negative Rate In-Domain Accuracy
Department of Computer Science, University of Kentucky, Lexington, KY, USA · UK Markey Cancer Center, Lexington, KY, USA · Kentucky Cancer Registry, Lexington, KY, USA +3
Stage-1 Controls the Entropy Regime, Not the Outcome
Jun 8, 2026Jianxiong ShenMulti-Stage Training Warm Starts
Towards Reliable Multilingual LLMs-as-a-Judge: An Empirical Study
May 27, 2026Irune Zubiaga, Aitor Soroa, Rodrigo AgerriMultilingual Benchmark Large Language Model Evaluation
HiTZ Center - Ixa, University of the Basque Country EHU
Rotation-Preserving Supervised Fine-Tuning
May 8, 2026Hangzhan Jin, Tianwei Ni, Lu Li +3Model Fine-Tuning Subspace
1Mila - Quebec AI Institute · 2Polytechnique Montréal · 3Université de Montréal +3
Lightweight Stylistic Consistency Profiling: Robust Detection of LLM-Generated Textual Content for Multimedia Moderation
May 7, 2026Siyuan Li, Aodu Wulianghai, Xi Lin +6Content Moderation Human-Written Text
School of Computer Science, Shanghai Jiao Tong University, Shanghai, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China · College of Computer Science and Technology, Zhejiang University, Hangzhou, China
Cross-Domain Transfer of Hyperspectral Foundation Models
Apr 29, 2026Nick Theisen, Peer NeubertHyperspectral Image Cross-Modality
Intelligent Autonomous Systems, University of Koblenz, Germany
EverydayGPT: Confidence-Gated Routing for Efficient and Safe Hybrid GPT-RAG Conversational QA
Apr 24, 2026Jaspreet Singh NahalHievi-Rag Gating
B.Tech Computer Science Engineering (Artificial Intelligence) Dr. A.P.J. Abdul Kalam Technical University, Delhi, India
CoDA: Towards Effective Cross-domain Knowledge Transfer via CoT-guided Domain Adaptation
Apr 21, 2026Jianzhi Yan, Le Liu, Buzhou Tang +3LLM Reasoning Strategies In-Domain Accuracy
Harbin Institute of Technology, Shenzhen, 518100, China · Pengcheng Laboratory, Shenzhen, 518100, China
Bidirectional Small-Granularity Search between Code and Text
Apr 19, 2026Marco A. Valenzuela-Escárcega, Enrique Noriega-Atala, Gus Hahn-Powell +2Text Analysis and Detection In-Domain Accuracy
Lex Machina · The University of Arizona, Tucson, AZ, USA
Web2Grasp: Learning Functional Grasps from Web Images of Hand-Object Interactions
May 7, 2025Hongyi Chen, Yunchao Yao, Yufei Ye +8Robotic Grasping Query Image
Carnegie Mellon University · Nvidia · National University of Singapore +1

Sep 29, 2026, cs.AIJ/K move · Enter open · S save

MLToolBench: Learning Tool-Augmented Agents for Machine Learning Development

Xin Yu, Lizhu Zhang, Jiamu Bai, Yanhong Wu+6

Synthetic Task Diagnosis In-Domain Accuracy

Open paper AskPDF arXiv

Machine learning engineering (MLE) agents have made substantial progress, but learning through ML experimentation remains costly in time and computation. Synthetic environments reduce these costs while introducing variations in data and experimental settings that require task-specific diagnosis. Access to diagnostic tools alone does not ensure that agents learn when to use them or how to act on their findings. We introduce ToolMLBench, a suite of executable tools for data inspection, code verification, and experiment diagnosis, together with an SFT and RL pipeline for learning their use. Diagnostic calls acquire evidence whose value depends on subsequent decisions, so final outcomes provide limited guidance on which calls to reinforce. We address this challenge with SPICE, which measures how privileged context changes the likelihood of a sampled tool action and uses this difference as a turn-level reward alongside the final outcome. We train on 80 synthetic tasks and evaluate on 25 in-domain and 10 out-of-domain tasks. Providing tool interfaces and descriptions alone yields inconsistent gains across unadapted models. With the same diagnostic interface, our training pipeline raises in-domain success from 24.8% to 52.4% for Qwen3-8B and from 35.6% to 69.2% for Qwen3.5-35B-A3B. The latter also improves from 31% to 48% out-of-domain, supporting learned diagnostic tool use on held-out sources and targets.

Momentum

Related topics

Latest papers 23