Overview

Terminal agents use a shell, filesystem, and command-line tools to inspect and change digital environments, often across long workflows that require planning, debugging, and recovery. Common training approaches include supervised fine-tuning on task trajectories, reinforcement learning with executable verifiers, and synthetic generation of tasks and environments; some methods also teach agents to predict how environments respond to actions. Benchmarks such as Terminal-Bench measure task completion, while newer evaluations test real-world workflows, multimedia tasks, and whether agents follow relevant instructions without being misled by distractors. A central challenge is making results reliable and transferable, since scores can depend on the harness and runtime, and task success alone may not capture process quality or safe, task-aligned behavior.

Latest papers

31 papers6 papers in the last four weeks, up 100% on the four weeks before. 0.0% of all new papers.

Feb 24, 2026

On Data Engineering for Scaling LLM Terminal Capabilities

Despite rapid recent progress in the terminal capabilities of large language models, the training data strategies behind state-of-the-art terminal agents remain largely undisclosed. We address this gap through a systematic study of data engineering practices for terminal agents, making two key contributions: (1) Terminal-Task-Gen, a lightweight synthetic task generation pipeline that supports seed-based and skill-based task construction, and (2) a comprehensive analysis of data and training strategies, including filtering, curriculum learning, long context training, and scaling behavior. Our pipeline yields Terminal-Corpus, a large-scale open-source dataset for terminal tasks. Using this dataset, we train Nemotron-Terminal, a family of models initialized from Qwen3(8B, 14B, 32B) that achieve substantial gains on Terminal-Bench 2.0: Nemotron-Terminal-8B improves from 2.5% to 13.0% Nemotron-Terminal-14B improves from 4.0% to 20.2%, and Nemotron-Terminal-32B improves from 3.4% to 27.4%, matching the performance of significantly larger models. To accelerate research in this domain, we open-source our model checkpoints and most of our synthetic datasets at https://huggingface.co/collections/nvidia/nemotron-terminal.