LLM Prompting

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 22% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 296

All topics

Nonsense Helps: Prompt Space Perturbation Broadens Reasoning Exploration
May 7, 2026Langlin Huang, Chengsong Huang, Jinyuan Li +3LLM Prompting RL for Language Model Reasoning
Washington University in St. Louis
Spatial Priming Outperforms Semantic Prompting: A Grid-Based Approach to Improving LLM Accuracy on Chart Data Extraction
May 6, 2026Andrei Lazarev, Dmitrii Sedov, Alexander GalkinLLM Prompting Document Information Extraction
Department of Control and Applied Mathematics Moscow Institute of Physics and Technology Moscow, Russia · Moscow Institute of Physics and Technology Moscow, Russia · Institute of Computer Science Lipetsk State Technical University Lipetsk, Russia
Elicitation Matters: How Prompts and Query Protocols Shape LLM Surrogates under Sparse Observations
May 6, 2026Ge Lei, Samuel J. CooperSurrogate Modeling Bayesian Optimization
Dyson School of Design Engineering Imperial College London Exhibition Road, London SW7 2AZ
From Memorization to Creation: Evaluating the Cognitive Depth of LLM-Generated Educational Questions
May 6, 2026Xiaolong Wang, Zhe Zhao, Song Lai +5LLM Evaluation LLM Prompting
Squirrel Ai Learning Shanghai, China · City University of Hong Kong Hong Kong, China · Zhejiang Normal University Squirrel Ai Learning Jinhua, China +2
Evaluating Advanced Prompting on Gemini Flash for Multi-Hop Biomedical QA
May 5, 2026Ahmed Bajaber, Mohammed AlliheediMulti-Hop QA LLM Evaluation
1Saudi Med AI Lab (SMAIL) 2Prince Sultan University, Riyadh, Saudi Arabia · 2Prince Sultan University, Riyadh, Saudi Arabia · 3Al-Baha University, Al Baha, Saudi Arabia
Self-Prompting Small Language Models for Privacy-Sensitive Clinical Information Extraction
May 5, 2026Yao-Shun Chuang, Tushti Mody, Uday Pratap Singh +6Named Entity Recognition Healthcare
McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston, TX 77030, United States · School of Public Health, The University of Texas Health Science Center at Houston, Houston, TX 77030, United States · School of Dentistry, The University of Texas Health Science Center at Houston, Houston, TX 77054, United States +1
Not All That Is Fluent Is Factual: Investigating Hallucinations of Large Language Models in Academic Writing
May 5, 2026Humam Khan, Md Tabrez Nafis, Shahab Saquib Sohail +2LLM Evaluation LLM Prompting
Department of Computer Science and Engineering, SEST Jamia Hamdard New Delhi, India · Energy, Resources and Industry WSP Calgary, Canada
Steer Like the LLM: Activation Steering that Mimics Prompting
May 5, 2026Geert Heyman, Frederik VandeputteLanguage Model Steering LLM Prompting
Nokia Bell Labs, Belgium.
BIT.UA-AAUBS at ArchEHR-QA 2026: Evaluating Open-Source and Proprietary LLMs via Prompting in Low-Resource QA
May 5, 2026Richard A. A. Jonker, Alexander Christiansen, Alexandros Maniatis +4LLM Grounding Healthcare
Aalborg University Business School Fibigerstræde 2, Aalborg East 9220, Denmark · IEETA, DETI, LASI, University of Aveiro Campus Universitário de Santiago, Aveiro 3810-193, Portugal
From prompting to evidence-based translation: A RAG+prompt system for Japanese-Chinese translation and its pedagogical potential
May 5, 2026Wenshi GuLLM Prompting Machine Translation
School of Foreign Languages, Beihang Univeristy.Beijing, China
Evaluating Prompting and Execution-Based Methods for Deterministic Computation in LLMs
May 4, 2026Hongkun YuLLM Evaluation LLM Prompting
Virginia Tech Blacksburg, VA, USA
Position: How can Graphs Help Large Language Models?
May 4, 2026Xiyuan Wang, Yi Hu, Yanbo Wang +2LLM Grounding Knowledge Augmentation for Language Models
Institute for Artificial Intelligence, Peking University, Beijing 100871, China · School of Computer Sciences, Beijing University of Posts and Telecommunications, Beijing 100876, China
When Correct Isn't Usable: Improving Structured Output Reliability in Small Language Models
May 4, 2026Cosimo Galeone, Minsu Park, Giuseppe Ettorre +1LLM Evaluation LLM Prompting
Alomana, Grottaglie, Italy
Conventional Commit Classification using Large Language Models and Prompt Engineering
May 3, 2026H. M. Sazzad Quadir, Sakib Al Hasan, Md. Nurul Ahad TawhidSoftware Engineering LLM Evaluation
Institute of Information Technology University of Dhaka Dhaka, Bangladesh
A Language for Describing Agentic LLM Contexts
May 3, 2026Noga Peleg Pelc, Gal A. Kaminka, Yoav GoldbergLLM Prompting LLM Agents
Dept. of Computer Science and AI Bar-Ilan University
Reducing Conversational Escalation in Large Language Model Dialogue with Nonviolent Communication Constraints
May 1, 2026Zhixing Sun, Shenghe Xu, Tao LiLLM Prompting LLM Safety
Beijing University of Posts and Telecommunications Beijing, China · City University of Hong Kong Hong Kong SAR, China
Impact of Task Phrasing on Presumptions in Large Language Models
May 1, 2026Kenneth J. K. OngPrompt Sensitivity LLM Prompting
AI.DA STC · ST Engineering, Singapore
How Frontier LLMs Adapt to Neurodivergence Context: A Measurement Framework for Surface vs. Structural Change in System-Prompted Responses
Apr 30, 2026Ishan Gupta, Pavlo BuryiLLM Alignment Language Model Safety Evaluation
Harrisburg University of Science and Technology
In-Context Prompting Obsoletes Agent Orchestration for Procedural Tasks
Apr 30, 2026Simon Dennis, Michael Diamond, Rivaan Patil +2LLM Prompting LLM Agent Orchestration
i14, University of Melbourne · i14
RuC: HDL-Agnostic Rule Completion Benchmark Generation
Apr 30, 2026Arnau Ayguadé Domingo, Miquel Alberti-Binimelis, Cristian Gutierrez-Gomez +5LLM Evaluation LLM Prompting
Barcelona Supercomputing Center · Universitat Polit`ecnica de Catalunya
A Reproducibility Study of LLM-Based Query Reformulation
Apr 30, 2026Amin Bigdeli, Radin Hamidi Rad, Hai Son Le +4LLM Evaluation LLM Prompting
University of Waterloo Waterloo, Ontario, Canada · Mila – Quebec AI Institute Montreal, Quebec, Canada · Toronto Metropolitan University Toronto, Ontario, Canada +2
Proactive Dialogue Model with Intent Prediction
Apr 30, 2026Yang LuoLLM Prompting Spoken Dialogue Systems
Department of Computer Science University of Hong Kong
Theory Under Construction: Orchestrating Language Models for Research Software Where the Specification Evolves
Apr 29, 2026Halley Young, Nikolaj BjörnerSoftware Engineering LLM Prompting
Microsoft Research
TDD Governance for Multi-Agent Code Generation via Prompt Engineering
Apr 29, 2026Tarlan Hasanli, Shahbaz Siddeeq, Bishwash Khanal +3LLM Prompting AI Agent Governance
Tampere University Tampere, Finland
Tree-of-Text: A Tree-based Prompting Framework for Table-to-Text Generation in the Sports Domain
Apr 29, 2026Shang-Hsuan Chiang, Tsan-Tsung Yang, An-Zi Yen +1Grounded Text Generation LLM Prompting
National Yang Ming Chiao Tung University
A Reproducibility Analysis of PO4ISR: Diagnosing and Mitigating Semantic Drift in LLM-Based Session Recommendation
Apr 29, 2026Aditya Tiwari, Konduri Naga Lakshmi Rekha, Rajesh Kumar MundotiyaSequential Recommendation LLM Prompting
MATRA Lab Department of Computer Science and Engineering Indian Institute of Technology Bhilai Chhattisgarh, India 491002
A Systematic Comparison of Prompting and Multi-Agent Methods for LLM-based Stance Detection
Apr 29, 2026Genan Dai, Zini Chen, Yi Yang +1Multi-Agent LLM Systems LLM Evaluation
School of Artificial Intelligence, Shenzhen Technology University, Shenzhen, China
Investigating Linguistic Steering: An Analysis of Adjectival Effects Across Large Language Model Architectures
Apr 28, 2026Lars MalmqvistPrompt Sensitivity Language Model Steering
Research and Implementation
From World-Gen to Quest-Line: A Dependency-Driven Prompt Pipeline for Coherent RPG Generation
Apr 28, 2026Dominik Borawski, Marta Szulc, Robert Chudy +2LLM Prompting Generative Modeling
Gda´nsk University of Technology
Zero-shot Large Language Models for Automatic Readability Assessment
Apr 27, 2026Riley Grossman, Yi ChenLLM Prompting
New Jersey Institute of Technology Newark, NJ

May 7, 2026, cs.AIJ/K move · Enter open · S save

Nonsense Helps: Prompt Space Perturbation Broadens Reasoning Exploration

Langlin Huang, Chengsong Huang, Jinyuan Li, Donghong Cai+2

Washington University in St. Louis

LLM Prompting RL for Language Model Reasoning Reinforcement Learning with Verifiable Rewards

Open paper AskPDF arXiv

Reinforcement learning with verifiable rewards, particularly Group Relative Policy Optimization (GRPO), has significantly advanced the reasoning capabilities of Large Language Models (LLMs). However, in complex tasks, GRPO frequently suffers from the ``zero-advantage problem'': when all sampled rollouts for a query fail, the relative advantage collapses to zero. Consequently, the model loses effective training signals for these questions, wasting the training data and computational budget. While simply increasing the sampling budget for these questions is a common remedy, the static sampling policy inherently constrains reasoning exploration, limiting the success rate. In this paper, we propose Lorem Perturbation for Exploration (LoPE), a simple yet effective training framework to break this exploration bottleneck. We posit that task-irrelevant prompt-space perturbations can shift the model's output distribution enough to unlock orthogonal reasoning pathways for hard questions. Specifically, LoPE prepends sequences stochastically assembled from Lorem Ipsum vocabulary (a pseudo-Latin placeholder text) to the prompts before resampling. Experiments across 1.7B, 4B, and 7B models demonstrate that LoPE significantly outperforms resampling with the original prompts. Further analysis reveals that other Latin-based random sequences with low perplexity are also effective perturbations. Our results establish LoPE as a strong baseline for broadening exploration in LLM reinforcement learning.

Momentum

Related topics

Latest papers 296