Guidance

Follow this topic Ask about this topic

Momentum

19 papers in the last four weeks, up 12% on the four weeks before. 0.2% of all new papers.

Jul 6Week of Sep 21

Latest papers 172

All topics

Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference
May 24, 2026Agata Żywot, Iason Skylitsis, Thijmen Nijdam +4Text-To-Image Diffusion Models Text-Conditioned Diffusion Model
University of Amsterdam, Netherlands
Smoother Action Chunking Flow Policy via Prior-Corrected Orthogonal Trust-Region Guidance
May 23, 2026Kai Fang, Hailong Pei, Xuemin ChiAction Chunks Flow Policies
South China University of Technology · Guangzhou, China · Zhejiang University +1
Representation-Guided Discrete Molecular Graph Retrosynthesis
May 23, 2026Jiahai Huang, Anjie Qiao, Zhen Wang +2Chemical Structures Synthesis
Sun Yat-sen University Guangzhou, China · University of Science and Technology of China Hefei, China
HyperGuide: Hyperbolic Guidance for Efficient Multi-Step Reasoning in Large Language Models
May 22, 2026Yuyu Liu, Haotian Xu, Yanan He +3LLM Reasoning Strategies Few-Step Generation
Department of Computer Science Stony Brook University · Department of Applied Mathematics and Statistics Stony Brook University · Department of Computer Science Yale University +2
Autonomous Frontier-Based Exploration with VLM Guidance
May 22, 2026Aarush Aitha, Avideh ZakhorVision-Language Navigation Exploration
EECS Department, University of California
When AI Takes Sides on Questions of Faith: Persistent Asymmetries in AI-Mediated Faith Guidance
May 21, 2026Brett Israelsen, Sheryl Carty, Josh Coates +3Asymmetry Question
Brigham Young University · B. H. Roberts Foundation
LANG: Reinforcement Learning for Multilingual Reasoning with Language-Adaptive Hint Guidance
May 21, 2026Yuchun Fan, Bei Li, Peiguang Li +9LLM Reasoning Strategies Multilingual Language Models
NLP Lab, School of Computer Science and Engineering, Northeastern University, Shenyang, China · Meituan Inc. 3NiuTrans Research, Shenyang, China
Conflict-Aware Additive Guidance for Flow Models under Compositional Rewards
May 20, 2026Xuehui Yu, Fucheng Cai, Meiyi Wang +2Flow Models Geometric Guidance
Smart Systems Institute, National University of Singapore, Singapore · Faculty of Computing, Harbin Institute of Technology, Harbin, China · School of Computing, National University of Singapore, Singapore
Probability-Conserving Flow Guidance
May 19, 2026Parsa Esmati, Junha Hyung, Amirhossein Dadashzadeh +2Classifier-Free Guidance Generative Flow Networks
University of Bristol · KAIST
Guiding Neuro-Symbolic Scenario Generation with Spatio-Temporal Logic
May 18, 2026Lorenzo Bonin, Francesco Giacomarra, Luca Bortolussi +2Scenario Generation Safety-Critical Scenarios
University of Trieste · University of Southern California
Lifelong LaCAM with Local Guidance for Lifelong MAPF
May 16, 2026Tomoki Arita, Keisuke OkumuraMulti-Agent Path Finding Guidance
Keio University, Japan · National Institute of Advanced Industrial Science and Technology (AIST), Japan
Offline Semantic Guidance for Efficient Vision-Language-Action Policy Distillation
May 15, 2026Jin Shi, Brady Zhang, Yishun LuAction Space Temporally Coherent Imitation Learning
Department of Mechanical Engineering University College London London, United Kingdom · Department of Engineering Science University of Oxford Oxford, United Kingdom
OHP-RL: Online Human Preference as Guidance in Reinforcement Learning for Robot Manipulation
May 15, 2026Yunyang Mo, Jian Li, Qiwei Wu +2Reinforcement Learning From Human Feedback Robotic Manipulation
The Hong Kong University of Science and Technology (Guangzhou)
Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance
May 14, 2026Kai Yan, Alexander G. Schwing, Yu-Xiong WangReinforcement Learning With Verifiable Reward Verifiable Rewards
University of Illinois Urbana-Champaign
Compositional Video Generation via Inference-Time Guidance
May 14, 2026Ariel Shaulov, Eitan Shaar, Amit Edenzon +2Video Generation Guidance
1Tel-Aviv University · 2Independent Researcher · 3Bar Ilan University +1
Loiter UAV Reinsertion Guidance for Fixed-wing UAV Corridors
May 13, 2026Pradeep J, Kedarisetty Siddhardha, Ashwini RatnooUnmanned Aerial Vehicles Geometric Guidance
B.Tech (Honours) Student, Department of Mechatronics Engineering · Assistant Professor, Department of Mechatronics Engineering · Professor, Department of Aerospace Engineering
Margin-calibrated Classifier Guidance for Property-driven Synthesis Planning
May 13, 2026Najwa Laabid, Vikas GargSynthesis Classifier-Free Guidance
Department of Computer Science Aalto University · YaiYai Ltd
Task-Adaptive Embedding Refinement via Test-time LLM Guidance
May 12, 2026Ariel Gera, Shir Ashury-Tahan, Gal Bloch +2Text Embeddings Text Corpora
IBM Research
GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization
May 12, 2026Xiaosong Jia, Bowen Yang, Zuhao Ge +17Recent Vision-Language Models Guidance
Institute of Trustworthy Embodied AI (TEAI), Fudan University · 2Shanghai Key Laboratory of Multimodal Embodied AI · Shanghai Jiao Tong University +1
Learning Agentic Policy from Action Guidance
May 12, 2026Yuxiang Ji, Zengbin Wang, Yong Wang +6Agentic Reinforcement Learning Large Language Model Agents
1Xiamen University · 2AMAP, Alibaba Group · Work done during internship at AMAP, Alibaba Group +1
Variance-aware Reward Modeling with Anchor Guidance
May 12, 2026Shuxing Fang, Ruijian Han, Liangyu Zhang +1Progress Reward Modeling Preference Alignment Learning
Department of Data Science and Artificial Intelligence, Hong Kong Polytechnic University · School of Statistics and Data Science, Shanghai University of Finance and Economics
Finite Volume-Informed Neural Network Framework for 2D Shallow Water Equations: Rugged Loss Landscapes and the Importance of Data Guidance
May 9, 2026Xiaofeng LiuParametric Physics-Informed Neural Network Reynolds-Averaged Navier-Stokes
Department of Civil and Environmental Engineering, Pennsylvania State University, University Park, PA, USA · Institute for Computational and Data Sciences, Pennsylvania State University, University Park, PA, USA
Guidance Is Not a Hyperparameter: Learning Dynamic Control in Diffusion Language Models
May 8, 2026Fan Zhou, Tim Van de CruysClassifier-Free Guidance Reward Gradients
KU Leuven
BrickCraft: Visuomotor Skill Composition with Situated Manual Guidance for Long-Horizon Interlocking Brick Assembly
May 8, 2026Jichuan Yu, Bowei Li, Zhenran Tang +4Geometric Guidance Craft
Tsinghua University · Carnegie Mellon University
Flow-Direct: Feedback-Efficient and Reusable Guidance for Flow Models via Non-Parametric Guidance Field
May 8, 2026Kim Yong Tan, Yueming Lyu, Ivor Tsang +1Generative Flow Networks Flow Models
College of Computing and Data Science, Nanyang Technological University, Singapore · Centre for Frontier AI Research, Agency for Science, Technology and Research, Singapore · Institute of High Performance Computing, Agency for Science, Technology and Research, Singapore
Sparkle: Realizing Lively Instruction-Guided Video Background Replacement via Decoupled Guidance
May 7, 2026Ziyun Zeng, Yiqi Lin, Guoqiang Liang +1Video Dataset Inpainting
Show Lab, National University of Singapore
P-Guide: Parameter-Efficient Prior Steering for Single-Pass CFG Inference
May 7, 2026Xin Peng, Ang GaoClassifier-Free Guidance Generative Flow Networks
School of Physical Science and Technology, Beijing University of Posts and Telecommunications, Beijing, China
Tightly-Coupled Estimation and Guidance for Robust Low-Thrust Rendezvous via Adaptive Homotopy
May 6, 2026Batu Candan, Simone ServadioIntent-Aligned Autonomous Spacecraft Guidance Adaptive Control
Department of Aerospace Engineering, Iowa State University, Ames, IA 50011.
Measuring AI Reasoning: A Guide for Researchers
May 4, 2026Munachiso Samuel Nwadike, Zangir Iklassov, Kareem Ali +2Reasoning Traces Large Language Model Evaluation
MBZUAI, Department of Natural Language Processing · MBZUAI, Department of Machine Learning
How to Guide Your Flow: Few-Step Alignment via Flow Map Reward Guidance
Apr 29, 2026Jerry Y. Huang, Justin Lin, Sheel Shah +2Generative Flow Networks Flow Map
Carnegie Mellon University
A Data-Centric Framework for Intraoperative Fluorescence Lifetime Imaging for Glioma Surgical Guidance
Apr 28, 2026Silvia Noble Anbunesan, Mohamed Abul Hassan, Jinyi Qi +4Glioma Microscopy
University of California, Davis · Department of Biomedical Engineering · Department of Pathology and Laboratory Medicine +1
Dual-Track CoT: Budget-Aware Stepwise Guidance for Small LMs
Apr 27, 2026Sagnik Chatterjee, Atharva Patil, Sricharan RameshLLM Reasoning Strategies Small Large Language Models
Learning from Imperfect Text Guidance: Robust Long-Tail Visual Recognition with High-Noise Label
Apr 25, 2026Mengke Li, Haiquan Ling, Yiqun Zhang +2Noisy Labels Recent Vision-Language Models
CSSE, Shenzhen University · SCST, Guangdong University of Technology · INFORMATICS, Xiamen University
Passive Variable Impedance For Shared Control
Apr 22, 2026Maximilian Mühlbauer, Nepomuk Werner, Ribin Balachandran +4Impedance Control Robotic Manipulator
School of Computation, Information and Technology, Sensor Based Robotic Systems and Intelligent Assistance Systems, Technical University Munich, Friedrich-Ludwig-Bauer-Str. 3, Garching, Germany. · German Aerospace Center (DLR), Robotics and Mechatronics Center (RMC), Münchener Str. 20, 82234 Weßling, Germany.
Scaling Self-Play with Self-Guidance
Apr 22, 2026Luke Bailey, Kaiyue Wen, Kefan Dong +2Self-Play Reinforcement Learning Baseline
Stanford University
Frequency-Forcing: From Scaling-as-Time to Soft Frequency Guidance
Apr 21, 2026Weitao DuLatent Flow Frequency
DAMO Academy
HoWToBench: Holistic Evaluation for LLM's Capability in Human-level Writing using Tree of Writing
Apr 21, 2026Andrew Zhuoer Feng, Cunxiang Wang, Yu Luo +7Human-Written Text Relevance
Department of Computer Science and Technology, Tsinghua University
Multi-UAV Path Following using Vector-Field Guidance
Apr 20, 2026Gautam Kumar, Amit Shivam, Ashwini RatnooMulti-Uav Unmanned Aerial Vehicles
Department of Aerospace Engineering, Indian Institute of Science Bangalore, India 560012 · Department of Electrical and Computer Engineering, University of Porto, Porto, Portugal
Intent-aligned Autonomous Spacecraft Guidance via Reasoning Models
Apr 19, 2026Yuji Takubo, Simone D'AmicoIntent-Aligned Autonomous Spacecraft Guidance Robust Trajectory
Stanford University · Lomita Mall, Stanford, CA, 94305 · Stanford University 496 Lomita Mall, Stanford, CA, 94305
KinetiDiff: Docking-Guided Diffusion for De Novo ACVR1 Inhibitor Design in Fibrodysplasia Ossificans Progressiva
Apr 17, 2026Aaryan PatelDrug Design Kinetics
Saugus High School, Santa Clarita, CA
Hybrid Decision Making via Conformal VLM-generated Guidance
Apr 16, 2026Debodeep Banerjee, Burcu Sayin, Stefano Teso +1Large Language Model Decisions Guidance
DI, University of Pisa · DISI, University of Trento · CIMeC, university of Trento
YingMusic-Singer: Controllable Singing Voice Synthesis with Flexible Lyric Manipulation and Annotation-free Melody Guidance
Mar 25, 2026Chunbo Hao, Junjie Zheng, Guobin Ma +6Singing Voice Conversion Melody
AI Lab, Giant Network, China
Safe-SAGE: Social-Semantic Adaptive Guidance for Safe Engagement through Laplace-Modulated Poisson Safety Functions
Mar 5, 2026Lizhi Yang, Ryan M. Bena, Meg Wilkinson +4Safety-Critical Scenarios Legged Robots
Caltech MCE · Tufts ME
Calibrated Test-Time Guidance for Bayesian Inference
Feb 25, 2026Daniel Geyfman, Felix Draxler, Jan Groeneveld +3Posterior Bayesian Inference
Department of Computer Science, University of California, Irvine, CA, USA · Seoul National University, Seoul, South Korea · Chan-Zuckerberg Initiative, Redwood City, CA, USA
Momentum Guidance: Plug-and-Play Guidance for Flow Models
Feb 23, 2026Runlong Liao, Jian Yu, Baiyu Su +3Flow Models Classifier-Free Guidance
The University of Texas at Austin, Austin, TX 78712, USA
EMAG: Self-Rectifying Diffusion Sampling with Exponential Moving Average Guidance
Dec 19, 2025Ankit Yadav, Ta Duc Huy, Lingqiao LiuClassifier-Free Guidance Diffusion Sampling
Australian Institute for Machine Learning, Adelaide University, Australia
Single-step Diffusion-based Video Coding with Semantic-Temporal Guidance
Dec 8, 2025Naifu Xue, Zhaoyang Jia, Jiahao Li +4Video Compression Video Coding
Communication University of China · University of Science and Technology of China · Microsoft Research Asia
Don't Tell the Answer, Truly Guide the Reasoning During RL Rollouts
Oct 10, 2025Xinyi Wang, Jinyi Han, Zishang Jiang +7LLM Reasoning Strategies Large Language Model Reinforcement Learning
School of Data Science, Fudan University · 2Shanghai Institute of Artificial Intelligence for Education, East China Normal University · College of Computer Science and Artificial Intelligence, Fudan University +1
Rethinking Visual Autoregressive Sampling with Information-Grounding Guidance
Sep 28, 2025Ky Dan Nguyen, Hoang Lam Tran, Anh-Dung Dinh +4Autoregressive Image Generation Image Generation
The University of Sydney, Sydney, New South Wales, Australia · The University of Western Australia, Perth, Western Australia, Australia
Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo
Jul 26, 2025Jinsu Yoo, Sooyoung Jeon, Zanming Huang +2Stereo Matching Lidar
The Ohio State University
Guided Unconditional and Conditional Generative Models for Super-Resolution and Inference of Quasi-Geostrophic Turbulence
Jul 1, 2025Anantha Narayanan Suresh Babu, Akhil Sadam, Pierre F. J. LermusiauxTurbulent Flows Generative Super-Resolution
Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, USA · Center for Computational Science and Engineering, Massachusetts Institute of Technology, Cambridge, USA
Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance
Jun 26, 2025Akio Hayakawa, Masato Ishii, Takashi Shibuya +1Audio-Video Generation Audio Understanding
Sony AI, Tokyo, Japan · Sony Group Corporation, Tokyo, Japan

May 24, 2026, cs.CVJ/K move · Enter open · S save

Injecting Image Guidance into Text-Conditioned Diffusion Models at Inference

Agata Żywot, Iason Skylitsis, Thijmen Nijdam, Zoe Tzifa-Kratira+3

University of Amsterdam, Netherlands

Text-To-Image Diffusion Models Text-Conditioned Diffusion Model Diffusion Models Guidance

Open paper AskPDF arXiv

Text-to-image diffusion models like Stable Diffusion generate high-quality images from text, but lack a way to inject visual guidance (e.g. sketches, styles) at inference without retraining. Existing methods either require computationally expensive fine-tuning or rely on style transfer techniques that risk semantic misalignment with textual prompts. We introduce Visual Concept Fusion (VCF), the first method offering dual conditioning on both an image and text prompt at inference time without any concept-specific training. VCF enables visual concept injection into Stable Diffusion by aligning CLIP image features with the text embedding space. VCF consists of three components: (1) a lightweight aligner that maps image tokens to the text embedding manifold using InfoNCE and cross-attention reconstruction losses, (2) a fusion strategy that preserves both textual and visual semantics, and (3) an optional Prompt-Noise Optimization (PNO) module for test-time refinement. Our experiments demonstrate that VCF successfully transfers visual attributes including style, composition, and color palette from reference images while maintaining prompt adherence. Quantitative results show a trade-off between text alignment (CLIP score) and visual correspondence (LPIPS), with VCF outperforming baselines in reference fidelity.

Momentum

Related topics

Latest papers 172