cs.LGFeb 3, 2026

Soft-Radial Projection for Constrained End-to-End Learning

Authors: Philipp J. Schneider, Daniel Kuhn

Organizations: Risk Analytics and Optimization Chair, EPFL

Abstract

Constrained end-to-end learning trains neural networks whose outputs must satisfy feasibility constraints, such as resource, budget, or operational limits. While projection and optimization layers guarantee constraint satisfaction, boundary-based projections can introduce unfavorable optimization geometry: regions of the unconstrained output space are mapped to the same active face of the feasible set. This makes the resulting map locally rank-deficient, suppressing gradients in constrained directions and potentially impairing optimization - a bottleneck known as gradient saturation. We propose Soft-Radial Projection (SRP), a differentiable reparameterization layer that maps unconstrained network outputs into the relative interior of a convex feasible set by smoothly rescaling rays from a strictly feasible anchor point. Unlike hard radial or orthogonal projections, the resulting map is one-to-one and has a full-rank Jacobian almost everywhere, while guaranteeing strict feasibility. We prove that constrained networks equipped with SRP retain universal approximation guarantees. For polytopes and balls, the layer admits a closed-form forward pass, while for general convex sets, the ray-boundary intersection reduces to a one-dimensional search. Experiments on decision-focused learning benchmarks demonstrate strong solution quality at low computational cost, with particularly favorable results in portfolio optimization and substantially lower inference latency than differentiable optimization layers in the evaluated settings.

Figures & tables

Appendix figures & tables18 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. ENFORCE: Nonlinear Constrained Learning with Adaptive-depth Neural Projection

    Feb 10, 2025Giacomo Lastrucci, Artur M. SchweidtmannConstrained Optimization

  2. RAYEN: Imposition of Hard Convex Constraints on Neural Networks

    Jul 17, 2023Jesus Tordesillas, Victor Klemm, Jonathan P. How +1Constrained OptimizationNeural Network Control

  3. Improving Feasibility via Fast Autoencoder-Based Projections

    Apr 3, 2026Maria Chzhen, Priya L. DontiConstrained OptimizationConstrained RL