cs.LGMay 10, 2026

When and How to Canonize: A Generalization Perspective

Authors: Yonatan SverdlovBenjamin FriedmanSnir HordanNadav Dym

Organizations: Technion – Israel Institute of Technology

Abstract

While invariant architectures are standard for processing symmetric data, there is growing interest in achieving invariance by applying group averaging or canonization to non-invariant backbones. However, the theoretical generalization properties of these alternative strategies remain poorly understood. We introduce a theoretical framework to analyze the generalization error of these methods by bounding their covering numbers. We establish a rigorous generalization hierarchy: the error bounds of canonized models are at best equal to the error bounds of structurally invariant and group-averaged models, and at worst equal to the bounds of non-invariant baselines. Furthermore, we show that there exist optimal canonizations which attain the optimal error bounds, and poor canonizations which attain the non-invariant error bounds, and that this depends on the regularity of the canonization. Finally, applying this framework to permutation groups in point cloud processing, we rigorously prove that the covering number of lexicographical sorting grows exponentially with point cloud dimension, whereas Hilbert curve canonization guarantees polynomial growth. This provides the first formal theoretical justification for the empirical success of Hilbert curve serialization in state-of-the-art point cloud architectures. We conclude with experiments that support our theoretical claims. Code is available at https://github.com/yonatansverdlov/Canonization

Explore similar work

May 15, 2026cs.CV

Invaria: Learning Scale and Density Invariance in Point Clouds via Next-Resolution Prediction

Modern image encoders achieve high generalization by decoupling semantic meaning from resolution, an ability yet to be fully realized in the 3D domain. We investigate the failure of 3D point cloud encoders to achieve similar generalization and find that existing models are highly sensitive to sampling resolution and scale changes, leading to significant performance degradation. This sensitivity is a major bottleneck for real-world deployment in robotics, as it suggests models overfit to specific quantization densities and object scales rather than learning invariant semantic features. To mitigate this dependency, we propose Invaria, a point cloud encoder that achieves scale and density invariance through next-resolution prediction and receptive field calibration. While our objective is not the explicit generation of high-resolution point clouds, we find that this training objective encourages the model to learn robust, structural invariants. The resulting encoder achieves significant performance gains during resolution shifts while maintaining high efficiency through a compact model size and reduced token requirements. Specifically, on ScanNet, Invaria achieves a 56.0% higher mIoU at 3×\times lower resolution and a 20% improvement when the objects scale is reduced by a factor of 3. These gains are achieved with a 45% smaller model size and an average reduction of 40% in input tokens.
Chun-Peng Chang, Shaoxiang Wang, Alain Pagani +2
May 4, 2026cs.LG

A Closed-Form Persistence-Landmark Pipeline for Certified Point-Cloud and Graph Classification

We introduce PLACE (Persistence-Landmark Analytic Classification Engine), a closed-form pipeline for classifying point clouds and graphs through their persistent-homology signatures. Three quantitative guarantees -- a margin-based excess-risk rate, a closed-form descriptor-selection rule, and a per-prediction certificate -- are derived from training labels alone, with no learned weights or held-out calibration. The embedding sums Mitra-Virk single-point coordinate functions over a sparse landmark grid; the closed-form weight rule wk2(dk+12dk2)/Rk2w_k^2 \propto (d_{k+1}^2 - d_k^2)/R_k^2 maximizes the distortion slope in Mitra-Virk's affine certificate under νν-coherence. (i) An O(kR/(Δmmin))O(kR/(Δ\sqrt{m_{\min}})) margin bound, driven by class-mean separation ΔΔ and embedding radius RR, matched in the sample-starved regime mR/Δm \lesssim R/Δ by a Le Cam minimax lower bound. (ii) The Mahalanobis margin under Ledoit-Wolf-shrunk covariance is the strongest closed-form ranker on a 64-descriptor chemical-graph pool (mean Spearman ρ=+0.56ρ= +0.56 across 11 benchmarks, positive on 10 of 11); the isotropic surrogate Δ/Δ/\sqrt{\ell} admits a closed-form selection-consistency rate on the homogeneous protein/social pools. (iii) A training-time-decided certificate, with no per-prediction overhead, in three concrete radii (Pinelis, Gaussian plug-in, and variance-aware Pinelis-Bernstein). Empirically, PLACE is the strongest diagram-based method on Orbit5k and matches the strongest topology-based baseline within statistical noise on MUTAG and COX2; remaining gaps fall into two diagnosable regimes (descriptor blindness on NCI1/NCI109; pool-coverage limits elsewhere). The Pinelis-Bernstein radius fires on 8 of the 12 benchmarks; on MUTAG the empirical and population nearest-centroid rules agree on every one of 940 held-out test predictions, validating the certificate's mechanism.
Sushovan Majhi, Atish Mitra, Žiga Virk +1
May 5, 2026cs.LG

A Closed-Form Adaptive-Landmark Kernel for Certified Point-Cloud and Graph Classification

We introduce PALACE (Persistence Adaptive-Landmark Analytic Classification Engine), the data-adaptive companion to PLACE, paying a small cross-validation tier on three knobs (budget, radii, bandwidth; 5\leq 5 choices each). A cover-theoretic core (Lebesgue-number criterion on the landmark cover) yields four closed-form guarantees. (i) A structural lower distortion bound λ(τ;ν)λ(τ;ν) on Dn\mathcal{D}_n under cross-diagram non-interference, with a (D/L)2(D/L)^2 budget reduction over the uniform grid when diagrams concentrate. (ii) Equal weights wk=K1/2w_k = K^{-1/2} maximizing λλ, and farthest-point-sampling positions 22-approximating the optimal kk-center covering radius; both derived from training labels alone, no gradient training. (iii) A kernel-RKHS classification rate O((k1)K/(γmmin))O((k-1)\sqrt{K}/(γ\sqrt{m_{\min}})) with binary necessity threshold m=Ω(K/γ)m = Ω(\sqrt K/γ) from a matching Le Cam lower bound, and a closed-form filtration-selection rule. The kernel-Mahalanobis margin ρ^Mah\hatρ_{\mathrm{Mah}} is the strongest closed-form ranker across the chemical-graph pool (mean Spearman ρ+0.60ρ\approx +0.60); the isotropic surrogate γ^/K\hatγ/\sqrt{K} admits a selection-consistency rate, and λ^\widehatλ from (i) provides an independent data-level signal (positive on COX2 and PTC). (iv) A per-prediction certificate, in non-asymptotic Pinelis and asymptotic Gaussian forms, with no calibration split. Empirically, PALACE is the strongest closed-form diagram-based method on Orbit5k (91.3±1.0%91.3 \pm 1.0\%, matching Persformer), leads every diagram-based competitor on COX2 and MUTAG, and is competitive on DHFR (within 1 pp of ECP). At 8×8\times domain inflation, adaptive placement maintains 94%94\% while the uniform grid collapses to chance (25%25\% on 4-class data).
Sushovan Majhi, Atish Mitra, Žiga Virk +1