Organizations: Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan. · Next Generation Artificial Intelligence Research Center (AI Center), The University of Tokyo, Tokyo, Japan.
Representation learning seeks meaningful sensory representations without supervision and can model aspects of human development. Although many neural networks empirically learn useful features, a principled account of what makes a representation "good" remains elusive. We study unsupervised categorization of transformations between pairs of inputs under algebraic constraints. Classical disentanglement favors mutually independent factors and fails when factors are coupled. Our prior Galois-theoretic approach decomposes a group via normal subgroups by learning a product of two transformations with one factor constrained to a normal subgroup, covering both commutative and non-commutative cases. That method, however, relied on auxiliary assumptions (e.g., motion and isometry restrictions) not required by decomposition theory, and ablations did not separate theory-based from auxiliary effects. We propose parameter division for a single transformation: we split its parameter into components, impose homomorphism constraints mapping the full transformation to one component, and identify the normal subgroup as the set of transformations when that component is fixed to the identity. This formulation drops the previous auxiliary assumptions and applies more broadly. We evaluate on image pairs involving rotation, translation, and scale; ablations show that group-decomposition constraints drive appropriate categorization.
Figures & tables
Fig. 1 : Schematic of the proposed formulation in the case of two parameters. By the closure property of a group G , when this group contains g1=g(θ1,ϕ1) and g2=g(θ2,ϕ2) , there exists g1,2=g(θ1,2,ϕ1,2) which satisfies g1,2=g1∘g2 . g1 , g2 , and g1,2 are mapped to θ1 , θ2 , and θ1,2 , respectively, by the mapping f:g(θ,ϕ)↦θ . If f is a homomorphism, θ1,2=θ1⋅θ2 should hold. Using this homomorphism f , we can obtain the normal subgroup N of G as the set of g under the condition that θ is set to the identity element θe .
Fig. 2 : Boxplots comparing the evaluation metric Ih with and without the homomorphism loss Lh . Boxplot (a) is for the dataset variant (i) rotation and translation, (b) is for the dataset variant (ii) scale and rotation, and (c) is for the dataset variant (iii) scale and translation.