Paper ID: 2410.11776

Encoding architecture algebra

Stephane Bersier, Xinyi Chen-Lin

Despite the wide variety of input types in machine learning, this diversity is often not fully reflected in their representations or model architectures, leading to inefficiencies throughout a model's lifecycle. This paper introduces an algebraic approach to constructing input-encoding architectures that properly account for the data's structure, providing a step toward achieving more typeful machine learning.

Submitted: Oct 15, 2024