Robust Reasoning and Learning with Brain-Inspired Representations under Hardware-Induced Nonlinearities
Organizations: University of California, Irvine Irvine, California, USA
Abstract
Traditional machine learning depends on high-precision arithmetic and near-ideal hardware assumptions, which is increasingly challenged by variability in aggressively scaled semiconductor devices. Compute-in-memory (CIM) architectures alleviate data-movement bottlenecks and improve energy efficiency yet introduce nonlinear distortions and reliability concerns. We address these issues with a hardware-aware optimization framework based on Hyperdimensional Computing (HDC), systematically compensating for non-ideal similarity computations in CIM. Our approach formulates encoding as an optimization problem, minimizing the Frobenius norm between an ideal kernel and its hardware-constrained counterpart, and employs a joint optimization strategy for end-to-end calibration of hypervector representations. Experimental results demonstrate that our method when applied to QuantHD achieves 84% accuracy under severe hardware-induced perturbations, a 48% increase over naive QuantHD under the same conditions. Additionally, our optimization is vital for graph-based HDC reliant on precise variable-binding for interpretable reasoning. Our framework preserves the accuracy of RelHD on the Cora dataset, achieving a 5.4 accuracy improvement over naive RelHD under nonlinear environments. By preserving HDC's robustness and symbolic properties, our solution enables scalable, energy-efficient intelligent systems capable of classification and reasoning on emerging CIM hardware.
Figures & tables
| Ref. | Speedup | Energy efficiency |
|---|---|---|
| RelHD vs 1080Ti ( Kang et al., 2022 ) | 33x | 59287x |
| FeReX vs 3090Ti ( Xu et al., 2024 ) | 250x | 18000x |
| MIMHD vs 1080 ( Kazemi et al., 2021 ) | 56x | 314x |
Hyperdimensional Computing
Hyperdimensional computing uses high-dimensional vector representations and algebraic operations for efficient learning, memory, and reasoning.
See all 39 papers