cs.LGMar 10, 2026

Hardware Efficient Approximate Convolution with Tunable Error Tolerance for CNNs

Authors: Vishal Shashidhar, Anupam Kumari, Roy P Paily

Organizations: Department of Electronics and Electrical Engineering, Indian Institute of Technology Guwahati

Abstract

Modern CNNs' high computational demands hinder edge deployment, as traditional hard'' sparsity (skipping mathematical zeros) loses effectiveness in deep layers or with smooth activations like Tanh. We propose a soft sparsity'' paradigm using a hardware efficient Most Significant Bit (MSB) proxy to skip negligible non-zero multiplications. Integrated as a custom RISC-V instruction and evaluated on LeNet-5 (MNIST), this method reduces ReLU MACs by 88.42% and Tanh MACs by 74.87% with zero accuracy loss--outperforming zero-skipping by 5x. By clock-gating inactive multipliers, we estimate power savings of 35.2% for ReLU and 29.96% for Tanh. While memory access makes power reduction sub-linear to operation savings, this approach significantly optimizes resource-constrained inference.

Figures & tables

Explore similar work

CardsList
  1. Right In-Place (RiP) Convolution: A Simple, General, and Near-Optimal Strategy for Memory-Efficient CNN Inference

    Sep 30, 2026Opegbemi Matthias Busoye, Tolulope Matthew Busoye, Eghonghon-aye EigbeMemory-Efficient InferenceConvolutional Neural Networks

  2. SPARX: Secure and Privacy-Aware Approximate CNN Acceleration with Edge RISC-V SoC

    Jun 8, 2026Sonu Kumar, Akash Sankhe, Mukul Lokhande +1Edge InferencePrivacy-Preserving ML

  3. CARMEN: CORDIC-Accelerated Resource-Efficient Multi-Precision Inference Engine for Deep Learning

    May 7, 2026Sonu Kumar, Mukul Lokhande, Santosh Kumar Vishvakarma +1Efficient Neural Network InferenceEnergy-Efficient ML