SLICE-CiM: Selective Layer-wise Inference Control Engine with Confidence-Based Early Exit for SRAM based Digital Compute-in-Memory
Organizations: Department of Electrical Engineering, Indian Institute of Technology Indore, Indore, India
Abstract
Digital SRAM compute-in-memory (CIM) macros enable energy-efficient CNN inference by eliminating off-chip weight transfers; however, peripheral control logic introduces three inefficiencies: bit- slice over-activation at reduced precision (L1), unnecessary accumula- tion depth (L2), and idle precision-transition stalls (L3). To address these, we present four synthesizable peripheral blocks: a Flush-Merge Enable (FME) controller, a Confidence-Based Early-Exit (EE) module, a Precision Register with Decoder (PR/PD), and a Bit-Serial Cycle Controller (CC), co-designed to minimize switching activity, wordline overhead, and leakage. Implemented in TSMC 65-nm CMOS at 335 MHz, the peripheral framework occupies 1769.760 μm2 post-synthesis and 1982.131 μm2 post-PnR. Gate-level VCD analysis reports 6.0706 μW leakage and 288.2902 μW (post-synthesis) / 322.8850 μW (post-PnR) dynamic power, totaling 328.9556 μW (0.2402% of system power). The EE module dominates dynamic power (58.2%), while WLG dominates area (58.1%). System evaluation on MobileNetV2 (CIFAR-100) shows efficiency scaling from 31.35 TOPS/W (8b/8b, 1.2 V) to 454.91 TOPS/W (2b/8b, 0.8 V), achieving 13.33x improvement without bitcell modification or retraining. The framework targets CNN workloads exploiting sparsity, with Transformer extension as future work.
Figures & tables
| TOPS/W | Acc. (%) | Avg Prec. (bits) | ||
|---|---|---|---|---|
| 0.5 | 0.5 | 37.91 | 69.42 | 4.58 |
| 0.6 | 0.4 | 41.63 | 68.70 | 4.31 |
| 0.7 | 0.3 | 39.40 | 68.12 | 4.19 |
| 0.4 | 0.6 | 35.68 | 70.10 | 4.75 |
| Method | Metric | Retrain | HW Model | CIM | Calib. | Avg Bits |
|---|---|---|---|---|---|---|
| EdMIPS [ 11 ] | FLOP comp. | Partial | FLOPs | No | Low | 5.50 |
| HAWQ [ 9 ] | Hessian trace | Yes | FLOP | No | Full QAT | 2.46 |
| HAQ [ 10 ] | RL reward | Yes | Latency LUT | No | High | 6.00 |
| This Work | CoV + sparsity | No | CIM slice | Yes | 1-pass | 4.31 |
| Parameters | TCAS-I’25 [ 3 ] | TCAS-II’22 [ 8 ] | JSSC’22 [ 6 ] | TCAS-I’23 [ 5 ] | JSSC’21 [ 12 ] | TCAS-I’24 [ 4 ] | TCAS-I’23 [ 13 ] | JSSC’23 [ 7 ] | ISSCC’21 [ 2 ] | Proposed |
| Tech. (nm) | 65 | 65 | 65 | 65 | 65 | 55 | 28 | 28 | 22 | 65 |
| Operation | Digital | Analog | Analog | Digital | Digital | Digital | Digital | Digital | Digital | Digital |
| Cell-type | 8.75T | 6T | 6T | 7T | 54T | 8T | 6.5T | 10T | 6T | 10T |
| VDD (V) | 1 | 0.9–1.2 | 0.9–1.05 | 0.8–1.1 | 0.6–0.8 | 1.2 | 0.6–1.1 | 0.6–0.9 | 0.72 | 0.8-1.2 |
| Macro (Kb) | 64 | 72+1 | 16 | 80 | 16 | 64 | 16 | 128 | 64 | 32 |
| Frequency (MHz) | 400 | 100 | 100 | 200 | 138 | 200 | 360 | 216 | 55.56 | 335 |
Efficient Neural Network Inference
Efficient neural network inference reduces the time, memory, and energy needed to run trained models across hardware and deployment settings.
See all 470 papers