The drive toward heterogeneous 2.5D chiplet packages promises unmatched performance and customization, yet the resulting density amplifies thermal challenges. To facilitate rapid design space exploration, we present ThermLeT, a multimodal transformer-based, scale invariant surrogate that integrates power density maps, spatial coordinate embeddings, material properties and heat transfer rate to predict steady state temperature in 13 ms, about four orders of magnitude faster than conventional finite element solvers such as ANSYS. To train the transformer model, we also create a dataset of 6,221 chiplet layouts perturbed from three representative architectures. On a 150 sample test set, ThermLeT achieves an RMSE of 3.16°C and an MAE of 2.24°C, improving accuracy by 35% over ThermEDGe and by 71% over HotSpot, while running approximately 6x and 11x lower inference latencies respectively. Ablation studies confirm robust generalization to unseen floorplans. Code and dataset available at https://github.com/MicroSystemsDesignLab/ThermLeT
Figures & tables
Fig. 1: Design parameter perturbations in 2.5D chiplet thermal analysis. Four categories of perturbations: spatial, power, material, and boundary conditions require complete thermal recalculation. This iterative evaluation process, while essential for design space exploration, becomes computationally prohibitive when evaluating thousands of configurations using traditional finite element methods.
Related Work
Input
Approach
Steady-State or Transient
ANSYS
Geometry Modeling
FEM/CFD
Both
HotSpot [ 13 ]
Layout, BC
FEM
Both
DeepOHeat [ 6 ]
Layout, BC, Power Map
Operator Learning ML
Transient
CoMeT [ 14 ]
Layout, BC, Power Map
FEM
Both
U-Net [ 15 ]
Layout, Power Map
Image-to-image and PINN
Steady-State
ThermEDGe [ 12 ]
Layout, Power Map
Encoder-Decoder Network
Both
TABLE I: Summary of related works with their inputs, approach, and simulation type.
Components
Materials
Thermal Conductivity (w/m.k)
CTE (ppm/°C)
Young’s Modulus (gpa)
Substrate
FR-4
0.3
13.0
20
C4 Bump
Tin-Lead (60-40)
50
20.5
20
μ Bump
SAC (SnAgCu)
50
20
50
Interposer
Silicon Anisotropic
148
2.6
150
Chiplets
Silicon Anisotropic
150
3.1
130
TIM
Indium
86
29
10
TABLE II: Material Properties for Key Components
Fig. 2: Cross-sectional schematic of the 2.5D chiplet integration stack. The structure includes key components such as C4 bumps, thermal interface materials (TIM), underfill, interposer, microbumps, chiplets, and a heatsink. This model serves as the foundation for finite element analysis (FEA) simulations
Multi-GPU
Micro150
Ascend 910
Chiplet
CPU
GPU
HBM
CPU
DRAM
Virtuian
Nimbus
HBM
Widths [mm]
12
18.2
7.75
8.25
8.75
31.4
10.5
7.75
Height [mm]
12
18.2
11.87
9
8.75
14.5
16
11.87
Power [W]
105
295
20
150
20
256
14
20
TABLE III: Chiplet dimensions and powers in 2.5D examples.
Fig. 3: Overview of the proposed ThermLeT architecture. The model takes three input modalities: power map, spatial coordinates, and material properties and embeds them using dedicated modules. These embeddings are fused and passed through a Transformer encoder and convolutional decoding blocks to predict the final temperature map. The design enables the model to capture spatial and physical dependencies for accurate thermal prediction across diverse chiplet architectures.
Fig. 4: Visual comaprision of temperature predictions: (a) Input Power map with different color representing different power values shown III (b) Ground truth generated using Ansys simulation (c,d) Temperature predictions by baseline ThermEDGe [ 12 ] and Hotspot [ 13 ] (e) Proposed transformer based temperature predictor.
Method
RMSE ↓
MAE ↓
ThermEDGe [ 12 ]
4.893
3.691
HotSpot [ 13 ]
10.734
9.886
ThermLeT (Power Only)
4.1186
3.307
ThermLeT (Ours)
3.160
2.238
TABLE IV: Evaluation metrics on the test set of 150 samples. Lower values indicate better performance.
Model
Latency
Throughput
FLOPs
(s/sample)
(samples/s)
(GFLOPs)
Ansys steady-state thermal
95.000*
-
ThermEDGe [ 12 ]
0.0762
13.11
11.42
HotSpot [ 13 ]
0.1442*
-
-
ThermLeT (Ours)
0.0130
76.77
155.79
TABLE V: Latency, throughput, and FLOPs for ThermLeT and baselines on the full dataset.
Input Modalities
RMSE ↓
MAE ↓
Power + Coord + MatProp (Full Model)
3.160
2.238
Power + MatProp
5.424
4.271
Power + Coord
6.162
4.858
TABLE VI: RMSE and MAE for different input combinations. The full model uses power, coordinates, and material properties.
Method
RMSE ↓
MAE ↓
ThermEDGe [ 12 ]
9.6493
7.6973
ThermLeT (Ours)
8.908
7.3745
TABLE VII: RMSE and MAE on unseen chiplet architectures (Ascend910 + Micro150) after training only on MultiGPU.
College of Information Science and Engineering, Northeastern University, Shenyang, China · Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong