Heterogeneous Computing

Ask about this topic

Overview

Heterogeneous computing assigns work across different resources—such as CPUs, GPUs, NPUs, FPGAs, and processing-in-memory devices—whose strengths and constraints vary. Common approaches include task and graph scheduling, workload partitioning, pipeline parallelism, compiler and kernel optimization, and joint hardware-runtime design; reinforcement learning and analytical cost models help make these decisions adaptive. Applications range from edge inference and robotics to large-model training and serving across distributed clusters. A central challenge is balancing computation against data movement, contention, and power while preserving accuracy and meeting latency targets, with solutions often depending on the specific hardware and workload.

Latest papers

CardsList

80 papers13 papers in the last four weeks, up 30% on the four weeks before. 0.1% of all new papers.

  1. Heterogeneous Space Data Centers: A Key Paradigm for Future Non-Terrestrial and In-Orbit Services

    Oct 23, 2026Peng Hu, Mustafa Alhassan, Amjad IqbalHeterogeneous ComputingLEO Satellite Networks

    Department of Electrical and Computer Engineering, University of Manitoba, Winnipeg, MB, R3T 5V6, Canada

  2. AgentDP: Towards Automated Model Deployment for Heterogeneous Embedded AI Applications

    Oct 22, 2026Leming Shen, Qiang Yang, Xinyu Huang +2MLOpsOn-Device Inference

    The Hong Kong Polytechnic University · University College London · U2University of Cambridge

  3. Efficient CPU-GPU collaborative MoE inference via Adaptive Expert Assignment

    Oct 16, 2026Wenhui Lv, Yunming Liao, Hongli Xu +2Mixture-of-Experts InferenceLLM Inference Acceleration

  4. One Communicator, Three Vendors: Extending the MoA Predictive Theory to a Real NVIDIA+AMD+CPU MPI Ensemble

    Oct 16, 2026Lenore Mullin, Gaetan HainsHigh-Performance ComputingHeterogeneous Computing

    College of Nanotechnology, Science and Engineering, University at Albany, SUNY, Albany, NY, USA · LACL, Université Paris-Est Créteil, Créteil, France

  5. Architecting for Hardware Diversity: Meta's End-to-End Co-Design for High-Performance AI Training on AMD GPUs

    Oct 15, 2026Haoyu Zhang, Arshad Rahman, Adnan Aziz +55Hardware-Software Co-DesignHeterogeneous Computing

  6. ETH: Data-Balanced Heterogeneous Pipeline Parallelism for Training Large Models

    Oct 15, 2026Mianjie Yu, Zhongmin Zhao, Zizhao Mo +9Distributed TrainingPipeline Parallelism

    University of Macau · Great Bay University · Sun Yat-sen University +1

  7. MoSAIC: Learning DAG Scheduling Heuristics from Optimal Schedules through Motif-Aware Recovery and LLM-Guided Reasoning

    Oct 10, 2026Shiva Ahir, Hashmath Shaik, Alex Doboli +2Automated Heuristic DesignLearning to Optimize

    Department of Electrical & Computer Engineering, Stony Brook University, New York, United States of America · Barcelona Supercomputing Center, Barcelona, Catalonia, Spain · Department of Computer Science, Hofstra University, New York, United States of America

  8. C2Flight: A Closed-Loop Co-Simulation Framework for Early-Stage Evaluation of Heterogeneous UAV Computing Systems

    Oct 10, 2026Xizhu Chen, Shuyuan Zhang, Yixuan Li +4Heterogeneous ComputingHardware-Software Co-Design

  9. LLM-Augmented Bayesian Optimization with Adaptive Policies for Chiplet Design Space Exploration

    Oct 10, 2026Hang Liu, Zhengfei Chen, Zhengrui Chen +3Large Language Model-Guided OptimizationElectronic Design Automation

    Zhejiang University, Hangzhou, China · ChipFlux, Hangzhou, China · ShanghaiTech University, Shanghai, China

  10. Rethinking Streaming-Perception Evaluation on Heterogeneous Edge Platforms

    Oct 4, 2026Misun Yu, Jinyoung Moon, Jemin LeeEdge InferenceHeterogeneous Computing

    Electronics and Telecommunications Research Institute (ETRI), Daejeon, Republic of Korea · Division of Electronics and Information Engineering, Jeonbuk National University, Jeonju, Republic of Korea

  11. EdgeAgent: Orchestrating On-Device LLM inference for End-User Multi-Agent Systems on CPU-GPU Unified Memory Architectures

    Oct 2, 2026Yuhai Long, Yuanxin Wei, Kai Wu +3On-Device InferenceLLM Inference Scheduling

    School of Computer Science and Engineering, Sun Yat-sen University · Sun Yat-sen University School of Computer Science and Engineering Guangzhou, China · China Mobile Internet Company Ltd +1

  12. HAPMoE: Heterogeneity-Aware Automatic Parallelism Planning for Mixture-of-Experts Models Training

    Sep 30, 2026Mengyuan Fan, Peizhuang Cong, Zixiao Huang +7Expert ParallelismHeterogeneous Computing

    State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · Infinigence AI · Tsinghua University

  13. Kafila: Serving Large Language Models on a Trusted Set of Heterogeneous Commodity Machines

    Sep 28, 2026Murtaza Rangwala, Richard O. Sinnott, Rajkumar BuyyaLLM InferenceLLM Inference Scheduling

    Quantum Cloud Computing and Distributed Systems (qCLOUDS) Lab, School of Computing and Information Systems, The University of Melbourne, Australia

  14. Cross-Backend QIEO: Universal Runtime Portability across OpenMP5, CUDA, HIP, and Multi-Language Interfaces

    Sep 25, 2026Aman Mittal, Ferdin Sagai Don Bosco, Kasturi Venkata Srikanth +3Evolutionary OptimizationHeterogeneous Computing

    BQP Bengaluru, India

  15. Hybrid GPU-CPU Retrieval for Personalized Search at Ultra-Large Scale

    Sep 18, 2026Hao Fu, Jichao Sun, Baiting Zhu +15Information RetrievalHybrid Retrieval

    Meta Platforms, Inc. Menlo Park, California, USA

  16. HiGFRL: Hierarchical Graph Fusion-Driven Reinforcement Learning for Dependency-Aware Task Scheduling in Heterogeneous Cloud

    Sep 14, 2026Tiangang Li, Shi Ying, Xiangbo TianReinforcement LearningHeterogeneous Computing

    School of Computer Science, Wuhan University, Wuhan 430072, China

  17. Physically Partitioned KVCache Format for CPU--GPU Load Balancing in MoE Inference

    Sep 13, 2026Enda Yu, Dezun Dong, Xiangke LiaoKV-Cache ManagementKV-Cache Offloading

    National University of Defense Technology China

  18. OpWeave: Flexible Operator Disaggregation for Heterogeneous LLM Serving

    Sep 13, 2026Zikun Li, Yixuan Mei, Shiqi Pan +9Disaggregated LLM ServingCost-Aware Inference

    Carnegie Mellon University · Peking University · Carnegie Mellon University and Google

  19. Partition-Aware Scheduling for Mobile Heterogeneous Inference Co-Execution

    Sep 13, 2026Zhuojin Li, Marco Paolieri, Leana GolubchikOn-Device InferenceHeterogeneous Computing

    University of Southern California, Los Angeles, CA, 90089, USA

  20. Rethinking Heterogeneous System Disaggregation for Subquadratic Attention

    Sep 11, 2026Arya Tschand, Yaosheng Fu, Vikram Sharma Mailthody +6Disaggregated LLM ServingLLM Inference Acceleration

    Harvard University Cambridge, Massachusetts, USA · NVIDIA Santa Clara, California, USA

  21. Fidelity-Aware Scheduling of Quantum Circuits on Multi-QPU Systems

    Sep 9, 2026Innocenzo Fulginiti, Antonio Tudisco, Salvatore Zammuto +7High-Performance ComputingHeterogeneous Computing

    Technical University of Munich, Munich, Germany · Department of Electronics and Telecommunications, Politecnico di Torino, Turin, Italy · MQSC, Garching near Munich, Germany +1

  22. Diamond Agent: Agentic Control of Federated HPC Resources as a Service

    Sep 5, 2026Haotian Xie, Junlin Chen, Mingkai Zheng +9High-Performance ComputingAgentic Workflows

    Rutgers University · University of Rochester · National Center for Supercomputing Applications +3

  23. Para-Pipe: Exploiting Hierarchical Operator Parallelism of ML Computational Graphs on SoCs

    Sep 3, 2026Yujie Zhang, Huiying Lan, Ehsan Aghapour +5Efficient Neural Network InferenceEnergy-Efficient ML

    School of Computing, National University of Singapore, Singapore · Parallel Computer Systems, the University of Amsterdam, 1098 XH Amsterdam, The Netherlands · Information Technology Department, Black Sesame Technologies, San Jose, CA 95131, USA

  24. Gen-TAS: A Generative AI-Aided Hardware-Software Task Allocation Framework for FPGA-GPP Heterogeneous Systems

    Aug 28, 2026Mary Kong, Yuqin Zhao, Semih Vazgecen +2Heterogeneous ComputingHardware-Software Co-Design

    Centre for Electronics Frontiers, Institute for Integrated Micro and Nano Systems, School of Engineering, University of Edinburgh, UK

  25. HYDRA: A Heterogeneous Chiplet DSE Framework for Serving Dynamic Hybrid LLM Workloads

    Aug 19, 2026Jiahao Lin, Alish Kanani, Sangwan Lee +2Hybrid Mamba-Transformer ArchitecturesLLM Serving

    University of Wisconsin–Madison · University of Ulsan

  26. Biological-Hybrid Intelligence: A Conceptual Framework for Distributed Biological--Artificial Computation

    Aug 19, 2026Michael Taynnan Barros, Sergio Lopez Bernal, Reinhold SchererAdaptive ComputationHeterogeneous Computing

    School of Computer Science and Electronic Engineering, University of Essex, Colchester, UK · Department of Information and Communications Engineering, University of Murcia, Murcia, Spain

  27. Architectural Implications of Agentic AI Workflows

    Aug 5, 2026Jirong Yang, Peizhe Liu, Chaojie Zhang +1LLM Inference SchedulingAgentic Workflows

    The University of Texas at Austin · Microsoft Azure

  28. Gleam: Adaptive Network-Efficient CUDA API Remoting for Cross-Device GPU Sharing over LANs

    Jul 25, 2026Zhihao Xu, Hao Zhong, Zeting Zhou +9Heterogeneous ComputingDistributed Inference

    Shanghai Jiao Tong University · Lenovo Information Products (Shenzhen) Ltd · Lenovo (Beijing) Ltd

  29. FusionML: Prefill, Not Decode - Mechanism and Boundaries of CPU+GPU Co-Execution on Unified-Memory Apple Silicon

    Jul 24, 2026Om MohiteLLM ServingLLM Inference Acceleration

    Independent Researcher, Mumbai, India

  30. GLidE-SLAM: GL-Accelerated Indirect-Direct Embedded SLAM

    Jul 18, 2026Carlos A. Pinheiro de Sousa, Heiko Hamann, Oliver DeussenSimultaneous Localization and MappingVisual Odometry

    The authors are with the Department of Computer and Information Science, University of Konstanz, 78464 Konstanz, Germany.