Heterogeneous Environment

Heterogeneous environments, characterized by variations in data distribution, computational resources, and communication conditions, pose significant challenges for machine learning. Current research focuses on developing robust algorithms and system architectures that address these challenges, including federated learning with adaptive aggregation and dynamic resource allocation, and employing techniques like reinforcement learning for optimal task scheduling across diverse hardware. Overcoming these limitations is crucial for enabling efficient and accurate machine learning in real-world applications, such as distributed sensor networks, personalized medicine, and large-scale scientific simulations.

Papers

October 29, 2024

EnvoDat: A Large-Scale Multisensory Dataset for Robotic Spatial Awareness and Semantic Reasoning in Heterogeneous Environments
Linus Nwankwo, Bjoern Ellensohn, Vedant Dave, Peter Hofer, Jan Forstner, Marlene Villneuve, Robert Galler, Elmar Rueckert
Multi Modal Robot Autonomy Heterogeneous Environment Semantic Reasoning Multisensory Data

September 5, 2024

On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments
Muxing Wang, Pengkun Yang, Lili Su
Reinforcement Learning Q Learning Convergence Rate Federated Prompt Cooperation Q Function Large Scale Multi Agent Heterogeneous Environment Slow Convergence

August 21, 2024

NuSegDG: Integration of Heterogeneous Space and Gaussian Kernel for Domain-Generalized Nuclei Segmentation
Zhenye Lou, Qing Xu, Zekun Jiang, Xiangjian He, Zhen Chen, Yi Wang, Chenxin Li, Maggie M. He, Wenting Duan
Nucleus Segmentation Gaussian Kernel Nucleus Instance Segmentation Heterogeneous Environment Chemical Domain

May 29, 2024

Momentum for the Win: Collaborative Federated Reinforcement Learning across Heterogeneous Environments
Han Wang, Sihong He, Zhili Zhang, Fei Miao, James Anderson
Optimal Policy Convergence Analysis Federated Reinforcement Learning Residual Momentum Heterogeneous Environment

May 15, 2024

Dual-Segment Clustering Strategy for Hierarchical Federated Learning in Heterogeneous Wireless Environments
Pengcheng Sun, Erwu Liu, Wei Ni, Kanglei Yu, Xinyu Qu, Rui Wang, Yanlong Bi, Chuanchun Zhang, Abbas Jamalipour
Heterogeneous Environment Communication Heterogeneity Bi Cluster

May 7, 2024

Causality Pursuit from Heterogeneous Environments via Neural Adversarial Invariance Learning
Yihong Gu, Cong Fang, Peter Bühlmann, Jianqing Fan
Heterogeneous Environment Causal Categorization Invariance Learning Data Driven Causal Adversarial Estimator

April 22, 2024

Apodotiko: Enabling Efficient Serverless Federated Learning in Heterogeneous Environments
Mohak Chadha, Alexander Jensen, Jianfeng Gu, Osama Abboud, Michael Gerndt
Serverless Computing Machine Learning Paradigm Heterogeneous Environment Asynchronous Training Serverless Cloud

December 9, 2023

Speed Up Federated Learning in Heterogeneous Environment: A Dynamic Tiering Approach
Seyed Mahmoud Sajjadi Mohammadabadi, Syed Zawad, Feng Yan, Lei Yang
Speed Effect Heterogeneous Computing Dynamic Scheduling Heterogeneous Environment Faster Client

November 13, 2023

Optical Quantum Sensing for Agnostic Environments via Deep Learning
Zeqiao Zhou, Yuxuan Du, Xu-Fei Yin, Shanshan Zhao, Xinmei Tian, Dacheng Tao
Deep Learning Heterogeneous Environment Scaling Limit Quantum Optic Quantum Sensor Quantum Fisher Information

April 25, 2023

Mobilizing Personalized Federated Learning in Infrastructure-Less and Heterogeneous Environments via Random Walk Stochastic ADMM
Ziba Parsons, Fei Dou, Houyi Du, Zheng Song, Jin Lu
Personalized Federated Learning ADMM Algorithm Heterogeneous Environment Generic Stochastic

February 16, 2023

Distributed Learning in Heterogeneous Environment: federated learning with adaptive aggregation and computation reduction
Jingxin Li, Toktam Mahmoodi, Hak-Keung Lam
LeArning Abstract Heterogeneous Data Global Mixing Heterogeneous Environment Training Instability Complexity Reduction Adaptive Aggregation Asynchronous Update

February 9, 2023

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models
Yingchun Wang, Jingcai Guo, Jie Zhang, Song Guo, Weizhan Zhang, Qinghua Zheng
Heterogeneous Environment Edge Model Federated Causal Edge Function Edge Data

January 12, 2023

Improvement of Computational Performance of Evolutionary AutoML in a Heterogeneous Environment
Nikolay O. Nikitin, Sergey Teryoshkin, Valerii Pokrovskii, Sergey Pakulin, Denis Nasonov
Practical Algorithm Large Relevance Improvement Computational Resource Evolutionary Optimization Computational Efficiency Heterogeneous Environment Evolutionary Machine Learning Graph Perspective

December 23, 2022

Deep Unfolding-based Weighted Averaging for Federated Learning in Heterogeneous Environments
Ayano Nakai-Kasai, Tadashi Wadayama
Deep Learning Model Training Deep Unfolding Large Scale Learning Heterogeneous Environment

December 19, 2022

XEngine: Optimal Tensor Rematerialization for Neural Networks in Heterogeneous Environments
Manuela Schuler, Richard Membarth, Philipp Slusallek
Neural Network Back Propagation Model Checkpoint Deep Learning Network Heterogeneous Environment Memory Efficiency Forward Gradient

November 2, 2022

RCD-SGD: Resource-Constrained Distributed SGD in Heterogeneous Environment via Submodular Partitioning
Haoze He, Parijat Dube
Stochastic Gradient Descent Submodular Maximization Training Algorithm Heterogeneous Environment SGD Style Inter Class Feature

September 22, 2022

A One-shot Framework for Distributed Clustered Learning in Heterogeneous Environments
Aleksandar Armacki, Dragana Bajovic, Dusan Jakovetic, Soummya Kar
Clustering Method K$ Mean One Shot Heterogeneous Environment

August 19, 2022

Globus Automation Services: Research process automation across the space-time continuum
Ryan Chard, Jim Pruyne, Kurt McKee, Josh Bryan, Brigitte Raumann, Rachana Ananthakrishnan, Kyle Chard, Ian Foster
Scientific Data Automation System Heterogeneous Environment

July 16, 2022

Parallel Best Arm Identification in Heterogeneous Environments
Nikolai Karpov, Qin Zhang
Multiple Agent Collaborative Learning Best Arm Identification Optimal Trade Heterogeneous Environment Heterogeneous Learning

June 22, 2022

FedorAS: Federated Architecture Search under system heterogeneity
Lukasz Dudziak, Stefanos Laskaridis, Javier Fernandez-Marques
Neural Architecture Search Federated Edge Learning Heterogeneous Environment System Heterogeneity

Heterogeneous Environment

Papers

EnvoDat: A Large-Scale Multisensory Dataset for Robotic Spatial Awareness and Semantic Reasoning in Heterogeneous Environments

On the Convergence Rates of Federated Q-Learning across Heterogeneous Environments

NuSegDG: Integration of Heterogeneous Space and Gaussian Kernel for Domain-Generalized Nuclei Segmentation

Momentum for the Win: Collaborative Federated Reinforcement Learning across Heterogeneous Environments

Dual-Segment Clustering Strategy for Hierarchical Federated Learning in Heterogeneous Wireless Environments

Causality Pursuit from Heterogeneous Environments via Neural Adversarial Invariance Learning

Apodotiko: Enabling Efficient Serverless Federated Learning in Heterogeneous Environments

Speed Up Federated Learning in Heterogeneous Environment: A Dynamic Tiering Approach

Optical Quantum Sensing for Agnostic Environments via Deep Learning

Mobilizing Personalized Federated Learning in Infrastructure-Less and Heterogeneous Environments via Random Walk Stochastic ADMM

Distributed Learning in Heterogeneous Environment: federated learning with adaptive aggregation and computation reduction

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

Improvement of Computational Performance of Evolutionary AutoML in a Heterogeneous Environment

Deep Unfolding-based Weighted Averaging for Federated Learning in Heterogeneous Environments

XEngine: Optimal Tensor Rematerialization for Neural Networks in Heterogeneous Environments

RCD-SGD: Resource-Constrained Distributed SGD in Heterogeneous Environment via Submodular Partitioning

A One-shot Framework for Distributed Clustered Learning in Heterogeneous Environments

Globus Automation Services: Research process automation across the space-time continuum

Parallel Best Arm Identification in Heterogeneous Environments

FedorAS: Federated Architecture Search under system heterogeneity