Maximum Entropy
Maximum entropy (MaxEnt) methods aim to find the probability distribution that best represents available data while maximizing uncertainty, minimizing bias, and avoiding unwarranted assumptions. Current research focuses on applying MaxEnt principles to diverse areas, including causal inference, reinforcement learning (with algorithms like Soft Actor-Critic and novel approaches like Matryoshka Policy Gradient), and improving the efficiency of MaxEnt model training for large datasets. These advancements are impacting fields like machine learning, physics-aware prediction, and traffic modeling by providing robust and generalizable solutions to complex problems involving uncertainty and incomplete information.
Papers
Maximum Entropy on Erroneous Predictions (MEEP): Improving model calibration for medical image segmentation
Agostina Larrazabal, Cesar Martinez, Jose Dolz, Enzo Ferrante
Maximum Entropy Population-Based Training for Zero-Shot Human-AI Coordination
Rui Zhao, Jinming Song, Yufeng Yuan, Hu Haifeng, Yang Gao, Yi Wu, Zhongqian Sun, Yang Wei