Paper ID: 2403.15416

Fuzzy hyperparameters update in a second order optimization

Abdelaziz Bensadok, Muhammad Zeeshan Babar

This research will present a hybrid approach to accelerate convergence in a second order optimization. An online finite difference approximation of the diagonal Hessian matrix will be introduced, along with fuzzy inferencing of several hyperparameters. Competitive results have been achieved

Submitted: Mar 8, 2024