On the Optimal Communication Weights in Distributed Optimization Algorithms
(2024) 26th International Symposium on Mathematical Theory of Networks and Systems MTNS 2024 — Location: Cambridge,United Kingdom (19.August.2024)
Files
240205705v1.pdf
Open Access - Adobe PDF
- 690.44 KB
Details
- Authors
- Abstract
- We establish that in distributed optimization, the prevalent strategy of minimizing the second-largest eigenvalue modulus (SLEM) of the averaging matrix for selecting communication weights, while optimal for existing theoretical performance bounds, is generally not optimal regarding the exact worst-case performance of the algorithms. This exact performance can be computed using the Performance Estimation Problem (PEP) approach. We thus rely on PEP to formulate an optimization problem that determines the optimal communication weights for a distributed optimization algorithm deployed on a specified undirected graph. Our results show that the optimal weights can outperform the weights minimizing the second-largest eigenvalue modulus (SLEM) of the averaging matrix. This suggests that the SLEM is not the best characterization of weighted network performance for decentralized optimization. Additionally, we explore and compare alternative heuristics for weight selection in distributed optimization.
- Affiliations
Citations
Colla, S., & Hendrickx, J. (2024). On the Optimal Communication Weights in Distributed Optimization Algorithms. Published. 26th International Symposium on Mathematical Theory of Networks and Systems MTNS 2024, Cambridge,United Kingdom. https://doi.org/10.1016/j.ifacol.2024.10.107