Best Response Dynamics Convergence for Generalised Nash Equilibrium Problems: An Opportunity for Autonomous Multiple Access Design in Federated Learning
Federated learning is envisioned to be a key enabler of network functionalities based on artificial intelligence. Multiple access mechanisms supporting the learning task must then be designed, in order to provide an efficient interplay between the communication and computation resources. This work considers thus a multi-level slotted random access scheme autonomously optimised by each node. Due to their mutual coupling, the nodes’ interaction is an instance of the Best Response Dynamics (BRD) of a Generalised Nash Equilibrium Problem (GNEP). Within this framework, levers are identified, guaranteeing the convergence of the interactions to an equilibrium point at which the federated learning task is supported. These levers, on which the network manager can act, are validated by numerical simulations. These latter moreover show that the performance loss due to the autonomous character of the nodes is negligible with respect to the result of a centralised optimisation. On a broader mathematical level, this work defines a class of GNEPs for which sufficient convergence conditions for the totally asynchronous BRD are obtained. The considered class, named the GNEPs with polyhedral strategy sets and variable right-hand sides, encompasses a wide variety of GNEPs, and in particular GNEPs which are neither jointly convex nor generalised potential games. The obtained conditions depend on the first and second derivatives of the objective and constraint functions, and they constitute thus an off-the-shelf framework to study the BRD of GNEPs belonging to the identified class.
Thiran, G., Stupia, I., & Vandendorpe, L. (2024). Best Response Dynamics Convergence for Generalised Nash Equilibrium Problems: An Opportunity for Autonomous Multiple Access Design in Federated Learning. I E E E Internet of Things Journal, 11(10), 18463-18482. https://doi.org/10.1109/JIOT.2024.3364756 (Original work published 2024)