Logo image
Multiplicative Weights Update with Constant Step-Size in Congestion Games: Convergence, Limit Cycles and Chaos
Conference proceeding

Multiplicative Weights Update with Constant Step-Size in Congestion Games: Convergence, Limit Cycles and Chaos

Gerasimos Palaiopanos, Ioannis Panageas and Georgios Piliouras
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), Vol.30
Advances in Neural Information Processing Systems
01/01/2017

Abstract

Computer Science Computer Science, Artificial Intelligence Science & Technology Technology
The Multiplicative Weights Update (MWU) method is a ubiquitous meta-algorithm that works as follows: A distribution is maintained on a certain set, and at each step the probability assigned to action gamma is multiplied by (1 - epsilon C(gamma)) > 0 where C(gamma) is the "cost" of action gamma and then rescaled to ensure that the new values form a distribution. We analyze MWU in congestion games where agents use arbitrary admissible constants as learning rates epsilon and prove convergence to exact Nash equilibria. Interestingly, this convergence result does not carry over to the nearly homologous MWU variant where at each step the probability assigned to action gamma is multiplied by (1 - epsilon)(C(gamma)) even for the simplest case of two-agent, two-strategy load balancing games, where such dynamics can provably lead to limit cycles or even chaotic behavior.

Metrics

1 Record Views

Details

Logo image