We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Dynamical Systems

Title: Limiting dynamics for Q-learning with memory one in two-player, two-action games

Abstract: We develop a computational method to identify all pure strategy equilibrium points in the strategy space of the two-player, two-action repeated games played by Q-learners with one period memory. In order to approximate the dynamics of these Q-learners, we construct a graph of pure strategy mutual best-responses. We apply this method to the iterated prisoner's dilemma and find that there are exactly three absorbing states. By analyzing the graph for various values of the discount factor, we find that, in addition to the absorbing states, limit cycles become possible. We confirm our results using numerical simulations.
Subjects: Dynamical Systems (math.DS); Adaptation and Self-Organizing Systems (nlin.AO)
Cite as: arXiv:2107.13995 [math.DS]
  (or arXiv:2107.13995v1 [math.DS] for this version)

Submission history

From: Janusz Meylahn [view email]
[v1] Thu, 29 Jul 2021 14:13:48 GMT (334kb,D)

Link back to: arXiv, form interface, contact.