We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Thermodynamic limit in learning period three

Abstract: A continuous one-dimensional map with period three includes all periods. This raises the following question: Can we obtain any types of periodic orbits solely by learning three data points? We consider learning period three with random neural networks and report the universal property associated with it. We first show that the trained networks have a thermodynamic limit that depends on the choice of target data and network settings. Our analysis reveals that almost all learned periods are unstable and each network has its characteristic attractors (which can even be untrained ones). Here, we propose the concept of characteristic bifurcation expressing embeddable attractors intrinsic to the network, in which the target data points and the scale of the network weights function as bifurcation parameters. In conclusion, learning period three generates various attractors through characteristic bifurcation due to the stability change in latently existing numerous unstable periods of the system.
Comments: 26 pages, 19 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Adaptation and Self-Organizing Systems (nlin.AO); Chaotic Dynamics (nlin.CD)
Cite as: arXiv:2405.08825 [stat.ML]
  (or arXiv:2405.08825v1 [stat.ML] for this version)

Submission history

From: Yuichiro Terasaki [view email]
[v1] Sun, 12 May 2024 17:57:25 GMT (26704kb,D)

Link back to: arXiv, form interface, contact.