We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Ancillary-file links:

Ancillary files (details):

Current browse context:

cond-mat.soft

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Condensed Matter > Soft Condensed Matter

Title: Machine Learning Without a Processor: Emergent Learning in a Nonlinear Electronic Metamaterial

Abstract: Standard deep learning algorithms require differentiating large nonlinear networks, a process that is slow and power-hungry. Electronic learning metamaterials offer potentially fast, efficient, and fault-tolerant hardware for analog machine learning, but existing implementations are linear, severely limiting their capabilities. These systems differ significantly from artificial neural networks as well as the brain, so the feasibility and utility of incorporating nonlinear elements have not been explored. Here we introduce a nonlinear learning metamaterial -- an analog electronic network made of self-adjusting nonlinear resistive elements based on transistors. We demonstrate that the system learns tasks unachievable in linear systems, including XOR and nonlinear regression, without a computer. We find our nonlinear learning metamaterial reduces modes of training error in order (mean, slope, curvature), similar to spectral bias in artificial neural networks. The circuitry is robust to damage, retrainable in seconds, and performs learned tasks in microseconds while dissipating only picojoules of energy across each transistor. This suggests enormous potential for fast, low-power computing in edge systems like sensors, robotic controllers, and medical devices, as well as manufacturability at scale for performing and studying emergent learning.
Comments: 11 pages 8 figures
Subjects: Soft Condensed Matter (cond-mat.soft); Emerging Technologies (cs.ET); Machine Learning (cs.LG)
Cite as: arXiv:2311.00537 [cond-mat.soft]
  (or arXiv:2311.00537v2 [cond-mat.soft] for this version)

Submission history

From: Sam Dillavou [view email]
[v1] Wed, 1 Nov 2023 14:16:37 GMT (7419kb,D)
[v2] Fri, 5 Apr 2024 22:50:25 GMT (7689kb,AD)

Link back to: arXiv, form interface, contact.