Welcome to the new version of CaltechAUTHORS. Login is currently restricted to library staff. If you notice any issues, please email coda@library.caltech.edu
Published April 29, 2021 | Supplemental Material + Published
Journal Article Open

Machine learning outperforms thermodynamics in measuring how well a many-body system learns a drive

Abstract

Diverse many-body systems, from soap bubbles to suspensions to polymers, learn and remember patterns in the drives that push them far from equilibrium. This learning may be leveraged for computation, memory, and engineering. Until now, many-body learning has been detected with thermodynamic properties, such as work absorption and strain. We progress beyond these macroscopic properties first defined for equilibrium contexts: We quantify statistical mechanical learning using representation learning, a machine-learning model in which information squeezes through a bottleneck. By calculating properties of the bottleneck, we measure four facets of many-body systems' learning: classification ability, memory capacity, discrimination ability, and novelty detection. Numerical simulations of a classical spin glass illustrate our technique. This toolkit exposes self-organization that eludes detection by thermodynamic measures: Our toolkit more reliably and more precisely detects and quantifies learning by matter while providing a unifying framework for many-body learning.

Additional Information

© The Author(s) 2021. This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. Received 24 November 2020. Accepted 01 April 2021. Published 29 April 2021. The authors thank Alexander Alemi, Isaac Chuang, Emine Kucukbenli, Nick Litombe, Seth Lloyd, Julia Steinberg, Tailin Wu, and Susanne Yelin for useful discussions. WZ is supported by ARO Grant W911NF-18-1-0101; the Gordon and Betty Moore Foundation Grant, under No. GBMF4343; and the Henry W. Kendall (1955) Fellowship Fund. JMG is funded by the AFOSR, under Grant FA9950-17-1-0136. SM was supported partially by the Moore Foundation, via the Physics of Living Systems Fellowship. This material is based upon work supported by, or in part by, the Air Force Office of Scientific Research, under award number FA9550-19-1-0411. JLE has been funded by the Air Force Office of Scientific Research Grant FA9550-17-1-0136 and by the James S. McDonnell Foundation Scholar Grant 220020476. NYH is grateful for an NSF grant for the Institute for Theoretical Atomic, Molecular, and Optical Physics at Harvard University and the Smithsonian Astrophysical Observatory. NYH also thanks CQIQC at the University of Toronto, the Fields Institute, and Caltech's Institute for Quantum Information and Matter (NSF Grant PHY-1733907) for their hospitality during the development of this paper. These authors contributed equally: Weishun Zhong and Jacob M. Gold. Author Contributions. J.M.G. simulated the spin glass. W.Z. built the machine-learning code and processed the spin-glass data. S.M. built the novelty-detection code. N.Y.H. managed the project and wrote the manuscript. All authors (W.Z., J.M.G., S.M., J.L.E., and N.Y.H.) contributed to the project design and data analysis. W.Z. and J.M.G. contributed equally. Data availability. The machine-learning and spin-glass-simulation code is available at Ref.20. Will be available once COVID-19 restrictions loosen enough that we can access the computers that store the files. The authors declare no competing interests.

Attached Files

Published - s41598-021-88311-7.pdf

Supplemental Material - 41598_2021_88311_MOESM1_ESM.pdf

Files

s41598-021-88311-7.pdf
Files (3.5 MB)
Name Size Download all
md5:0d0a346684a9db7c07fae4af0c5e804b
2.9 MB Preview Download
md5:6cd8bdf52d303514c70204dbb94d17a0
673.5 kB Preview Download

Additional details

Created:
August 20, 2023
Modified:
October 23, 2023