Jamming in multilayer supervised learning models - Archive ouverte HAL Access content directly
Journal Articles Physical Review Letters Year : 2019

Jamming in multilayer supervised learning models


Critical jamming transitions are characterized by an astonishing degree of universality. Analytic and numerical evidence points to the existence of a large universality class that encompasses finite and infinite dimensional spheres and continuous constraint satisfaction problems (CCSP) such as the non-convex perceptron and related models. In this paper we investigate multilayer neural networks (MLNN) learning random associations as models for CCSP which could potentially define different jamming universality classes. As opposed to simple perceptrons and infinite dimensional spheres, which are described by a single effective field in terms of which the constraints appear to be one-dimensional, the description of MLNN, involves multiple fields, and the constraints acquire a multidimensional character. We first study the models numerically and show that similarly to the perceptron, whenever jamming is isostatic, the sphere universality class is recovered, we then write the exact mean-field equations for the models and identify a dimensional reduction mechanism that leads to a scaling regime identical to one of the infinite dimensional spheres. We suggest that this mechanism could be general enough to explain finite dimensional universality.
Fichier principal
Vignette du fichier
1809.09945 (911.38 Ko) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

hal-02395521 , version 1 (19-12-2023)



Silvio Franz, Sungmin Hwang, Pierfrancesco Urbani. Jamming in multilayer supervised learning models. Physical Review Letters, 2019, 123 (16), ⟨10.1103/PhysRevLett.123.160602⟩. ⟨hal-02395521⟩
93 View
1 Download



Gmail Facebook X LinkedIn More