File:Double descent in a two-layer neural network (Figure 3a from Rocks et al. 2022).png

Original file(3,302 × 1,530 pixels, file size: 396 KB, MIME type: image/png)

Summary

Description
English: A plot used as an illustration of the double descent phenomenon in deep learning in [1] ("test error falls, rises, then falls as a ratio of parameters to data").

From the original publication:

"we plot the training error, test error, bias, and variance as a function of for fixed (more data points than input features [... for a] Random nonlinear features model (two-layer neural network). Analytic solutions for the ensemble-averaged [...] training error (blue squares) and test error (black circles) [...are] plotted as a function of for fixed . Analytic solutions are indicated as dashed lines with numerical results shown as points. [...] a black dashed line marks the boundary between the under and overparameterized regimes at ."
Date
Source Jason W. Rocks and Pankaj Mehta: Memorizing without overfitting: Bias, variance, and interpolation in overparameterized models. Phys. Rev. Research 4, 013201 – Published 15 March 2022. https://doi.org/10.1103/PhysRevResearch.4.013201
Author Jason W. Rocks and Pankaj Mehta

Licensing

w:en:Creative Commons
attribution
This file is licensed under the Creative Commons Attribution 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.

Captions

Add a one-line explanation of what this file represents

Items portrayed in this file

depicts

15 March 2022

image/png

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current17:57, 4 June 2023Thumbnail for version as of 17:57, 4 June 20233,302 × 1,530 (396 KB)HaeBUploaded a work by Jason W. Rocks and Pankaj Mehta from Jason W. Rocks and Pankaj Mehta: Memorizing without overfitting: Bias, variance, and interpolation in overparameterized models. Phys. Rev. Research 4, 013201 – Published 15 March 2022. https://doi.org/10.1103/PhysRevResearch.4.013201 with UploadWizard
The following pages on the English Wikipedia use this file (pages on other projects are not listed):

Metadata