File:NTK evolution.gif

Original file(900 × 600 pixels, file size: 3.96 MB, MIME type: image/gif, looped, 116 frames, 4.6 s)

Summary

Description
English: At initialization, an ensemble of wide neural networks is a zero-mean Gaussian process; during training (gradient descent on mean-square error), the ensemble evolves according to the neural tangent kernel. The converged ensemble is a Gaussian process whose mean is the ridgeless kernel regression estimator and whose variance vanishes on the training points.
Date
Source Own work
Author Dkarkada

Licensing

I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

Captions

Add a one-line explanation of what this file represents

Items portrayed in this file

depicts

29 April 2023

image/gif

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current17:15, 8 May 2023Thumbnail for version as of 17:15, 8 May 2023900 × 600 (3.96 MB)Dkarkadachange xaxis label
05:23, 3 May 2023Thumbnail for version as of 05:23, 3 May 2023900 × 600 (3.94 MB)Dkarkadaclarified NTK curve in the legend
05:14, 3 May 2023Thumbnail for version as of 05:14, 3 May 2023900 × 600 (3.74 MB)DkarkadaUploaded while editing "Neural tangent kernel" on en.wikipedia.org
The following pages on the English Wikipedia use this file (pages on other projects are not listed):