Translations:Overfitting and Regularization/34/en: Difference between revisions
(Importing a new version from external source) |
(Importing a new version from external source) Tag: Manual revert |
||
| Line 1: | Line 1: | ||
* ''' | * '''Batch normalization''' — normalising layer inputs reduces internal covariate shift and has a mild regularizing effect. | ||
* '''Label smoothing''' — replaces | * '''Label smoothing''' — replaces one-hot targets with a mixture, e.g. <math>y_{\text{smooth}} = (1 - \epsilon)\, y + \epsilon / C</math>, preventing overconfidence. | ||
* '''Noise injection''' — adding Gaussian noise to inputs, weights, or gradients during training. | * '''Noise injection''' — adding Gaussian noise to inputs, weights, or gradients during training. | ||
Revision as of 22:02, 27 April 2026
- Batch normalization — normalising layer inputs reduces internal covariate shift and has a mild regularizing effect.
- Label smoothing — replaces one-hot targets with a mixture, e.g. $ y_{\text{smooth}} = (1 - \epsilon)\, y + \epsilon / C $, preventing overconfidence.
- Noise injection — adding Gaussian noise to inputs, weights, or gradients during training.