Translations:Overfitting and Regularization/34/en

    From Marovi AI
    Revision as of 00:30, 27 April 2026 by FuzzyBot (talk | contribs) (Importing a new version from external source)
    (diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
    • Batch normalization — normalising layer inputs reduces internal covariate shift and has a mild regularizing effect.
    • Label smoothing — replaces one-hot targets with a mixture, e.g. $ y_{\text{smooth}} = (1 - \epsilon)\, y + \epsilon / C $, preventing overconfidence.
    • Noise injection — adding Gaussian noise to inputs, weights, or gradients during training.