Translations:Softmax Function/17/en

    From Marovi AI
    Revision as of 22:02, 27 April 2026 by FuzzyBot (talk | contribs) (Importing a new version from external source)

    A naive implementation of softmax can overflow when logits are large (e.g., $ e^{1000} $ is infinite in floating point). The standard fix subtracts the maximum logit: