Translations:Softmax Function/17/en: Difference between revisions

Latest revision as of 23:34, 27 April 2026

Information about message (contribute)

This message has no documentation. If you know where or how this message is used, you can help other translators by adding documentation to this message.

Message definition (Softmax Function)

A naive implementation of softmax can overflow when {{Term|logits}} are large (e.g., <math>e^{1000}</math> is infinite in floating point). The standard fix subtracts the maximum {{Term|logits|logit}}:

A naive implementation of softmax can overflow when logits are large (e.g., $e^{1000}$ is infinite in floating point). The standard fix subtracts the maximum logit:

Revision as of 00:30, 27 April 2026 (view source) FuzzyBot (talk \| contribs) (Importing a new version from external source)		Latest revision as of 23:34, 27 April 2026 (view source) FuzzyBot (talk \| contribs) (Importing a new version from external source) Tag: Manual revert
(2 intermediate revisions by the same user not shown)
Line 1:		Line 1:
	A naive implementation of softmax can overflow when logits are large (e.g., <math>e^{1000}</math> is infinite in floating point). The standard fix subtracts the maximum logit:		A naive implementation of softmax can overflow when {{Term\|logits}} are large (e.g., <math>e^{1000}</math> is infinite in floating point). The standard fix subtracts the maximum {{Term\|logits\|logit}}: