Translations:Attention Mechanisms/15/en: Difference between revisions

    From Marovi AI
    (Importing a new version from external source)
    (Importing a new version from external source)
    Tag: Manual revert
     
    (One intermediate revision by the same user not shown)
    (No difference)

    Latest revision as of 23:33, 27 April 2026

    Information about message (contribute)
    This message has no documentation. If you know where or how this message is used, you can help other translators by adding documentation to this message.
    Message definition (Attention Mechanisms)
    Vaswani et al. (2017) introduced the formulation used in the {{Term|transformer}}. Given matrices of queries <math>Q</math>, keys <math>K</math>, and values <math>V</math>:

    Vaswani et al. (2017) introduced the formulation used in the transformer. Given matrices of queries $ Q $, keys $ K $, and values $ V $: