Translations:Word Embeddings/24/en - Revision history

FuzzyBot: Importing a new version from external source

2026-04-27T23:34:55Z

Importing a new version from external source

← Older revision		Revision as of 23:34, 27 April 2026
Line 1:		Line 1:
	* '''Negative sampling''' — instead of computing the full softmax, the model contrasts the true context word against <math>k</math> randomly sampled "negative" words.		* '''Negative sampling''' — instead of computing the full {{Term\|softmax}}, the model contrasts the true context word against <math>k</math> randomly sampled "negative" words.
	* '''Hierarchical softmax''' — organises the vocabulary in a binary tree, reducing the softmax cost from <math>O(V)</math> to <math>O(\log V)</math>.		* '''Hierarchical {{Term\|softmax}}''' — organises the vocabulary in a binary tree, reducing the {{Term\|softmax}} cost from <math>O(V)</math> to <math>O(\log V)</math>.

FuzzyBot: Importing a new version from external source

2026-04-27T22:01:53Z

Importing a new version from external source

← Older revision		Revision as of 22:01, 27 April 2026
Line 1:		Line 1:
	* '''Negative sampling''' — instead of computing the full ~~{{Term\|~~softmax}}, the model contrasts the true context word against <math>k</math> randomly sampled "negative" words.		* '''Negative sampling''' — instead of computing the full softmax, the model contrasts the true context word against <math>k</math> randomly sampled "negative" words.
	* '''Hierarchical ~~{{Term\|~~softmax}}''' — organises the vocabulary in a binary tree, reducing the ~~{{Term\|~~softmax}} cost from <math>O(V)</math> to <math>O(\log V)</math>.		* '''Hierarchical softmax''' — organises the vocabulary in a binary tree, reducing the softmax cost from <math>O(V)</math> to <math>O(\log V)</math>.

FuzzyBot: Importing a new version from external source

2026-04-27T19:42:30Z

Importing a new version from external source

← Older revision		Revision as of 19:42, 27 April 2026
Line 1:		Line 1:
	* '''Negative sampling''' — instead of computing the full softmax, the model contrasts the true context word against <math>k</math> randomly sampled "negative" words.		* '''Negative sampling''' — instead of computing the full {{Term\|softmax}}, the model contrasts the true context word against <math>k</math> randomly sampled "negative" words.
	* '''Hierarchical softmax''' — organises the vocabulary in a binary tree, reducing the softmax cost from <math>O(V)</math> to <math>O(\log V)</math>.		* '''Hierarchical {{Term\|softmax}}''' — organises the vocabulary in a binary tree, reducing the {{Term\|softmax}} cost from <math>O(V)</math> to <math>O(\log V)</math>.

FuzzyBot: Importing a new version from external source

2026-04-27T00:31:06Z

Importing a new version from external source

New page

* '''Negative sampling''' — instead of computing the full softmax, the model contrasts the true context word against <math>k</math> randomly sampled "negative" words.
* '''Hierarchical softmax''' — organises the vocabulary in a binary tree, reducing the softmax cost from <math>O(V)</math> to <math>O(\log V)</math>.