Translations:Word Embeddings/8/en

• Dimensionality — vectors are extremely high-dimensional (typically $ V > 100{,}000 $).
• No similarity — every pair of one-hot vectors is equally distant: $ \mathbf{e}_i^\top \mathbf{e}_j = 0 $ for $ i \neq j $. "Cat" is as far from "dog" as it is from "democracy."