Word2vec math: king - man + woman = queen, mostly

In Which I Lose My Mind over Embeddings (HPLM Chapter 2)

Word2vec math: king - man + woman = queen, mostly

Maayan Roth tests the famous word embedding equation king - man + woman = queen across three models: text8, enwik9, and GloVe 6B. All three return queen, but other equations fail, like paris - france + italy yielding venice, turin, or rome depending on model size. Roth also built an interactive app to explore word vector arithmetic.

What? How? That sounds completely made up.

More from this day

2026-08-20