Characterizing Departures from Linearity in Word Translation (ACL 2018)

nakashole.com

Nakashole and Flauger show that mapping two monolingual word embedding spaces in different languages onto each other requires a non-linear mapping (current approaches all use a linear transformation). This is similar to the finding in our ACL 2018 paper that monolingual embedding spaces are not approximately isomorphic. The authors illustrate this by locally approximating these maps using linear maps for each neighbourhood and find that they vary across word embedding space. In addition, they find that the amount of variation is tightly correlated with the distance between the neighbourhoods.

Read more...
Linkedin

Want to receive more content like this in your inbox?