⭐️ What BERT is Not


Allyson Ettinger, a computational linguist, joins the Data Skeptic podcast to discuss her work in computational linguistics, specifically in exploring some of the ways in which the popular natural language processing approach BERT has limitations.

tl;dr. Although displaying impressive performance, BERT also suffers from surprising weaknesses, from extreme vulnerability to adversarial inputs to exploiting flaws in the benchmark or completely failing to show a generalizable understaning of the meaning of negation within the context of a sensitivity text.


Want to receive more content like this in your inbox?