Engineering is the Bottleneck in Deep Learning Research

The author, a PhD student focused on deep learning, points out some disappointing, although perhaps not surprising, flaws in its research community:

...we’re under-appreciating the fact that we’re dealing with pure software. That sounds obvious, but it’s actually a big deal. Setting up tightly controlled experiments in fields like medicine or psychology is almost impossible and involves an extraordinary amount of work. With software it’s essentially free. It’s more unique than most of us realize. But we’re just not doing it.

The solution? Good old fashioned engineering. Writing and sharing high quality, documented code.


Want to receive more content like this in your inbox?