Andrej Karpathy, previously of OpenAI and now Director of AI at Tesla, is trying to have his Marc Andreessen moment, wherein he creates the mental model for the coming decade in tech. Decide for yourself:
The “classical stack” of Software 1.0 is what we’re all familiar with — it is written in languages such as Python, C++, etc. It consists of explicit instructions to the computer written by a programmer. By writing each line of code, the programmer is identifying a specific point in program space with some desirable behavior. In contrast, Software 2.0 is written in neural network weights.
Pete Warden (Google) adds in his own thoughts in an excellent follow-on post:
I know this will all sound like more deep learning hype, and if I wasn’t in the position of seeing the process happening every day I’d find it hard to swallow too, but this is real. Bill Gates is supposed to have said “Most people overestimate what they can do in one year and underestimate what they can do in ten years“, and this is how I feel about the replacement of traditional software with deep learning. There will be a long ramp-up as knowledge diffuses through the developer community, but in ten years I predict most software jobs won’t involve programming.
These posts are both must-reads.Read more...