Benchmarking Core ML — Estimating model runtimes on iOS

Jameson Toole has done some extensive measurements of CoreML performance using real architectures and devices. He then used these to infer an estimated runtime of any architecture based on the number of operations used. These may come in handy if you need a rough estimation if your model will work on mobile and don't want to go through the hassle of deploying your model using CoreML.


Want to receive more content like this in your inbox?