Is the non-accelerated model also a quantised version? The EdgeTPU is very efficient, but you can get a significant performance drop unless you take care when converting. Modern CPUs can do classification fast enough that you could do background processing and unless you have really tens of thousands of images, you'd be done in an hour or two