which is odd, because nearly every modern cpu has some sort of hardware acceleration available for AI stuff... has the tech stack just become so convoluted that we're actually going backwards?

I do with they had OSS'ed the code for at least the desktop app, but maybe there were licensing issues? or just no one cared.