Hacker News

vood
Ask HN: Best back end to run models on Google TPU?

So, I got Pixel 10 Pro, and I'd like to run parakeet (or whisper) model on it for voice to text. I'm building an ai dictation app (aidictation.com). I'm struggling to find a way to run this model on device. I have to reserve to use groq API, which is suboptimal.

Any recommendations?


amitchandel072 days ago

[dead]

hn-front (c) 2024 voximity
source