Skip to content

Top New Best Ask Show Jobs

Are there any AI speech-to-text model that can run locally on Mobile devices? | Better HN

Are there any AI speech-to-text model that can run locally on Mobile devices?

1 pointsimshashank1y ago6 comments

6 comments

FloatArtifact1y ago

https://voiceinput.futo.org/

imshashankOP1y ago

Thanks for sharing.

jaggs1y ago

Layla Lite? App.

imshashankOP1y ago

Wow, so it's possible. Any idea how are they doing this?

jaggs1y ago

Maybe a really tiny LLM? Like this? https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-gguf/blo...

[Edit: just checked Reddit and it's apparently a 3B model (phi 2)]

https://www.reddit.com/r/LocalLLaMA/comments/1bpw9c7/running...

j / k navigate · click thread line to collapse