Replies: 2 comments
-
Great to see you're looking at WASM! I actually attempted it a few days ago but failed due to the medium model being too big to load (I know, obvious in hindsight). My use case is translation so the tiny model isn't applicable, but this is a really exciting development anyway. |
Beta Was this translation helpful? Give feedback.
0 replies
-
The WASM example is now fully functional: The performance is better than I expected thanks to the WASM SIMD intrinsics. Would love to hear some feedback if someone gives it a try! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
We can easily build
whisper.cpp
as a WASM library using Emscripten:It looks like a big subset of SIMD intrinsics are already supported, so the performance might not be really bad:
https://emscripten.org/docs/porting/simd.html
So let's try running
whisper.cpp
directly in the browser!Beta Was this translation helpful? Give feedback.
All reactions