Skip to content

Latest commit

 

History

History
 
 

wchess

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 

wchess

Voice-controlled chess using Whisper

Online demo: https://whisper.ggerganov.com/wchess/

wchess-0.mp4

Command-line tool

mkdir build && cd build
cmake -DWHISPER_SDL2=1 ..
make -j

./bin/wchess -m ../models/ggml-base.en.bin

Move: start

a b c d e f g h
r n b q k b n r 8
p p p p p p p p 7
. * . * . * . * 6
* . * . * . * . 5
. * . * . * . * 4
* . * . * . * . 3
P P P P P P P P 2
R N B Q K B N R 1

White's turn
[(l)isten/(p)ause/(q)uit]: 

TODO

  • Fix bugs in the chess moves logic
  • Improve web-browser audio capture - sometimes it does not record the voice properly
  • Add support for more languages by making the generated grammar string multilingual
  • Explore ways to improve the dynamic grammar to be narrower

PRs welcome!

Thanks

  • chessboardjs for the neat chessboard JS library used in this demo