Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Update CPP 1.7.2 and 1.7.3 Is Too Slow in Subtitle Edit #2666

Open
abc16361 opened this issue Dec 24, 2024 · 5 comments
Open

New Update CPP 1.7.2 and 1.7.3 Is Too Slow in Subtitle Edit #2666

abc16361 opened this issue Dec 24, 2024 · 5 comments

Comments

@abc16361
Copy link

Hello,

Whisper CPP is used in Subtitle Edit to transcribe audio to text. It has been working pretty smoothly until recent updating to CPP 1.7.2 and 1.7.3. The transcribing process goes much slower in both latest CPP updates; for example, it takes more than 26 minutes to complete the process in CPP 1.7.2 and 1.7.3 on a 5 minutes mp3 file with a medium.en Whisper model, much longer than the time of 5~6 minutes in previous CPP versions. A new file 'openblas.dll' is used in CPP 1.7.2 and 1.7.3, but a file named ' liboenblas.dll' is used instead in previous versions. When the file 'openblas.dll' was replaced with the 'liboenblas.dll', renamed as 'openblas.dll', in CPP 1.7.3, the process finished surprisingly within 2.6 minutes. More details discussion about this issue can be found in SubtitleEdit/subtitleedit#9113.

A Whisper log file used in Subtitle Edit and libopenblas.dll are also attached here, hopefully it helps.
cpp.zip

Thank you!
SE408_CPP172updated
SE410_CPP173

@vivadavid
Copy link

I've also noticed Whisper being much slower in Subtitle Edit recently.

These are some results that I've obtained with the small model on an mp3 audio that is 2 minutes 30 seconds long:

  • Subtitle Edit 4.0.10 using Whisper CPP 1.7.3: 5m 15s.
  • Subtitle Edit 4.0.9 using Whisper CPP 1.7.2: 7m 55s.
  • Subtitle Edit 4.0.8 using Whisper CPP 1.7.1(?): 1m 00s.

@RoyalXXX
Copy link

RoyalXXX commented Dec 25, 2024

I have the same problem. CPP in the latest Subtitle Edit has become very slow, more than 5 times slower than in Subtitle Edit 4.0.8. It was the only fast Whisper engine on devices that don't have RTX. Very sad that it no longer works.

@RoyalXXX
Copy link

@abc16361 are you using the libopenblas file from version SE 4.0.8 for the SE 4.10.0? Did I understand you correctly?

@abc16361
Copy link
Author

@abc16361 are you using the libopenblas file from version SE 4.0.8 for the SE 4.10.0? Did I understand you correctly?

I am still using SE 4.0.8 with ' libopenblas ', but I just tested SE 4.0.10 with ' libopenblas ' from my SE 4.0.8 and the result is pretty good, less than 4 minutes on a 5 minutes mp3, using medium.en model. The way I did is:

  • setup FFmpeg first on a brand new SE 4.0.10;
  • download CPP on SE 4.0.10, then 13 files would be downloaded into Cpp folder;
  • copy the file ' libopenblas.dll ' into the Cpp folder in SE 4.0.10;
  • rename file ' openblas.dll ' as ' openblas.dll bk ' in Cpp folder so that it won't be used;
  • then rename ' libopenblas.dll ' as ' openblas.dll ' so that it can be used in SE 4.0.10
  • copy medium.en model to Models folder;
  • then start to run

The transcript is accurate as that on SE 4.0.8.

@RoyalXXX
Copy link

@abc16361 thank you very much for the detailed explanation. But I will also stay on version 4.0.8. I'll wait until this problem is fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants