New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

I keep getting flash attention error #2

Open

Manfox177 opened this issue Jul 3, 2024 · 0 comments

Manfox177 commented Jul 3, 2024

I keep getting this error everytime i run the train script RuntimeError: FlashAttention only supports Ampere GPUs or newer.

I've checked everywhere how can i fix it and i've also tried turing off and on the bf and tf params but still no progress.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment