Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Windows 11+Conda: What is right version of triton to be used to work with unsloth #460

Open
sumitshrestha opened this issue May 13, 2024 · 1 comment

Comments

@sumitshrestha
Copy link

I am trying to run fine tuning on llama 3 just like others here using unsloth on my local windows 11. I have set up two virtual env one using 3.10 and other using 3.11.
when i installed the packages
conda install pytorch-cuda=<12.1/11.8> pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers
i get error. so, i installed pytorch using command provided in the official website.
when i ran the python script it failed at
from unsloth import FastLanguageModel
the error is

ModuleNotFoundError: No module named 'triton'

So, i tried installing triton using different ways but failed. This morning i downloaded the whl file and installed triton that way. here is the link to it https://pypi.org/project/triton-library/#files. When i installed i got another error related again to triton

ModuleNotFoundError: No module named 'triton.common'

So, what would be right version of triton i should be using with unsloth?

@sumitshrestha sumitshrestha changed the title What is right version of triton to be used to work with unsloth Windows 11+Conda: What is right version of triton to be used to work with unsloth May 13, 2024
@Primary-Ad2848
Copy link

Same problem...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants