unsloth installation problem

[hyper11011]

WARNING: Generating metadata for package unsloth produced metadata for project name unknown. Fix your #egg=unsloth fragments.
Discarding git+https://github.com/unslothai/unsloth.git: Requested unknown from git+https://github.com/unslothai/unsloth.git has inconsistent name: filename has 'unsloth', but metadata has 'unknown'
ERROR: Could not find a version that satisfies the requirement unsloth (unavailable) (from versions: none)
ERROR: No matching distribution found for unsloth (unavailable)

[danielhanchen]

Sorry on the delay! Can you copy paste ur exact installation instructions here? Also is this Windows / Linux?

[skerit]

I'm using the llama 3 colab file, but on a vast.ai server:

!pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
!pip install --no-deps "xformers<0.0.26" trl peft accelerate bitsandbytes

I also tried

!pip install "unsloth @ git+https://github.com/unslothai/unsloth.git"
!pip install --no-deps "xformers<0.0.26" trl peft accelerate bitsandbytes

But I got the same error

Collecting unsloth@ git+https://github.com/unslothai/unsloth.git
  Cloning https://github.com/unslothai/unsloth.git to /tmp/pip-install-003vhf9y/unsloth_c51ad7c7d9274626a241db165f755ccb
  Running command git clone --filter=blob:none --quiet https://github.com/unslothai/unsloth.git /tmp/pip-install-003vhf9y/unsloth_c51ad7c7d9274626a241db165f755ccb
  Resolved https://github.com/unslothai/unsloth.git to commit 715e935b5eda5768d1bab6592095dc192ddab7e6
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
  WARNING: Generating metadata for package unsloth produced metadata for project name unknown. Fix your #egg=unsloth fragments.
Discarding git+https://github.com/unslothai/unsloth.git: Requested unknown from git+https://github.com/unslothai/unsloth.git has inconsistent name: filename has 'unsloth', but metadata has 'unknown'
ERROR: Could not find a version that satisfies the requirement unsloth (unavailable) (from versions: none)
ERROR: No matching distribution found for unsloth (unavailable)
Requirement already satisfied: xformers<0.0.26 in /usr/local/lib/python3.10/dist-packages (0.0.25.post1)
Requirement already satisfied: trl in /usr/local/lib/python3.10/dist-packages (0.8.6)
Requirement already satisfied: peft in /usr/local/lib/python3.10/dist-packages (0.11.2.dev0)
Requirement already satisfied: accelerate in /usr/local/lib/python3.10/dist-packages (0.31.0.dev0)
Requirement already satisfied: bitsandbytes in /usr/local/lib/python3.10/dist-packages (0.43.1)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

---

Edit: I'm guessing the docker template I was using on vast.ai was a bit outdated.

After I switched to the Pytorch 2.2.0 cuda12.1 devel template, I had no more issues installing the unsloth package and everything worked as expected.

[danielhanchen]

Great!

[yakov-rakhlin]

i still having the issue when using torch 2.3.0

Collecting unsloth[cu118-torch230]@ git+https://github.com/unslothai/unsloth.git
  Cloning https://github.com/unslothai/unsloth.git to /tmp/pip-install-330e70xt/unsloth_e16b4b10e65e4517bd41fe552a1d709f
  Running command git clone --filter=blob:none --quiet https://github.com/unslothai/unsloth.git /tmp/pip-install-330e70xt/unsloth_e16b4b10e65e4517bd41fe552a1d709f
  Resolved https://github.com/unslothai/unsloth.git to commit b0781339f035c72b3028d846eb2261e8115cd375
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
  WARNING: Generating metadata for package unsloth produced metadata for project name unknown. Fix your #egg=unsloth fragments.
Discarding git+https://github.com/unslothai/unsloth.git: Requested unknown from git+https://github.com/unslothai/unsloth.git has inconsistent name: filename has 'unsloth', but metadata has 'unknown'
ERROR: Could not find a version that satisfies the requirement unsloth (unavailable) (from versions: none)
ERROR: No matching distribution found for unsloth (unavailable)

[danielhanchen]

@yakov-rakhlin What is your python version?

[yakov-rakhlin]

@danielhanchen I'm using python 3.10

[danielhanchen]

@yakov-rakhlin How about

pip install -U xformers --index-url https://download.pytorch.org/whl/cu121
pip install "unsloth[kaggle-new] @ git+https://github.com/unslothai/unsloth.git"

[yakov-rakhlin]

@danielhanchen
still the same issue:

Collecting unsloth[kaggle-new]@ git+https://github.com/unslothai/unsloth.git
  Cloning https://github.com/unslothai/unsloth.git to /tmp/pip-install-06ri50c8/unsloth_c8953b5c6a98482d9d1f77e79f604588
  Running command git clone --filter=blob:none --quiet https://github.com/unslothai/unsloth.git /tmp/pip-install-06ri50c8/unsloth_c8953b5c6a98482d9d1f77e79f604588
  Resolved https://github.com/unslothai/unsloth.git to commit b0781339f035c72b3028d846eb2261e8115cd375
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
  WARNING: Generating metadata for package unsloth produced metadata for project name unknown. Fix your #egg=unsloth fragments.
Discarding git+https://github.com/unslothai/unsloth.git: Requested unknown from git+https://github.com/unslothai/unsloth.git has inconsistent name: filename has 'unsloth', but metadata has 'unknown'
ERROR: Could not find a version that satisfies the requirement unsloth (unavailable) (from versions: none)
ERROR: No matching distribution found for unsloth (unavailable)

update:
I was able to git clone the repo locally and then run:
python3 -m pip install .[kaggle-new]
but the installed packet is UNKNOWN-0.0.0

Processing /opt/unsloth
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Installing backend dependencies ... done
  Preparing metadata (pyproject.toml) ... done
WARNING: unknown 0.0.0 does not provide the extra 'kaggle-new'
Building wheels for collected packages: UNKNOWN
  Building wheel for UNKNOWN (pyproject.toml) ... done
  Created wheel for UNKNOWN: filename=UNKNOWN-0.0.0-py3-none-any.whl size=5138 sha256=5c700b3151ec56bbba31b47fbca6ecbe414d86251db251e286509c78d2e5140f
  Stored in directory: /tmp/pip-ephem-wheel-cache-w5hpzuyy/wheels/82/8b/7d/25be95cdef93115fae5ee7814b3f0ba9af6b449e89f84adee5
Successfully built UNKNOWN
Installing collected packages: UNKNOWN
  Attempting uninstall: UNKNOWN
    Found existing installation: UNKNOWN 0.0.0
    Uninstalling UNKNOWN-0.0.0:
      Successfully uninstalled UNKNOWN-0.0.0
Successfully installed UNKNOWN-0.0.0

[danielhanchen]

@yakov-rakhlin That's extremely weird - Colab works fine right? Windows / Linux?