Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unable to compile for ROCM on Ubuntu 22.04 #134

Open
bugfixin opened this issue Sep 16, 2023 · 1 comment · May be fixed by #136
Open

Unable to compile for ROCM on Ubuntu 22.04 #134

bugfixin opened this issue Sep 16, 2023 · 1 comment · May be fixed by #136

Comments

@bugfixin
Copy link

Using the command $ CC="/opt/rocm/llvm/bin/clang" CXX="/opt/rocm/llvm/bin/clang++" CT_HIPBLAS=1 pip install ctransformers --no-binary ctransformers I am unable to compile ctransformers for ROCM. I've tried with ROCM 5.5.3 as well as 5.6.1, and for ctransformers versions 0.2.26 and 0.2.27.

Each time I get an error: /models/ggml/ggml-cuda-ggllm.h:15:37: error: array has incomplete element type 'struct cudaDeviceProp'

Full error (2799 lines...) attached.

Am I doing something wrong or missing some dependencies? I've tried without the CC and CXX variables set, but that fails even earlier as it tries to compile with the standard gcc utilities.

ctransformers-error.txt
@muaiyadh muaiyadh linked a pull request Sep 17, 2023 that will close this issue
Open
@huotianyu
Copy link

the below command worked well！
CMAKE_ARGS="-DLLAMA_HIPBLAS=on -DLLAMA_CLBLAST=on -DCMAKE_C_COMPILER=/opt/rocm/llvm/bin/clang -DCMAKE_CXX_COMPILER=/opt/rocm/llvm/bin/clang++ -DCMAKE_PREFIX_PATH=/opt/rocm" FORCE_CMAKE=1 pip install ctransformers --no-binary ctransformers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Remove GGML_USE_CUBLAS when CT_HIPBLAS is defined muaiyadh/ctransformers
2 participants
@huotianyu @bugfixin