Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't interact with model when using LM Studio embedding model #219

Open
tiammue opened this issue Oct 26, 2024 · 1 comment
Open

Can't interact with model when using LM Studio embedding model #219

tiammue opened this issue Oct 26, 2024 · 1 comment

Comments

@tiammue
Copy link

tiammue commented Oct 26, 2024

When I use "nomic-ai/nomic-embed-text-v1.5-GGUF/nomic-embed-text-v1.5.f32.gguf" via LM Studio and interact with the AI, I get the following error message:

Traceback (most recent call last):
File "C:\Users\username.conda\envs\a0\Lib\site-packages\langchain_community\vectorstores\faiss.py", line 304, in similarity_search_with_score_by_vector
scores, indices = self.index.search(vector, k if filter is None else fetch_k)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\username.conda\envs\a0\Lib\site-packages\faiss\class_wrappers.py", line 329, in replacement_search
assert d == self.d
^^^^^^^^^^^
AssertionError

using Windows 11 24H2 Build 26100.2033 and

Agent Zero 0.7 built on 2024-10-6

initialize.py.txt
(renamed it to .txt to upload it)

It works fine when using openAI as the embedding model provider.

@thinkyhead
Copy link

Same error on macOS with…

embedding_llm = models.get_ollama_embedding(model_name="nomic-embed-text")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants