Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ollama feature branch #48

Merged
merged 4 commits into from
May 10, 2024
Merged

Conversation

markomanninen
Copy link
Contributor

@markomanninen markomanninen commented May 9, 2024

This PR consists of a Node.js example application that uses vector embeddings with the embedJs RAG module to store the text from various sources in the in-memory vector database, retrieve them with similarity search, and inference results with Ollama Large Language Models.

The main motivation for including Ollama is on the open-source and local running of the RAG applications.

Local embeddings codes have been removed from the PR, and only Ollama's new model-specific changes are maintained.

VCS has structured the README content table a bit. I intended to add only the Ollama part.

@adhityan
Copy link
Collaborator

LGTM. I will merge this now. Changes will be available with the next library version towards end of this week.

@adhityan
Copy link
Collaborator

There is a conflict with main atm. Could you resolve and push again?

@markomanninen
Copy link
Contributor Author

Conflicts solved. Can you get the code from the last PR?

@adhityan adhityan merged commit 6d3bbb3 into llm-tools:main May 10, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants