Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

OpenSearch and OpenAI #1041

Closed
wants to merge 4 commits into from
+592 −0
Closed

OpenSearch and OpenAI #1041

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
b657809
Aiven for OpenSearch and OpenAI
ftisiot Feb 5, 2024
6bef509
fixed
ftisiot Feb 21, 2024
91c69b0
Merge branch 'main' into main
ftisiot Feb 22, 2024
ab628e4
fixed typo
ftisiot Feb 23, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
7 changes: 7 additions & 0 deletions authors.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,14 @@ ggrn:
website: "https://twitter.com/ggrdson"
avatar: "https://pbs.twimg.com/profile_images/1371549909820657664/ZG-HDNlI_400x400.jpg"


ftisiot:
name: "Francesco Tisiot"
website: "https://ftisiot.net"
avatar: "https://ftisiot.net/images/ftisiot400.png"

teomusatoiu:
name: "Teodora Musatoiu"
website: "https://www.linkedin.com/in/teodora-musatoiu/"
avatar: "https://avatars.githubusercontent.com/u/156829031?s=400&u=af40fe04d9255139eb3bbf8dc83422cc694e862b&v=4"

20 changes: 20 additions & 0 deletions examples/vector_databases/opensearch/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
# OpenSearch

OpenSearch is a popular open-source search/analytics engine and [vector database](https://opensearch.org/platform/search/vector-database.html).
With OpenSearch you can efficiently store and query any kind of data including your vector embeddings at scale.

[Aiven](https://go.aiven.io/openai-opensearch-aiven) provides a way to experience the best of open source data technologies, including OpenSearch, in a secure, well integrated, scalable and trustable data platform. [Aiven for OpenSearch](https://aiven.io/opensearch) allows you to experience OpenSearch in minutes, on all the major cloud vendor and regions, supported by a self-healing platform with a 99.99% SLA.

For technical details, refer to the [OpenSearch documentation](https://opensearch.org/docs/latest/search-plugins/knn/index/).

## OpenAI cookbook notebooks 📒

Check out our notebooks in this repo for working with OpenAI, using OpenSearch as your vector database.

### [Semantic search](aiven-opensearch-semantic-search.ipynb)

In this notebook you'll learn how to:

- Index the OpenAI Wikipedia embeddings dataset into OpenSearch
- Encode a question with the `text-embedding-3-small` model
- Perform a semantic search