Skip to content

Latest commit

 

History

History
37 lines (28 loc) · 1.13 KB

README.md

File metadata and controls

37 lines (28 loc) · 1.13 KB
Raw

Sandwich Chatbot

This app uses an existing ollama instance to expose an api endpoint for a chatbot about sandwiches.

You can attach the app using the following command:

fly launch --attach --from https://github.com/fly-apps/sandwich-chatbot

Note

You need to run an ollama instance and specify the OLLAMA_HOST env variable in the fly.toml You can spin up an instance using fly launch --from https://github.com/fly-apps/hello-ollama --flycast --name <your-app> Refer to the repository for more information.

Running the app

First, you will have to specify an OLLAMA_HOST. Make sure your ollama has the llama3.1 model available. To run the app for local development:

fastapi dev

Once the app is up, you can use the chatbot:

curl -X POST "http://localhost:8000/sandwich-chat" \
   -H "Content-Type: application/json" \
   -d '{"session_id": "xyz", "query": "whats a sandwich?"}'
curl -X POST "http://localhost:8000/sandwich-chat" \
   -H "Content-Type: application/json" \
   -d '{"session_id": "xyz", "query": "repeat the last sentence"}'