Pythagora-io/ GPT-pilot

Ported to Ollama docker Compose

Ollama Pilot Docker Container Template

• Install Ollama Server with ROCm GPU
• Make Sure that you have the following Images:

llama3:8b-instruct-q6_K

Install Miniconda

wget https://raw.githubusercontent.com/hqnicolas/Ollama-Pilot-CasaOs/main/install_miniconda.sh
sudo chmod 777 install_miniconda.sh
sudo ./install_miniconda.sh

• install CasaOs

sudo apt-get update -y
sudo apt-get install curl -y
wget -qO- https://get.casaos.io/v0.4.7 | sudo bash
# for newer version: curl -fsSL https://get.casaos.io | sudo bash

Install Docker-Compose

wget https://raw.githubusercontent.com/hqnicolas/Ollama-Pilot-CasaOs/main/install_docker.sh
sudo chmod 777 docker.sh
sudo ./docker.sh

Install Postgres

wget https://raw.githubusercontent.com/hqnicolas/Ollama-Pilot-CasaOs/main/install_postgres.sh
sudo chmod 777 install_postgres.sh
sudo ./install_postgres.sh

-Clone Pythagora Repo. -Configure docker-compose.yml

git clone https://github.com/Pythagora-io/gpt-pilot.git
cd gpt-pilot
wget https://raw.githubusercontent.com/hqnicolas/Ollama-Pilot-CasaOs/main/casaos-compose.yaml
sudo rm docker-compose.yml
mv casaos-compose.yaml docker-compose.yml
nano docker-compose.yml

Example

• Edit casaos-compose.yaml to point for Ollama Server

• OPENAI_ENDPOINT=http://10.1.1.1:11434/v1/chat/completions

Configure .env

cd pilot
mv .env.example .env
# Edit the file .env with your config
nano .env

• OPENAI_ENDPOINT=http://10.1.1.1/:11434/v1/chat/completions
• OPENAI_API_KEY=ollama
• DB_NAME=pilot
• DB_HOST=postgres
• DB_PORT=5432
• DB_USER=pilot
• DB_PASSWORD=pilot
• MODEL_NAME=llama3:8b-instruct-q6_K

Build

cd ..
sudo docker compose build gpt-pilot
sudo docker compose up gpt-pilot

• web browser to http://localhost:7681/

python main.py

• Output Folder:

/DATA/Downloads/pythagora/gpt-pilot/workspace/