Skip to content

Latest commit

 

History

History
118 lines (81 loc) · 4.49 KB

README.md

File metadata and controls

118 lines (81 loc) · 4.49 KB
Raw

logo

Dria Compute Node

Dria Compute Node serves the computation results within Dria Knowledge Network.

License: Apache-2.0 Workflow: Tests Docker Version Discord

About

A Dria Compute Node is a unit of computation within the Dria Knowledge Network. It's purpose is to process tasks given by the Dria Admin Node. To get started, see node guide!

Tasks

Compute nodes can technically do any arbitrary task, from computing the square root of a given number to finding LLM outputs from a given prompt, or validating an LLM's output with respect to knowledge available on the web accessed via tools.

  • Ping/Pong: Dria Admin Node broadcasts ping messages at a set interval, it is a required duty of the compute node to respond with a pong to these so that they can be included in the list of available nodes for task assignment. These tasks will respect the type of model provided within the pong message, e.g. if a task requires gpt-4o and you are running phi3, you won't be selected for that task.

  • Workflows: Each task is given in the form of a workflow, based on Ollama Workflows. In simple terms, each workflow defines the agentic behavior of an LLM, all captured in a single JSON file, and can represent things ranging from simple LLM generations to iterative web searching.

Node Running

Refer to node guide to quickly get started and run your own node!

Releases

For production images:

  • Versioned: With each release, a versioned image is deployed on Docker hub with the version tag :vX.X.X.
  • Latest: The latest production image is always under the :latest tag.

For development images:

  • Master: On each push to master branch, a new image is created with the tag master-<commit>-<timestamp>.
  • Unstable: The latest development image is always under the :unstable tag.

You can see the list of deployed images on Docker Hub.

Development

If you have a feature that you would like to add with respect to its respective issue, or a bug fix, feel free to fork & create a PR!

If you would like to run the node from source (which is really handy during development), you can use our shorthand scripts within the Makefile. You can see the available commands with:

make help

You will need OpenSSL installed as well, see shorthand commands here. While running Ollama elsewhere (if you are using it) or with an OpenAI API key provided, you can run the compute node with:

make run      # info-level logs
make debug    # debug-level logs

If you have a valid .env file, you can run the latest Docker image via compose as well:

docker compose up

# Ollama without any GPUs
docker compose --profile=ollama-cpu up
# Ollama for NVIDIA gpus
docker compose --profile=ollama-cuda up
# Ollama for AMD gpus
docker compose --profile=ollama-rocm up

Testing

You can the tests as follows:

make test

We also have some benchmarking and profiling scripts, see node performance for more details.

Documentation

You can view the inline documentation with:

make docs

Styling

Lint and format with:

make lint   # clippy
make format # rustfmt

License

This project is licensed under the Apache License 2.0.