rook-ceph

Set up Rook Ceph on a bare-metal cluster

Prerequisites

• Virtualbox
• Vagrant
• Ansible
• Helm

Set up Kubernetes cluster

Bring up VMs: 1 master and 3 workers.

cd rook-ceph
vagrant up

SSH into k8s-worker-1, then list block devices.

ssh [email protected]
lsblk

Provision a cluster

cd ../create-single-master-cluster
ansible-playbook -i playbook/inventory.yml playbook/playbook.yml

Download kubeconfig to your local

mkdir ~/.kube-local
scp [email protected]:/home/ci/.kube/config ~/.kube-local/config
export KUBECONFIG=~/.kube-local/config && kubectl get nodes

Deploy Ceph Operator

helm repo add rook-release https://charts.rook.io/release
helm upgrade --install --create-namespace --namespace rook-ceph rook-ceph rook-release/rook-ceph

kubectl --namespace rook-ceph get pods -l "app=rook-ceph-operator"

Deploy Ceph Cluster

helm repo add rook-release https://charts.rook.io/release
helm upgrade --install --create-namespace --namespace rook-ceph rook-ceph-cluster \
   --set operatorNamespace=rook-ceph rook-release/rook-ceph-cluster

kubectl --namespace rook-ceph get pods

Verify that the cluster is in a healthy state.

cd ../rook-ceph
kubectl create -f toolbox.yml
kubectl -n rook-ceph rollout status deploy/rook-ceph-tools
kubectl -n rook-ceph exec -it deploy/rook-ceph-tools -- bash

ceph status