Q1 Disaster Recovery Exercise

[kiwixbot]

In order to strengthen our infrastructure, we want to:

• Document our Disaster Recovery Plan
• Simulate a Disaster and recover the service to ensure documentation exists and is up to date

This ticket requests the assignees to:

• Pick a Service from Kiwix/openZIM/Offspot
• Redeploy it completly using its backup, using the documentation or writing it.

See Zimfarm documentation.

Note: this is an automatic reminder intended for the assignee(s).

[benoit74]

Should we do the website this quarter?

[benoit74]

Confirmed yesterday in weekly meeting, we will focus on backup of the corporate website for Q1. Quite a significant work probably since we have to put in place a backup strategy and test / document the restore procedure.

[rgaudin]

Backup Startegy:

• add our services node IP to the Cyon whitelist for remote access
• A k8s cronjob similar to other DB backups that connects remotely, dumps and uploads to borgbase (regular process)
• cleanup of files on Cyon storage (there are many leftover files from previous versions)
• PVC that holds an sshfs of the Cyon account
• a k8s cronjob that targets that PVC as /storage and uploads files to a website-files (regular process)

[rgaudin]

Automatic daily backup of Wordpress DB done via 7a2bb69