Data Warehouse Restic-Docker Backup System

This project sets up a simple and secure backup system using Restic on Docker

🚀 Features

• Automated Backups: Back up multiple Docker volumes using Restic.
• Snapshot Management: Easily manage and restore snapshots.
• Customizable: Modify the backup script to suit your needs.

---

📋 Prerequisites

1. Docker: Ensure Docker is installed on your system. Install Docker.
2. Docker Compose: Ensure Docker Compose is installed. Install Docker Compose.

---

🛠️ Setup Instructions

1. Clone the Repository

cd restic

2. Restic Monitors and Backs Up the Following Volumes

Restic is configured to back up data from several external Docker volumes on Redback VM. Before running the backup system, make sure these volumes exist.

data-lakehouse_minio-data
data-lakehouse_minio-config
fileuploadservice_dremio-data
dp-postgres-data
dp-es-data
dp-logstash-data

Run the following commands to create them:

docker volume create data-lakehouse_minio-data
docker volume create data-lakehouse_minio-config
docker volume create fileuploadservice_dremio-data
docker volume create dp-postgres-data
docker volume create dp-es-data
docker volume create dp-logstash-data

3. Configure Restic Password

Create a restic-password.txt file in the project directory and add your Restic repository password:

your-secure-password

4. Make Scripts Executable

Ensure the backup script is executable:

chmod +x scripts/backup.sh

---

▶️ Running the Backup System

Start the Restic Container

Run the following command to start the Restic container:

docker-compose up -d

Verify the Logs

Check the logs of the `restic container to ensure backups are running:

docker logs -f restic-backup

---

🔄 Managing Snapshots

List Available Snapshots

To list all available snapshots, run:

docker exec -it restic-backup sh

Restore a Snapshot

To restore a specific snapshot, use the following command:

restic restore `snapshot-id` --target /restore

Replace <snapshot-id> with the ID of the snapshot you want to restore.

Access Restored Files

The restored files will be available in the ./restore directory on your host machine.

---

🛑 Stopping the Backup System

To stop the Restic container, run:

docker-compose down

---

📝 Notes

• Ensure all required volumes are created before starting the container.
• Modify the backup.sh script to customize the backup process.
• Use docker-compose logs to troubleshoot any issues.

---

📖 Resources

• Restic Documentation
• Docker Documentation
• Docker Compose Documentation