| Both sides previous revisionPrevious revisionNext revision | Previous revisionLast revisionBoth sides next revision |
| computing:rsyncrsnapshot [2020/01/27 20:08] – oemb1905 | computing:rsyncrsnapshot [2023/04/10 21:16] – oemb1905 |
|---|
| ------------------------------------------- | ------------------------------------------- |
| |
| Let's start with rsnapshot. Before you begin, you must already know how to add a hard drive to your system, a mount point, and an appropriate fstab entry. This also assumes you have an MTA properly set-up in order to send email. To create a basic configuration, do the following: | Since I am backing up multiple remote hosts, I chose to create separate configs for each remote host instead of putting those destinations in the ''/etc/rsnapshot.conf'' together with the localhost/backup server. I have the config set to retain 90 days worth of backups called "alpha" and it is set to sync first. The localhost configuration is as follows: |
| | |
| | #base config |
| | config_version 1.2 |
| | snapshot_root /mnt/backups/rsnapback/localhost.domain/ |
| | cmd_cp /bin/cp |
| | cmd_rm /bin/rm |
| | cmd_rsync /usr/bin/rsync |
| | cmd_ssh /usr/bin/ssh |
| | cmd_logger /usr/bin/logger |
| | verbose 2 |
| | loglevel 3 |
| | logfile /var/log/rsnapshot.log |
| | sync_first 1 |
| | use_lazy_deletes 1 |
| | retain alpha 90 |
| | #localhost |
| | backup /home/ home/ |
| | backup /etc/ etc/ |
| | backup /usr/local/bin/ bin/ |
| | backup /root/ root/ |
| | backup /var/www/ www/ |
| | |
| | Then, to run this, I use a simple script I created. Again, this script is just for running the localhost, so it can also be used for someone's single desktop: |
| | |
| | #!/bin/bash |
| | service="/usr/bin/rsnapshot" |
| | logfile="/home/logs/tempa.log" |
| | START1="$(date +%s)" |
| | touch $logfile |
| | $service -V sync > $logfile |
| | END1="$(date +%s)" |
| | DURATION1=$[ ${END1} - ${START1} ] |
| | MINUTES=$[ ${DURATION1} / 60 ] |
| | sed -i "1s/^/Jonathan, at $(date), the rsnapshot sync took exactly ${DURATION1} seconds which is approximately ${MINUTES} minutes to complete.\n/" $logfile |
| | if |
| | tail -n -5 $logfile | grep "completed" |
| | then |
| | START1="$(date +%s)" |
| | echo "Jonathan, at $(date), the sync has completed and I am now running alpha." |
| | $service -V alpha >> $logfile |
| | END1="$(date +%s)" |
| | DURATION1=$[ ${END1} - ${START1} ] |
| | MINUTES=$[ ${DURATION1} / 60 ] |
| | sed -i "1s/^/Jonathan, at $(date), the rsnapshot alpha took exactly ${DURATION1} seconds which is approximately ${MINUTES} minutes to complete.\n/" $logfile |
| | mail -s "[$(hostname -f)]-rsnap-success-$(date)" alerts@alerts.com < $logfile |
| | rm $logfile |
| | chown user:user -R /mnt/backups/rsnapback/localhost.domain/ |
| | chmod 770 -R /mnt/backups/rsnapback/localhost.domain/ |
| | else |
| | echo "Jonathan, at $(date), the sync has failed and I am now notifying you." |
| | mail -s "[$(hostname -f)]-rsnap-failure-$(date)" alerts@alerts.com < $logfile |
| | rm $logfile |
| | fi |
| | |
| | Then, in ''/etc/cron.d/rsnapshot'', I set up a cronjob to run this script on a schedule. For my particular use case, twice a day is sufficient, but this can obviously be adjusted to the user's needs: |
| | |
| | 0 0,14 * * * root /bin/bash /usr/local/bin/rsnap-alpha-netback.jonathanhaack.com.sh > /dev/null 2>&1 |
| | |
| | Now that the localhost/backup server is backing up it's own essential boot volume files to the backup zpool, it's time to create the configs and scripts for the remote hosts. In my case, I have over 15 remote hosts set up this way, so I will highlight the setup for one in order to demonstrate what I've done. First, create a directory for the configs such as ''/etc/rsnapshot/'' and then create a config file within it such as ''/etc/rsnapshot/rsnapshot-domain.com.conf''. The config for the remote host looks very similar to the localhost config, but it has syntax for connecting to the remote host. Of course, make sure that you have properly exchanged ssh keys and installed rsync on the remote host before proceeding: |
| | |
| | #base config |
| | config_version 1.2 |
| | snapshot_root /mnt/backups/rsnapback/domain.com/ |
| | cmd_cp /bin/cp |
| | cmd_rm /bin/rm |
| | cmd_rsync /usr/bin/rsync |
| | cmd_ssh /usr/bin/ssh |
| | cmd_logger /usr/bin/logger |
| | verbose 2 |
| | loglevel 3 |
| | logfile /var/log/rsnapshot.log |
| | sync_first 1 |
| | use_lazy_deletes 1 |
| | retain alpha 90 |
| | #directories |
| | backup root@domain.com:/etc/ etc/ |
| | backup root@domain.com:/usr/local/bin/ bin/ |
| | backup root@domain.com:/var/www/ www/ |
| | backup root@domain.com:/home/ home/ |
| | backup root@domain.com:/root/ root/ |
| | |
| | Now that the config is setup, you use a script very similar to the localhost script above, but note the syntax changes for sync and alpha that will specify to rsnapshot to use this particular configuration file. Additionally, just like the localhost, I specified for rsnapshot to retain a snapshot called alpha for 90 days, which suits my use case. Here's the script for the remote hosts: |
| | |
| | #!/bin/bash |
| | service="/usr/bin/rsnapshot" |
| | logfile="/home/sexa/logs/domain.com.log" |
| | host="domain.com" |
| | START1="$(date +%s)" |
| | touch $logfile |
| | $service -c /etc/rsnapshot/rsnapshot-$host.conf -V sync > $logfile |
| | END1="$(date +%s)" |
| | DURATION1=$[ ${END1} - ${START1} ] |
| | MINUTES=$[ ${DURATION1} / 60 ] |
| | sed -i "1s/^/Jonathan, at $(date), the rsnapshot sync took exactly ${DURATION1} seconds which is approximately ${MINUTES} minutes to complete.\n/" $logfile |
| | if |
| | tail -n -5 $logfile | grep "completed" |
| | then |
| | START1="$(date +%s)" |
| | echo "Jonathan, at $(date), $(hostname -f) ran a sync that completed so I am now running alpha." |
| | $service -c /etc/rsnapshot/rsnapshot-$host.conf -V alpha >> $logfile |
| | END1="$(date +%s)" |
| | DURATION1=$[ ${END1} - ${START1} ] |
| | MINUTES=$[ ${DURATION1} / 60 ] |
| | sed -i "1s/^/Jonathan, at $(date), the rsnapshot alpha took exactly ${DURATION1} seconds which is approximately ${MINUTES} minutes to complete.\n/" $logfile |
| | #echo "Jonathan, at $(date), the rsnapshot alpha took exactly ${DURATION1} seconds which is approximately ${MINUTES} minutes to complete." | tee -a $logfile |
| | mail -s "[${host}]-rsnap-success-$(date)" alerts@alerts.com < $logfile |
| | rm $logfile |
| | chown user:user -R /mnt/backups/rsnapback/$host/ |
| | chmod 770 -R /mnt/backups/rsnapback/$host/ |
| | else |
| | echo "Jonathan, at $(date), $(hostname -f) ran a sync that failed and I am now notifying you." |
| | mail -s "[${host}]-rsnap-failure-$(date)" alerts@alerts.com < $logfile |
| | rm $logfile |
| | fi |
| | |
| | |
| | |
| | |
| | |
| | |
| | [BEGIN OLD] Let's start with rsnapshot. Before you begin, you must already know how to add a hard drive to your system, a mount point, and an appropriate fstab entry. This also assumes you have an MTA properly set-up in order to send email. To create a basic configuration, do the following: |
| |
| sudo apt install rsnapshot | sudo apt install rsnapshot |
| <backup /etc/ localhost> | <backup /etc/ localhost> |
| |
| Now, edit the default script inside ''cron.d'' and for, simple configurations, just enable the four entries they have inside that template. The default cron entries look like this: | Now, edit the default script inside ''/etc/cron.d/rsnapshot'' and for, simple configurations, just enable the four entries they have inside that template. The default cron entries look like this: |
| |
| <0 */4 * * * root /usr/bin/rsnapshot alpha> | <0 */4 * * * root /usr/bin/rsnapshot alpha> |
| |
| sudo rsync -avi --delete /home/user/backup/of/mysqldump.sql root@server.com:/home/location/of/mysqldump.sql | sudo rsync -avi --delete /home/user/backup/of/mysqldump.sql root@server.com:/home/location/of/mysqldump.sql |
| | |
| Enjoy. | Once you master these steps, checkout remote-upgrades, so you can use these backup scripts and tools with a greater remote vpn and backup solution. |
| |
| This tutorial is a designated "Invariant Section" of the "Technotronic" section of Haack's Wiki as described on the [[https://jonathanhaack.com/dokuwiki/doku.php?id=start|Start Page]]. | This tutorial is a designated "Invariant Section" of the "Technotronic" section of Haack's Wiki as described on the [[https://jonathanhaack.com/dokuwiki/doku.php?id=start|Start Page]]. |
