- Overview
- Backup steps
- Backup Order: Database First or Data Directory First" level="3"> Backup Order: Database First or Data Directory First
- Backing up Databases
- Backing up Seafile library data
- Restore from backup
Overview
There are generally two parts of data to backup
- Seafile library data
- Databases
If you setup seafile server according to our manual, you should have a directory layout like:
haiwen # Replace the name with your organization name
--seafile-server-2.x.x # untar from seafile package
--seafile-data # seafile configuration and data (if you choose the default)
--seahub-data # seahub data
--ccnet # ccnet configuration and data
--seahub.db # sqlite3 database used by seahub
--seahub_settings.py # optional config file for seahub
All your library data is stored under the ‘haiwen’ directory.
Seafile also stores some important metadata data in a few databases. The names and locations of these databases depends on which database software you use.
For SQLite, the database files are also under the ‘haiwen’ directory. The locations are:
- ccnet/PeerMgr/usermgr.db: contains user information
- ccnet/GroupMgr/groupmgr.db: contains group information
- seafile-data/seafile.db: contains library metadata
- seahub.db: contains tables used by the web front end (seahub)
For MySQL, the databases are created by the administrator, so the names can be different from one deployment to another. There are 3 databases:
- ccnet-db: contains user and group information
- seafile-db: contains library metadata
- seahub.db: contains tables used by the web front end (seahub)
Backup steps
The backup is a three step procedure:
- Optional: Stop Seafile server first if you’re using SQLite as database.
- Backup the databases;
- Backup the seafile data directory;
Backup Order: Database First or Data Directory First" class="reference-link"> Backup Order: Database First or Data Directory First
- backup data directory first, SQL later: When you’re backing up data directory, some new objects are written and they’re not backed up. Those new objects may be referenced in SQL database. So when you restore, some records in the database cannot find its object. So the library is corrupted.
- backup SQL first, data directory later: Since you backup database first, all records in the database have valid objects to be referenced. So the libraries won’t be corrupted. But new objects written to storage when you’re backing up are not referenced by database records. So some libraries are out of date. When you restore, some new data are lost.
The second sequence is better in the sense that it avoids library corruption. Like other backup solutions, some new data can be lost in recovery. There is always a backup window.
However, if your storage backup mechanism can finish quickly enough, using the first sequence can retain more data.
We assume your seafile data directory is in /data/haiwen
. And you want to backup to /backup
directory. The /backup
can be an NFS or Windows share mount exported by another machine, or just an external disk. You can create a layout similar to the following in /backup
directory:
/backup
---- databases/ contains database backup files
---- data/ contains backups of the data directory
Backing up Databases
It’s recommended to backup the database to a separate file each time. Don’t overwrite older database backups for at least a week.
MySQL
Assume your database names are ccnet-db
, seafile-db
and seahub-db
. mysqldump automatically locks the tables so you don’t need to stop Seafile server when backing up MySQL databases. Since the database tables are usually very small, it won’t take long to dump.
mysqldump -h [mysqlhost] -u[username] -p[password] --opt ccnet-db > /backup/databases/ccnet-db.sql.`date +"%Y-%m-%d-%H-%M-%S"`
mysqldump -h [mysqlhost] -u[username] -p[password] --opt seafile-db > /backup/databases/seafile-db.sql.`date +"%Y-%m-%d-%H-%M-%S"`
mysqldump -h [mysqlhost] -u[username] -p[password] --opt seahub-db > /backup/databases/seahub-db.sql.`date +"%Y-%m-%d-%H-%M-%S"`
SQLite
You need to stop Seafile server first before backing up SQLite database.
sqlite3 /data/haiwen/ccnet/GroupMgr/groupmgr.db .dump > /backup/databases/groupmgr.db.bak.`date +"%Y-%m-%d-%H-%M-%S"`
sqlite3 /data/haiwen/ccnet/PeerMgr/usermgr.db .dump > /backup/databases/usermgr.db.bak.`date +"%Y-%m-%d-%H-%M-%S"`
sqlite3 /data/haiwen/seafile-data/seafile.db .dump > /backup/databases/seafile.db.bak.`date +"%Y-%m-%d-%H-%M-%S"`
sqlite3 /data/haiwen/seahub.db .dump > /backup/databases/seahub.db.bak.`date +"%Y-%m-%d-%H-%M-%S"`
Backing up Seafile library data
The data files are all stored in the /data/haiwen
directory, so just back up the whole directory. You can directly copy the whole directory to the backup destination, or you can use rsync to do incremental backup.
To directly copy the whole data directory,
cp -R /data/haiwen /backup/data/haiwen-`date +"%Y-%m-%d-%H-%M-%S"`
This produces a separate copy of the data directory each time. You can delete older backup copies after a new one is completed.
If you have a lot of data, copying the whole data directory would take long. You can use rsync to do incremental backup.
rsync -az /data/haiwen /backup/data
This command backup the data directory to /backup/data/haiwen
.
Restore from backup
Now supposed your primary seafile server is broken, you’re switching to a new machine. Using the backup data to restore your Seafile instance:
- Copy
/backup/data/haiwen
to the new machine. Let’s assume the seafile deployment location new machine is also/data/haiwen
. - Restore the database.
- Since database and data are backed up separately, they may become a little inconsistent with each other. To correct the potential inconsistency, run seaf-fsck tool to check data integrity on the new machine. See seaf-fsck documentation.
Restore the databases
Now with the latest valid database backup files at hand, you can restore them.
MySQL
mysql -u[username] -p[password] ccnet-db < ccnet-db.sql.2013-10-19-16-00-05
mysql -u[username] -p[password] seafile-db < seafile-db.sql.2013-10-19-16-00-20
mysql -u[username] -p[password] seahub-db < seahub-db.sql.2013-10-19-16-01-05
SQLite
cd /data/haiwen
mv ccnet/PeerMgr/usermgr.db ccnet/PeerMgr/usermgr.db.old
mv ccnet/GroupMgr/groupmgr.db ccnet/GroupMgr/groupmgr.db.old
mv seafile-data/seafile.db seafile-data/seafile.db.old
mv seahub.db seahub.db.old
sqlite3 ccnet/PeerMgr/usermgr.db < usermgr.db.bak.xxxx
sqlite3 ccnet/GroupMgr/groupmgr.db < groupmgr.db.bak.xxxx
sqlite3 seafile-data/seafile.db < seafile.db.bak.xxxx
sqlite3 seahub.db < seahub.db.bak.xxxx