Use nice and ionice for your daily backups

Posted: 07/09/2012 in Shell tips
Tags: , ,

I had a problem in my web-server vps.
I make daily compressed backups from my data and transferred them to another vps using tar and rsyc. I noticed high cpu usage nad load above 1.
After a little research i found this useful article and i will write here to find it easily:

“Anyone running a web server will either use a RAID for information protection, or will run a cron job that backups all the data daily

If you are running a budget server like mine, then most likely you’ll be doing daily backups. At 4 am everyday a backup process runs and stores a dump of the SQL and gzip of all the web folders including the SVN repository on a separate harddrive, which gets unmounted after the backup is done. The process takes around 2 hours to complete, during which the hard drives are all stressed and if the backup scripts were not carefully written they will hog any apache request due to slow disk access.

Because the primary reason of a webserver is to serve pages, I do two things to guarantee that any apache or database process will take precedence in resources when compared to the backup process:
1. The backup process runs with nice -n19 . This means that the process is running with a CPU idle priority, and will only use the CPU if no other process needs it. Using only nice will guarantee that the CPU is free, but programs like tar and gzip are big disk users and although they might not use a lot of CPU, a very small CPU usage is enough to generate big disk reads/writes. Large disk reads/writes usually will block other processes and keep them waiting for the disk resource, and will thus slow down apache, postgres and mysql and finally all pages accessed during the backup. In simple words, during backup if one tries to browse any of my websites when the backup process is only niced, the pages will load very slow.
2. This leads us to the second precaution, ionice -c2 -n7 nice -n19 . ionice is a tool that not so many people know that it exists. It basically prioritizes the disk access for different processes. Long tasks that access the disk a lot, and which are not that important or time critical should be given a lower priority compared to those that require fast turn around. ionice has three priority classes given by the parameter -c. Class 1 is real time priority, and only root can run processes in that class. Class 2 is best effort priority, within which there are 0-7 levels given by the -n parameter, 0 being highest priority and 7 being lowest. Class 3 is idle time.

ionicing and nicing the backup process makes a huge difference in the speed and response of the webserver during the daily backup, especially if it was long.”

After that i changed the bash script that i use to make and transfer my backups and i make most of the code to use fro compression to look like this

ionice -c2 -n7 nice -n19 tar cpzf ....

The benefits for my server are huge. Try it your self.

the main article you can find it here

Advertisements
Comments
  1. bob says:

    According to ‘man ionice’ Class 1 is real time and class 3 is idle.

  2. Xavier says:

    Is there any reason in particular por using the best effort class instead of the idle class for ionice?

  3. grinux says:

    No particular reason. I tested and it is ok. You use the -c3 class ?

  4. WhistleBlower says:

    Copying an article tha predate yours by about 4 years, and not even giving credit? Smooth.
    http://www.clker.com/blog/2008/06/25/ionice-and-daily-backups/

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s