nixCraft Linux Forum

nixCraft

Linux Tech Support Forum

how to do MYSQL online backup of huge database

This is a discussion on how to do MYSQL online backup of huge database within the Databases servers forums, part of the Mastering Servers category; hello This is Manish. Well I want to do mysql online backup of databases up to 120GB size. I tried ...


Go Back   nixCraft Linux Forum > Mastering Servers > Databases servers

Register FAQ Members List Calendar Mark Forums Read
  #1 (permalink)  
Old 06-08-2007, 02:39 AM
Junior Member
User
 
Join Date: Jun 2007
My distro: Centos & Freebsd
Posts: 15
Rep Power: 0
manish_2479 is on a distinguished road
Send a message via AIM to manish_2479 Send a message via MSN to manish_2479 Send a message via Yahoo to manish_2479
Default how to do MYSQL online backup of huge database

hello
This is Manish. Well I want to do mysql online backup of databases up to 120GB size. I tried mysqldump and mysqlhotcopy and also mysqlzrm. but none of them works and the version of mysql is 4.X. on gentoo. So is there any opensource soultion for the mysql database backup.

Thanking you
Manish
Reply With Quote
Sponsored Links
  #2 (permalink)  
Old 06-08-2007, 12:00 PM
rockdalinux's Avatar
Contributors
User
 
Join Date: May 2005
Location: Bangalore
My distro: RHEL, HP-UX, Solaris, FreeBSD, Ubuntu
Posts: 554
Rep Power: 6
rockdalinux is a jewel in the rough rockdalinux is a jewel in the rough rockdalinux is a jewel in the rough
Default

Yes large or huge database is problem for live backup. If you have performance problems with your server while making hot / live backups, try any one of the solution

#1. Set up replication and perform backups on the slave rather than on the master ... see this tutorial ONLamp.com -- Live Backups of MySQL Using Replication

#2. Use a Veritas filesystem to make snapshots (you need Veritas product
__________________
Rocky Jr.
You may have my body & soul, but you will never touch my pride!

If you have knowledge, let others light their candles at it.

Certified to work on HP-UX / Sun Solaris / RedHat
Reply With Quote
  #3 (permalink)  
Old 06-08-2007, 12:14 PM
raj raj is offline
Contributors
User
 
Join Date: Jun 2005
Location: Hyderabad
Posts: 146
Rep Power: 4
raj is on a distinguished road
Default

ZRM for MySQL Enterprise and Cluster Editions does work with large databases you need to purchase this software, it is not a free version. Zmanda Recovery Manager for MySQL - Enterprise Edition. You can also use free version which requires a lot of config option. I suggest try replication option as suggested by rockdalinux
__________________
Raj
Linux rulz.
I have never turned back in my life ; I shall not do so today.. haha
Reply With Quote
  #4 (permalink)  
Old 06-19-2007, 04:58 PM
Member
User
 
Join Date: Jul 2006
Posts: 72
Rep Power: 0
kasimani
Send a message via Yahoo to kasimani
Default backup with mixed utilities-- try to find and mix up them

for online backup, if u r going to use replication, then u need huge amount of RAM, by which ur application, queries, and so on... and even live backup takes place.

so look at it if have enough amount of RAM, my opinion is 8GB RAM will be fair for this task.

but why don't u a shell script or use any user tweakable source application in which the process is like this

1) first it make dump compressed with tar.gz then transfer to storage.
ofcourse it will also take much memory but with less bandwidth.
Reply With Quote
  #5 (permalink)  
Old 07-12-2008, 12:36 PM
Junior Member
User
 
Join Date: Jul 2008
Location: Washington, US
My distro: CentOS, Ubuntu
Posts: 6
Rep Power: 0
memnoch_proxy is on a distinguished road
Default

Sounds like you need regular downtime (those tables must be terribly slow to repair, too.)

Have you considered doing LVM snapshotting? The big drawback to that is the load-spike caused by copying extends once you restart and data starts getting written again. If you're doing a lot of data collection using the ARCHIVE engine, then that load spike won't be so big.

But--if you're not using replication now, I very much think you're going to want to soon. Come up with an LVM snapshot process and rsync the data to a slave ... that will be the fastest way to get replication started.

Good luck!
Reply With Quote
Reply

Bookmarks


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads

Thread Thread Starter Forum Replies Last Post
need to convert text files into mysql database zafar466 Databases servers 2 07-12-2008 12:31 PM
ssh backup particular mysql table / database brothers Databases servers 11 10-25-2007 05:06 PM
MySql FTP server backup script zafar466 Shell scripting 3 09-25-2007 05:43 PM
MySQL Backup Script krisa Shell scripting 1 02-02-2007 11:57 PM
How do I backup MySQL Databases? chiku All about FreeBSD/OpenBSD/NetBSD 2 08-19-2006 07:15 PM


All times are GMT +5.5. The time now is 05:53 PM.


Powered by vBulletin® Version 3.7.2 - Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.2.0

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36