You are not logged in.
Pages: 1
I am getting ready to tear down a server and I need to pull a directory off the server which has massive data on it. The directory is /data on "server_old" I would like to move that data as fast as possible to "server_new" but am not sure the best way to do so. Should I scp the data over SSH? Do I do some kind of Rsync command with compression switch enabled so the data is compressed and then sent over ssh to the "server_new"?
Any advice is greatly appreciated!
[root@server_old ~]# df -hT
Filesystem Type Size Used Avail Use% Mounted on
/dev/sdb1 ext3 396G 364G 12G 97% /data
PS - Both servers are hooked up to a 1000MB switch and have Gigabit NIC's installed.
./
Offline
rsync ?
ffc
Offline
No, definitly don't use SCP, SFTP or rsync, which also uses SSH. SSH encrypts everything, which is very slow even on fast processors and beneficial only when moving stuff over an untrusted network. It would probably be fastest to use NFS or FTP to copy the data to your new server.
Offline
forklift
"Be conservative in what you send; be liberal in what you accept." -- Postel's Law
"tacos" -- Cactus' Law
"t̥͍͎̪̪͗a̴̻̩͈͚ͨc̠o̩̙͈ͫͅs͙͎̙͊ ͔͇̫̜t͎̳̀a̜̞̗ͩc̗͍͚o̲̯̿s̖̣̤̙͌ ̖̜̈ț̰̫͓ạ̪͖̳c̲͎͕̰̯̃̈o͉ͅs̪ͪ ̜̻̖̜͕" -- -̖͚̫̙̓-̺̠͇ͤ̃ ̜̪̜ͯZ͔̗̭̞ͪA̝͈̙͖̩L͉̠̺͓G̙̞̦͖O̳̗͍
Offline
OK - I see this thread is going nowhere...
./
Offline
If it's possible, just put your new hard drive inside of your old server and rsync your data with the "-ax" options to the new partition.
rsync -ax /olddir /newdir
-a -> archive mode, that means "preserve owner, group, user rights, symlinks, etc."
-x -> do not sync other filesystems mounted inside the one your copying (e.g. if you have mounted a partition in the /olddir directory, that partition is not copied)
In love I believe and in Linux I trust
Offline
If it's possible, just put your new hard drive inside of your old server and rsync your data with the "-ax" options to the new partition.
rsync -ax /olddir /newdir
-a -> archive mode, that means "preserve owner, group, user rights, symlinks, etc."
-x -> do not sync other filesystems mounted inside the one your copying (e.g. if you have mounted a partition in the /olddir directory, that partition is not copied)
That's probably your best option, or if you can't physical move the drives, just setup rsync on 'old_server' to listen for incoming connections. This doesn't use encryption so will be faster than tunnelling it over SSH.
Are you familiar with our Forum Rules, and How To Ask Questions The Smart Way?
BlueHackers // fscanary // resticctl
Offline
So it looks like Rsync is the best bet with the exception that it uses encryption over SSH. I have never used NFS but I know that would require my configuring the NFS server daemon on the server under /etc/exports file and then having to download and install a NFS client on the new server so it can connect to the NFS server.
./
Offline
I've been told that ssh encryption is much faster using blowfish algorithm, so if you can't move the disk you could try with
rsync -e "ssh -c blowfish" -ax --numeric-ids /olddir user@newserver:/newdir
Last edited by zukka (2009-09-24 13:43:37)
Offline
Thanks! I will give the above listed a shot!
./
Offline
NFS is not the best option because if the connection is broken you cannot be sure where you left off. rsync can be used over rsh which does no encryption (rsync -e rsh). Of course, you need rshd running, which can be started through xinetd or manually.
Offline
netcat is probably fastest. If you want to compress/encrypt as well it's up to you. I used the example in the link to copy over my localnet.
Last edited by vacant (2009-09-24 14:31:52)
Offline
how about git?
Offline
If the OP was trying to sync the 2 machines, and keep them in sync over time then git might be suitable, but for a one-time transfer from A or B, seems a bit of overkill given the other solutions available...
Are you familiar with our Forum Rules, and How To Ask Questions The Smart Way?
BlueHackers // fscanary // resticctl
Offline
I would use rsync for this. rsync only uses ssh if you tell it to. If both machines are on your local network you don't really need to encrypt the transfer as you would if sending the stream through the internet. Setup a rsync server on the old machine and use the rsync protocol instead of ssh.
Offline
Pages: 1