In the past, I have used a USB to transfer a few video files from one computer to another. This time I have over 1 terabyte of movies and shows I’d like to transfer. What is the best method?
I know it will take a very long time
Quickest -
- Take the lid off the source PC put the HDD in it
- Copy the stuff.
- Pull it out
- Put it the other PC,
- Your done
Formatting the HDD my be optional.
Connect both computers over ethernet and rsync the data across. It will still take several hours over gigabit ethernet though.
-
Take the drive from PC 1 and attach to PC 2 => copy / paste
-
External drive
What file system do you get the most compatibility out of?
-
Parallel port would be faster than serial, but if you’re using serial I’d go with Z modem for the compression and error correction.
I would write it to an nvme drive and swap that drive to the new pc
What is the best method?
Sometimes the best method isn’t a transfer at all. Don’t forget transporting is an option.
Do you need to transfer the files? or could you just use an external you share between different PCs?
If an external works, but seems inconvenient, you can fix that by having the drive connected to a USB switch. When connected to a switch you can press a button or use a remote to change which PC the drive is connected to giving you instant access to the drive contents without having to sync/copy anything over.Links below for examples of USB switches
https://www.amazon.com/Cable-Matters-Sharing-Computers-Peripherals/dp/B083JKDNRJ/
https://www.amazon.com/Sabrent-Computers-Peripherals-Indicators-USB-SW30/dp/B074TYDJK2/Simplest method is to copy via normal drag and drop, provided you have halfway decent hardware copying locally on the same network and a wired connection, 1Terabyte will not take too long, maybe a few hours on a standard Gigabit connection.
There are other options as the Windows SMB network protocol can be a bit slow.
Simplest method, use FTP to copy the files over at “line speed” - you can use filezilla in both client and server versions.
If you are using Linux, you can also use “rsync” to copy files over to a remote machine, “Syncing” means it compares the files on source and destination and only copies the differences, this is a more efficient way to copy files. Do some research on the command to use, I usually use some variant of
rsync -av /source/folder/ user@server:/destination/folder
Windows also has a similar file syncing tool called “robocopy” (it’s built in to every version of Windows since WinXP), With this you can also use something called “Multithreading” to copy lots of files at once if you have a lot of cores (be careful that the destination has a few cores as well as this can saturate a network link). Basic robocopy command (with threading) example is:“
robocopy.exe c:\source \\server\destinaton /copy:DAT /xo /r:1 /w:1 /mt:4 /np /e
” (syncs files, ignoring older files in destination, copying Data/Attributes/Timestamps, does not show progress - clutters screen, only tries once and waits 1 second for the retry - can always re run if lots of failures, copies all folders (even empty ones) to preserve structure, and uses 4 CPU threads to prevent big files stalling the copy) Lots more options but this should do for the basics. (using /COPYALL needs you to run in Administrator mode on terminal window due to the auditing admin rights this uses, not needed in most cases and won’t work if you aren’t copying NTFS to NTFS)This post is an automated archive from a submission made on /r/DataHoarder, powered by Fediverser software running on alien.top. Responses to this submission will not be seen by the original author until they claim ownership of their alien.top account. Please consider reaching out to them let them know about this post and help them migrate to Lemmy.
Lemmy users: you are still very much encouraged to participate in the discussion. There are still many other subscribers on [email protected] that can benefit from your contribution and join in the conversation.
Reddit users: you can also join the fediverse right away by getting by visiting https://portal.alien.top. If you are looking for a Reddit alternative made for and by an independent community, check out Fediverser.
I’ve been sending 10TB from one PC to another on my network over the last 2 days, it’s nearly done. It’s a wired network, and while sometimes I use tools like robocopy for more granular control over the the copy settings and logging of any copy errors, I generally find the standard windows copy tool to be faster.
rsync
over a wired network. That way, I can stop and resume at any time.USB 3.1 Gen2 is hard to beat. 10Gbps. But for HDDs the HDDs themselves will be the bottleneck. For sustained file transfers, perhaps no more than up to 3Gbps, even if installed in the same PC. Good SATA SSDs may manage closer to 6Gbps. NVMe SSDs are likely to saturate USB 3.1 Gen2. Then PCI-e directly between installed drives is the fastest. Normal cabled network is only 1Gbps.
File transfers to/from external multibay USB DAS can be done in parallel, involving multiple HDDs, and come close to saturating 10Gbps USB3.1 Gen2 speeds.
Then there is thunderbolt.
Start a rsync transfer when you go to bed. In the morning it will most likely be done.
Over LAN with flavored solution of your choice.
Other than that, I use one of my spare drives and my USB docking station if I need to move it outside of my own house. I never really had a need for dedicated external drives but a docking station is handy for many things, this being one of them.I have a PC in a spot of my house I can’t get a cable to. But that’s the PC I do my Blu Ray ripping and encoding on, so I keep a 5tb external drive for moving the files to my NAS afterwards. Sometimes it would take days over WiFi instead of minutes to hours over USB 3 twice. (and piss off my wife for saturating the wifi, heh)
So consider a powerline network adapter, or move the PC to a place you can run a cable.
My experience with powerline is pretty terrible. And there is no better place for it sadly.
You could go over a wired network.
1 Tb shouldn’t be too bad. You could try an external HD, but that becomes a double operation (1 copy to the drive, 1 copy off) or use your home network.
Create a share of the folder(s) you want to copy and then access from the new PC to copy and paste to. Speed will depend on your network speed AND drive speeds.