'3.3 Tb folder of a 10 bit RGB DPX sequence takes approx 5 hours to copy from a raid tower to a single 4TB 7200 rpm drive in a cradle'
Let me doubt that - as it would mean the single spindle has a sustained write rate of 180MBps, which I have yet to see.
BG
www.finale.tv
From: "bigfish@pacbell.net [Avid-L2]" <Avid-L2@yahoogroups.com>
To: Avid-L2@yahoogroups.com
Sent: Thursday, December 15, 2016 2:20 PM
Subject: Re: [Avid-L2] OT: Shotput Pro Copy/Process times?
This is not for us this is a delivery requirement for the network. The network requires a copy of the Camera Original with a MD5 checksum log file. So far it doesn't seem like a 1TB folder of camera media should take anywhere near 12 or 24 hours.
As we are new to the software I'm wondering if there is anything they did in setting up the copy that could contribute to the lengthy time.
I know from my own experience with a 3.3 Tb folder of a 10 bit RGB DPX sequence takes approx 5 hours to copy from a raid tower to a single 4TB 7200 rpm drive in a cradle with everything connected to a usb 3 card.
The first thing they have tried to copy is about 1TB so it would seem something is messed up if it is projecting 12 to 24 hours to copy.
As we are new to the software I'm wondering if there is anything they did in setting up the copy that could contribute to the lengthy time.
I know from my own experience with a 3.3 Tb folder of a 10 bit RGB DPX sequence takes approx 5 hours to copy from a raid tower to a single 4TB 7200 rpm drive in a cradle with everything connected to a usb 3 card.
The first thing they have tried to copy is about 1TB so it would seem something is messed up if it is projecting 12 to 24 hours to copy.
---In Avid-L2@yahoogroups.com, <bouke@...> wrote :
MD5 is a very simple simple math operation, but it requires a total read of the source and target file.
So, you need to copy the file, and read both source and target, and do a bit of math. Depending on your system, this will take am much as 3 times more time as just a single copy.
Why are your doing this to yourself? One copy (Even with checksum) is not enough. You need at least 2 backups. So why bother?
Make TWO copies of the source, and you're as safe (Concidering a Md5 checksum good backup gets eaten by a dog. Wouldn't you like a non checksum copy?)
On Dec 15, 2016, at 21:10, Bogdan Grigorescu bogdan_grigorescu@... [Avid-L2] <Avid-L2@yahoogroups.com> wrote:how long for the copy if you turn off MD5?in my experience, MD5 verification essentially doubles the copy time.and DITs in the field normally use XXHash-64 checksum, which is significantly faster.BG
From: "John Moore bigfish@... [Avid-L2]" <Avid-L2@yahoogroups.com>
To: Yahoogroups <avid-l2@yahoogroups.com>; Yahoogroups <editing-list@yahoogroups.com>
Sent: Thursday, December 15, 2016 11:46 AM
Subject: [Avid-L2] OT: Shotput Pro Copy/Process times?After my recent thread regarding copying software the offered MD5 checksum and a log Shotput Pro was suggested by several. We purchased it and on a MacPro Tower with a 4TB Graid source drive and a 20TB Graid target drive, both connected to a usb 3 card for approximately 1 TB of Panasonic Varicam 35 4096x2160 avc-intra media the computer said 24 hours to copy. After a few restarts they moved the software to a different MacPro Tower. Both Macs are mid 2010 modified to 12 core running OS 10.9.5. The second computer said 12 hours but both seemed to stall in the process.We are not familiar with this process but I have been told by a more experienced friend the MD5 is CPU intensive. The CPU are 12 core 3.33Ghz. I can't believe that DITs in the field are taking 12 hours to copy drives to comply with the checksum MD5 log that is being required by the network. Most of our shoots have more like 2TB of camera media. I know there are options to just check file size and other check sum types that aren't as time consuming but the network specifically requests MD5. Is the large size of video files making the MD5 process much longer than it would be with more typical data that IT folks would deal with.What should 1TB of camera media take to copy on the above listed drives with an MD5 checksum.Also due to our OS they are running ShotPut Pro 5.x not 6 as that requires OS 10.10 which won't work with the rest of our infrastructure.John Moore Barking Trout Productions Studio City, CA bigfish@...
__._,_.___
Posted by: Bogdan Grigorescu <bogdan_grigorescu@yahoo.com>
| Reply via web post | • | Reply to sender | • | Reply to group | • | Start a New Topic | • | Messages in this topic (8) |
Have you tried the highest rated email app?
With 4.5 stars in iTunes, the Yahoo Mail app is the highest rated email app on the market. What are you waiting for? Now you can access all your inboxes (Gmail, Outlook, AOL and more) in one place. Never delete an email again with 1000GB of free cloud storage.
this is the Avid-L2
.
__,_._,___
No comments:
Post a Comment