Good to know. Would using the command line speed up the process? I'm surprised that just putting the files back in the original folder is taking a long time. I'm pretty sure I'm correct that the actual data is not being moved just the directory pointer structure. My experience has always been when moving folders around on the same drive no actual media is moved just paths change. Am I thinking of that correctly?
---In Avid-L2@yahoogroups.com, <jay_mahavier@...> wrote :
you should learn the MV line command. Finder is not that great at handling large numbers of files.
Jay
On Apr 13, 2018, at 2:28 PM, bigfish@... [Avid-L2] <Avid-L2@yahoogroups.com> wrote:
Here's a fun observation. When I drag and drop 5,000 dpx files from one folder to another on the same drive it is now taking about 20 minutes to complete. There is no moving of media that I know of given it's all on the same drive and just moving folders. As I posted previously my limited understanding is this is just adjusting the pointers in the directory and not moving the actual media data in the files.
I'm noticing that as the progress bars stalls while it processed it appears that it reaches points where it shoots over 334 at a time. I wonder what the significance of 334 is to the OS and file copying.
---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :So in the end I got Automator to work. I did find that dealing with the large number of files is problematic for drag and drop. If I selected all the dpx files and dragged into Automater I got a beach ball that persisted to the point that I gave up dragging them all at once. I created a buffer folder and dragged 5,000 files at a time into there and renamed them. I repeated this but even dragging 5,000 files to a new folder took time. I was not moving the files to another drive just to a different folder on the same drive. Still it became nerve racking to wait several minutes for a group of 5,0000 files to finally move to the new folder.
I then made use of the "add" button rather than drag and dropping to get the files into Automator. That took a couple minutes but it did the proper renaming and I didn't have to bounce to a buffer folder. I was able to add approx 50,000 files and do them all at once without moving them out of the original folder. I know now that is how I should have proceeded to begin with.
I am curious what takes so long when dragging and dropping large numbers of files to a new folder on the same drive. The data isn't being copied it's just the directory pointers that change. Does it really take 3 to 4 minutes to change the pointers on 5,000 files? I restarted a few times to make sure there wasn't some memory leak type thing happening. I have 24GB of ram but I don't know if ram comes into play.
I got very nervous watching the copy process taking so long and after a few minutes the files disappear from the source folder and then a few minutes later pop up in the destination folder. The copy progress bar moved slowly and would pause several times. I guess the computer is processing under the hood. Just seemed less stable than I would have thought but then I rarely copy such large numbers of individual files at the desktop level. Usually I will just drag the folder containing all the files.
---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :That's new to me, as is most of this. I know of but never do this stuff. I've had some success with automator but with over 100,000 files it seems to not like me dragging and dropping that many files. I've cut it down to 5,000 a process and it seems to handle it. I think the software suggestion make more sense in the long run but at least for now I'm brute forcing it with automator.
---In Avid-L2@yahoogroups.com, <speckydave@...> wrote :Hi John,I know I'm a bit late to the party, but you know you can just use the Mac Finder to batch rename?Just select all files, right-click and select 'Rename' to bring up a kind of 'Find and Replace' dialogue.Should be enough for what you're trying to do and simpler than Automator.D.
--
Sent from my mobile phone - please excuse spellung.
On Thu, 12 Apr 2018, 01:41 John Moore bigfish@... [Editing-List], <Editing-List@yahoogroups.com> wrote:When exporting a DPX file the network has a specific file naming convention they want applied. Avid takes the sequence name and makes it the text for the individual DPX files. The format becomes "Sequence Title".0000000.dpx (without the "s)So here in lies the rub. Avid will only take the first 64 characters of the sequence name and the rest gets truncated. I believe there is a way to use Automator on a Mac to batch rename but that's not something we've done before. The resulting DPX file works fine it just doesn't have all the requested text on the individual files.I will start googling but is there some sort of 64 character limit to file naming in the DPX spec? I doubt there is because I wouldn't think the network would have made this request if there was. Some days I just feel so guilty for having all the fun.John Moore Barking Trout Productions Studio City, CA bigfish@...
__._,_.___
Posted by: bigfish@pacbell.net
| Reply via web post | • | Reply to sender | • | Reply to group | • | Start a New Topic | • | Messages in this topic (16) |
Have you tried the highest rated email app?
With 4.5 stars in iTunes, the Yahoo Mail app is the highest rated email app on the market. What are you waiting for? Now you can access all your inboxes (Gmail, Outlook, AOL and more) in one place. Never delete an email again with 1000GB of free cloud storage.
this is the Avid-L2
.
__,_._,___
No comments:
Post a Comment