HI Dave,
that sounds like a very interesting solution.
This week and next, we're prepping the episode to go to online, but after that I can definitely have my night ae split the media files up as you mentioned and recreate the database file.
I'll check the systems on the indexing part to see if that might be the case.
Thanks again!
---In avid-l2@yahoogroups.com, <mactvman@...> wrote:
Let me start by saying I am old school and have worked primarily with Unity. No experience with Isis at all.
Having said that I have seen issues with random files going offline caused by one thing...
Too many files per folder. Avid sets UNITY to create new folders at 5,000 files per folder. This is way to liberal in my opinion, especially if you are running MacOS based clients. I consider multiple folders with over 2,500 files to be a cause of the files going offline issue.
It sounds like you have MANY files at the 5,000 file count. If it was my job to manage the workspaces, I would split the files into folders of no more than 2,000 files per folder, and rebuild the databases.
Another routine management step I do on big projects is to put primary source media on different partitions from pre-compute or user generated media, and make the primary source media read only to the editors. By allowing only the ingestors or assistants access to write access, and strictly training them to keep the file count below 2,000 files per folder, this ensures that the show or film media stays online.
If it makes sense, you can give each editor his or her own "render" partition, that only they can write to. In this way you can track who is managing their pre-compute files properly. Some editors are in the habit of re-rendering EVERYTHING several times a day, and ending up with several thousand audio and video dissolve pre-computes in just a couple of weeks. I am a big fan of "expert" render, and going in and blowing out old pre-computes every few weeks.
Allowing the editors write access to only their render drives is also a good way to protect the primary source media from mistakes in media management accidentally blowing away key files.
Also, as a side note, make sure that NONE of your systems are set to "index" any of your shared storage volumes. Additionally, make sure none of your systems have sharing turned on. This slows down the OS considerably, and causes the system to time out when accessing folders with large file counts.
My .02,
Good Luck,
Dave Hogan
Burbank, CA
---In avid-l2@yahoogroups.com, <mikepvee@...> wrote:
According to ISIS I have 334,692 files and 18,498 folders.
---In Avid-L2@yahoogroups.com, <domqsilverio@...> wrote:
On Wed, Nov 6, 2013 at 3:29 PM, <mikepvee@...> wrote:
@Ofer, there are no quarantine files. the drive itself is purely for Avid MediaFiles
@Robert, ISIS as a whole contains everything. Backups for the raw media files, acquired footage (video & stills), Project folders, etc
they are all in different partitions though. Renders, Media (Avid MediaFiles), Master Backup (for raw footage), Master Media (acquired + VFX/GFX), SFX, MUSIC, and Exports.
I still have around 2tb left on ISIS as a whole out of 32tb capacity (although I only have access to 22tb)
---In avid-l2@yahoogroups.com, <avidrhl@...> wrote:Also, do you keep other material on ISIS? JPEGs, QuickTime files? Attic files?Look at your total file count. The capacity of ISIS is large but not infinite.—
Sent from Mailbox for iPhoneOn Wed, Nov 6, 2013 at 2:37 PM, Ofer Raveh <o.raveh@...> wrote:
Are there any Quarantined files?Ofer RavehACSR
From: "mikepvee@..." <mikepvee@...>
To: Avid-L2@yahoogroups.com
Sent: Tuesday, November 5, 2013 12:35 PM
Subject: [Avid-L2] RE: losing file link constantly (how can I optimize avid?)The media drive itself currently has 6tb of space allocated and it is 85% full.I've constantly increased space to keep used % to be under 90% at all time.I know that avid creates a new folder every 4-5k files.will splitting the amount of folders per drive help avid keep track of files?
---In avid-l2@yahoogroups.com, <namyrb@...> wrote:What're the sizes and used capacities of your volumes?We usually keep them under a terabyte per volume at 75-80% capacity. This helps us rebuild DBs or relink quickly as there are always less things to scan when we run into and pinpoint problems.As for the 75-80% capacity... I had a guy from keycode laugh at me when he saw one of my drives at 98%... so that's the sole reason why I keep them at those levels.On Mon, Nov 4, 2013 at 6:04 PM, <mikepvee@...> wrote:yowch, that sounds like what I'm going through as well.I've shut down ISIS for the night, i reindexed ALL the folders in the drives, and used new user settings.I haven't reinstalled avid, but that's not somethign I can do right now.
I still have a month and a half left so i hope to never run into this issue ever again.. although i have no idea what is causing avid to fail at linking these files.I'm worried that it's because the project is getting big and the software can't keep track of everything.
Is it possible that offloading these media files to different drives will alleviate the issue? or will it not matter anyways since avid is still access the same amount of folders?
---In Avid-L2@yahoogroups.com, <avid-l2@yahoogroups.com> wrote:
We have been experiencing a similar random problem.Avid 6.5.2 / 6.5.3 & Unity 5.5.1Our issue started out with titles going offline. I was the primary creator of these titles, rendering to my directory on one of our render workspaces.This progressed to random shots going offline, all of which existed on different workspaces, similarly, some going back several months. Most of these were shots that I had imported, but some were from other users.Most of the time the problems occurred when I copied new MXF media into the media workspaces. The usual rebuild of the databases occurred, then random shots would go offline, including shots that were on OTHER locked workspaces.Our tech support had us go through the usual:-Delete & rebuild databases-Create new user media directories-Create new workspaces-Rebuild old workspaces-The old standby, create new user settings.-Resynchronize Unity clocks-Swap out my internal driveThe problems remained.After multiple attempts at each of these, mysteriously, the problems have stopped.We only have one more week on this film, so fingers are firmly crossed.-ScottPompeii / VFX EditorOn Monday, November 4, 2013 11:32 AM, "mikepvee@..." <mikepvee@...> wrote:
Hello ladies and gentlemen,I am running into a new issue.The show I am working on is hooked to ISIS 5000. Currently we have 1 single drive partition that houses the vast majority of all our footage.My issue is that lately Avid has been having trouble linking back to files some are new files, some are files that have been unmodified for over 2 months. the files would usually come up as offline until I go in and individually relink the files. I don't know what is causing it but it's been hampering the editor's work since everytime they work on a different episode, something goes offline.What I've done so far:Deleted ALL .pmr & .mdb file and forcing all the avids to reindex all the foldersPre-Relink all the files before an editor can get to it.What I'm wondering:Is it possible that there is literally too much media on one drive and avid is having a hard time sorting and keeping track of the files?Currently there are 17 folders (4 folders that are not full... yet)Would it help Avid if I split these files out onto another partition? so there are less files per drive? or does it not even matter?I spend a good amount of my time everyday having to deal with these relinking issues when these files haven't been modified for months.Thanks!
| Reply via web post | Reply to sender | Reply to group | Start a New Topic | Messages in this topic (14) |
No comments:
Post a Comment