Wednesday, September 11, 2019

Re: [Avid-L2] MacPro Mid 2010 vs mid 2012 DPX Export Performance difference?

 


"…my understanding is 128GB works for linux and windows boots and for mac OS 96GB is the most that will be used. "


I didn't know that – that's helpful – thanks!

I'll add (what is likely an obvious thing) that any RAM above that can be used by other applications. This is especially true of Photoshop & After Effects which seem to latch on to RAM and not release it, even though neither are the currently active application.

Anyone else experience that?

Cheers,

-B


On Sep 11, 2019, at 12:06 PM, bigfish@pacbell.net [Avid-L2] <Avid-L2@yahoogroups.com> wrote:

I am a member of the upgrade group where I lurk and learn.  From my limited google my understanding is 128GB works for linux and windows boots and for mac OS 96GB is the most that will be used.   I get that more ram is better I was just surprised that just 8 GB made such a dramatic difference on this show.  I've done several very similar shows on this computer without having it get laggy.  This particular show was about 10 minutes longer than most that are close to an hour.  Perhaps that contributed to the behavior I saw.



---In Avid-L2@yahoogroups.com, <mactvman@...> wrote :

Hey John,

Current MC 2019.x versions primary recommendation for Media Composer is 16GB minimum and 32 gigs recommended.  Makes sense that the extra 8gb makes a difference.

I recall that on older versions of Media Composer you could run with less ram (as little as 8gb), but for high performance situations that 64GB and 96GB was previously recommended.

I am part of a user group on Facebook called MacPro Upgrades, that you may want to check out.  The discuss the bleeding edge of performance on our old MacPros.

You can stuff the 2010 and 2012 dual processor machines with up to 128 GB of ram.  I have that much in my machine, but I don't use it for UHD outputs.

The common wisdom is that for highest performance, that the RAM needs to be matching, and in triplets.  Ideally 96GB in matched and batched 16GB sticks.

The file section in that Facebook users group has all the details.

Dave Hogan,
Burbank, CA


On Sep 7, 2019, at 8:24 PM, bigfish@... [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


Okay so I got adventurous, what better thing to do on a Saturday night at work, and the GB or extra Ram seems to  be a real tipping point.  I went back to 24GB and saw a ton of memory pressure and the time estimate crept up to 8.5 hours.  I have nested paint effects and when it hits those it must be particularly memory taxing with an unrendered sequence.  So as has been stated in this thread Ram does make a difference but I didn't know how significantly different 8GB would be.  

I've read up that even though spec for MacPro 5.1 is 64GB Ram max according to OWC with Mac OS you can go up to 96GB and if running linux or windows that can be up to 128GB.  Now I'm wondering how significant upping to 96GB might be on my home system.  I think there are caveats to using 16GB Ram sticks like they all have to be 16GB and can't be mixed with other sizes.  I'll have to look into that.  That would be 6 slots worth.  Hmmmm any more knowledgeable tech heads care to chime in.  After all OKI Dog was closed last night on my way home from work again so I might as well just stay at work and keep testing. 


---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :

So today trying the same DPX export with the 8GB of ram added and the export estimate is 4 hours and 15 minutes and not climbing up like it was yesterday.  Activity manager shows about 29.5GB or memory being used and there is no red memory pressure being displayed in activity monitor.  Also the system is not laggy like it was yesterday.

So either the extra 8GB got Avid past the tipping point and or perhaps when I installed the new ram I blew out some dust and also perhaps the reseating of the CPU tray might have improved the connections to the back plane.  That's just a guess but the difference is night and day, literally and figuratively.

Now I did have the computer running all night with Adobe Media Encoder exporting which took about 5 hours after I left and then the computer sat idle.  Point being it wasn't shut off for an extended cool down period so that wouldn't factor in.  I have a temp monitor and it shows no signs today or yesterday of particularly high temps.

If I was really adventurous I'd pull the extra Ram to check.  Perhaps I will but for now I'm glad it's working like it use to.  It is surprising to me that 8GB or ram could account for such a drastic difference but what do I know.  On my home system with 64GB of ram activity monitor showed avid using more like 36GB ram.  The home system did the export in 4.5 to 4.75 hours.  The big difference is that at home my source media, DNxHRHQX was coming of a single Hitachi Deskstar 4TB HD and at work my source media is coming from a 4GB fibre connected 16 drive raid array.  I'm kinda surprised how my USB 3 dock at home does so well but the media was very contiguous as it was copied from my work media so there would be little fragmentation still pretty impressive to me.


---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :

I had thought they had fixed the memory leak issue.  It's funny I find at home Avid link will suck up 22GB of ram creeping up the longer it runs.  The same doesn't happen at work it's weird.  I tried running MC 2018.12..5 but for some reason it wouldn't work with the NitrisDX circa 2009, even after I installed the included DX driver.  So I couldn't go to 2018.12..5 perhaps 2018.12.7 will work with the NitrisDX.  It's been a lot like herding cats of late.

What's curious is this same system has done similar shows without being so laggy.  I did find an extra 8GB or ram to fill out the two open slots.  Can't really tell if that's made a difference yet but I guess it can't hurt..


---In Avid-L2@yahoogroups.com, <forshurz@...> wrote :

RAM makes a difference, 2018.12.3 has a bad memory leak, and you can run apple hardware test on your work computer (extended) which will take over an hour to complete. If you really want to test, take the 64GB from your home computer and install it on your work computer and see if that's the big difference.

On Sep 6, 2019, at 4:09 PM, John Moore bigfish@... [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


It feels like something has changed or gone south on my work computer.

Work computer mid 2010 MacPro upgraded to 12 Core 3.33GHz, 24GB ram, GTX-680, Mac OS 10.12.6, Avid MC 2018.12.3, NitrisDX circa 2009,  4Gig Fibre Atto card to Fibrenetix 16 drive chassis, Internal 3 way 4TB hitachi stripe raid..

Home computer mid 2012 MacPro 12core upgraded to 3.46 GHz, 64GB ram, GTX-680, Cyclone Microsystems Expansion chassis 1500 watt PS with 2 TitanX 12 GBvram GPUs, DNxIO, Mac OS 10.12.6, Avid MC 2018.12.3.

At work an hour and 10 minute DCI 4096_2160 sdr Rec 709 show took abut 8 hours to export a DPX.  Now for the archival ungraded master that is unrendered it's bouncing around 12 to 14 hours and the whole system gets latent and virtually unusable.  I tried reformating the Graid 20TB target drive with and the result did not improve much.

I then copied all the media for the project onto a single 4TB Hitachi Deskstar and took it home.  Running the Hitachi drive as source and going to the same Graid as at work the time estimate is about 4hours and 15 minutes and the overall system is snappy as hell.  I did notice on the work system that Avid memory use was at times slamming up to close to 22GB or ram and the red memory pressure was showing a lot of red.  I've done this before on this system with an unrendered archival master and there was memory pressure indicated but the system didn't grind to a halt.  Could ram make that much of a difference.  I see at home Avid is using 36.85GB memory along with kernal task at 2.82GB, AvidOPFrameGeneratorApp 1.084GB and AVid DMFSupportSvc 866.9MB.  

I would think at work with source media coming off a 16 drive san chassis connected through 4Gig fibre would supply data faster than a single spinning HD.  At least the spinning HD isn't very fragmented.  I'm wondering why the big difference between systems.  I had asked for 64GB ram on the work system but they balked at investing in old tech.  I don't know what else it could be.  The only other thing is I replaced the Radeon 5770GPU in the work tower with a GTX-680 flashed for mac from another system.  I've done a couple 4K shows since that swap without this issue and this timeline is simpler than most of the other shows.

I wonder if the ram is getting wonky or the fibre card or Gpu.  Anybody got a suggestion on what a good hardware diagnostic to run.  I might have disk warrior on the system but are there some built in utilities that might check ram etc....?

John Moore Barking Trout Productions Studio City, CA bigfish@...






__._,_.___
Posted by: Benjamin Hershleder <ben@contactben.com>
Reply via web post • Reply to sender • Reply to group • Start a New Topic • Messages in this topic (9)
this is the Avid-L2

.

__,_._,___
Posted by Video Geek Squad at 10:43 AM 0 comments

Re: [Avid-L2] Assistance needed on older Avid project

 

Thanks Dave!! I've passed along your info. Very Helpful.

--
Tim McLaughlin
Premiere Pro Editor
http://vimeo.com/mcltim

On Thu, Aug 29, 2019 at 6:37 PM Dave Hogan mactvman@yahoo.com [Avid-L2] <Avid-L2@yahoogroups.com> wrote:
 

First some housekeeping…The most current version of v5.5x is 5.5.5, so an update might help.  (That version is still available on the AVID download site.)

Also, here is an article from AVID that describes the need to explicitly install an AVX plugin for that file format, and links for mac and pc to get it:


Some standard things about old AMA linking…

Don't use "auto" setting when linking, explicitly pick the AMA AVCHD plugin.  The auto setting was very dicey in older versions of Media Composer and often blocked functionality.

There are several bug reports about not being able to do some AVC codecs in real time on v5.5x so I suggest if you get the card to link, transcode!

Finally, there may be windows drivers required if you are using a card reader.

Hope this helps…

Dave Hogan
Burbank, CA


On Aug 29, 2019, at 9:40 AM, Roger Shufflebottom rogershuff@yahoo.co..uk [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


I'm guessing that 5.5.2 did not offer AMA for such Panasonic clips. Maybe download a trial later version, get the plugin and transcode to Avid media?

With Best Wishes, Roger Shufflebottom +44 7973 543 660


On Thursday, 29 August 2019, 17:04:02 BST, Tim McLaughlin mcltim.156@gmail.com [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


 

Friend of mine running MC 5.5.2 on a Windows 7 laptop is having difficulty importing material sourced from his Panasonic AVCCAM. Same setup worked fine last year for a similar project.

Error message that he is getting is along the lines of "this is not the first clip of a spanned clip, if this is a spanned clip it will be out of sync."

Of course - none of these files are spanned.

As a result of this message, he finds himself unable to batch import his material and is having to import one entire week of footage one clip at a time. I suggested that he AMA the files into his system, but he has been unable to do so - I'm guessing because of the age of his system.


--
Tim McLaughlin
Premiere Pro Editor (who once upon a time worked in Avid and Final Cut too!)
http://vimeo.com/mcltim


__._,_.___
Posted by: Tim McLaughlin <mcltim.156@gmail.com>
Reply via web post • Reply to sender • Reply to group • Start a New Topic • Messages in this topic (6)
this is the Avid-L2

.

__,_._,___
Posted by Video Geek Squad at 9:52 AM 0 comments

Re: [Avid-L2] MacPro Mid 2010 vs mid 2012 DPX Export Performance difference?

 

I am a member of the upgrade group where I lurk and learn.  From my limited google my understanding is 128GB works for linux and windows boots and for mac OS 96GB is the most that will be used.   I get that more ram is better I was just surprised that just 8 GB made such a dramatic difference on this show.  I've done several very similar shows on this computer without having it get laggy.  This particular show was about 10 minutes longer than most that are close to an hour.  Perhaps that contributed to the behavior I saw.



---In Avid-L2@yahoogroups.com, <mactvman@...> wrote :

Hey John,

Current MC 2019.x versions primary recommendation for Media Composer is 16GB minimum and 32 gigs recommended.  Makes sense that the extra 8gb makes a difference.

I recall that on older versions of Media Composer you could run with less ram (as little as 8gb), but for high performance situations that 64GB and 96GB was previously recommended.

I am part of a user group on Facebook called MacPro Upgrades, that you may want to check out.  The discuss the bleeding edge of performance on our old MacPros.

You can stuff the 2010 and 2012 dual processor machines with up to 128 GB of ram.  I have that much in my machine, but I don't use it for UHD outputs.

The common wisdom is that for highest performance, that the RAM needs to be matching, and in triplets.  Ideally 96GB in matched and batched 16GB sticks.

The file section in that Facebook users group has all the details.

Dave Hogan,
Burbank, CA


On Sep 7, 2019, at 8:24 PM, bigfish@... [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


Okay so I got adventurous, what better thing to do on a Saturday night at work, and the GB or extra Ram seems to  be a real tipping point.  I went back to 24GB and saw a ton of memory pressure and the time estimate crept up to 8.5 hours.  I have nested paint effects and when it hits those it must be particularly memory taxing with an unrendered sequence.  So as has been stated in this thread Ram does make a difference but I didn't know how significantly different 8GB would be.  

I've read up that even though spec for MacPro 5.1 is 64GB Ram max according to OWC with Mac OS you can go up to 96GB and if running linux or windows that can be up to 128GB.  Now I'm wondering how significant upping to 96GB might be on my home system.  I think there are caveats to using 16GB Ram sticks like they all have to be 16GB and can't be mixed with other sizes.  I'll have to look into that.  That would be 6 slots worth.  Hmmmm any more knowledgeable tech heads care to chime in.  After all OKI Dog was closed last night on my way home from work again so I might as well just stay at work and keep testing. 


---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :

So today trying the same DPX export with the 8GB of ram added and the export estimate is 4 hours and 15 minutes and not climbing up like it was yesterday.  Activity manager shows about 29.5GB or memory being used and there is no red memory pressure being displayed in activity monitor.  Also the system is not laggy like it was yesterday.

So either the extra 8GB got Avid past the tipping point and or perhaps when I installed the new ram I blew out some dust and also perhaps the reseating of the CPU tray might have improved the connections to the back plane.  That's just a guess but the difference is night and day, literally and figuratively.

Now I did have the computer running all night with Adobe Media Encoder exporting which took about 5 hours after I left and then the computer sat idle.  Point being it wasn't shut off for an extended cool down period so that wouldn't factor in.  I have a temp monitor and it shows no signs today or yesterday of particularly high temps.

If I was really adventurous I'd pull the extra Ram to check.  Perhaps I will but for now I'm glad it's working like it use to.  It is surprising to me that 8GB or ram could account for such a drastic difference but what do I know.  On my home system with 64GB of ram activity monitor showed avid using more like 36GB ram.  The home system did the export in 4.5 to 4.75 hours.  The big difference is that at home my source media, DNxHRHQX was coming of a single Hitachi Deskstar 4TB HD and at work my source media is coming from a 4GB fibre connected 16 drive raid array.  I'm kinda surprised how my USB 3 dock at home does so well but the media was very contiguous as it was copied from my work media so there would be little fragmentation still pretty impressive to me.


---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :

I had thought they had fixed the memory leak issue.  It's funny I find at home Avid link will suck up 22GB of ram creeping up the longer it runs.  The same doesn't happen at work it's weird.  I tried running MC 2018.12.5 but for some reason it wouldn't work with the NitrisDX circa 2009, even after I installed the included DX driver.  So I couldn't go to 2018.12.5 perhaps 2018.12.7 will work with the NitrisDX.  It's been a lot like herding cats of late.

What's curious is this same system has done similar shows without being so laggy.  I did find an extra 8GB or ram to fill out the two open slots.  Can't really tell if that's made a difference yet but I guess it can't hurt.


---In Avid-L2@yahoogroups.com, <forshurz@...> wrote :

RAM makes a difference, 2018.12.3 has a bad memory leak, and you can run apple hardware test on your work computer (extended) which will take over an hour to complete. If you really want to test, take the 64GB from your home computer and install it on your work computer and see if that's the big difference.

On Sep 6, 2019, at 4:09 PM, John Moore bigfish@... [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


It feels like something has changed or gone south on my work computer.

Work computer mid 2010 MacPro upgraded to 12 Core 3.33GHz, 24GB ram, GTX-680, Mac OS 10.12.6, Avid MC 2018.12.3, NitrisDX circa 2009,  4Gig Fibre Atto card to Fibrenetix 16 drive chassis, Internal 3 way 4TB hitachi stripe raid.

Home computer mid 2012 MacPro 12core upgraded to 3.46 GHz, 64GB ram, GTX-680, Cyclone Microsystems Expansion chassis 1500 watt PS with 2 TitanX 12 GBvram GPUs, DNxIO, Mac OS 10.12.6, Avid MC 2018.12.3.

At work an hour and 10 minute DCI 4096_2160 sdr Rec 709 show took abut 8 hours to export a DPX.  Now for the archival ungraded master that is unrendered it's bouncing around 12 to 14 hours and the whole system gets latent and virtually unusable.  I tried reformating the Graid 20TB target drive with and the result did not improve much.

I then copied all the media for the project onto a single 4TB Hitachi Deskstar and took it home.  Running the Hitachi drive as source and going to the same Graid as at work the time estimate is about 4hours and 15 minutes and the overall system is snappy as hell.  I did notice on the work system that Avid memory use was at times slamming up to close to 22GB or ram and the red memory pressure was showing a lot of red.  I've done this before on this system with an unrendered archival master and there was memory pressure indicated but the system didn't grind to a halt.  Could ram make that much of a difference.  I see at home Avid is using 36.85GB memory along with kernal task at 2.82GB, AvidOPFrameGeneratorApp 1.084GB and AVid DMFSupportSvc 866.9MB.  

I would think at work with source media coming off a 16 drive san chassis connected through 4Gig fibre would supply data faster than a single spinning HD.  At least the spinning HD isn't very fragmented.  I'm wondering why the big difference between systems.  I had asked for 64GB ram on the work system but they balked at investing in old tech.  I don't know what else it could be.  The only other thing is I replaced the Radeon 5770GPU in the work tower with a GTX-680 flashed for mac from another system.  I've done a couple 4K shows since that swap without this issue and this timeline is simpler than most of the other shows.

I wonder if the ram is getting wonky or the fibre card or Gpu.  Anybody got a suggestion on what a good hardware diagnostic to run.  I might have disk warrior on the system but are there some built in utilities that might check ram etc...?

John Moore Barking Trout Productions Studio City, CA bigfish@...




__._,_.___
Posted by: bigfish@pacbell.net
Reply via web post • Reply to sender • Reply to group • Start a New Topic • Messages in this topic (8)
this is the Avid-L2

.

__,_._,___
Posted by Video Geek Squad at 9:06 AM 0 comments

Re: [Avid-L2] MacPro Mid 2010 vs mid 2012 DPX Export Performance difference?

 

Hey John,

Current MC 2019.x versions primary recommendation for Media Composer is 16GB minimum and 32 gigs recommended.  Makes sense that the extra 8gb makes a difference.

I recall that on older versions of Media Composer you could run with less ram (as little as 8gb), but for high performance situations that 64GB and 96GB was previously recommended.

I am part of a user group on Facebook called MacPro Upgrades, that you may want to check out.  The discuss the bleeding edge of performance on our old MacPros.

You can stuff the 2010 and 2012 dual processor machines with up to 128 GB of ram.  I have that much in my machine, but I don't use it for UHD outputs.

The common wisdom is that for highest performance, that the RAM needs to be matching, and in triplets.  Ideally 96GB in matched and batched 16GB sticks.

The file section in that Facebook users group has all the details.

Dave Hogan,
Burbank, CA


On Sep 7, 2019, at 8:24 PM, bigfish@pacbell.net [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


Okay so I got adventurous, what better thing to do on a Saturday night at work, and the GB or extra Ram seems to  be a real tipping point.  I went back to 24GB and saw a ton of memory pressure and the time estimate crept up to 8.5 hours.  I have nested paint effects and when it hits those it must be particularly memory taxing with an unrendered sequence.  So as has been stated in this thread Ram does make a difference but I didn't know how significantly different 8GB would be.  

I've read up that even though spec for MacPro 5.1 is 64GB Ram max according to OWC with Mac OS you can go up to 96GB and if running linux or windows that can be up to 128GB.  Now I'm wondering how significant upping to 96GB might be on my home system.  I think there are caveats to using 16GB Ram sticks like they all have to be 16GB and can't be mixed with other sizes.  I'll have to look into that.  That would be 6 slots worth.  Hmmmm any more knowledgeable tech heads care to chime in.  After all OKI Dog was closed last night on my way home from work again so I might as well just stay at work and keep testing. 


---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :

So today trying the same DPX export with the 8GB of ram added and the export estimate is 4 hours and 15 minutes and not climbing up like it was yesterday.  Activity manager shows about 29.5GB or memory being used and there is no red memory pressure being displayed in activity monitor.  Also the system is not laggy like it was yesterday.

So either the extra 8GB got Avid past the tipping point and or perhaps when I installed the new ram I blew out some dust and also perhaps the reseating of the CPU tray might have improved the connections to the back plane.  That's just a guess but the difference is night and day, literally and figuratively.

Now I did have the computer running all night with Adobe Media Encoder exporting which took about 5 hours after I left and then the computer sat idle.  Point being it wasn't shut off for an extended cool down period so that wouldn't factor in.  I have a temp monitor and it shows no signs today or yesterday of particularly high temps.

If I was really adventurous I'd pull the extra Ram to check.  Perhaps I will but for now I'm glad it's working like it use to.  It is surprising to me that 8GB or ram could account for such a drastic difference but what do I know.  On my home system with 64GB of ram activity monitor showed avid using more like 36GB ram.  The home system did the export in 4.5 to 4.75 hours.  The big difference is that at home my source media, DNxHRHQX was coming of a single Hitachi Deskstar 4TB HD and at work my source media is coming from a 4GB fibre connected 16 drive raid array..  I'm kinda surprised how my USB 3 dock at home does so well but the media was very contiguous as it was copied from my work media so there would be little fragmentation still pretty impressive to me.


---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :

I had thought they had fixed the memory leak issue.  It's funny I find at home Avid link will suck up 22GB of ram creeping up the longer it runs.  The same doesn't happen at work it's weird.  I tried running MC 2018.12.5 but for some reason it wouldn't work with the NitrisDX circa 2009, even after I installed the included DX driver.  So I couldn't go to 2018.12.5 perhaps 2018.12.7 will work with the NitrisDX.  It's been a lot like herding cats of late.

What's curious is this same system has done similar shows without being so laggy.  I did find an extra 8GB or ram to fill out the two open slots.  Can't really tell if that's made a difference yet but I guess it can't hurt.


---In Avid-L2@yahoogroups.com, <forshurz@...> wrote :

RAM makes a difference, 2018.12.3 has a bad memory leak, and you can run apple hardware test on your work computer (extended) which will take over an hour to complete. If you really want to test, take the 64GB from your home computer and install it on your work computer and see if that's the big difference.

On Sep 6, 2019, at 4:09 PM, John Moore bigfish@... [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


It feels like something has changed or gone south on my work computer.

Work computer mid 2010 MacPro upgraded to 12 Core 3.33GHz, 24GB ram, GTX-680, Mac OS 10.12.6, Avid MC 2018.12.3, NitrisDX circa 2009,  4Gig Fibre Atto card to Fibrenetix 16 drive chassis, Internal 3 way 4TB hitachi stripe raid.

Home computer mid 2012 MacPro 12core upgraded to 3.46 GHz, 64GB ram, GTX-680, Cyclone Microsystems Expansion chassis 1500 watt PS with 2 TitanX 12 GBvram GPUs, DNxIO, Mac OS 10.12.6, Avid MC 2018.12.3.

At work an hour and 10 minute DCI 4096_2160 sdr Rec 709 show took abut 8 hours to export a DPX.  Now for the archival ungraded master that is unrendered it's bouncing around 12 to 14 hours and the whole system gets latent and virtually unusable.  I tried reformating the Graid 20TB target drive with and the result did not improve much.

I then copied all the media for the project onto a single 4TB Hitachi Deskstar and took it home.  Running the Hitachi drive as source and going to the same Graid as at work the time estimate is about 4hours and 15 minutes and the overall system is snappy as hell.  I did notice on the work system that Avid memory use was at times slamming up to close to 22GB or ram and the red memory pressure was showing a lot of red.  I've done this before on this system with an unrendered archival master and there was memory pressure indicated but the system didn't grind to a halt.  Could ram make that much of a difference.  I see at home Avid is using 36.85GB memory along with kernal task at 2.82GB, AvidOPFrameGeneratorApp 1.084GB and AVid DMFSupportSvc 866.9MB.  

I would think at work with source media coming off a 16 drive san chassis connected through 4Gig fibre would supply data faster than a single spinning HD.  At least the spinning HD isn't very fragmented.  I'm wondering why the big difference between systems.  I had asked for 64GB ram on the work system but they balked at investing in old tech.  I don't know what else it could be.  The only other thing is I replaced the Radeon 5770GPU in the work tower with a GTX-680 flashed for mac from another system.  I've done a couple 4K shows since that swap without this issue and this timeline is simpler than most of the other shows.

I wonder if the ram is getting wonky or the fibre card or Gpu.  Anybody got a suggestion on what a good hardware diagnostic to run..  I might have disk warrior on the system but are there some built in utilities that might check ram etc...?

John Moore Barking Trout Productions Studio City, CA bigfish@...




__._,_.___
Posted by: Dave Hogan <mactvman@yahoo.com>
Reply via web post • Reply to sender • Reply to group • Start a New Topic • Messages in this topic (7)
this is the Avid-L2

.

__,_._,___
Posted by Video Geek Squad at 3:30 AM 0 comments

Monday, September 9, 2019

Re: [Avid-L2] MacPro Mid 2010 vs mid 2012 DPX Export Performance difference?

 

I've ran a system with 96GB and didn't see a noticeable increase, so I'd stick with 64GB. 


On Sep 7, 2019, at 8:24 PM, bigfish@pacbell.net [Avid-L2] <Avid-L2@yahoogroups..com> wrote:


Okay so I got adventurous, what better thing to do on a Saturday night at work, and the GB or extra Ram seems to  be a real tipping point.  I went back to 24GB and saw a ton of memory pressure and the time estimate crept up to 8.5 hours.  I have nested paint effects and when it hits those it must be particularly memory taxing with an unrendered sequence.  So as has been stated in this thread Ram does make a difference but I didn't know how significantly different 8GB would be.  

I've read up that even though spec for MacPro 5.1 is 64GB Ram max according to OWC with Mac OS you can go up to 96GB and if running linux or windows that can be up to 128GB.  Now I'm wondering how significant upping to 96GB might be on my home system.  I think there are caveats to using 16GB Ram sticks like they all have to be 16GB and can't be mixed with other sizes.  I'll have to look into that.  That would be 6 slots worth.  Hmmmm any more knowledgeable tech heads care to chime in.  After all OKI Dog was closed last night on my way home from work again so I might as well just stay at work and keep testing. 


---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :

So today trying the same DPX export with the 8GB of ram added and the export estimate is 4 hours and 15 minutes and not climbing up like it was yesterday.  Activity manager shows about 29.5GB or memory being used and there is no red memory pressure being displayed in activity monitor.  Also the system is not laggy like it was yesterday.

So either the extra 8GB got Avid past the tipping point and or perhaps when I installed the new ram I blew out some dust and also perhaps the reseating of the CPU tray might have improved the connections to the back plane.  That's just a guess but the difference is night and day, literally and figuratively.

Now I did have the computer running all night with Adobe Media Encoder exporting which took about 5 hours after I left and then the computer sat idle.  Point being it wasn't shut off for an extended cool down period so that wouldn't factor in.  I have a temp monitor and it shows no signs today or yesterday of particularly high temps.

If I was really adventurous I'd pull the extra Ram to check.  Perhaps I will but for now I'm glad it's working like it use to.  It is surprising to me that 8GB or ram could account for such a drastic difference but what do I know.  On my home system with 64GB of ram activity monitor showed avid using more like 36GB ram.  The home system did the export in 4.5 to 4.75 hours.  The big difference is that at home my source media, DNxHRHQX was coming of a single Hitachi Deskstar 4TB HD and at work my source media is coming from a 4GB fibre connected 16 drive raid array.  I'm kinda surprised how my USB 3 dock at home does so well but the media was very contiguous as it was copied from my work media so there would be little fragmentation still pretty impressive to me.


---In Avid-L2@yahoogroups.com, <bigfish@...> wrote :

I had thought they had fixed the memory leak issue.  It's funny I find at home Avid link will suck up 22GB of ram creeping up the longer it runs.  The same doesn't happen at work it's weird.  I tried running MC 2018.12.5 but for some reason it wouldn't work with the NitrisDX circa 2009, even after I installed the included DX driver.  So I couldn't go to 2018.12.5 perhaps 2018.12.7 will work with the NitrisDX.  It's been a lot like herding cats of late.

What's curious is this same system has done similar shows without being so laggy.  I did find an extra 8GB or ram to fill out the two open slots.  Can't really tell if that's made a difference yet but I guess it can't hurt.


---In Avid-L2@yahoogroups.com, <forshurz@...> wrote :

RAM makes a difference, 2018.12.3 has a bad memory leak, and you can run apple hardware test on your work computer (extended) which will take over an hour to complete. If you really want to test, take the 64GB from your home computer and install it on your work computer and see if that's the big difference.

On Sep 6, 2019, at 4:09 PM, John Moore bigfish@... [Avid-L2] <Avid-L2@yahoogroups.com> wrote:


It feels like something has changed or gone south on my work computer.

Work computer mid 2010 MacPro upgraded to 12 Core 3.33GHz, 24GB ram, GTX-680, Mac OS 10.12.6, Avid MC 2018.12.3, NitrisDX circa 2009,  4Gig Fibre Atto card to Fibrenetix 16 drive chassis, Internal 3 way 4TB hitachi stripe raid.

Home computer mid 2012 MacPro 12core upgraded to 3.46 GHz, 64GB ram, GTX-680, Cyclone Microsystems Expansion chassis 1500 watt PS with 2 TitanX 12 GBvram GPUs, DNxIO, Mac OS 10.12.6, Avid MC 2018.12.3.

At work an hour and 10 minute DCI 4096_2160 sdr Rec 709 show took abut 8 hours to export a DPX.  Now for the archival ungraded master that is unrendered it's bouncing around 12 to 14 hours and the whole system gets latent and virtually unusable.  I tried reformating the Graid 20TB target drive with and the result did not improve much.

I then copied all the media for the project onto a single 4TB Hitachi Deskstar and took it home.  Running the Hitachi drive as source and going to the same Graid as at work the time estimate is about 4hours and 15 minutes and the overall system is snappy as hell.  I did notice on the work system that Avid memory use was at times slamming up to close to 22GB or ram and the red memory pressure was showing a lot of red.  I've done this before on this system with an unrendered archival master and there was memory pressure indicated but the system didn't grind to a halt.  Could ram make that much of a difference.  I see at home Avid is using 36.85GB memory along with kernal task at 2.82GB, AvidOPFrameGeneratorApp 1.084GB and AVid DMFSupportSvc 866.9MB.  

I would think at work with source media coming off a 16 drive san chassis connected through 4Gig fibre would supply data faster than a single spinning HD.  At least the spinning HD isn't very fragmented.  I'm wondering why the big difference between systems.  I had asked for 64GB ram on the work system but they balked at investing in old tech.  I don't know what else it could be.  The only other thing is I replaced the Radeon 5770GPU in the work tower with a GTX-680 flashed for mac from another system.  I've done a couple 4K shows since that swap without this issue and this timeline is simpler than most of the other shows.

I wonder if the ram is getting wonky or the fibre card or Gpu.  Anybody got a suggestion on what a good hardware diagnostic to run.  I might have disk warrior on the system but are there some built in utilities that might check ram etc...?

John Moore Barking Trout Productions Studio City, CA bigfish@...




__._,_.___
Posted by: Tommy Pham <forshurz@yahoo.com>
Reply via web post • Reply to sender • Reply to group • Start a New Topic • Messages in this topic (6)
this is the Avid-L2

.

__,_._,___
Posted by Video Geek Squad at 9:07 AM 0 comments

Sunday, September 8, 2019

[Avid-L2] File - FAQ AVID-L2.txt

 


Welcome to the Avid-L2
FAQ!
AVID-L II Frequently Asked Questions (FAQ)

Subscribing (or unsubscribing) to the Avid-L2
Send an e-mail message to:
Avid-L2-subscribe@yahoogroups.com

Or, to unsubscribe, send e-mail to:
Avid-L2-unsubscribe@yahoogroups.com

Note that by subscribing, you are acknowledging that you have read
and understand this FAQ See below for additional detail.
Changing your e-mail address:
To change your e-mail - As this is a yahoo mailing list, you can re-set your non-yahoo email address from the http://groups.yahoo.com/group/Avid-L2/ web page.

Your options for member types can be reviewed on the group's home page. At any time, you can view messages on the web site for this group itself

Membership types are Indvidual messages, Digests of 25 messages each, special announcements only, or no mail at all.

To change your member type, visit the group web site and modify your membership type in the check boxes provided

Policies
Despite what email address or handle you use, you should register as a Yahoo user to participate in the Avid-L2, for access to the web features of this group.
Subscribers should set up an account with their legal first and last names, then send the request to join.
This is a Moderated list, and all subscription requests must be approved by the moderator(s). If you have a Yahoo account already that you would like to use, but doesn't contain your first and last names, please include your first and last name in the subscription request to the moderator when you request to join.

As always, Yahoo and the moderators of this list are not responsible for the use third parties may make of information you have made publicly available in this or any other public
forum. Please take a look at the applicable Yahoo Terms of Use and Privacy
Policy for more information about public information and forums.
Off Topic Filtering. Part of the interest of the Avid-L2 is it's range
of topics. If you are posting an Off-topic thread, please preface the
subject with OT: Use the colon after the letters.
Email filters and rules can be used by subscribers to move Off Topic posts to where ever they would like in their email organization by using a rule/filter with Sender of: Avid-l2@yahoogroups.com and subject contains OT: .

The Avid-L is a helpful yet rough around the edges crowd. Topics that are not welcome are religion, politics, and other disruptive topics that interfere with the operation of the list. Moderation of these topics will be quick, so simply put- Let's all just play nice

Comercial Posts must be prefaced with [comercial] in the subject or they will be rejected.
Jobs should have [job] in their header, and press releases should have [pr] in their header

Background

Avid-L was established in 1994 at Calvin College by Steven Koster.
It was created to be a forum for Avid users to meet, discuss, and share
information.

Avid-L quickly grew into the premiere on-line users group for
professional film and video editors. It was one of the earliest examples

of an Internet community, allowing hundreds of editors worldwide to
share their experiences and expertise with their peers. There was no
better place for a professional Avid editor to get such wealth of
informed professional advice.

At various times, individual subscribers volunteered services to the
group. Searchable archives were maintained by Germany's Berlin Users
Group as well as the UIUC. A tips & tricks list was posted by Andy
Birkhead of Innovative Edit. Wes Plate, a longtime contributor, not only

shared key techniques on his Web site, he also created a photo gallery
for members' portraits.

In 1997, several subscribers began a tradition of meeting in person at
the NAB trade show in Las Vegas. The first gatherings were organized by Jaime Fowler. In 1999,
Avid Technology itself began sponsoring these gatherings as an exclusive reception and seminar for Avid-L members only. In 2002, this changed to the "Avid Users Group" meeting.

By 1999, Avid-L boasted over 1600 subscribers, exhibiting a true
international scope with over 300 international members. The community
included participants from a wide variety of well-known corporate
organizations in broadcasting, technical, and content creation fields,
as well as and multiple local TV stations, colleges, and universities.

In 2000, Avid-L joined AvidProNet.com, and then, in 2002, was integrated
Into Avid.com.

In 2005 Due to problems with signal to noise ratio and abusive posters, the Avid-L2 was formed. A year later the Avid-L was discontinued by Avid.

At the middle of 2006, the L2 has around 1100 members, with plenty of "lurker only" members who simply use the web version of the list. The L2 is spam-free, by moderation and with Yahoo's tools and will remain that way. The integrated archives with both old L and L2 posts came on line recently as well at the University of Illinois. That can be found at http://archives.itg.uiuc.edu/avid/.

Cross-posting to the FCP-L is welcome, tho reply's will not flow back to either list necessarily- check your own email reply preferences. The Final Cut list is found at: http://movies.groups.yahoo.com/group/FinalCutPro-L

Welcome, and Enjoy!

Extras!
With a Yahoo account tied to your subscription to the Avid-L2, you can use the web features of the Group.

Calendar Various Avid events are in the Calender. If you have an event you'd like posted, pull down and fill out the Calendar event request and send it to any Moderator

Database - The database area contains Avid Feature requests, Help Wanted, Freelance Listings and For Sale sections. Feel free to add your listings to any of these areas. Job Postings will remain up for 1 month. Please date all postings to the database areas, being pertinent is a good way to be.

Files- The files section contains various sundry files, including the latest Avid release notes. Check back often for changes.

Photos - Pictures of your Avid setup are welcome, or pictures relating to a post you need a photo to explain. Photos will be posted after moderator approval. Who knows, your picture might grace the front page for a while.

Links- Various helpful links, including direct links to Avid CPR releases can be found here, also the link to the archives.

JDS

__._,_.___
Reply via web post • Reply to sender • Reply to group • Start a New Topic • Messages in this topic (396)
this is the Avid-L2

.

__,_._,___
Posted by Video Geek Squad at 2:43 AM 0 comments
Subscribe to: Posts (Atom)