Thursday, January 7, 2010

[Avid-L2] Script-based editing and production

I recently sent some questions to the group regarding the potential value that pure audio search would bring to video editing and production software similar to the tools offered by Avid, Adobe, Apple, etc.

I'd like to share another example of how ScriptSync could be useful, and get feedback on other ideas that you have for making use of Nexidia technology.

First, a basic overview of how this works. ScriptSync, at its core, leverages Nexidia's phonetic search technology to locate groups of words within an audio file. These words are derived from shooting scripts and transcripts in the case of Media Composer. Because ScriptSync can locate any group of words within any audio file(s), the text does not have to cover all the words spoken in the audio (similarly, the text could cover much more than that audio). The resulting output is a word-for-word time alignment (to the millisecond) of the words from the text that are found in the audio. Extra words are not assigned a time (no artificial forced-alignment).

MSNBC leverages both transcripts and closed-captions to produce a text index of each word spoken in their television shows. For an example of how they leverage this feature, see -- http://www.msnbc.msn.com/id/27721638/. (select "Play", watch the commercial, the select either `transcript' or `clip and embed' mode in the player controls).

For each inaugural address (since the 1930's), the video has been sync'ed with the audio. The end user can select any group of words in the transcript and the player will advance and play that exact portion of the audio. Text can be highlighted and a virtual clip of the associated video is available to be previewed and embedded externally. Relevant keywords have also been pulled out of the text and located within the video – select any keyword below the player and each instance of that word is displayed with a marker along a timeline representing the video; each marker can be selected to jump-to the word spoken in the video.

In addition to this consumer application of Nexidia technology, do you have ideas on how ScriptSync would be valuable to the professional editing community?

Would a text-based video editor – i.e., ability to select text, sequence and re-sequence text segments, resulting in a modified scene sequence that could be previewed as if it were a single edited video – streamline or otherwise make your job easier?

Do you see applications of this technology in specific tasks or processes you do while editing video?

How do you see this technology best delivered – as an application feature where archived content accessible and can be sync'ed? As a service where a text file and video(s) can be uploaded and processed?

Another note about MSNBC – they also use Nexidia technology to time align all network programming with it's associated closed-captioning. The closed-captioning is sometimes of poor quality and often broken into much larger chunks that needs to be "filtered" using ScriptSync to identify only that which is relevant to the program. The resulting time-aligned metadata provides a foundation for rich keyword based search and browsing of topical content on their website.

------------------------------------

Search the offical complete Avid-L archives at: http://archives.bengrosser.com/avid/

Everything you MUST know about Color Correction in one book: http://tinyurl.com/ColorCorectionforvideo Get your copy todayYahoo! Groups Links

<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/Avid-L2/

<*> Your email settings:
Individual Email | Traditional

<*> To change settings online go to:
http://groups.yahoo.com/group/Avid-L2/join
(Yahoo! ID required)

<*> To change settings via email:
Avid-L2-digest@yahoogroups.com
Avid-L2-fullfeatured@yahoogroups.com

<*> To unsubscribe from this group, send an email to:
Avid-L2-unsubscribe@yahoogroups.com

<*> Your use of Yahoo! Groups is subject to:
http://docs.yahoo.com/info/terms/

No comments:

Post a Comment