Video Rewrite: Driving Visual Speech with Audio
Christoph Bregler, Michele Covell, Malcolm Slaney
Abstract
Video Rewrite uses existing footage to create automatically new video of a person mouthing words that she did not speak in the original footage. This technique is useful in movie dubbing, for example, where the movie sequence can be modified to sync the actors' lip motions to the new soundtrack.
Topics & Concepts
syncComputer scienceAudio visualSpeech recognitionSequence (biology)MultimediaCommunicationComputer graphics (images)Human–computer interactionArtificial intelligencePsychologyFrame (networking)TelecommunicationsBiologyGeneticsVideo Analysis and SummarizationAdvanced Vision and ImagingHuman Motion and Animation