We have set out to create a software which will generate a movie of a person (on
which we have previously gathered data – our Marionette) speaking the words of
another, our Actor, who moves his lips in whatever fashion he chooses. The input
to the system is a video featuring a person, speaking to the camera. The output
is a video of the Marionette, moving it’s lips the same way.
