Many video sequences consist of a locally dynamic background containing moving foreground subjects. In this project we will develop a novel way of re-displaying these sequences, by giving the user control over a virtual camera frame. Based on video mosaicing, we first compute a static high quality background panorama. After segmenting and removing the foreground subjects from the original video, the remaining elements are merged into a dynamic background panorama, which seamlessly extends the original video footage. We then re-display this augmented video by warping and cropping the panorama. The virtual camera can have an enlarged field-of-view and a controlled camera motion. Our technique is able to process videos with complex camera motions, reconstructing high quality panoramas without parallax artefacts, visible seams or blurring, while retaining repetitive dynamic elements.

In this project we will develop algorithm and create an application.

1. Supervisor:
   Dmitry Rudoy
   04-8294750
   Email: dmitryr@tx.technion.ac.il
   
2. Field:
   Computer Graphics in 3D
3. Requirements:
   Image Processing and Analysis (046200), preferably learnt before
   
4. Project status:
   Taken by the students Limor Greenberg and Yaniv Romano
   
5. Visit:
   Project web site