Yoav Y. Schechner: Research

Radiometric Non-idealities

Cameras may have non-ideal radiometric aspects, including spatial non-uniformity, e.g., due to vignetting; a nonlinear radiometric response of the sensor; and temporal variations due to automatic gain control (AGC). Often, these characteristics exist simultaneously, and are typically unknown. They thus hinder consistent photometric measurements. In particular, they create annoying seams in image mosaics. Prior studies approached part of these problems while excluding others.

We handle all these problems in a unified framework. We suggest an approach for simultaneously estimating the radiometric response, the spatial non-uniformity and the temporally varying gain. The approach does not rely on dedicated processes that intentionally vary exposure settings. Rather, it is based on an ordinary frame sequence acquired during camera motion. The estimated non-ideal characteristics are then compensated for. We state fundamental ambiguities associated with this recovery problem, while exposing a novel image invariance.

The method is demonstrated in several experiments, where different frames are brought into mutual radiometric consistency. The accuracy achieved is sufficient for seamless mosaicing, with no need to resort to dedicated seam-feathering methods.

Publications

1. Anatoly Litvinov and Yoav Y. Schechner, “Addressing radiometric nonidealities: A unified framework,” Proc. IEEE CVPR, Vol. 2, pp. 52-59 (2005).
2. Anatoly Litvinov and Yoav Y. Schechner, “Radiometric framework for image mosaicking,” Journal of the Optical Society of America - A, Vol. 22 , No. 5 , pp. 839-848 (2005).

Presentations

1. “Radiometric Nonidealities: A Unified Framework” (6.2 Mb, PowerPoint)
2. The presentation above references two movies: Experiment 1 (11.7 Mb, AVI) and Experiment 2 (14.3 Mb, AVI).

Related Research

1. Generalized mosaicing