FREE VIEWPOINT IMAGE GENERATION FROM HANDHELD-CAMERA SEQUENCE(International Workshop on Advanced Image Technology 2006)

概要

論文の詳細を見る
This paper discusses a new method to generate free viewpoint images from handheld-camera sequence. In this research, a captured image is treated as ray information. Collected rays that pass over the focal point of a virtual camera constitute the free viewpoint image with interpolating lack rays. However, ray interpolation from freely arranged images, like handheld-camera sequence, has rarely been discussed. Here, we propose a novel method to generate arbitrary viewpoint images with ray interpolation. An arbitrary viewpoint image is generated by the following procedures on pixel-by-pixel basis. First, we project a focused pixel into a 3D space as a ray. Second, we reproject a point on the ray to the captured images near the ray, and third, we search for pixel-to-pixel correspondence to determine the pixel's depth. Finally, we interpolate the pixel by blending the corresponding points. Using the proposed scheme, we successfully synthesized arbitrary viewpoint images from handheld-camera sequence.
社団法人電子情報通信学会の論文
2006-01-03