Image-based Eye Pose and Reflection Analysis for Advanced Interaction Techniques and Scene Understanding

概要

論文の詳細を見る
Recently, the geometric relation between a human eye and its image has been formalized to analyze environmental light reflections in the cornea. Proceeding with these efforts, our study proposes a theory of the light transport at the corneal surface including multiple eye poses, develops novel applications, and performs comprehensive experimental evaluation. Based on anthropometric data, a spherical-curvature geometric eye model is developed, and subsequently applied to discuss methods for eye pose estimation from projected circular eye features. The combination of camera and corneal mirror acts as a catadioptric imaging system, for which we describe the back projection to reconstruct the position of a light source, and the forward projection of light from a given source into the image. The theory has several practical applications in scene reconstruction and human-computer interaction, where we discuss the geometric calibration of display-camera setups as one particular problem. We propose a novel approach that eliminates the requirement of special hardware and tedious user interaction by analyzing screen reflections in the cornea. Based on this setting, thorough experimental evaluation shows that simple scene reconstruction results in a large error. We discuss possible reasons and introduce an optimization scheme that achieves feasible results by exploiting geometry constraints within the system. Our study provides sophisticated strategies for analyzing the geometric relation between camera, eye pose, corneal shape, and scene structure within arbitrary dynamic environments. The findings and developments enable novel insights, understanding, and applications in the analysis of human-scene interaction. We believe that this work has implications on several fields and is an important contribution.
2011-05-12

Image-based Eye Pose and Reflection Analysis for Advanced Interaction Techniques and Scene Understanding

スポンサーリンク

概要

著者

関連論文

スポンサーリンク