Gaze Detection by Estimating the Depths and 3D Motion of Facial Features in Monocular Images
スポンサーリンク
概要
- 論文の詳細を見る
This paper describes a new method for detecting the gaze position of a user on a monitor from monocular images. In order to detect the gaze position, we extract facial features (both eyes, nostrils and lip corners) automatically in 2D camera images and estimate the 3D depth information and the initial 3D positions of those features by recursive estimation algorithm in starting images. Then, when a user moves his/her head in order to gaze at one position on a monitor, the moved 3D positions of those features can be estimated from 3D motion estimation by Extended Kalman Filter (EKF) and affine transform. Finally, the gaze position on a monitor is calculated from the normal vector of the plane determined by those moved 3D positions of features, Especially, in order to obtain the exact 3D depth and positions of initial feature points, we unify three coordinate systems (face, monitor and camera coordinate system) based on perspective transformation. As experimental results, the 3D depth and the position estimation error of initial feature points, which is the RMS error between the estimated initial 3D feature positions and the real positions (measured by 3D position tracker sensor) is about 1.28cm (0.75cm in X axis, 0.85cm in Y axis, O.6cm in Z axis) and the 3D motion estimation errors of feature points by Extended Kalman Filter (EKF) are about 3.6 degrees and 1.4cm in rotation and translation, respectively. From that, we can obtan the gaze position on a monitor (17 inches) and the gaze position accuracy between the calculated positions and the real ones is about 2.1 inches of RMS error.
- 社団法人電子情報通信学会の論文
- 1999-10-25
著者
-
LEE Min
Department of Internal Medicine, Chonnam National University Hospital
-
Lee Min
Department Of Electrical And Computer Engineering Yonsei University
-
PARK Kang
Department of Electrical and Computer Engineering, Yonsei University
-
NAM Si
Department of Electrical and Computer Engineering, Yonsei University
-
KIM Jaihie
Department of Electrical and Computer Engineering, Yonsei University
-
Nam Si
Department Of Electrical And Computer Engineering Yonsei University
-
Kim Jaihie
Department Of Electrical And Computer Engineering Yonsei University
-
Park K
Yonsei Univ. Seoul Kor
-
Lee Min
Department Of Aeronautics And Astronautics Kyushu University
関連論文
- Long-Term Clinical Course of Patients With Isolated Myocardial Bridge
- Facilitated Skin Permeation of Oregonin by Elastic Liposomal Formulations and Suppression of Atopic Dermatitis in NC/Nga Mice
- Protective Effects of Isoliquiritigenin Against Methamphetamine-Induced Neurotoxicity in Mice
- Investigation of Abnormal Drain Current Increase of Tunneling Field-Effect Transistors(Session 3A : Emerging Device Technology 2)
- Investigation of Abnormal Drain Current Increase of Tunneling Field-Effect Transistors(Session 3A : Emerging Device Technology 2)
- A TP53-truncating germline mutation (E287X) in a family with characteristics of both hereditary diffuse gastric cancer and Li-Fraumeni syndrome
- Early Statin Therapy Within 48 Hours Decreased One-Year Major Adverse Cardiac Events in Patients With Acute Myocardial Infarction
- Primary large cell neuroendocrine carcinoma of the urinary bladder
- Saeng-Maek-San, a Medicinal Herb Complex, Protects Liver Cell Damage Induced by Alcohol
- Effect of Green Tea Consumption on Endothelial Function and Circulating Endothelial Progenitor Cells in Chronic Smokers
- Sphingosine kinase inhibitor suppresses a T_h1 polarization via the inhibition of immunostimulatory activity in murine bone marrow-derived dendritic cells
- A Study of LPE HgCdTe Wafer Characteristics Flattened with Single-Point Diamond Turning Method (先端デバイスの基礎と応用に関するアジアワークショップ(AWAD2005))
- A Study of LPE HgCdTe Wafer Characteristics Flattened with Single-Point Diamond Turning Method (先端デバイスの基礎と応用に関するアジアワークショップ(AWAD2005))
- Three New Stereoisomers of Condensed Tannins from the Roots of Rosa multiflora
- Biocompatibility of Surface-Treated Pure Titanium and Ti-6A1-4V Alloy
- First-line therapy with doxycycline in ocular adnexal mucosa-associated lymphoid tissue lymphoma : A retrospective analysis of clinical predictors
- Sarcoptes scabiei in Infundibulum of Nodular Scabies
- Gaze Detection by Estimating the Depths and 3D Motion of Facial Features in Monocular Images
- O-1-194 Cost Effectiveness of Laparoscopic Appendectomy in Korean Academic Hospital
- Hodge structures on parabolic cohomology
- Approximate Frequency Beam Command of the RPFSR System in the Ground Based Coordinate System
- Comparative study on the major element chemical compositions of Antarctic chondrites to those of non-Antarctic falls with reference to terrestrial weathering
- Carcinosarcoma of the rectosigmoid colon in a 13-year-old girl
- A New Iris Recognition Method Using Independent Component Analysis(Image Recognition, Computer Vision)
- Batch Production of High-Content Fructo-Oligosaccharides from Sucrose by the Mixed-Enzyme System of β-Fructofuranosidase and Glucose Oxidase
- A Case of Necrotizing Sclerokeratitis and Endophthalmitis Caused by Beauveria bassiana
- Fritillaria ussuriensis Extract Inhibits the Production of Inflammatory Cytokine and MAPKs in Mast Cells
- JKCF2-5 A synonymous variation in Protease-Activated Receptor-2 is associated with atopy in Korean children(Atopic eczema and related diseases,Free Paper Session 2,Japan-Korea-China Joint Symposium)
- アジアの生物学的精神医学の現状 : (1)韓国
- Association of a synonymous GAT3 polymorphism with antiepileptic drug pharmacoresistance
- Neural Stem Cells Modified by a Hypoxia-Inducible VEGF Gene Expression System Improve Cell Viability under Hypoxic Conditions and Spinal Cord Injury
- Effects of Hydrazine Surface Treatment on HgCdTe Long-Wavelength Infrared Photodiodes
- Three New Orcinol-Conjugated Hydrolysable Tannins from the Leaves of Cleyera japonica
- E1-2 Genetic variation in chitotriosidase is associated with atopy in Korean children(English Session 1)
- Testicular tuberculosis in multidrug-resistant pulmonary tuberculosis