A Machine Learning Approach for an Indonesian-English Cross Language Question Answering System(Natural Language Processing)

スポンサーリンク

概要

• 論文の詳細を見る

• We have built a CLQA (Cross Language Question Answering) system for a source language with limited data resources (e.g. Indonesian) using a machine learning approach. The CLQA system consists of four modules: question analyzer, keyword translator, passage retriever and answer finder. We used machine learning in two modules, the question classifier (part of the question analyzer) and the answer finder. In the question classifier, we classify the EAT (Expected Answer Type) of a question by using SVM (Support Vector Machine) method. Features for the classification module are basically the output of our shallow question parsing module. To improve the classification score, we use statistical information extracted from our Indonesian corpus. In the answer finder module, using an approach different from the common approach in which answer is located by matching the named entity of the word corpus with the EAT of question, we locate the answer by text chunking the word corpus. The features for the SVM based text chunking process consist of question features, word corpus features and similarity scores between the word corpus and the question keyword. In this way, we eliminate the named entity tagging process for the target document. As for the keyword translator module, we use an Indonesian-English dictionary to translate Indonesian keywords into English. We also use some simple patterns to transform some borrowed English words. The keywords are then combined in boolean queries in order to retrieve relevant passages using IDF scores. We first conducted an experiment using 2,837 questions (about 10% are used as the test data) obtained from 18 Indonesian college students. We next conducted a similar experiment using the NTCIR (NH Test Collection for IR Systems) 2005 CLQA task by translating the English questions into Indonesian. Compared to the Japanese-English and Chinese-English CLQA results in the NTCIR 2005, we found that our system is superior to others except for one system that uses a high data resource employing 3 dictionaries. Further, a rough comparison with two other Indonesian-English CLQA systems revealed that our system achieved higher accuracy score.

• 社団法人電子情報通信学会の論文
• 2007-11-01

著者

• Purwarianti Ayu

  Department Of Information And Computer Sciences Toyohashi University

• Tsuchiya Masatoshi

  Information and Media Center, Toyohashi University of Technology

• Tsuchiya Masatoshi

  Information And Media Center Toyohashi University Of Technology

• Nakagawa Seiichi

  Toyohashi Univ. Technol. Toyohashi‐shi Jpn

• Nakagawa Seiichi

  Department Of Information And Computer Sciences Toyohashi University

• PURWARIANTI Ayu

  Electronic and Information Department, Toyohashi University of Technology

• NAKAGAWA Seiichi

  Electronic and Information Department, Toyohashi University of Technology

• Tsuchiya Masatoshi

  Toyohashi Univ. Technol.

関連論文

• 中間言語を用いたインドネシア語-日本語対訳辞書の拡充
• Topic dependent language model based on on-line voting (言語理解とコミュニケーション)
• A transitive translation for Indonesian-Japanese CLQA (自然言語処理)
• A Machine Learning Approach for an Indonesian-English Cross Language Question Answering System(Natural Language Processing)
• Indonesian-Japanese Transitive Translation using English for CLIR
• Topic dependent language model based on on-line voting (音声)
• Topic dependent language model based on clustering of noun word history
• Word and class dependency of N-gram language model (音声言語情報処理)
• Word and class dependency of N-gram language model (言語理解とコミュニケーション・第9回音声言語シンポジウム)
• Word and class dependency of N-gram language model (音声・第9回音声言語シンポジウム)
• TEXT-INDEPENDENT SPEAKER IDENTIFICATION ON TIMIT DATABASE
• Text-Independent/Text-Prompted Speaker Recognition by Combining Speaker-Specific GMM with Speaker Adapted Syllable-Based HMM(Speaker Recognition, Statistical Modeling for Speech Processing)
• Evaluation of Combinational Use of Discriminant Analysis-Based Acoustic Feature Transformation and Discriminative Training
• LVCSR based on context-dependent syllable acoustic models (Speech) -- (国際ワークショップ"Asian workshop on speech science and technology")
• Robust distant speech recognition by combining variable-term spectrum based position-dependent CMN with conventional CMN (Speech) -- (国際ワークショップ"Asian workshop on speech science and technology")
• Linear Discriminant Analysis Using a Generalized Mean of Class Covariances and Its Application to Speech Recognition
• Robust Speech Recognition by Combining Short-Term and Long-Term Spectrum Based Position-Dependent CMN with Conventional CMN
• LVCSR based on context-dependent syllable acoustic models
• Robust distant speech recognition by combining variable-term spectrum based position-dependent CMN with conventional CMN
• Improving Keyword Recognition of Spoken Queries by Combining Multiple Speech Recognizer's Outputs for Speech-driven WEB Retrieval Task(Spoken Language Systems, Corpus-Based Speech Technologies)
• An Unsupervised Speaker Adaptation Method for Lecture-Style Spontaneous Speech Recognition Using Multiple Recognition Systems(Spoken Language Systems, Corpus-Based Speech Technologies)
• Speaker Change Detection and Speaker Clustering Using VQ Distortion Measure
• Noisy Speech Recognition Based on Integration/Selection of Multiple Noise Suppression Methods Using Noise GMMs
• Succeeding Word Prediction for Speech Recognition Based on Stochastic Language Model
• A Survey on Automatic Speech Recognition(Special Issue on the 2000 IEICE Excellent Paper Award)
• Relationship among Recognition Rate, Rejection Rate and False Alarm Rate in a Spoken Word Recognition System
• Speaker Recognition by Combining MFCC and Phase Information in Noisy Conditions
• Distant Speech Recognition Using a Microphone Array Network
• Auditory perception versus automatic estimation of location and orientation of an acoustic source in a real environment
• Continuous Speech Recognition Using an On-Line Speaker Adaptation Method Based on Automatic Speaker Clustering (Special Issue on Speech Information Processing)
• Distant-Talking Speech Recognition Based on Spectral Subtraction by Multi-Channel LMS Algorithm
• A Spoken Dialog System for Spontaneous Conversations Considering Response Timing and Response Type
• Indonesian-Japanese Transitive Translation using English for CLIR
• Class-Based N-Gram Language Model for New Words Using Out-of-Vocabulary to In-Vocabulary Similarity

もっと見る 閉じる

スポンサーリンク