Determining Indexing Strings with Statistical Analysis(Special Issue on Text Processing for Information Access)

スポンサーリンク

概要

• 論文の詳細を見る

• Determining indexing strings is an important factor in information retrieval. Ideally, the strings should be words that represent documents of queries. Although any single word may be the first candidate for indexing strings for an English corpus, it may not be ideal due to the existence of compound nouns, which are often good indexing strings, and which often depend on the genre of the corpus used. The situation is even worse in Japanese or Chinese where the words are not separated by spaces. In this paper, we propose a method of determining indexing strings based on statistical analysis. The novel features of our method are to make the most of the statistical resources such as dictionaries and stop word lists. In evaluating our method using a Japanese test collection, we found that it actually improves the precision of information retrieval systems.

• 社団法人電子情報通信学会の論文
• 2003-09-01

著者

• Takeda Yoshiyuki

  Toyohashi University Of Technology

• Yamamoto Eiko

  Communications Research Laboratory

• UMEMURA Kyoji

  Toyohashi University of Technology

関連論文

• Determining Indexing Strings with Statistical Analysis(Special Issue on Text Processing for Information Access)
• Improvements of Katz K Mixture Model

スポンサーリンク