Technical Evaluation of MT Systems from the Developer's Point of View:Exploiting Test-sets for Quality Evaluation
スポンサーリンク
概要
- 論文の詳細を見る
This paper describes a method of evaluating quality for developers of machine translation systems to easily check imperfections in their own systems. Our method employs test-sets in which example sentences, their model translations, yes/no questions for evaluating the system output, similar examples (if any), and grammatical explanations have been systematically aligned. The example sentences have been collected focusing on wide coverage of both basic linguistic phenomena and linguistic phenomena problematic to MT systems. The questions in the test-sets are designed to clarify the evaluation viewpoints. Given the system outputs for each example sentence in question, the system developer needs only to answer the question assigned to the example sentence. This judgment does not vary among evaluators, thus enabling an objective evaluation.
- 言語処理学会の論文
言語処理学会 | 論文
- 複合語の分野連想語の効率的決定法
- クラス指向事例収集手法による言い換えコーパスの構築
- 動詞項構造辞書への大規模用例付与
- 言い換え技術に関する研究動向
- Morpho-Syntactic Rules for Detecting Japanese Term Variation: Establishment and Evaluation