A method for sentence analysis of Japanese based on bigrams of cognitive units
スポンサーリンク
概要
- 論文の詳細を見る
While most natural language processing systems adopt morphemes as units of processing, humans are known to use larger processing units, which we call cognitive units. The human process of sentence analysis can be considered as consisting of two stages: detection and selection of cognitive units. Based on this idea, this paper proposes a method for sentence analysis which first detects possible cognitive units using a state transition diagram, and then selects correct cognitive units on the basis of their bigrams. The proposed method was applied to text error correction, and the experimental results confirmed that it can achieve a higher performance than that can be attained using morpheme bigrams.
- 言語処理学会の論文
言語処理学会 | 論文
- 複合語の分野連想語の効率的決定法
- クラス指向事例収集手法による言い換えコーパスの構築
- 動詞項構造辞書への大規模用例付与
- 言い換え技術に関する研究動向
- Morpho-Syntactic Rules for Detecting Japanese Term Variation: Establishment and Evaluation