What Test Constructors Should Keep in Mind : Constructing and Scoring a Translation Test
スポンサーリンク
概要
- 論文の詳細を見る
Translation tests are widely used for high school term tests and entrance examinations as well as university entrance examinations. Although a considerable number of papers point out the possibility of low reliability for scoring, little is known about the factors raters play in the reliability of scoring (Watanabe, 1994). This study examines how the professional backgrounds of raters affect rating criteria. The results indicated that novice raters tended to over-estimate examinees' comprehension whereas experienced raters were more likely to focus on the correctness of the Japanese sentence. In addition, it turned out that the difficulty of sentences affected the scoring of both experienced and novice raters. After administering a sorting task, the difficulty of the sentences showed that the perception of sentence difficulty did not correspond to the difficulty of examinees' translation. The paper closes by suggesting several pedagogical implications for administering translation tests. Of particular importance is that test developers should consider not only the complexity of sentence structures and vocabulary, but also the examinees' topic familiarity of the sentences to be translated.
- 日本言語テスト学会の論文
- 2005-02-20
著者
-
Hijikata Yuko
Graduate School University Of Tsukuba:the Japan Society For The Promotion Of Science
-
USHIRO Yuji
University of Tsukuba
-
KOGA Tsutomu
Graduate School, University of Tsukuba
-
SATO Tsuyoshi
Graduate School, University of Tsukuba
-
NIKLAI Gergely
Graduate School, University of Tsukuba
-
MURATA Erina
Graduate School, University of Tsukuba
-
SATO Tsuyoshi
Graduate School of Information Sciences, Tohoku University
関連論文
- Effects of Necessary Information on Listening Tests : Focus on its Location and Characteristics
- Comparing Effects of Two Types of Vocabulary Knowledge on Six Question Types in Reading Tests Among Japanese EFL Learners
- Comparison of L2 Readers' Performance in Translation, Recall, and Summary Tasks
- What Makes Distractors Plausible in Multiple-Choice Reading Tests?
- What Test Constructors Should Keep in Mind : Constructing and Scoring a Translation Test
- Measures of Macroproposition Construction in EFL Reading : Summary Writing Task vs. the Meaning Identification Technique