| 1,211 | 9 | 6 |
| 下载次数 | 被引频次 | 阅读次数 |
本文回顾了国内外英语作文、英/汉翻译和英语口语自动评分研究的发展脉络,梳理了自动评分技术在以上三个领域的起源、演变路径与应用情况,并对各项技术的优势和不足之处进行了评价。本文最后反思现有自动评分研究面临的困难和挑战,指出了未来研究的发展方向和趋势。
Abstract：This paper reviews the development of research on automated scoring of English essays, Chinese-to-English/English-to-Chinese translations and spoken Englishin China and other countries. It first combs the origin,evolutionary paths and applications of automatic scoring technology in the above-mentioned three fields respectively, and then evaluates the advantages and disadvantages of each technology. Finally, it reflects on the challenges faced by the existing automatic scoring studies,and points out directions and trends for future research.
[1] Bernstein, J. C. Computer scoring of spoken responses[A]. In C. A. Chapelle(ed). The Encyclopedia of Applied Linguistics, Volume II[C]. Oxford:Wiley Blackwell, 2012:857-863.
[2] B e r n s t e i n, J., A.Va n M o e r e&J. C h e n g.Va l i d a t i n g a u t o m a t e d s p e a k i n g t e s t s[J].Language Testing, 2010(3):355-377.
[3] Burstein, J. The e-rater?scoring engine:Automated essay scoring with natural language processing[A]. In M. D. Shermis&J. Burstein(eds). Automated Essay Scoring:A Crossdisciplinary Perspective[C]. Mahwah, NJ:Lawrence Erlbaum Associates, 2003:113-121.
[4] Burstein, J. Automated essay evaluation and scoring[A]. In C. A. Chapelle(ed). The Encyclopedia of Applied Linguistics, Volume I[C]. Oxford:Wiley Blackwell, 2012:309-315.
[5] Chapelle, C.&Y. Chung. The promise of NLP and speech processing technologies in language assessment[J]. Language Testing, 2010(3):301-315.
[6] Chung, G. K.&E. L. Baker. Issues in the reliability and validity of automated scoring of constructed responses[A]. In M. D. Shermis&J. Burstein(eds). Automated Essay Scoring:A Cross-disciplinary Perspective[C]. Mahwah,NJ:Lawrence Erlbaum Associates, 2003:23-40.
[7] Derwing, T. M., M. J. Munro.&M. Carbonaro.Does popular speech recognition software work with ESL speech?[J]. TESOL Quarterly,2000(3):592-603.
[8] Dikli, S. An overview of automated scoring of essays[J]. Journal of Technology, Learning, and Assessment, 2006(1):3-35.
[9] Doddington, G. Automatic evaluation of machine translation quality using N-gram co-occurrence statistics[A]. In Proceedings of the Second International Conference on Human Language Technology Research[C]. San Diego, CA, 2002:128-132.
[10] Ehsani, F.&E. Knodt. Speech technology in computer-aided language learning:Strengths and limitations of a new CALL paradigm[J].Language Learning&Technology, 1998(1):54-73.
[11] Elliot, S. IntelliMetricTM:From here to validity[A]. In M. D. Shermis&J. Burstein(eds).Automated Essay Scoring:A Cross-disciplinary Perspective[C]. Mahwah, NJ:Lawrence Erlbaum Associates, 2003:71-86.
[12] Higgins, D., X. Xi, K. Zechner&D. Williamson.A three-stage approach to the automated scoring of spontaneous spoken responses[J]. Computer Speech and Language, 2011(2):282-306.
[13] Jiang, J., L. Jiang&X. Lu. Automated scoring of students’ English-to-Chinese translations of three text types[J]. Journal of Quantitative Linguistics, 2018(3):238-255.
[14] J u r a f s k y, D.&J. H. M a r t i n. S p e e c h a n d Language Processing:An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition(2nd ed)[M]. Upper Saddle River, N.J.:Pearson Prentice Hall, 2009.
[15] Kang, O.&L. Pickering. Acoustic and temporal analysis for assessing speaking[A]. In A. J.Kunnan(ed). The Companion to Language Assessment:Vol. II. Approaches and Development[C]. Hoboken:John Wiley&Sons, 2014:1047-1062.
[16] Kukich, K. Beyond automated essay scoring[J].IEEE Intelligent Systems&Their Applications,2000(5):22-27.
[17] L andauer, T. K., D. Laham&P. W. Foltz.Automated essay scoring and annotation of essays with the Intelligent Essay Assessor[A]. In M. D.Shermis&J. Burstein(eds). Automated Essay Scoring:A Cross-disciplinary Perspective[C].Mahwah, NJ:Lawrence Erlbaum Associates,2003:87-112.
[18] Levis, J. Computer technology in teaching and researching pronunciation[J]. Annual Review of Applied Linguistics, 2007, 27:184-202.
[19] Page, E. B. Project Essay Grade:PEG[A].I n M. D. S h e r m i s&J. B u r s t e i n(e d s).Automated Essay Scoring:A Cross-disciplinary P e r s p e c t i v e[C]. M a h w a h, N J:L a w r e n c e Erlbaum Associates, 2003:43-54.
[20] Papineni, K., S. Roukos, T. Ward&W. Zhu. Bleu:A method for automatic evaluation of machine translation[A]. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics[C]. Philadelphia, Pennsylvania:Association for Computational Linguistics, 2002:311-318.
[21] Pearson Education. VersantTM English Test:Test Description&Validation Summary[M]. Palo Alto, CA:Pearson Knowledge Technologies,2011.
[22] Shermis, M. D.&J. Burstein. Automated Essay Scoring:A Cross-disciplinary Perspective[M].Mahwah, NJ:Lawrence Erlbaum Associates,2003.
[23] Teubert, W. The role of parallel corpora in translation and multilingual lexicography[A].In B. Altenberg&S. Granger(eds). Lexis in Contrast:Corpus-based Approaches[C].Amsterdam&Philadelphia:John Benjamins,2002:189-214.
[24] Valenti, S., F. Neri&A. Cucchiarelli. An overview of current research on automated essay grading[J]. Journal of Information Technology Education, 2003(2):319-330.
[25] Van Moere, A. Automated spoken language testing:Test construction and scoring model development[A]. In L. Araújo(ed). Computerbased Assessment(CBA)of Foreign Language Speaking Skills[C]. Luxembourg:Publications Office of the European Union, 2010:84-99.
[26] Xi, X. Automated scoring and feedback systems:Where are we and where are we heading?[J].Language Testing, 2010(3):291-300.
[27] X i, X., D. H i g g i n s, K. Z e c h n e r&D. M.Williamson. Automated Scoring of Spontaneous Speech Using SpeechRaterSM V1.0[M]. Princeton,NJ:Educational Testing Service, 2008.
[28] Yang, Y., C. W. Buckendahl, P. J. Juszkiewicz&D. S. Bhola. A review of strategies for validating computer-automated scoring[J].Applied Measurement in Education, 2002(4):391-412.
[29]桂诗春.潜伏语义分析的理论及其应用[J].现代外语, 2003(1):76-84.
[30]江进林.英译汉语言质量自动量化研究[J].现代外语, 2013(1):85-91; 110.
[31]江进林.中国学生英译汉机器评分模型的研究和构建[M].北京:高等教育出版社, 2016.
[32]江进林,文秋芳. N元组和翻译单位对英译汉自动评分作用的比较研究[J].现代外语,2010(2):177-184; 219-220.
[33]江进林,文秋芳.大规模测试中学生英译汉机器评分模型的构建[J].外语电化教学,2012(2):3-8.
[34]梁茂成.中国学生英语作文自动评分模型的构建[M].北京:外语教学与研究出版社,2011.
[35]梁茂成.大规模考试英语作文自动评分系统的研制[M].北京:高等教育出版社, 2012.
[36]罗凯洲,韩宝成. Ordinate与SpeechRater口语自动评分系统评述与启示[J].外语电化教学,2014(4):27-32.
[37]王金铨.中国学生汉译英机助评分模型的研究与构建[M].北京:外语教学与研究出版社,2010.
[38]王金铨,万昕,董子云.翻译质量评价方法及其在计算机翻译评价系统中的应用[J].中国翻译, 2018(4):73-78.
[39]王金铨,文秋芳.中国学生大规模汉译英测试机助评分模型的研究与构建[J].现代外语,2009(4):415-420; 438.
[40]王金铨,朱周晔.汉译英翻译能力自动评价研究[J].中国外语, 2017(2):66-71.
[41]文秋芳,秦颖,江进林.英语考试翻译自动评分中双语对齐技术的应用[J].外语电化教学,2009(1):3-8.
基本信息:
DOI：
中图分类号:H319.3
引用信息:
[1]江进林,陈丹丹.主观题自动评分研究——回顾、反思与展望[J].中国外语,2021,18(06):58-64.
基金信息:
受到“对外经济贸易大学杰出青年学者资助项目”（编号：19JQ07）; “对外经济贸易大学中央高校基本科研业务费专项资金”（编号：CXTD11-02）的资助