Journal directory listing - Volume 63 (2018) - Journal of Research in Education Sciences【63(4)】December (Special Issue: The Concepts and Practices for Achieving Literacy)

(Special Issue) Development and Validation of an Online Assessment Module for Mandarin Reading Literacy for Middle School Students of the 12-Year Basic Education Program Author: Pei-Jung Hsieh (Research Center for Testing and Assessment, National Academy for Educational Research)

Vol.&No.:Vol. 63, No.4
Date:December 2018

Reading is one of the key elements of the 12-year basic education curriculum guidelines for elementary schools, junior high schools, and general senior high schools: Language and Literature Category - Chinese Language and Literature. This study developed an online reading assessment module in line with the new curriculum guidelines. A literacy-based assessment module was established to construct an assessment framework, text selection or writing principles, item writing principles, and reading literacy-oriented items. The psychometric characteristics of the items were also investigated to support the validity of the module. The principles and items were validated through the triangulation method. By conducting assessment framework meetings and item writing workshops, a 3-dimensional assessment framework, 17 indicators, 5 text writing principles, and 10 item writing principles were obtained. The Online Assessment for Science Literacy platform was adopted for 23 testlets with 201 items for pilot test administration. The participants were 1,685 junior high school students from 58 schools in Taiwan. Item difficulty, discrimination, and infit mean square statistics were analyzed using the CTT and TAM packages in R. The average discrimination of 17 testlets (73.91%) was more than .30. The average p-value of multiple choice items ranged from .45 to .74. The average discrimination of half of the constructed response items was .37 and the average p-value was .24, which revealed high discrimination and high difficulty. The sample items were also provided as a reference for preparing assessment designs for schools in the future.

Keywords:literacy-based assessment, online assessment, reading comprehension, secondary education

《Full Text》 檔名

  1. 大學入學考試中心(2018)。107學年度學科能力測驗試題國文考科(選擇題)。取自http://www.【College Entrance Examination Center. (2018). 2018 general scholastic ability test: Mandarin Chinese. Retrieved from %AC%E5%9C%8B%E6%96%87%E5%AE%9A%E7%A8%BF.pdf】
  2. 中央社(2016,9月13日)。研究曝光 糖業者掩飾糖不利心臟健康。取自 tw/news/ahel/201609130487-1.aspx【Central News Agency. (2016, September 13). Sugar industry and coronary heart disease research. Retrieved from】
  3. 任宗浩(2018)。素養導向評量的界定與實踐。載於蔡清華(主編),課程協作與實踐第二輯(pp. 75-82)。臺北市:教育部協作中心。【Jen, T.-H. (2018). Literacy-based assessment: Principles and practice. In C.-H. Tsai (Ed.), Curriculum coordination in practice (Vol. II, pp. 75-82). Taipei, Taiwan: Coordination Center for Teacher Professional Development, Curriculum, Instruction and Assessment.】
  4. 佘曉清、林煥祥(主編)(2017)。PISA 2015臺灣學生的表現。新北市:心理。【She, H.-C., & Lin, H.-S. (Eds.). (2017). Taiwan student performance on PISA 2015. New Taipei City, Taiwan: Psychological.】
  5. 侯佩君、杜素豪、廖培珊、洪永泰、章英華(2008)。臺灣鄉鎮市區類型之研究:「臺灣社會變遷基本調查第五期計畫之抽樣分層效果分析」。調查研究─方法與應用,23,7-32。doi:10.7014/TCYCFFYYY.200804.0007【Hou, P.-C., Tu, S.-H., Liao, P.-S., Hung, Y.-T., & Chang, Y.-H. (2008). The typology of townships in Taiwan: The analysis of sampling stratification of the 2005-2006 “Taiwan Social Change Survey”. Survey Research − Method and Application, 23, 7-32. doi:10.7014/TCYCFFYYY.200804.0007】
» More
APA FormatHsieh, P.-J. (2018). Development and validation of an online assessment module for mandarin reading literacy for middle school students of the 12-year basic education program. Journal of Research in Education Sciences, 63(4), 193-228. doi: 10.6209/JORIES.201812_63(4).0007