期刊目錄列表 - 60卷(2015) - 【教育科學研究期刊】60(3) 九月刊

大學生基本素養測驗的發展及信度效度分析 作者:陳柏熹(國立臺灣師範大學教育心理與輔導學系)、黃馨瑩(國立臺灣師範大學科學教育中心)、陳郁欣(國立臺灣師範大學教育心理與輔導學系)、葉泰廷(國立臺灣師範大學教育心理與輔導學系)、蘇少祖(國立臺灣師範大學教育心理與輔導學系)

卷期:60卷第3期
日期:2015年9月
頁碼:95-126
DOI:10.6209/JORIES.2015.60(3).04

摘要:
本研究目的旨在發展大學生基本素養測驗並進行信度與效度評估。藉由分析國內大專院校的通識教育目標和核心素養,並參考ATC21S提出的21世紀現代學生需具備的10項基本素養,歸納出大學生基本素養測驗的九項素養,分別為:溝通合作、美感素養、科學思辨、資訊素養、終身學習、創新領導、問題解決、公民社會及生涯發展。測驗形式為線上多媒體情境式題型,每個題本均包含九項素養的內容,每項素養皆有二至三個題組。研究對象為全國大專校院一至四年級學生,研究樣本來自20校10,958名大學生。由效度評估結果可知,大學生基本素養測驗的題組效果不大,可以忽略,並採用部分計分模式來估計,幾乎所有試題與模式都能適配,顯示建構效度良好。試題發展過程均歷經嚴謹修審題程序,取得良好專家效度證據。此外,不同性別和年級的學生在各素養的表現上差異不大,和過去的文獻相符合,具有良好的效標關聯效度。信度證據方面,各素養能力估計誤差約在 .20~ .60 logit之間,單一題本的信度高於 .69,顯示本測驗題數雖少,但信度大致良好。整體而言,大學生基本素養測驗具良好的信度與效度。
 

關鍵詞:信度、效度、素養評量、情境式測驗、線上測驗

《詳全文》 檔名

參考文獻:
  1. 王保進(2011)。以學生學習成效品質保證為核心之第二週期系所評鑑作業規範。評鑑雙月刊,33,7-11。【Wang, B.-J. (2011). Student learning outcomes associating with quality assurance mechanism for department and graduate institute evaluation. Evaluation Bimonthly, 33, 7-11.】
  2. 林煥祥、劉聖忠、林素微、李暉(2008)。台灣參加PISA 2006成果報告。科技部專題研究計畫成果報告(NSC95-2522-S-026-002)。花蓮市:國立花蓮教育大學;高雄市:國立高雄師範大學。【Lin, H.-X., Liu, S.-Z., Lin, S.-W., & Li, H. (2008). PISA 2006 results in Taiwan. Ministry of Science and Technology project report (NSC95-2522-S-026-002). Hualien, Taiwan: National Hualien University of Education; Kaohsiung, Taiwan: National Kaohsiung Normal University.】
  3. 郭生玉(2012)。心理與教育研究法。新北市:精華。【Guo, S.-Y. (2012). Educational psychology and methodology. New Taipei City, Taiwan: Jin-Hua.】
  4. 陳儀蓉、黃芳銘(2006)。組織公民行為量表在男女員工群體上之測驗恆等性檢定。測驗學刊,53(2),297-326。【Chen, Y.-J., & Hwang, F.-M. (2006). Assessing measurement invariance of organizational citizenship behavior citizenship behavior scale between male and female staff. Psychological Testing, 53(2), 297-326.】
  5. 陳柏熹(2011)。心理與教育測驗:測驗編製理論與實務。新北市:精策教育。【Chen, P.-H. (2011). Psychology and educational testing: Theory and practice. New Taipei City, Taiwan: Kinetics.】
» 展開更多
中文APA引文格式陳柏熹、黃馨瑩、陳郁欣、葉泰廷、蘇少祖(2015)。大學生基本素養測驗的發展及信度效度分析。教育科學研究期刊60(3),95-126。doi:10.6209/JORIES.2015.60(3).04
APA FormatChen, P.-H., Huang, H.-Y., Chen, Y.-H., Yeh, T.-T., & Su, S.-T. (2015). Evaluation of the Psychometric Properties of the General Literacy Test for University Students. Journal of Research in Education Sciences, 60(3), 95-126. doi:10.6209/JORIES.2015.60(3).04

Journal directory listing - Volume 60 (2015) - Journal of Research in Education Sciences【60(3)】September

Evaluation of the Psychometric Properties of the General Literacy Test for University Students Author: Po-Hsi Chen(Department of Educational Psychology and Counseling, National Taiwan Normal University), Hsin-Ying Huang(Science Education Center, National Taiwan Normal University), Yu-Hsin Chen(Department of Educational Psychology and Counseling, National Taiwan Normal University), Tai-Ting Yeh (Department of Educational Psychology and Counseling, National Taiwan Normal University), Shao-Tsu Su(Department of Educational Psychology and Counseling, National Taiwan Normal University)

Vol.&No.:Vol. 60, No. 3
Date:September 2015
Pages:95-126
DOI:10.6209/JORIES.2015.60(3).04

Abstract:

This study evaluated the psychometric properties of the General Literacy Test for University Students. To develop the assessment framework, the educational objectives of general literacy courses of universities in Taiwan as well as the core competencies of Assessment and Teaching of 21st Century Skills were all reviewed and considered. The general literacy test is composed of nine literacy domains: communication and collaboration, esthetics, information, lifelong learning, career, leadership, problem solving, social concerns and citizenship, and scientific thinking. The items of the general literacy test were developed into a multimedia assessment. In addition, booklets including two to three testlets on each of the nine literacy domains were organized. Overall, 10,958 students from 20 universities participated. The results demonstrated that testlet effect could be ignored and the partial credit model could be used to analyze data. In addition, the items fit the partial credit model closely and the test demonstrated favorable construct validity. In addition, small differences existed between gender and grades. The results were consistent with those of previous studies and showed that the test’s criterion-related validity was acceptable. Furthermore, the standard error of ability ranged from .20 to .60 logit and the reliabilities of the booklets were more than .69 in the nine literacy domains. The evidence supports the high degree of reliability and validity of basic literacy assessment.

Keywords:reliability, validity, literacy assessment, scenario based test, online test