運用視覺化學習分析瞭解程序性技能學習行為:以大學統計實習課程為例
作者:國立臺灣大學生物產業傳播暨發展學系/心理學系岳修平、京都大學資訊學研究所許嘉瑜、國立臺灣大學圖書資訊學系林維真
卷期:69卷第3期
日期:2024年09月
頁碼:171-194
DOI:https://doi.org/10.6209/JORIES.202409_69(3).0006
摘要:
對大班統計實習課程而言,觀察學習者行為非常重要,也具有高度挑戰性。為了更全面地瞭解課堂動態,本研究在大學基礎統計學實習課程中,建置採用線上課程平臺來記錄學習者觀看與註記等學習行為資料,並以視覺化方式對應課堂環境、教學內容與學習者行為進行時間序列分析。總共蒐集並分析58名大學生,在一堂統計實習課中的7,869筆行為數據。研究結果顯示,高表現與低表現學習者有不同的課程講義參照行為,高表現學習者在實習課堂和測驗中都展現更具策略性的學習行為,他們較為積極地跟隨教學者的講授,開書測驗中有計劃地遍閱講義,檢索與判斷相關資源的表現也都比較好;低表現者則不會逐頁跟隨教師的講解,測驗中也不太會參照講義,依賴聽課時的印象答題。研究結果支持觀看講義頁面的次序與軌跡等學習者行為的質性指標,可以對照測驗分數等量化指標,作為有效的另類評量方法。教師由視覺化分析結果能更快地捕捉全班學生的學習和測驗行為概況。本研究結果支持學習分析的實施應基於學習歷程檔案評量典範,可視化學習者行為作為評量結果,能夠導引教學者適時提供學習資源與支援,增進教學互動。本研究對相關課程教學與評量應用具有參考性,並對未來研究提出重要的理論概念與方法等建議。
關鍵詞:學習分析、統計實習、視覺化、學習歷程檔案評量
《詳全文》
參考文獻:
» 展開更多
- Akçapınar, G., Hasnine, M. N., Majumdar, R., Flanagan, B., & Ogata, H. (2019, March 4-8). Using learning analytics to detect off-task reading behaviors in class [Paper presentation]. Companion Proceedings of the 9th International Conference on Learning Analytics and Knowledge (LAK’19), Tempe, AZ, USA.
- Barab, S. A., & Squire, K. (2004). Design-based research: Putting a stake in the ground. Journal of the Learning Sciences, 13(1), 1-14. https://doi.org/10.1207/s15327809jls1301_1
- Ben-Zvi, D. (1999). Alternative assessment in statistics education [Paper presentation]. Proceedings of the 52nd Session of the International Statistical Institute, Helsinki, Finland.
- Braun, I., Ritter, S., & Vasko, M. (2014). Inverted classroom by topic-a study in mathematics for electrical engineering students. International Journal of Engineering Pedagogy, 4(3), 11-17. https://doi.org/10.3991/ijep.v4i3.3299
- Delazer, M., Domahs, F., Lochy, A., Bartha, L., Brenneis, C., & Trieb, T. (2004). The acquisition of arithmetic knowledge– An FMRI study. Cortex; A Journal Devoted to the Study of the Nervous System and Behavior, 40(1), 166-167. https://doi.org/10.1016/s0010- 9452(08)70936-5
- Dessì, D., Fenu, G., Marras, M., & Recupero, D. R. (2019). Bridging learning analytics and cognitive computing for big data classification in micro-learning video collections. Computers in Human Behavior, 92, 468-477. https://doi.org/10.1016/j.chb.2018.03.004
- Dodeen, H. (2015). Teaching test-taking strategies: Importance and techniques. Psychology Research, 5(2), 108-113. https://doi.org/10.17265/2159-5542/2015.02.003
- Dzubinski, L. (2014). Teaching presence: Co-creating a multi-national online learning community in an asynchronous classroom. Online Learning Journal, 18(2). https://www.learntechlib.org/ p/183749/
- Franklin, C. A., Kader, G. D., Bargagllotti, A. E., Scheaffer, R. L., Case, C. A., & Spangler, D. A. (2016). Statistical education of teachers (SET). American Statistical Association.
- Gagnon-Bartsch, J. A., Sales, A. C., Wu, E., Botelho, A. F., Erickson, J. A., Miratrix, L. W., & Heffernan, N. T. (2023). Precise unbiased estimation in randomized experiments using auxiliary observational data. Journal of Causal Inference, 11(1), 20220011. https://doi.org/10.1515/ jci-2022-0011
- GAISE College Report ASA Revision Committee. (2016). Guidelines for assessment and instruction in statistics education college report 2016. https://www.amstat.org/asa/files/pdfs/GAISE/ GaiseCollege_Full.pdf
- Garfield, J., & Chance, B. (2000). Assessment in statistics education: Issues and challenges. Mathematical Thinking and Learning, 2(1-2), 99-125. https://doi.org/10.1207/ S15327833MTL0202_5
- Hsu, C.-Y., Horikoshi, I., Li, H., Majumdar, R., & Ogata, H. (2023). Supporting “time awareness” in self-regulated learning: How do students allocate time during exam preparation? Smart Learning Environments, 10(1), 21. https://doi.org/10.1186/s40561-023-00243-z
- Larwin, K., & Larwin, D. (2011). A meta-analysis examining the impact of computer-assisted instruction on postsecondary statistics education: 40 years of research. Journal of Research on Technology in Education, 43(3), 253-278. https://doi.org/10.1080/15391523.2011.10782572
- Lawrence, J. A., & Singhania, R. P. (2004). A study of teaching and testing strategies for a required statistics course for undergraduate business students. Journal of Education for Business, 79(6), 333-338. https://doi.org/10.3200/JOEB.79.6.333-338
- Li, S. (2006). Practice makes perfect: A key belief in China. In F. K. S. Leung, K.-D. Graf, & F. J. Lopez-Real (Eds.), Mathematics education in different cultural traditions– A comparative study of East Asia and the West, the 13th ICMI study (pp. 129-138). Springer. https://doi.org/ 10.1007/0-387-29723-5_8
- Lim, C. S., Tang, K. N., & Kor, L. K. (2012). Drill and practice in learning (and beyond). In N. M. Seel (Ed.), Encyclopedia of the sciences of learning (pp. 1040-1042). Springer. https://doi.org/ 10.1007/978-1-4419-1428-6_706
- Lin, W., Kotakehara, Y., Hirota, Y., Murakami, M., Kakusho, K., & Yueh, H.-P. (2021). Modeling reading behaviors: An automatic approach to eye movement analytics. IEEE Access, 9, 63580-63590. https://doi.org/10.1109/ACCESS.2021.3074913
- Lu, O. H. T., Huang, A. Y. Q., Huang, J. C. H., Lin, A. J. Q., Ogata, H., & Yang, S. J. H. (2018). Applying learning analytics for the early prediction of students’ academic performance in blended learning. Journal of Educational Technology & Society, 21(2), 220-232.
- Merrill, P. F., & Salisbury, D. (1984). Research on drill and practice strategies. Journal of Computer-Based Instruction, 11(1), 19-21.
- Moore, D. S., McCabe, G. P., & Craig, B. (2007). Introduction to the practice of statistics (6th ed.). W.H. Freeman.
- Ogata, H., Yin, C., Oi, M., Okubo, F., Shimada, A., Kojima, K., & Yamada, M. (2015, November 30-December 4). e-Book-based learning analytics in university education [Paper presentation]. Proceedings of the 23rd International Conference on Computers in Education, ICCE 2015, Hangzhou, China.
- Patton, M. Q. (2014). Qualitative research & evaluation methods: Integrating theory and practice. Sage.
- Park, T., Hong, M., & Kondrat, D. (2022). Undergraduate students’ attitudes toward statistics: How Excel makes a student’s life easier. Journal of Evidence-Based Social Work, 19(3), 263-271. https://doi.org/10.1080/26408066.2022.2025968
- Peng, Y., Hong, E., & Mason, E. (2014). Motivational and cognitive test-taking strategies and their influence on test performance in mathematics. Educational Research and Evaluation, 20(5), 366-385. https://doi.org/10.1080/13803611.2014.966115
- Phillips, D. C. (2012). Behaviorism and behaviorist learning theories. In N. M. Seel (Ed.), Encyclopedia of the sciences of learning (pp. 438-442). Springer. https://doi.org/10.1007/ 978-1-4419-1428-6_750
- Prieto, L. P., Sharma, K., Kidzinski, Ł., Rodríguez‐Triana, M. J., & Dillenbourg, P. (2018). Multimodal teaching analytics: Automated extraction of orchestration graphs from wearable sensor data. Journal of Computer Assisted Learning, 34(2), 193-203. https://doi.org/10.1111/ jcal.12232
- Preisman, K. A. (2014). Teaching presence in online education: From the instructor’s point of view. Online Learning, 18(3), n3. https://doi.org/10.24059/olj.v18i3.446
- Rathakrishnan, M., Raman, A., Haniffa, M. A. B., Mariamdaran, S. D., & Haron, A. B. (2018). The drill and practice application in teaching science for lower secondary students. International Journal of Education, Psychology and Counseling, 3(7), 100-108.
- Romero, C., & Ventura, S. (2020). Educational data mining and learning analytics: An updated survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 10(3), e1355. https://doi.org/10.1002/widm.1355
- Sandoval, W. A., & Bell, P. (2004). Design-based research methods for studying learning in context: Introduction. Educational Psychologist, 39(4), 199-201. https://doi.org/10.1207/ s15326985ep3904_1
- Slootmaeckers, K., Kerremans, B., & Adriaensen, J. (2014). Too afraid to learn: Attitudes towards statistics as a barrier to learning statistics and to acquiring quantitative skills. Politics, 34(2), 191-200. https://doi.org/10.1111/1467-9256.12042
- Timberlake, W., & Silva, F. J. (1994). Observation of behavior, inference of function, and the study of learning. Psychonomic Bulletin & Review, 1(1), 73-88. https://doi.org/10.3758/BF03200762
- Tishkovskaya, S., & Lancaster, G. A. (2012). Statistical education in the 21st century: A review of challenges, teaching innovations and strategies for reform. Journal of Statistics Education, 20(2). https://doi.org/10.1080/10691898.2012.11889641
- Xing, W., Chen, X., Stein, J., & Marcinkowski, M. (2016). Temporal predication of dropouts in MOOCs: Reaching the low hanging fruit through stacking generalization. Computers in Human Behavior, 58, 119-129. https://doi.org/10.1016/j.chb.2015.12.007
- Yueh, H.-P., & Chiang, F.-K. (2020). AI and robotics in reshaping the dynamics of learning. British Journal of Educational Technology, 51(5), 1804-1807. https://doi.org/10.1111/bjet.13017
- Yueh, H.-P., & Wang, Y.-C. (2000). A study of students’ attitudes toward the electronic portfolio practice. Bulletin of Educational Psychology, 31(2), 65-83. https://doi.org/10.6251/BEP. 19991231
Journal directory listing - Volume 69 (2024) - Journal of Research in Education Sciences【69(3)】September(Special Issue:Porfolio Assessment: Challenge and Innovations )
Tracing Students’ Learning Behaviors in Statistical Practice Sessions: What Do Visualizations of Learning Logs Tell Us?
Author: Hsiu-Ping Yueh (Department of Psychology/ Department of Bio-Industry Communication and Development, National Taiwan University), Chia-Yu Hsu (Graduate Institute of Informatics, Kyoto University), Weijane Lin (Department of Library and Information Science, National Taiwan University)
Vol.&No.:Vol. 69, No. 3
Date:September 2024
Pages:171-194
DOI:https://doi.org/10.6209/JORIES.202409_69(3).0006
Abstract:
Observing the learning behaviors of large groups of students during hands-on statistical learning activities is challenging for instructors and calls for radical new measures. This study adopted an online learning platform that recorded student behaviors as learning logs while they completed drills and practices. A visualization approach was used to analyze the time-series behavioral data with direct and detailed measurements in a real-time classroom setting. A total of 7,869 learning logs from 58 college students in a statistical practice session were collected and visualized to map student behaviors to the classroom environment, instruction, and phases of the course. The key findings suggested that students with higher test scores exhibited better strategic learning behaviors by referencing course materials frequently during class and tests. High performers actively followed lectures and instructors and strategically located and used appropriate learning resources during tests. In contrast, low performers were reluctant to use lectures and handouts referentially but relied more on the instructor’s in-person guidance. The results supported the idea that learning logs tracking student movements, trajectories, and annotations could complement the assessment of quantitative test scores. Visualized analytics allowed instructors to understand students’ learning and test-taking strategies at a group level, and visualizing student behaviors as assessment results could guide instructors in providing timely learning resources and support to enhance teaching interactions. This study filled an important research gap by connecting the abundant behavioral information to its practical applications in statistics teaching and learning by bridging the divide between the vast quantities of educational data available and its meaningful use in instructional settings. The findings also provided empirical support for the feasibility and importance of implementing learning analytics based on the paradigm of portfolio assessment, with specific implications for teaching statistics and related practice courses.
Keywords:learning analytics, statistical practices, visualization, portfolio assessment