朝向問題化的設計思考 —意義驅動課程評鑑引導設計
作者:國立清華大學教育與學習科技學系陳美如、國立師範大學教育系陳佩英、國立清華大學教育與學習科技學系張雅惠、國立政治大學教育學系郭昭佑、國立清華大學教育與學習科技學系廖元歆
卷期:69卷第1期
日期:2024年03月
頁碼:207-239
DOI:https://doi.org/10.6209/JORIES.202403_69(1).0007
摘要:
面對世界變革及教育系統之需求,本研究重新從認識論與方法論建立課程評鑑之基礎,並擴大視野,跨越邊界,透過朝向問題化的設計思考,規劃能喚起個體在群體中,及對系統的覺知,反思課程實踐,建立具價值與意義之課程評鑑引導設計。本研究主要運用團體討論法,經過8次,每次1-2小時的團體討論,進行「意義驅動與展化的課程評鑑工作坊」之引導設計,並以關鍵字分析和提問類型進行資料分析,再以參與工作坊學員之意見調查與備課文件作為語料分析之佐證。研究發現為:融入展化學習及U型理論之問題化的設計思考可生成課程新的理解;透過提問展開課程評鑑之選擇觀點、建立理解與策略之路徑值得探詢;問題化過程關注真實問題與脈絡、意向與思考性語言不可或缺、運用社群運作,能有意義地連結個體的思維與集體共創的課程;多樣提問類型扮演不同功能,可豐實並活化問題化思考過程。最後,根據研究發現提出相關建議。
關鍵詞:問題化、設計思考、意義驅動、對話、課程評鑑
《詳全文》
參考文獻:
» 展開更多
- 卯靜儒、李姍靜、鄭淑惠、林君憶(2020)。我們需要怎樣的課程評鑑?台灣教育,722,47-57。
- Mao, C.-J., Li, S.-J., Cheng, S.-H., & Lin, C.-Y. (2020). What kind of course evaluation do we need? Taiwan Education Review, 722, 47-57.】"
- 吳姿杏(2019)。序。載於C. O. Scharmer,U型理論精要:從我到我們的系統思考,個人修練、組織轉型的學習之旅(戴至中,譯)。經濟新潮社。(原書出版於2018年)
- Wu Z.-X. (2019). Recommended preamble. In C. O. Scharmer, The essentials of theory U: Core principles and applications (Z.-Z. Dai, Trans.). Economic News Agency. (Original work published 2018)】"
- 張國賢(2008)。偶然的邏輯—德勒茲與胡塞爾的意義理論。揭諦,15,65-85。
- Chang, K.-H. (2008). Accidental logic– Deleuze and Husserl’s theory of meaning. Reveal, 15, 65-85.】"
- 陳佩英、沈心慈(2021)。師說新語:T-Lab實踐社群共創協作教練實作之旅程。臺灣師大出版社。
- Chen, P., & Sim, S.-C. (2021). Teachers speaking: A journey of co-creating a collaborative coaching model by the T-lab community of practice. NTNU Publisher.】"
- 陳佩英、曾正宜(2011)。探析專業學習社群的展化學習經驗與課程創新行動—活動理論取徑。教育研究集刊,57(2),39-84。https://doi.org/10.6910/BER.201106_(57-2).0002
- Chen, P., & Tzeng, J.-Y. (2011). Exploring the expansive learning and curriculum innovation of a professional learning community: An approach of activity theory. Bulletin of Educational Research, 57(2), 39-84. https://doi.org/10.6910/BER.201106_(57-2).0002】"
- 黃政傑(1987)。課程評鑑。師大書苑。
- Huang, Z.-J. (1987). Curriculum evaluation. Lucky Bookstore.】"
- 黃嘉莉、謝傳崇(2022)。為何教師專業發展活動不有效?TALIS 2018臺灣國中教師調查結果之羅吉斯驗證。教育科學研究期刊,67(1),1-32。https://doi.org/10.6209/ JORIES.202203_67(1).0001
- Huang, J.-L., & Hsieh, C.-C. (2022). Why are teacher professional development activities ineffective? An investigation of the results of the TALIS 2018 survey of Taiwan junior high school teachers. Journal of Research in Education Sciences, 67(1), 1-32. https://doi.org/10.6209/JORIES.202203_67(1).0001】"
- 黃嘉莉、陳美如、翁暄睿(2022)。1980~2020年國際師資培育研究聚類與趨勢分析。教育科學研究期刊,67(3),1-35。https://doi.org/10.6209/JORIES.202209_67(3).0001
- Huang, J.-L., Chen, M.-J., & Weng, H.-J. (2022). Mapping the categories and trends of teacher education research: 1980-2020. Journal of Research in Education Sciences, 67(3), 1-35. https://doi.org/10.6209/ JORIES.202209_67(3).0001】"
- 黃嘉雄(2010)。課程評鑑。心理。
- Huang, C.-H. (2010). Curriculum evaluation. Psychological.】"
- 顧瑜君(2009)。我們需要什麼樣的課程評鑑?課程與教學,12(1),73-98。https://doi.org/ 10.6384/CIQ.200901.0073
- Ku, Y.-C. (2009). Rethinking curriculum evaluation. Curriculum & Instruction Quarterly. 12(1), 73-98. https:// doi.org/10.6384/CIQ.200901.0073】"
- Alkin, M. C. (Ed.). (2013). Evaluation roots: A wider perspective of theorists’ views and influences. (2nd ed.). Sage.
- Alvesson, M., & Sandberg, J. (2011). Generating research questions through problematization. Academy of Management Review, 36(2), 247-271. https://doi.org/10.5465/amr.2009.0188
- Bereiter, C., & Scardamalia, M. (2003). Learning to work creatively with knowledge. In E. D. Corte, L. Vershaffel, N. Entwistle, & J. van Merriënboer (Eds.), Unravelling basic components and dimensions of powerful learning environments (pp. 55-68). European Association for Research on Learning and Instruction. Pergamon.
- Bereiter, C. (2014). Principled practical knowledge: Not a bridge but a ladder. Journal of the Learning Sciences, 23(1), 4-17. https://doi.org/10.1080/10508406.2013.812533
- Brown, T., & Katz, B. (2011). Change by design. Journal of Product Innovation Management, 28(3), 381-383. https://doi.org/10.1111/j.1540-5885.2011.00806.x
- Canadian Evaluation Society. (2014). Annual Report 2013-2014. The CUEE Secretariat School of Public Administration University of Victoria, Canada.
- Deacon, R. (2000). Theory as practice: Foucault’s concept of problematization. Telos, 118, 127-142.
- Engeström, Y. (1987). Learning by expanding: An activity-theoretical approach to developmental research (2nd ed.). Cambridge University Press.
- Engeström, Y. (1999). Activity theory and individual and social transformation. In Y. Engeström, R. Miettinen, & R.-L. Punamäki (Eds.), Perspectives on activity theory (pp. 19-38). Cambridge University Press. https://doi.org/10.1017/cbo9780511812774.003
- Engeström, Y. (2016). Studies in expansive learning: Learning what is not yet there. Cambridge University Press. https://doi.org/10.1017/CBO9781316225363
- Engeström, Y. (2020). Ascending from the abstract to the concrete as a principle of expansive learning. Psychological Science and Education, 25(5), 31-43. https://doi.org/10.17759/ pse.2020250503
- Foucault, M. (1984). The Foucault reader (R. Rabinow, ed.). Pantheon Books.
- Gardner, H. (2020). A synthesizing mind: A memoir from the creator of multiple intelligences theory. MIT Press. https://doi.org/10.7551/mitpress/12405.001.0001
- Greeno, J. G., & Engeström, Y. (2014). Learning in activity. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (2nd ed., pp. 128-150). Cambridge University Press.
- Guba, E. G., & Lincoln, Y. S. (1989). Fourth generation evaluation. Sage.
- Haraway, D. J. (2016). Staying with the trouble: Making kin in the chthulucene. Duke University Press.
- Hargreaves, A., & Shirley, D. (2009). The fourth way: The inspiring future for educational change. Corwin Press. https://doi.org/10.4135/9781452219523.n4
- Hong, H. Y., & Sullivan, F. R. (2009). Towards an idea-centered, principle-based design approach to support learning as knowledge creation. Educational Technology Research and Development, 57(5), 613-627. https://doi.org/10.1007/s11423-009-9122-0
- Jonassen, D. H. (1997). Instructional design models for well-structured and III-structured problem-solving learning outcomes. Educational Technology Research and Development, 45(1), 65-94. https://doi.org/10.1007/BF02299613
- Kali, Y. (2016, June). Transformative learning in design research: The story behind the scenes. International Conference of the Learning Sciences, Singapore. https://doi.org/10.13140/ RG.2.2.21293.33760
- Kali, Y., & Hoadley, C. (2021). Design-based research methods in CSCL: Calibrating our epistemologies and ontologies. In U. Cress, C. Rosé, A. F. Wise, & J. Oshima (Eds.), International handbook of computer-supported collaborative learning (pp. 479-496). Springer. https://doi.org/10.1007/978-3-030-65291-3_26
- Ketele, J. M. D. (2011). Evaluation and curriculum: Conceptual basis, debate, issues. Educational Science Archive, 25, 89-106. https://doi.org/10.4000/dse.1022
- Lawson, R. (2015). Curriculum design for assuring learning-leading the way: Final report. Office for Learning and Teaching, Department of Education. https://ro.uow.edu.au/cgi/viewcontent. cgi?article=1541&context=asdpapers
- Lenoir, Y. (2011). The impact of current curriculum concepts on the evaluation model. Education Science Archive, 25, 13-28. https://doi.org/10.4000/dse.973
- Manning, C. D., Raghavan, P., & Schütze, H. (2008). Introduction to information retrieval. Cambridge University Press. https://doi.org/10.1017/CBO9780511809071
- Nonaka, I., & Takeuchi, H. (1996). The knowledge-creating company: How Japanese companies create the dynamics of innovation. Oxford University Press.
- Organization for Economic Co-operation and Development. (2017). The OECD handbook for innovative learning environments. OECD Publishing. https://doi.org/10.1787/ 9789264277274-en
- Oshima, J., Oshima, R., & Saruwatari, S. (2020). Analysis of students’ ideas and conceptual artifacts in knowledge-building discourse. British Journal of Educational Technology, 51(4), 1308-1321. https://doi.org/10.1111/bjet.12961
- Paavola, S., Lipponen, L., & Hakkarainen, K. (2004). Models of innovative knowledge communities and three metaphors of learning. Review of Educational Research, 74(4), 557-576. https:// doi.org/10.3102/00346543074004557
- Priya, R., & Vijayarani, S. (2016, December 12). Keyword extraction techniques: A review [Paper presentation]. International Conference on Data Mining and Big Data, Barcelona, Spain.
- Scharmer, C. O. (2009). Theory U: Leading from the future as it emerges-the social technology of presencing. Berrett-Koehler.
- Scharmer, C. O. (2018). The essentials of theory U: Core principles and applications. Berrett-Koehler.
- Schleicher, A. (2021). Learning from the past, looking to the future: Excellence and equity for all. International Summit on the Teaching Profession, OECD Publishing. https://doi.org/10.1787/ f43c1728-en
- Senge, P. (2004). Building learning organizations. Knowledge Management.
- Sesno, F. (2017). Ask more: The power of questions to open doors, uncover solutions and spark change. HarperCollins.
- Spivak, G. C. (1985). Scattered speculations on the question of value. Diacritics, 15(4), 73-93. https://doi.org/10.2307/464935
- Stengers, I. (2021). Putting problematization to the test of our present. Theory, Culture & Society, 38(2), 71-92. https://doi.org/10.1177/0263276419848061
- Stufflebeam, D. L. (2003). The CIPP model for evaluation. In T. Kellaghan, D. L. Stufflebeam, & L. A. Wingate (Eds.), International handbook of educational evaluation (pp. 31-62). Springer. https://doi.org/10.1007/978-94-010-0309-4_4
- Trausan-Matu, S., Rupert, W., & Major, L. (2021). Dialogism. In U. Cress, C. Rosé , A. F. Wise, & J. Oshima (Eds.), International handbook of computer-supported collaborative learning (pp. 219-239). Springer. https://doi.org/10.1007/978-3-030-65291-3_12
- Tseng, Y.-H., Lin, C.-J., & Lin, Y.-I. (2007). Text mining techniques for patent analysis. Information Processing & Management, 43(5), 1216-1247. https://doi.org/10.1016/j.ipm.2006.11.011
Towards Problematic Design Thinking : Guiding Meaning-driven Curriculum Evaluation
Author: Mei-Ju Chen (Department of Education and Learning Technology, National Tsing Hua University) , Pei-Ying Chen (Department of Education, National Taiwan Normal University), Ya-Hui Chang (Department of Education and Learning Technology, National Tsing Hua University) , Chao-Yu Guo (Department of Education, National Chengchi University) , Yuan-Sin Liao (Department of Education and Learning Technology, National Tsing Hua University)
Vol.&No.:Vol. 69, No. 1
Date:March 2024
Pages:207-239
DOI:https://doi.org/10.6209/JORIES.202403_69(1).0007
Abstract:
Motivation and Purpose
As Taiwan enters the third decade of the twenty-first century, its educational systems must be well-equipped for the future. However, Taiwan’s seemingly rigorous and concrete curriculum evaluations as evidenced by past experience, have shown its limitations. Without a solid foundation in the needs and challenges of educators and the educated, curriculum evaluations become mere formalities incapable of driving self-reflection and improvement. Additionally, such evaluations must prompt critical inquiry into the following questions: “Why do we need curriculum evaluations?” “Why adopt one system of curriculum evaluation over another?” and “What do curriculum evaluations mean to us?” This study sought to utilize methodological and epistemological insights to ground curriculum evaluations in the context of the problems they seek to address; this allows us to expand our horizons, cross boundaries, and, through problem-oriented design thinking, make educators more aware of the systems and groups of which they are a part. Such reflection on curriculum evaluations prompted the creation of a series of meaningful curriculum evaluation measures and courses.
Literature Review
Epistemological reflections informed the present study’s multidisciplinary approach to curriculum evaluation; problem-oriented design thinking served as the engine for this study’s guiding design; and expansive learning and U-theory provided reference strategies, tools, and learning environment support.
Research Questions
The research questions this study sought to answer are as follows:
1. How does the problematization process influence the design of meaning-driven curriculum evaluations?
2. What key themes emerge during the problematization process within teams conducting meaning-driven curriculum evaluations?
3. How do various types of questioning facilitate design thinking in problematization for meaning-driven curriculum evaluation?
4. Through the lens of problematization in design thinking, what innovative guiding designs are developed for conducting meaning-driven curriculum evaluations?
Method
This study employed eight focus group sessions, each lasting 1-2 hours, to guide the design of a “Meaning-driven and Expansive Curriculum Evaluation Workshop.” Keywords and question types from the session transcripts were analyzed and coded; they were supplemented by opinion surveys of the workshop participants and their lesson preparation materials.
Results and Discussion
1. Problematization— which is the process of identifying problems to be addressed and their solutions— is clearly discernible in the chronological evolution of the group discussions, which moved from clarifying key points of curriculum evaluation to designing a workshop on guiding evaluation design.
In chronological order, the key questions of the problematization process were as follows.
Early-stage questions were posed to clarify the problems surrounding curriculum evaluation in Taiwan and its relationship to educators. Beginning with the problems inherent in the current traditional evaluation system, participants questioned the meaning and value of curriculum evaluation, forming the workshop’s goals. Late-stage questions were designed to transform the meaning and goals that emerged during the discussions and incorporate them into the design of the workshop courses. The subsequent process of problematization emphasized creative collaboration and explored more fundamental problems, such as: “How can curriculum evaluation help educators improve their motivation and skills?” and “What must be done next?”
2. Multiple themes emerged from keyword analysis of problematization content, specifically:
(1) The problematization process involves real problems/needs in the context of the curriculum:
All the questions from the group discussion process were imported into a keyword analysis software. “What,” “how,” and “why” ranked as the top three keywords. The high frequency of these question words indicates that the group discussion focused on inquiry and exploration, which are basic functions of the problematization process. The team evaluated problems in the context of the curriculum, using questions to suggest avenues for experimental improvements.
(2) Reflective and intentional language is essential to the design thinking process:
Hypothetical questions typically inspire an epistemological approach of inquiry and verification, or evaluative thinking; this requires the use of reflective language. The keywords, the context of the educators’ questions, and the language used demonstrate that the participants focused their thinking and decision-making on the usability, appropriateness, and improvability of the proposed curriculum and were thus continually optimizing and evaluating ideas. The discussion leaders emphasized the participants’ intentions in curriculum evaluation during the discussion process. Additionally, the keyword “want” occurred frequently (17 times), underscoring the participants’ focus on changing their behaviors and responding to needs.
(3) A learning community is the operational basis for the problematization process:
The fourth-highest ranked keyword was “we,” whereas “they” was ranked 10th, indicating that the educators were focused on solving problems as a community. This community focus is consistent with U-theory’s approach of creating a social field that enables a team to generate collective wisdom and a sense of direction through exploration and reflection. The questions guided participants to consider the relationship between individuals and the team.
(4) Members know that their ultimate goal is benefiting students, prompting critical reflection on and engagement with the evaluation process:
The goal of any curriculum is to educate students. Curriculum evaluation is a crucial component of curriculum development that requires educators to remain flexible. Because the educators did not use traditional terms such as “evaluation” and “performance” in their questions, their meaning-driven curriculum evaluation emphasized the context of education itself, focusing on teachers and students and responding to their needs in the process of meeting the evaluation objectives.
3. Questions serve several functions in guiding the design thinking underpinning the problematization process:
Through question analysis, 258 questions were categorized into 5 types: (1) Value-oriented questions concerning feelings, relationships, and meanings; (2) assessment-oriented questions using logical explorations in the context of a particular problem to reach a solution; (3) strategy-oriented questions focusing on perceiving problems and developing time-sensitive strategies to address them; (4) empathy-oriented questions promoting collaboration and dialogue; (5) task-oriented questions involving action planning, reflective evaluation, and collaboration.
4. The meaning-driven curriculum evaluation guiding design was generated, and a meaning-driven curriculum evaluation was proposed:
The eight group discussions resulted in a 2-day meaning-driven curriculum evaluation guiding design workshop. The design philosophy emphasized participation and cocreation, where learning evolved continually through questioning and the cultivation of shared learning spaces. The process clarified participants’ perspectives on curriculum evaluation, starting from real problems/needs and moving through individual experiences to community dialogue and cocreation. The workshop was based on participants’ questions and encouraged individual reflection, group collaboration, and team cocreation. The guiding design was dynamic, emphasizing participant interaction and responses, with real-time adjustments made as new problems were identified.
Conclusion
1. The themes and types of questions generated from keyword analysis indicate the feasibility of integrating expansive learning and U-theory to guide understanding in problematization thinking and planning.
2. The act of questioning reveals perspectives and options through mutual understanding and shared strategic vision to create a curriculum evaluation that is sensitive to the real needs of teachers and students.
3. The problematization process focuses on real problems/needs in context. Reflective and intentional language is indispensable to the problematization process. Moreover, a group approach to designing a curriculum evaluation establishes meaningful connections between educators’ thoughts and needs and the curriculum they deliver.
4. A diversity of question types enriches and animates the problematization process.
Recommendations
1. Educators must be encouraged to engage in discourse with an open mind, maintain flexibility, and embrace uncertainty.
2. Design thinking must be integrated into curriculum evaluations.
3. A diversity of questions and opinions must be encouraged in curriculum evaluation.
Keywords:problematization, design thinking, meaning-driven, discourse, curriculum evaluation