Verifying the Invariance of a Measurement Model for Achievement Goals Theory by Using the Multiple Group Structural Equation Modeling
Author: Chung-Chin Wu(Institute of Education, National Cheng-Kung University)
Vol.&No.:Vol. 59, No. 3
Date:September 2014
Pages:59-95
DOI:10.6209/JORIES.2014.59(3).03
Abstract:
The appropriateness of measure content, ambiguity of theoretical concepts, and interferences of theoretical measure are three problems in achievement goal research. These problems have yet to receive comprehensive attention or empirical examinations. The purposes of this study were (1) to revise the problems caused by achievement goal measures and to compile a Mandarin version of a 3×2 achievement goal measure (the best fit and most parsimonious model was chosen based on model comparisons), (2) to examine the multiple group invariance of the theoretical model by utilizing multiple group structural equation modeling, and (3) to investigate the influences of gender and the educational phase on each of the 3×2 achievement goals. The results are summarized as follows: (1) the measurement of 3×2 achievement goals yielded favorable reliability and construct validity. Moreover, this model is regarded as the best fit and the most parsimonious model. (2) The measurement presents favorable validity between gender and moderate validity between the educational phase. (3) In general, boys pursued higher approach- and avoidance-oriented goals than girls, indicating the complexity of achievement goals. Suggestions are proposed based on these findings presented at the end of the article.
Keywords:goal orientation, achievement goals, multiple group structural equation modeling
《Full Text》
References:
- 李宜玫(2012)。數學低成就學習動機之類型與區別分析:中小學弱勢學生與一般學生之比較。教育科學研究期刊,57(4),39-71。 doi:10.3966/2073753X2012125704002【Lee, Y.-M. (2012). Discriminating math low-achievement motivation patterns: Comparing disadvantaged and other students in elementary and junior high school. Journal of Research in Education Sciences, 57(4), 39-71. doi:10.3966/2073753X2012125704002】
- 李茂能(2007)。結構方程模式軟體AMOS之簡介及其在測驗編製上之應用。臺北市:心理。【Li, M.-N. (2007). The introduction and application on tests compiling of structural equation modeling software–AMOS. Taipei, Taiwan: Psychological.】
- 林易慧、程炳林(2006)。課室目標線索與個人目標導向對國小學童解題成就及自我調整學習之交互效果。教育心理學報,37(3),231-255。 doi:10.6251/BEP.20051209【Lin, Y.-H., & Cherng, B.-L. (2006). The interaction effects between the cues of classroom goal and personal goal orientations on solving mathematics problems and self-regulated learning. Bulletin of Educational Psychology, 37(3), 231-255. doi:10.6251/BEP.20051209】
- 林哲宇(2010)。ARCS融入體驗式學習之學習活動中目標導向與教學策略對國小生電腦技能學習之影響(未出版碩士論文)。國立臺灣師範大學,臺北市。【Lin, C.-Y. (2010). The effects of instructional strategies and goal orientation on elementary school students within an ARCS integrated experiential learning activity (Unpublished master’s thesis). National Taiwan Normal University, Taipei, Taiwan.】
- 林宴瑛(2006)。個人目標導向、課室目標結構與自我調整學習策略之關係及潛在改變量分析(未出版碩士論文)。國立成功大學,臺南市。【Lin, Y.-Y. (2006). The relation and latent change analysis among individual goal orientations, classroom goal structures and self-regulated learning strategies (Unpublished master’s thesis). National Cheng Kung University, Tainan, Taiwan.】
» More
- 李宜玫(2012)。數學低成就學習動機之類型與區別分析:中小學弱勢學生與一般學生之比較。教育科學研究期刊,57(4),39-71。 doi:10.3966/2073753X2012125704002【Lee, Y.-M. (2012). Discriminating math low-achievement motivation patterns: Comparing disadvantaged and other students in elementary and junior high school. Journal of Research in Education Sciences, 57(4), 39-71. doi:10.3966/2073753X2012125704002】
- 李茂能(2007)。結構方程模式軟體AMOS之簡介及其在測驗編製上之應用。臺北市:心理。【Li, M.-N. (2007). The introduction and application on tests compiling of structural equation modeling software–AMOS. Taipei, Taiwan: Psychological.】
- 林易慧、程炳林(2006)。課室目標線索與個人目標導向對國小學童解題成就及自我調整學習之交互效果。教育心理學報,37(3),231-255。 doi:10.6251/BEP.20051209【Lin, Y.-H., & Cherng, B.-L. (2006). The interaction effects between the cues of classroom goal and personal goal orientations on solving mathematics problems and self-regulated learning. Bulletin of Educational Psychology, 37(3), 231-255. doi:10.6251/BEP.20051209】
- 林哲宇(2010)。ARCS融入體驗式學習之學習活動中目標導向與教學策略對國小生電腦技能學習之影響(未出版碩士論文)。國立臺灣師範大學,臺北市。【Lin, C.-Y. (2010). The effects of instructional strategies and goal orientation on elementary school students within an ARCS integrated experiential learning activity (Unpublished master’s thesis). National Taiwan Normal University, Taipei, Taiwan.】
- 林宴瑛(2006)。個人目標導向、課室目標結構與自我調整學習策略之關係及潛在改變量分析(未出版碩士論文)。國立成功大學,臺南市。【Lin, Y.-Y. (2006). The relation and latent change analysis among individual goal orientations, classroom goal structures and self-regulated learning strategies (Unpublished master’s thesis). National Cheng Kung University, Tainan, Taiwan.】
- 邱皓政(2011)。結構方程模式:LISREL的理論、技術與應用。臺北市:雙葉書廊。【Chiu, H.-C. (2011). Structural equation modeling: Theory and application of LISREL. Taipei, Taiwan: Yeh Yeh Book Gallery.】
- 程炳林(2003)。四向度目標導向模式之研究。師大學報:教育類,48(1),15-40。 doi:10.3966/2073753X2003044801002【Cherng, B.-L. (2003). Study of the model of 4 dimensions goal orientation. Journal of Taiwan Normal University: Education, 48(1), 15-40. doi:10.3966/2073753X2003044801002】
- 彭淑玲(2004)。四向度課室目標結構、個人目標導向與課業求助行為之關係(未出版碩士論文)。國立成功大學,臺南市。【Peng, S.-L. (2004). The relationship among 4-dimensions classroom goal structure, personal goal orientation, and academic help-seeking behaviors (Unpublished master’s thesis). National Cheng Kung University, Tainan, Taiwan.】
- 張映芬、程炳林(2011)。國中生動機涉入之分類結構及其相關因素探討。教育心理學報,43(2),521-546。 doi:10.6251/BEP.20101018【Chang, Y.-F., & Cherng, B.-L. (2011). The classification and related factors of motivational engagement for junior high school students. Bulletin of Educational Psychology, 43(2), 521-546. doi:10.6251/BEP.20101018】
- 謝岱陵(2003)。國中生四向度目標導向之中介效果分析(未出版碩士論文)。國立成功大學,臺南市。【Hsieh, T.-L. (2003). The analysis of mediating effect of 4-dimensional goal orientation of junior high school students (Unpublished master’s thesis). National Cheng Kung University, Tainan, Taiwan.】
- 羅文秀、張淑玲(2005)。國中學生的工具性動機、目標導向與數學學業成就相關之研究。新竹師院學報,20,27-61。【Lo, W.-H., & Chang, S.-L. (2005). The relationships among instrumentality, goal orientations, and mathematics academic achievement of junior high school students. Journal of National Hsin Chu Teachers College, 20, 27-61.】
- 蘇嘉鈴、程炳林(2005)。國中生行動導向、目標導向與動機調整策略之關係。教育心理學報,36(4),395-415。 doi:10.6251/BEP.20050429【Su, J.-L., & Cherng, B.-L. (2005). The relationships among action orientation, goal orientations, and motivational regulation strategies of junior high school students. Bulletin of Educational Psychology, 36(4), 395-415. doi:10.6251/BEP.20050429 】
- Aiken, L. R. (1997). Questionnaires and inventories: Surveying opinions and assessing personality. New York, NY: John Wiley & Sons.
- Anderman, E. M., & Midgley, C. (1997). Changes in achievement goal orientations, perceived academic competence, and grades across the transition to middle-level schools. Contemporary Educational Psychology, 22(3), 269-298. doi:10.1006/ceps.1996.0926
- Bagozzi, R. B., & Yi, Y. (1988). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16(1), 74-94. doi:10.1177/009207038801600107
- Belsley, D. A., Kuh, K., & Welsch, R. E. (1980). Regression diagnostics: Identifying influential data and sources of collinearity. New York, NY: Wiley & Sons.
- Bong, M. (2009). Age-related differences in achievement goal differentiation. Journal of Educational Psychology, 101(4), 879-896. doi:10.1037/a0015945
- Byrne, B. M. (2004). Testing for multigroup invariance using AMOS graphics: A road less traveled. Structural Equation Modeling, 11(2), 272-300. doi:10.1207/s15328007sem1102_8
- Byrne, B. M. (2008). Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psicothema, 20(4), 872-882.
- Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structure: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456-466. doi:10.1037/0033-2909.105.3.456
- Cavallo, A. M. L., Potter, W. H., & Rozman, M. (2004). Gender differences in learning constructs, shifts in learning constructs, and their relationship to course achievement in a structured inquiry, yearlong college physics course for life science majors. School Science and Mathematics, 104(6), 288-300. doi:10.1111/j.1949-8594.2004.tb18000.x
- Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255. doi:10.1207/S15328007SEM0902_5
- Conroy, D. E., Elliot, A. J., & Hofer, S. M. (2003). A 2×2 achievement goals questionnaire for sport: Evidence for factorial invariance, temporal stability, and external validity. Journal of Sport & Exercise Psychology, 25(4), 456-476.
- Covington, M. V., & Mueller, K. J. (2001). Intrinsic versus extrinsic motivation: An approach/avoidance reformulation. Educational Psychology Review, 13(2), 157-176. doi:10. 1023/A:1009009219144
- Curran, P. J., West, S. G., & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1(1), 16-29. doi:10.1037/1082-989X.1.1.16
- Cury, F., Elliot, A. J., Fonseca, D. D., & Moller, A. C. (2006). The social-cognitive model of achievement motivation and the 2×2 achievement goal framework. Journal of Personality and Social Psychology, 90(4), 666-679. doi:10.1037/0022-3514.90.4.666
- Dweck, C. S. (1986). Motivational processes affecting learning. American Psychologist, 41(10), 1040-1048. doi:10.1037/0003-066X.41.10.1040
- Dweck, C. S. (2000). Self-theories: Their role in motivation, personality, and development. Philadelphia, PA: Psychology Press.
- Elliot, A. J. (1999). Approach and avoidance motivation and achievement goals. Educational Psychologist, 34(3), 169-189. doi:10.1207/s15326985ep3403_3
- Elliot, A. J. (2005). Competence and motivation: Competence as the core of achievement motivation. In A. J. Elliot & C. S. Dweck (Eds.), Handbook of competence and motivation (pp. 52-72). New York, NY: Guilford Press.
- Elliot, A. J., & Church, M. A. (1997). A hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology, 72(1), 218-232. doi:10.1037/ 0022-3514.72.1.218
- Elliot, A. J., & Church, M. A. (2002). Client-articulated avoidance goals in the therapy context. Journal of Counseling Psychology, 49(2), 243-254. doi:10.1037//0022-0167.49.2.243
- Elliot, A. J., & Fryer, J. (2008). The goal construct in psychology. In J. Shah & W. Gardner (Eds.), Handbook of motivation science (pp. 235-250). New York, NY: Guilford Press.
- Elliot, A. J., & Harackiewicz, J. M. (1996). Approach and avoidance achievement goals and intrinsic motivation: A mediational analysis. Journal of Personality and Social Psychology, 70(3), 461-475. doi:10.1037/0022-3514.70.3.461
- Elliot, A. J., & McGregor, H. A. (1999). Test anxiety and the hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology, 76(4), 628-644. doi:10.1037/0022-3514.76.4.628
- Elliot, A. J., & McGregor, H. A. (2001). A 2×2 achievement goal framework. Journal of Personality and Social Psychology, 80(3), 501-519. doi:10.1037//0022-3514.80.3.501
- Elliot, A. J., McGregor, H. A., & Gable, S. (1999). Achievement goals, study strategies, and exam performance: A mediational analysis. Journal of Educational Psychology, 91(3), 549-563. doi: 10.1037/0022-0663.91.3.549
- Elliot, A. J., & Murayama, K. (2008). On the measurement of achievement goals: Critique, illustration, and application. Journal of Educational Psychology, 100(3), 613-628. doi:10. 1037/0022-0663.100.3.613
- Elliot, A. J., Murayama, K., & Pekrun, R. (2011). A 3×2 achievement goal model. Journal of Educational Psychology, 103(3), 632-648. doi:10.1037/a0023952
- Escribe, C., & Huet, N. (2005). Knowledge accessibility, achievement goals, and memory strategy maintenance. British Journal of Educational Psychology, 75(1), 87-104. doi:10.1348/00070990 4X19227
- Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. doi:10.2307/3151312
- Friedel, J. M., Cortina, K. S., Turner, J. C., & Midgley, C. (2007). Achievement goals, efficacy beliefs and coping strategies in mathematics: The roles of perceived parent and teacher goal emphases. Contemporary Educational Psychology, 32(3), 434-458. doi:10.1016/j.cedpsych. 2006.10.009
- Fryer, J. W., & Elliot, A. J. (2007). Stability and change in achievement goals. Journal of Educational Psychology, 99(4), 700-714. doi:10.1037/0022-0663.99.4.700
- Greene, B. A., DeBacker, T. K., Ravindran, B., & Krows, A. J. (1999). Goals, values, and beliefs as predictors of achievement and effort in high school mathematics classes. Sex Roles, 40(5/6), 421-458. doi:10.1023/a:1018871610174
- Hair, J. F., William, C. B., Barry, J. B., & Rolph, E. A. (2009). Multivariate data analysis (7th ed.). Englewood Cliffs, NJ: Prentice Hall.
- Harackiewicz, J. M., Barron, K. E., & Elliot, A. J. (1997). Predictors and consequences of achievement goals in the college classroom: Maintaining interest and making the grade. Journal of Personality and Social Psychology, 73(6), 1284-1295. doi:10.1037/0022-3514.73.6.1284
- Harackiewicz, J. M., Barron, K. E., & Elliot, A. J. (1998). Rethinking achievement goals: When are they adaptive for college students and why? Educational Psychologist, 33(1), 1-21. doi:10. 1207/s15326985ep3301_1
- Harackiewicz, J. M., Barron, K. E., Tauer, J. M., Carter, S. M., & Elliot, A. J. (2000). Short-term and long-term consequences of achievement goals: Predicting interest and performance over time. Journal of Educational Psychology, 92(2), 316-330. doi:10.1037//0022-0663.92.2.316
- Harackiewicz, J. M., Barron, K. E., Tauer, J. M., & Elliot, A. J. (2002). Predicting success in college: A longitudinal study of achievement goals and ability measures as predictors of interest and performance from freshman year through graduation. Journal of Educational Psychology, 94(3), 562-575. doi:10.1037//0022-0663.94.3.562
- Harackiewicz, J. M., & Elliot, A. J. (1993). Achievement goals and intrinsic motivation. Journal of Personality and Social Psychology, 65(5), 904-915. doi:10.1037/0022-3514.65.5.904
- Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7(3), 238-247. doi:10.1037/1040-3590.7.3.238
- Horst, S. J., Finney, S. J., & Barron, K. E. (2007). Moving beyond academic achievement goal measures: A study of social achievement goals. Contemporary Educational Psychology, 32(4), 667-698. doi:10.1016/j.cedpsych.2006.10.011
- Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1-55. doi:10.1080/10705519909540118
- Huang, C.-J. (2012). Discriminant and criterion-related validity of achievement goals in predicting academic achievement: A meta-analysis. Journal of Educational Psychology, 104(1), 48-73. doi:10.1037/a0026223
- Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS command language. Chicago, IL: Scientific Software International.
- Kaplan, D. (2009). Structural equation modeling: Foundations and extensions (2nd ed.). Los Angeles, CA: Sage. doi:10.4135/9781452226576
- Kline, R. B. (2011). Principle and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press. doi:10.1111/insr.12011_25
- Maehr, M. L., & Zusho, A. (2009). Achievement goal theory: The past, present, and future. In K. R. Wentzel & A. Wigfield (Eds.), Handbook of motivation at school (pp. 77-104). New York, NY: Routledge.
- McDonald, P. R. (1999). Test theory a unified treatment. Mahwah, NJ: Lawrence Erlbaum Associates.
- McGregor, H. A., & Elliot, A. J. (2002). Achievement goals as predictors of achievement-relevant processes prior to task engagement. Journal of Educational Psychology, 94(2), 381-395. doi:10.1037//0022-0663.94.2.381
- Meece, J. L., Herman, P., & McCombs, B. L. (2003). Relations of learner-centered teaching practices to adolescents’ achievement goals. International Journal of Educational Research, 39(4-5), 457-475. doi:10.1016/j.ijer.2004.06.009
- Meece, J. L., & Jones, M. G. (1996). Gender differences in motivation and strategy use in science: Are girls rote learners? Journal of Research in Science Teaching, 33(4), 393-406. doi:10.1002/(SICI)1098-2736(199604)33:4<393::AID-TEA3>3.0.CO;2-N
- Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525-543. doi:10.1007/BF02294825
- Myers, R. H. (1990). Classical and modern regression with applications. Boston, MA: Duxbury Press.
- Nicholls, J. G. (1984). Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance. Psychological Review, 91(3), 328-346. doi:10.1037//0033-295X.91.3.328
- Pachur, T., Hertwig, R., & Steinmann, F. (2012). How do people judge risks: Availability heuristic, affect heuristic, or both? Journal of Experimental Psychology: Applied, 18(3), 314-330. doi:10. 1037/a0028279
- Patrick, H., Ryan, A. M., & Pintrich, P. R. (1999). The differential impact of extrinsic and mastery goal orientations on males’ and females’ self-regulated learning. Learning and Individual Differences, 11(2), 153-171. doi:10.1016/S1041-6080(00)80003-5
- Pekrun, R., Elliot, A. J., & Maier, M. A. (2009). Achievement goals and achievement emotions: Testing a model of their joint relations with academic performance. Journal of Educational Psychology, 101(1), 115-135. doi:10.1037/a0013383
- Pintrich, P. R. (2000). Multiple goals, multiple pathways: The role of goal orientation in learning and achievement. Journal of Educational Psychology, 92(3), 544-555. doi:10.1037//0022-0663.92. 3.544
- Preckel, F., Goetz, T., Pekrun, R., & Kleine, M. (2008). Gender differences in gifted and average-ability students: Comparing girls’ and boys’ achievement self-concept, interest, and motivation in Mathematics. Gifted Child Quarterly, 52(2), 146-159. doi:10.1177/0016986208315834
- Régner, I., Escribe, C., & Dupeyrat, C. (2007). Evidence of social comparison in mastery goals in natural academic settings. Journal of Educational Psychology, 99(3), 575-583. doi:10.1037/ 0022-0663.99.3.575
- Roussel, P., Elliot, A. J., & Feltman, R. (2011). The influence of achievement goals and social goals on help-seeking from peers in an academic context. Learning and Instruction, 21(3), 394-402. doi:10.1016/j.learninstruc.2010.05.003
- Schunk, D. H., Pintrich, P. R., & Meece, J. L. (2008). Motivation in education: Theory, research, and applications. Upper Saddle River, NJ: Pearson.
- Shim, S. S., Ryan, A. M., & Anderson, C. J. (2008). Achievement goals and achievement during early adolescence: Examining time-varying predictor and outcome variables in growth-curve analysis. Journal of Educational Psychology, 100(3), 655-671. doi:10.1037/0022-0663.100.3. 655
- Smith, G. T., Fischer, S., & Fister, S. M. (2003). Incremental validity principles in test construction. Psychological Assessment, 15(4), 467-477. doi:10.1037/1040-3590.15.4.467
- Steenkamp, E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25(1), 78-107. doi:10.1086/209528
- Thrash, T. M., & Elliot, A. J. (2002). Implicit and self-attributed achievement motives: Concordance and predictive validity. Journal of Personality, 70(5), 729-756. doi:10.1111/1467-6494.05022
- Torkzadeh, G., Koufteros, X., & Pflughoeft, K. (2003). Confirmatory analysis of computer self-efficacy. Structural Equation Modeling, 10(2), 263-275. doi:10.1207/S15328007SEM 1002_6
- Wang, J.-C., & Wang, X.-Q. (2012). Structural equation modeling: Applications using Mplus. Chichester, UK: Wiley. doi:10.1002/9781118356258
- Wentzel, K. R. (1999). Social motivational processes and interpersonal relationships. Journal of Educational Psychology, 91(1), 76-97. doi:10.1037//0022-0663.91.1.76
- Witkow, M. R., & Fuligni, A. J. (2007). Achievement goals and daily school experiences among adolescents with Asian, Latino, and European American backgrounds. Journal of Educational Psychology, 99(3), 584-596. doi:10.1037/0022-0663.99.3.584