Associations between Goal Orientation and Self-Regulated Learning Strategies are Stable across Course Types, Underrepresented Minority Status, and Gender

A Replication of Muis and Franco (2009)




SEM Replication, Achievement Goals, Learning Strategies, Heterogeneity


In this pre-registered replication of findings from Muis and Franco [2009; Contemporary Educational Psychology, 34(4), 306-318], college students (N = 978) from across the United States and Canada were surveyed regarding their goal orientations and learning strategies. A structural equation modelling approach was used to assess the associations between goal orientations and learning strategies. Six of the eight significant associations (75%) found by Muis and Franco replicated successfully in the current study. Mastery approach goals positively predicted endorsement of all learning strategies (Rehearsal, Critical Thinking, Metacognitive Self-Regulation and Elaboration). Performance avoidance goals negatively predicted critical thinking, while positively predicting metacognitive self-regulation and rehearsal. Evidence for moderation by assignment type was found. No evidence of the moderation of these associations by gender, underrepresented minority status, or course type (STEM, Humanities, or Social Sciences) was found. The reliability of common scales used in educational research and issues concerning the replication of studies using structural equation modeling are discussed.


Metrics Loading ...


Alipourfard, N., Arendt, B., Benjamin, D. M., Benkler, N., Bishop, M. M., Burstein, M., Bush, M., Caverlee, J., Chen, Y., Clark, C., Dreber, A., Errington, T. M., Fidler, F., Fox, N. W., Frank, A., Fraser, H., Friedman, S., Gelman, B., Gentile, J., & Wu, J. (2021). Systematizing confidence in open research and evidence (SCORE) [Preprint]. SocArXiv. DOI:

Anderson, N. (2020). Examining ways COVID-19 adaptation derailed our assumptions about online learning. In 2020 IEEE Conference on e-Learning, e-Management and e-Services (IC3e) (pp. 67–70). DOI:

Bjork, R. A., & Bjork, E. L. (1992). A new theory of disuse and an old theory of stimulus fluctuation. In From learning processes to cognitive processes: Essays in honor of William K. Estes (pp. 35–67).

Broekkamp, H., & Van Hout-Wolters, B. H. A. M. (2006). Students’ adaptation of study strategies when preparing for classroom tests. Educational Psychology Review, 19(4), 401. DOI:

Carroll, J. B. (1963). A model of school learning. Teachers College Record, 64(8), 1–9. DOI:

Carroll, J. B. (1989). The Carroll model: A 25-year retrospective and prospective view. Educational Researcher, 18(1), 26–31. DOI:

Carvalho, P. F., Sana, F., & Yan, V. X. (2020). Self-regulated spacing in a massive open online course is related to better learning. NPJ Science of Learning, 5(1), 1–7. DOI:

Chen, K.-C., & Jang, S.-J. (2010). Motivation in online learning: Testing a model of self-determination theory. Computers in Human Behavior, 26(4), 741–752. DOI:

Cortina, J. M., Markell-Goldstein, H. M., Green, J. P., & Chang, Y. (2021). How are we testing interactions in latent variable models? Surging forward or fighting shy? Organizational Research Methods, 24(1), 26–54. DOI:

Crede, M., & Harms, P. (2019). Questionable research practices when using confirmatory factor analysis. Journal of Managerial Psychology, 34(1), 18–30. DOI:

DeBacker, T. K., Crowson, H. M., Beesley, A. D., Thoma, S. J., & Hestevold, N. L. (2008). The challenge of measuring epistemic beliefs: An analysis of three self-report instruments. The Journal of Experimental Education, 76(3), 281–312. DOI:

Deemer, S. (2004). Classroom goal orientation in high school classrooms: Revealing links between teacher beliefs and classroom environments. Educational Research, 46(1), 73–90. DOI:

D’Lima, G. M., Winsler, A., & Kitsantas, A. (2014). Ethnic and gender differences in first-year college students’ goal orientation, self-efficacy, and extrinsic and intrinsic motivation. The Journal of Educational Research, 107(5), 341–356. DOI:

Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4–58. DOI:

Elliot, A. J., & McGregor, H. A. (2001). A 2 x 2 achievement goal framework. Journal of Personality and Social Psychology, 80(3), 501–519. DOI:

Engelschalk, T., Steuer, G., & Dresel, M. (2017). Quantity and quality of motivational regulation among university students. Educational Psychology, 37(9), 1154–1170. DOI:

Flake, J. K., & Fried, E. I. (2020). Measurement schmeasurement: Questionable measurement practices and how to avoid them. Advances in Methods and Practices in Psychological Science, 3(4), 456–465. DOI:

Fong, C. J., Alejandro, A. J., Krou, M. R., Segovia, J., & Johnston-Ashton, K. (2019). Ya’at’eeh: Racereimaged belongingness factors, academic outcomes, and goal pursuits among indigenous community college students. Contemporary Educational Psychology, 59, 101805. DOI:

Fuchs, L. S., Fuchs, D., Karns, K., Hamlett, C. L., Katzaroff, M., & Dutka, S. (1997). Effects of task-focused goals on low-achieving students with and without learning disabilities. American Educational Research Journal, 34(3), 513–543. DOI:

Harackiewicz, J. M., Barron, K. E., Carter, S. M., Lehto, A. T., & Elliot, A. J. (1997). Predictors and consequences of achievement goals in the college classroom: Maintaining interest and making the grade. Journal of Personality and Social Psychology, 73(6), 1284–1295. DOI:

Harackiewicz, J. M., Barron, K. E., Pintrich, P. R., Elliot, A. J., & Thrash, T. M. (2002). Revision of achievement goal theory: Necessary and illuminating. Journal of Educational Psychology, 94(3), 638–645. DOI:

Hecker, B. L. (2017). Four decades of open science. Nature Physics, 13(6), 523–525. DOI:

Henry, F., Dua, E., Kobayashi, A., James, C., Li, P., Ramos, H., & Smith, M. S. (2017). Race, racialization and Indigeneity in Canadian universities. Race Ethnicity and Education, 20(3), 300–314. DOI:

Hofer, B. K. (2000). Dimensionality and disciplinary differences in personal epistemology. Contemporary Educational Psychology, 25(4), 378–405. DOI:

Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. DOI:

Hurtado, S., & Ruiz Alvarado, A. (2012). The climate for underrepresented groups and diversity on campus (tech. rep.). HERI Research Brief.

Kaplan, A., & Maehr, M. L. (2007). The contributions and prospects of goal orientation theory. Educational Psychology Review, 19(2), 141–184. DOI:

Kuncel, N. R., Credé, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages, class ranks, and test scores: A meta-analysis and review of the literature. Review of Educational Research, 75(1), 63–82. DOI:

Li, K. (2019). MOOC learners’ demographics, self-regulated learning strategy, perceived learning and satisfaction: A structural equation modeling approach. Computers & Education, 132, 16–30. DOI:

Liem, A. D., Lau, S., & Nie, Y. (2008). The role of self-efficacy, task value, and achievement goals in predicting learning strategies, task disengagement, peer relationship, and achievement outcome. Contemporary Educational Psychology, 33(4), 486–512. DOI:

Macnamara, B. N., Hambrick, D. Z., & Oswald, F. L. (2014). Deliberate practice and performance in music, games, sports, education, and professions: A meta-analysis. Psychological Science, 25(8), 1608–1618. DOI:

McGee, E. O. (2020). Interrogating structural racism in STEM higher education. Educational Researcher, 49(9), 633–644. DOI:

Meece, J. L., Anderman, E. M., & Anderman, L. H. (2006). Classroom goal structure, student motivation, and academic achievement. Annual Review of Psychology, 57(1), 487–503. DOI:

Merkle, E. C., & Rosseel, Y. (2015). Blavaan: Bayesian structural equation models via parameter expansion. ArXiv Preprint ArXiv:1511.05604.

Mouratidis, A., Michou, A., Demircio ̆glu, A. N., & Sayil, M. (2018). Different goals, different pathways to success: Performance-approach goals as direct and mastery-approach goals as indirect predictors of grades in mathematics. Learning and Individual Differences, 61, 127–135. DOI:

Muis, K. R., & Franco, G. M. (2009). Epistemic beliefs: Setting the standards for self-regulated learning. Contemporary Educational Psychology, 34(4), 306–318. DOI:

Museus, S. D., & Liverman, D. (2010). High-performing institutions and their implications for studying underrepresented minority students in STEM. New Directions for Institutional Research, 2010(148), 17–27. DOI:

Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1991). A manual for the use of the motivated strategies for learning questionnaire (MSLQ) (tech. rep.). ERIC.

Plucker, J. A., & Makel, M. C. (2021). Replication is important for educational psychology: Recent developments and key issues. Educational Psychologist, 56(2), 90–100. DOI:

Psaltou-Joycey, A. P. A. (2008). Cross-cultural differences in the use of learning strategies by students of Greek as a second language. Journal of Multilingual and Multicultural Development, 29(4), 310–324. DOI:

Purdie, N., Hattie, J., & Douglas, G. (1996). Student conceptions of learning and their use of self-regulated learning strategies: A cross-cultural comparison. Journal of Educational Psychology, 88(1), 87–100. DOI:

Ranellucci, J., Muis, K. R., Duffy, M., Wang, X., Sampasivam, L., & Franco, G. M. (2013). To master or perform? Exploring relations between achievement goals and conceptual change learning. British Journal of Educational Psychology, 83(3), 431–451. DOI:

Revelle, W. (2018). Psych: Procedures for psychological, psychometric, and personality research. R Package Version, 1(10).

Rivers, M. L., & Dunlosky, J. (2020). Are test-expectancy effects better explained by changes in encoding strategies or differential test experience? Journal of Experimental Psychology: Learning, Memory, and Cognition, 10. DOI:

Seaman, C. S., & Weber, R. (2015). Undisclosed flexibility in computing and reporting structural equation models in communication science. Communication Methods and Measures, 9(4), 208–232. DOI:

Senko, C., Hama, H., & Belmonte, K. (2013). Achievement goals, study strategies, and achievement: A test of the “learning agenda” framework. Learning and Individual Differences, 24, 1–10. DOI:

Senko, C., Hulleman, C. S., & Harackiewicz, J. M. (2011). Achievement goal theory at the crossroads: Old controversies, current challenges, and new directions. Educational Psychologist, 46(1), 26–47. DOI:

Senko, C., & Miles, K. M. (2008). Pursuing their own learning agenda: How mastery-oriented students jeopardize their class performance. Contemporary Educational Psychology, 33(4), 561–583. DOI:

Shi, D., Lee, T., & Maydeu-Olivares, A. (2019). Understanding the model size effect on SEM fit indices. Educational and Psychological Measurement, 79(2), 310–334. DOI:

Tabak, F., Nguyen, N., Basuray, T., & Darrow, W. (2009). Exploring the impact of personality on performance: How time-on-task moderates the mediation by self-efficacy. Personality and Individual Differences, 47(8), 823–828. DOI:

Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. DOI:

van der Zee, T., & Reich, J. (2018). Open education science. AERA Open, 4(3), 2332858418787466. DOI:

Vrugt, A., & Oort, F. J. (2008). Metacognition, achievement goals, study strategies and academic achievement: Pathways to achievement. Metacognition and Learning, 3(2), 123–146. DOI:

Xia, Y., & Yang, Y. (2019). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51(1), 409–428. DOI:

Yan, V. X., & Schuetze, B. A. (2023). What is meant by “growth mindset”? Current theory, measurement practices, and empirical results leave much open to interpretation: Commentary on Macnamara and Burgoyne (2023) and Burnette et al. (2023). Psychological Bulletin, (3-4), 206–219. DOI:






Replication Reports