Indonesian Version of the Short Mental Toughness Questionnaire (MTQ): Factor Structure and Measurement Invariance
Year 2025,
Volume: 16 Issue: 1, 208 - 228, 30.04.2025
Tri Setyo Guntoro
,
Sutoro Sutoro
,
Naomi Pahabol
,
Yahya Eko Nopiyanto
,
Gerdha Kristina Ivony Numberi
,
Agus Zainuri
,
Evi Sinaga
,
Dewi Nurhidayah
,
Bayu Budi Prakoso
,
Miftah Fariz Prima Putra
Abstract
This study aims to evaluate the factor structure of the short version of the Mental Toughness Questionnaire (S-MTQ) in the Indonesian context and test measurement invariance based on gender (male vs. female) and status (athlete vs. non-athlete). A total of 710 people (Mage = 22.07 years; SD = 7.99) consisting of 490 (69.01%) males and 220 (30.99%) females; 476 (67.04%) athletes and 234 (32.96%) non-athletes were involved in the study. Confirmatory factor analysis (CFA) was used to evaluate the factor structure of the short MTQ. The results showed that the unidimensional models tested, MTQ-18 and MTQ-10, were unfit. Therefore, a revision was carried out by removing items that had low loading factor values. The results of the revised Indonesian version (MTQid-6) found CFI = .983, TLI = .969, RMSEA = .052, and SRMR = .024, which indicated that the MTQid-6 unidimensional model was very satisfactory. MTQid-6 has a loading factor category ranging from good to very good (λ = .50 to .74). This validity is strengthened by convergent validity results, which show that MTQid-6 has a significant correlation with MTI, PPI-A, and APSQ (p < .001). The reliability analysis results show high internal consistency values, namely α = .762, = .763. Invariance testing found invariance at the configural, metric, and scalar levels (ΔCFI ≤ -.01, ΔRMSEA ≤ .015). With these results, MTQid-6 can be used to measure MT, both in athletes and non-athletes, in both males and females in the Indonesian population.
Ethical Statement
The protocol of the study was approved by the Health Research Ethics Committee, Faculty of Public Health, Universitas Cenderawasih with the number 065/KEPK-FKM UC issued on August 1, 2023. All respondents were requested to provide written informed consent before participating in this study.
Supporting Institution
Direktorat Riset, Teknologi, dan Pengabdian Kepada Masyarakat (DRTPM), Direktorat Jenderal Pendidikan Tinggi, Riset, dan Teknologi, Kementerian Pendidikan dan Kebudayaan.
Project Number
Grant No. 546/UN20.2.1/PG/2024
Thanks
This study was funded by Direktorat Riset, Teknologi, dan Pengabdian Kepada Masyarakat (DRTPM), Direktorat Jenderal Pendidikan Tinggi, Riset, dan Teknologi, Kementerian Pendidikan dan Kebudayaan (Grant No. 546/UN20.2.1/PG/2024). We would like to thank all participants who helped us and were willing to be involved in this research.
References
- Andayani, T. M., Kristina, S. A., Endarti, D., Haris, R. N. H., & Rahmawati, A. (2020). Translation, Cultural Adaptation, and Validation of Short-Form 6D on the General Population in Indonesia. Value in Health Regional Issues, 21, 205–210. https://doi.org/10.1016/j.vhri.2019.11.004
- Azwar, S. (2013). Reliabilitas dan validitas. Pustaka Pelajar.
- Bagozzi, R. P. (2010). Structural equation models are modelling tools with many ambiguities: Comments acknowledging the need for caution and humility in their use. Journal of Consumer Psychology, 20(2), 208–214. https://doi.org/10.1016/j.jcps.2010.03.001
- Birch, P. D. J., Crampton, S., Greenlees, I., Lowry, R., & Coffee, P. (2019). The Mental Toughness Questionniare-48: A Re-examination of Factorial Validity. International Journal of Sport Psychology, 48(3), 331–355. https://doi.org/10.7352/IJSP.2017.48.331
- Browne, M. W., & Cudeck, R. (1992). Alternative Ways of Assessing Model Fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005
- Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
- Cherry, H. L. (2005). Psychometric Analysis of an Inventory Assessing Mental Toughness [University of Tennessee - Knoxville]. https://trace.tennessee.edu/utk_gradthes/588
- Clough, P., Earle, K., & Sewell, D. (2002). Mental toughness: the concept and its measurement. In I. M. Cockerill (Ed.), Solutions in sport psychology. Cengage Learning, EMEA.
- Clough, P. J., & Strycharczyk, D. (2012). Developing Mental Toughness: Improving Performance, Wellbeing and Positive Behaviour in Others. Kogan Page Limited.
- Clough, Peter, Earle, K., Perry, J. L., & Crust, L. (2012). Comment on “Progressing measurement in mental toughness: A case example of the Mental Toughness Questionnaire 48” by Gucciardi, Hanton, and Mallett (2012). Sport, Exercise, and Performance Psychology, 1(4), 283–287. https://doi.org/10.1037/a0029771
- Comrey, A. L., & Lee, H. B. (1992). A First Course in Factor Analysis. Lawrence Erlbaum Associates, Inc.
- Crust, L., & Azadi, K. (2010). Mental toughness and athletes’ use of psychological strategies. European Journal of Sport Science, 10(1), 43–51. https://doi.org/10.1080/17461390903049972
- Dagnall, N., Denovan, A., Papageorgiou, K. A., & Clough, P. J. (2019). Psychometric Assessment of Shortened Mental Toughness Questionnaires (MTQ): Factor Structure of the MTQ-18 and the MTQ-10. Frontiers in Psychology, 10(1993), 1–12. https://doi.org/10.3389/fpsyg.2019.01933
- Denovan, A., Dagnall, N., Hill-Artamonova, E., & Musienko, T. (2021). Mental toughness questionnaire (MTQ18): A Russian version. National Security and Strategic Planning, 2021(3), 47–59. https://doi.org/10.37468/2307-1400-2021-3-47-59
- Geisinger, K. F. (1994). Cross-Cultural Normative Assessment: Translation and Adaptation Issues Influencing the Normative Interpretation of Assessment Instruments. Psychological Assessment, 6(4), 304–312. https://doi.org/10.1037/1040-3590.6.4.304
- Gerber, M., Best, S., Meerstetter, F., Walter, M., Ludyga, S., Brand, S., Bianchi, R., Madigan, D. J., Isoard-Gautheur, S., & Gustafsson, H. (2018). Effects of stress and mental toughness on burnout and depressive symptoms: A prospective study with young elite athletes. Journal of Science and Medicine in Sport, 21(12), 1200–1205. https://doi.org/10.1016/j.jsams.2018.05.018
- Gjersing, L., Caplehorn, J. R., & Clausen, T. (2010). Cross-cultural adaptation of research instruments: Language, setting, time and statistical considerations. BMC Medical Research Methodology, 10. https://doi.org/10.1186/1471-2288-10-13
- Golby, J., Sheard, M., & van Wersch, A. (2007). Evaluating the Factor Structure of the Psychological Performance Inventory. Perceptual and Motor Skills, 105(1), 309–325. https://doi.org/10.2466/pms.105.1.309-325
- Gucciardi, D. F. (2017). Mental toughness: progress and prospects. Current Opinion in Psychology, 16(16), 17–23. https://doi.org/10.1016/j.copsyc.2017.03.010
- Gucciardi, D. F., & Gordon, S. (2009). Development and preliminary validation of the cricket mental toughness inventory (CMTI). Journal of Sports Sciences, 27(12), 1293–1310. https://doi.org/10.1080/02640410903242306
- Gucciardi, D. F., Gordon, S., & Dimmock, J. A. (2008). Towards an understanding of mental toughness in Australian football. Journal of Applied Sport Psychology, 20(3), 261–281. https://doi.org/10.1080/10413200801998556
- Gucciardi, D. F., Gordon, S., & Dimmock, J. A. (2009). Development and preliminary validation of a mental toughness inventory for Australian football. Psychology of Sport and Exercise, 10(1), 201–209. https://doi.org/10.1016/j.psychsport.2008.07.011
- Gucciardi, D. F., Hanton, S., Gordon, S., Mallett, C. J., & Temby, P. (2014). The Concept of Mental Toughness: Tests of Dimensionality, Nomological Network, and Traitness. Journal of Personality, 83(1), 26–44. https://doi.org/10.1111/jopy.12079
- Gucciardi, D. F., Hanton, S., & Mallett, C. J. (2012). Progressing measurement in mental toughness: A case example of the Mental Toughness Questionnaire 48. Sport, Exercise, and Performance Psychology, 1(3), 194–214. https://doi.org/10.1037/a0027190
- Gucciardi, D. F., Hanton, S., & Mallett, C. J. (2013). Progressing measurement in mental toughness: A response to Clough, Earle, Perry, and Crust. Sport, Exercise, and Performance Psychology, 2(3), 157–172. https://doi.org/10.1037/spy0000002
- Guntoro, T. S., & Putra, M. F. P. (2022). Athletes’ religiosity: How it plays a role in athletes’ anxiety and life satisfaction. HTS Teologiese Studies/Theological Studies, 78(1), a7802. https://doi.org/10.4102/hts.v78i1.7802
- Guntoro, T. S., Sutoro, Putra, M. F. P., Kurdi, Németh, Z., & Setiawan, E. (2023). The role of anthropometry, physical, psychological and personality for elite athletes in competitive sports. Pedagogy of Physical Culture and Sports, 27(4), 331–339. https://doi.org/10.15561/26649837.2023.0409
- Hambleton, R. K., & de Jong, J. H. A. L. (2003). Advances in translating and adapting educational and psychological tests. Language Testing, 20(2), 127–134. https://doi.org/10.1191/0265532203lt247xx
- ITC. (2017). ITC Guidelines for Translating and Adapting Tests (Second Edition). International Journal of Testing, 15305058. https://doi.org/10.1080/15305058.2017.1398166
- Kawabata, M., Pavey, T. G., & Coulter, T. J. (2021). Evolving the validity of a mental toughness measure: Refined versions of the Mental Toughness Questionnaire-48. Stress and Health, 37(2), 378–391. https://doi.org/10.1002/smi.3004
- Kerlinger, F. N. (2006). Asas-asas penelitian behavioral. Gadjah Mada Univeristy Press.
- Kobasa, S. C. (1979). Stressful life events, personality, and health: An inquiry into hardiness. Journal of Personality and Social Psychology, 37(1), 1–11. https://doi.org/10.1037/0022-3514.37.1.1
- Liew, G. C., Kuan, G., Chin, N. S., & Hashim, H. A. (2019). Mental toughness in sport: Systematic review and future. German Journal of Exercise and Sport Research, 49(4), 381–394. https://doi.org/10.1007/s12662-019-00603-3
- Ohrbach, R., Bjorner, J., Metric, Q., Jezewski, M., John, M. T., & Lobbezoo, F. (2013). Guidelines for establishing cultural equivalency of Instruments. https://ubwp.buffalo.edu/
- Papageorgiou, K. A., Malanchini, M., Denovan, A., Clough, P. J., Shakeshaft, N., Schofield, K., & Kovas, Y. (2018). Longitudinal associations between narcissism, mental toughness and school achievement. Personality and Individual Differences, 131, 105–110. https://doi.org/10.1016/j.paid.2018.04.024
- Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003). Psychological Aspects of Natural Language Use: Our Words, Our Selves. Annual Review of Psychology, 54, 547–577. https://doi.org/10.1146/annurev.psych.54.101601.145041
- Putra, M. F. P., Kurdi, Syahruddin, S., Hasibuan, S., Sinulingga, A., Kamaruddin, I., Kristiyandaru, A., Mashud, Hariadi, I., Guntoro, T. S., Sutoro, S., Sinaga, E., Ibrahim, Setiawan, E., Ridwan, M., Wanena, T., Hidayat, R. R., & Hariadi, I. (2024). An Indonesian Version of Mental Toughness Index: Testing Psychometric Properties in Athletes and Non-athletes. Retos, 55, 816–824. https://doi.org/10.47197/retos.v55.106086
- Putra, M. F. P., Rahayuni, K., Wanena, T., Larung, E. Y. P., Sinaga, E., Zainuri, A., Dwiariani, D. A., Numbery, G. K. I., Hidayat, R. R., & Wandik, Y. (2025). Psychometric Properties of the Athlete Psychological Strain Questionnaire (APSQ): Adapting and Validating Its Indonesian Version. Sport and Tourism Central European Journal, 8(1), 1–10.
- Putra, M. F. P., Sutoro, Guntoro, T. S., Sinaga, E., Wanena, T., Rahayuni, K., Jannah, M., Warni, W. E., Juriana, Priambodo, A., Tahki, K., Hariadi, I., Hidayat, R. R., & Wandik, Y. (2024). Cross-cultural adaptation of the psychological performance inventory-alternative (PPI-A) for the Indonesian context. Retos, 56, 990–997. https://doi.org/10.47197/retos.v56.103765
- Putra, M. F. P., Sutoro, & Sinaga, E. (2023). Mental atlet: Konstruk, pengukuran, dan arah penelitian ke depan. Multilateral : Jurnal Pendidikan Jasmani Dan Olahraga, 22(1), 63–79. https://doi.org/10.20527/multilateral.v22i1.14785
- Rice, S. M., Parker, A. G., Mawren, D., Clifton, P., Lloyd, M., Kountouris, A., Smith, B., Mcgorry, P. D., & Purcell, R. (2019). Preliminary psychometric validation of a brief screening tool for athlete mental health among male elite athletes: the Athlete Psychological Strain Questionnaire. International Journal of Sport and Exercise Psychology, 18(1), 850–865. https://doi.org/10.1080/1612197X.2019.1611900
- Sheard, M., Golby, J., & Van Wersch, A. (2009). Progress toward construct validation of the Sports Mental Toughness Questionnaire (SMTQ). European Journal of Psychological Assessment, 25(3), 186–193. https://doi.org/10.1027/1015-5759.25.3.186
- Sutoro, Guntoro, T. S., & Putra, M. F. P. (2023). Development and validation mental training model: Mental Toughness Training Circle (MTTC). F1000Reserach, 12(169), 1–36. https://doi.org/10.12688/f1000research.129010.1
- Stamatis, A., Morgan, G. B., Papadakis, Z., Mougios, V., Bogdanis, G., & Spinou, A. (2021). Cross-cultural invariance of the mental toughness index among American and Greek athletes. Current Psychology, 40, 5793-5800.
- Tiwari, S., & Sharma, J. (2007). Development and Validation of Mental Toughness Questionnaire for Volleyball Players. Annamali University, India.
- Vaughan, R., Hanna, D., & Breslin, G. (2018). Psychometric properties of the Mental Toughness Questionnaire 48 (MTQ48) in elite, amateur and nonathletes. Sport, Exercise, and Performance Psychology, 7(2), 128–140. https://doi.org/10.1037/spy0000114
- Wandik, Y., Dina, Guntoro, T. S., Sutoro, Wambrauw, O. O. O., Abidjulu, C. F., Irab, S. P., Jembise, T. L., Wanena, T., Kmurawak, R. M. B., Rahayu, A. S., Manalu, J., Yektiningtyas, W., Gultom, M., Zainuri, A., J., N. J., Sinaga, E., Hidayat, R. R., Nurhidayah, D., … Putra, M. F. P. (2024). Interrelation of mental toughness, religiosity, and happiness of elite adolescent athletes based on gender, type of sport, and level of education. Retos, 56, 981–989. https://doi.org/10.47197/retos.v56.103469
- Wang, W. C., Chen, H. F., & Jin, K. Y. (2015). Item Response Theory Models for Wording Effects in Mixed-Format Scales. Educational and Psychological Measurement, 75(1), 157–178. https://doi.org/10.1177/0013164414528209
Year 2025,
Volume: 16 Issue: 1, 208 - 228, 30.04.2025
Tri Setyo Guntoro
,
Sutoro Sutoro
,
Naomi Pahabol
,
Yahya Eko Nopiyanto
,
Gerdha Kristina Ivony Numberi
,
Agus Zainuri
,
Evi Sinaga
,
Dewi Nurhidayah
,
Bayu Budi Prakoso
,
Miftah Fariz Prima Putra
Project Number
Grant No. 546/UN20.2.1/PG/2024
References
- Andayani, T. M., Kristina, S. A., Endarti, D., Haris, R. N. H., & Rahmawati, A. (2020). Translation, Cultural Adaptation, and Validation of Short-Form 6D on the General Population in Indonesia. Value in Health Regional Issues, 21, 205–210. https://doi.org/10.1016/j.vhri.2019.11.004
- Azwar, S. (2013). Reliabilitas dan validitas. Pustaka Pelajar.
- Bagozzi, R. P. (2010). Structural equation models are modelling tools with many ambiguities: Comments acknowledging the need for caution and humility in their use. Journal of Consumer Psychology, 20(2), 208–214. https://doi.org/10.1016/j.jcps.2010.03.001
- Birch, P. D. J., Crampton, S., Greenlees, I., Lowry, R., & Coffee, P. (2019). The Mental Toughness Questionniare-48: A Re-examination of Factorial Validity. International Journal of Sport Psychology, 48(3), 331–355. https://doi.org/10.7352/IJSP.2017.48.331
- Browne, M. W., & Cudeck, R. (1992). Alternative Ways of Assessing Model Fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005
- Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
- Cherry, H. L. (2005). Psychometric Analysis of an Inventory Assessing Mental Toughness [University of Tennessee - Knoxville]. https://trace.tennessee.edu/utk_gradthes/588
- Clough, P., Earle, K., & Sewell, D. (2002). Mental toughness: the concept and its measurement. In I. M. Cockerill (Ed.), Solutions in sport psychology. Cengage Learning, EMEA.
- Clough, P. J., & Strycharczyk, D. (2012). Developing Mental Toughness: Improving Performance, Wellbeing and Positive Behaviour in Others. Kogan Page Limited.
- Clough, Peter, Earle, K., Perry, J. L., & Crust, L. (2012). Comment on “Progressing measurement in mental toughness: A case example of the Mental Toughness Questionnaire 48” by Gucciardi, Hanton, and Mallett (2012). Sport, Exercise, and Performance Psychology, 1(4), 283–287. https://doi.org/10.1037/a0029771
- Comrey, A. L., & Lee, H. B. (1992). A First Course in Factor Analysis. Lawrence Erlbaum Associates, Inc.
- Crust, L., & Azadi, K. (2010). Mental toughness and athletes’ use of psychological strategies. European Journal of Sport Science, 10(1), 43–51. https://doi.org/10.1080/17461390903049972
- Dagnall, N., Denovan, A., Papageorgiou, K. A., & Clough, P. J. (2019). Psychometric Assessment of Shortened Mental Toughness Questionnaires (MTQ): Factor Structure of the MTQ-18 and the MTQ-10. Frontiers in Psychology, 10(1993), 1–12. https://doi.org/10.3389/fpsyg.2019.01933
- Denovan, A., Dagnall, N., Hill-Artamonova, E., & Musienko, T. (2021). Mental toughness questionnaire (MTQ18): A Russian version. National Security and Strategic Planning, 2021(3), 47–59. https://doi.org/10.37468/2307-1400-2021-3-47-59
- Geisinger, K. F. (1994). Cross-Cultural Normative Assessment: Translation and Adaptation Issues Influencing the Normative Interpretation of Assessment Instruments. Psychological Assessment, 6(4), 304–312. https://doi.org/10.1037/1040-3590.6.4.304
- Gerber, M., Best, S., Meerstetter, F., Walter, M., Ludyga, S., Brand, S., Bianchi, R., Madigan, D. J., Isoard-Gautheur, S., & Gustafsson, H. (2018). Effects of stress and mental toughness on burnout and depressive symptoms: A prospective study with young elite athletes. Journal of Science and Medicine in Sport, 21(12), 1200–1205. https://doi.org/10.1016/j.jsams.2018.05.018
- Gjersing, L., Caplehorn, J. R., & Clausen, T. (2010). Cross-cultural adaptation of research instruments: Language, setting, time and statistical considerations. BMC Medical Research Methodology, 10. https://doi.org/10.1186/1471-2288-10-13
- Golby, J., Sheard, M., & van Wersch, A. (2007). Evaluating the Factor Structure of the Psychological Performance Inventory. Perceptual and Motor Skills, 105(1), 309–325. https://doi.org/10.2466/pms.105.1.309-325
- Gucciardi, D. F. (2017). Mental toughness: progress and prospects. Current Opinion in Psychology, 16(16), 17–23. https://doi.org/10.1016/j.copsyc.2017.03.010
- Gucciardi, D. F., & Gordon, S. (2009). Development and preliminary validation of the cricket mental toughness inventory (CMTI). Journal of Sports Sciences, 27(12), 1293–1310. https://doi.org/10.1080/02640410903242306
- Gucciardi, D. F., Gordon, S., & Dimmock, J. A. (2008). Towards an understanding of mental toughness in Australian football. Journal of Applied Sport Psychology, 20(3), 261–281. https://doi.org/10.1080/10413200801998556
- Gucciardi, D. F., Gordon, S., & Dimmock, J. A. (2009). Development and preliminary validation of a mental toughness inventory for Australian football. Psychology of Sport and Exercise, 10(1), 201–209. https://doi.org/10.1016/j.psychsport.2008.07.011
- Gucciardi, D. F., Hanton, S., Gordon, S., Mallett, C. J., & Temby, P. (2014). The Concept of Mental Toughness: Tests of Dimensionality, Nomological Network, and Traitness. Journal of Personality, 83(1), 26–44. https://doi.org/10.1111/jopy.12079
- Gucciardi, D. F., Hanton, S., & Mallett, C. J. (2012). Progressing measurement in mental toughness: A case example of the Mental Toughness Questionnaire 48. Sport, Exercise, and Performance Psychology, 1(3), 194–214. https://doi.org/10.1037/a0027190
- Gucciardi, D. F., Hanton, S., & Mallett, C. J. (2013). Progressing measurement in mental toughness: A response to Clough, Earle, Perry, and Crust. Sport, Exercise, and Performance Psychology, 2(3), 157–172. https://doi.org/10.1037/spy0000002
- Guntoro, T. S., & Putra, M. F. P. (2022). Athletes’ religiosity: How it plays a role in athletes’ anxiety and life satisfaction. HTS Teologiese Studies/Theological Studies, 78(1), a7802. https://doi.org/10.4102/hts.v78i1.7802
- Guntoro, T. S., Sutoro, Putra, M. F. P., Kurdi, Németh, Z., & Setiawan, E. (2023). The role of anthropometry, physical, psychological and personality for elite athletes in competitive sports. Pedagogy of Physical Culture and Sports, 27(4), 331–339. https://doi.org/10.15561/26649837.2023.0409
- Hambleton, R. K., & de Jong, J. H. A. L. (2003). Advances in translating and adapting educational and psychological tests. Language Testing, 20(2), 127–134. https://doi.org/10.1191/0265532203lt247xx
- ITC. (2017). ITC Guidelines for Translating and Adapting Tests (Second Edition). International Journal of Testing, 15305058. https://doi.org/10.1080/15305058.2017.1398166
- Kawabata, M., Pavey, T. G., & Coulter, T. J. (2021). Evolving the validity of a mental toughness measure: Refined versions of the Mental Toughness Questionnaire-48. Stress and Health, 37(2), 378–391. https://doi.org/10.1002/smi.3004
- Kerlinger, F. N. (2006). Asas-asas penelitian behavioral. Gadjah Mada Univeristy Press.
- Kobasa, S. C. (1979). Stressful life events, personality, and health: An inquiry into hardiness. Journal of Personality and Social Psychology, 37(1), 1–11. https://doi.org/10.1037/0022-3514.37.1.1
- Liew, G. C., Kuan, G., Chin, N. S., & Hashim, H. A. (2019). Mental toughness in sport: Systematic review and future. German Journal of Exercise and Sport Research, 49(4), 381–394. https://doi.org/10.1007/s12662-019-00603-3
- Ohrbach, R., Bjorner, J., Metric, Q., Jezewski, M., John, M. T., & Lobbezoo, F. (2013). Guidelines for establishing cultural equivalency of Instruments. https://ubwp.buffalo.edu/
- Papageorgiou, K. A., Malanchini, M., Denovan, A., Clough, P. J., Shakeshaft, N., Schofield, K., & Kovas, Y. (2018). Longitudinal associations between narcissism, mental toughness and school achievement. Personality and Individual Differences, 131, 105–110. https://doi.org/10.1016/j.paid.2018.04.024
- Pennebaker, J. W., Mehl, M. R., & Niederhoffer, K. G. (2003). Psychological Aspects of Natural Language Use: Our Words, Our Selves. Annual Review of Psychology, 54, 547–577. https://doi.org/10.1146/annurev.psych.54.101601.145041
- Putra, M. F. P., Kurdi, Syahruddin, S., Hasibuan, S., Sinulingga, A., Kamaruddin, I., Kristiyandaru, A., Mashud, Hariadi, I., Guntoro, T. S., Sutoro, S., Sinaga, E., Ibrahim, Setiawan, E., Ridwan, M., Wanena, T., Hidayat, R. R., & Hariadi, I. (2024). An Indonesian Version of Mental Toughness Index: Testing Psychometric Properties in Athletes and Non-athletes. Retos, 55, 816–824. https://doi.org/10.47197/retos.v55.106086
- Putra, M. F. P., Rahayuni, K., Wanena, T., Larung, E. Y. P., Sinaga, E., Zainuri, A., Dwiariani, D. A., Numbery, G. K. I., Hidayat, R. R., & Wandik, Y. (2025). Psychometric Properties of the Athlete Psychological Strain Questionnaire (APSQ): Adapting and Validating Its Indonesian Version. Sport and Tourism Central European Journal, 8(1), 1–10.
- Putra, M. F. P., Sutoro, Guntoro, T. S., Sinaga, E., Wanena, T., Rahayuni, K., Jannah, M., Warni, W. E., Juriana, Priambodo, A., Tahki, K., Hariadi, I., Hidayat, R. R., & Wandik, Y. (2024). Cross-cultural adaptation of the psychological performance inventory-alternative (PPI-A) for the Indonesian context. Retos, 56, 990–997. https://doi.org/10.47197/retos.v56.103765
- Putra, M. F. P., Sutoro, & Sinaga, E. (2023). Mental atlet: Konstruk, pengukuran, dan arah penelitian ke depan. Multilateral : Jurnal Pendidikan Jasmani Dan Olahraga, 22(1), 63–79. https://doi.org/10.20527/multilateral.v22i1.14785
- Rice, S. M., Parker, A. G., Mawren, D., Clifton, P., Lloyd, M., Kountouris, A., Smith, B., Mcgorry, P. D., & Purcell, R. (2019). Preliminary psychometric validation of a brief screening tool for athlete mental health among male elite athletes: the Athlete Psychological Strain Questionnaire. International Journal of Sport and Exercise Psychology, 18(1), 850–865. https://doi.org/10.1080/1612197X.2019.1611900
- Sheard, M., Golby, J., & Van Wersch, A. (2009). Progress toward construct validation of the Sports Mental Toughness Questionnaire (SMTQ). European Journal of Psychological Assessment, 25(3), 186–193. https://doi.org/10.1027/1015-5759.25.3.186
- Sutoro, Guntoro, T. S., & Putra, M. F. P. (2023). Development and validation mental training model: Mental Toughness Training Circle (MTTC). F1000Reserach, 12(169), 1–36. https://doi.org/10.12688/f1000research.129010.1
- Stamatis, A., Morgan, G. B., Papadakis, Z., Mougios, V., Bogdanis, G., & Spinou, A. (2021). Cross-cultural invariance of the mental toughness index among American and Greek athletes. Current Psychology, 40, 5793-5800.
- Tiwari, S., & Sharma, J. (2007). Development and Validation of Mental Toughness Questionnaire for Volleyball Players. Annamali University, India.
- Vaughan, R., Hanna, D., & Breslin, G. (2018). Psychometric properties of the Mental Toughness Questionnaire 48 (MTQ48) in elite, amateur and nonathletes. Sport, Exercise, and Performance Psychology, 7(2), 128–140. https://doi.org/10.1037/spy0000114
- Wandik, Y., Dina, Guntoro, T. S., Sutoro, Wambrauw, O. O. O., Abidjulu, C. F., Irab, S. P., Jembise, T. L., Wanena, T., Kmurawak, R. M. B., Rahayu, A. S., Manalu, J., Yektiningtyas, W., Gultom, M., Zainuri, A., J., N. J., Sinaga, E., Hidayat, R. R., Nurhidayah, D., … Putra, M. F. P. (2024). Interrelation of mental toughness, religiosity, and happiness of elite adolescent athletes based on gender, type of sport, and level of education. Retos, 56, 981–989. https://doi.org/10.47197/retos.v56.103469
- Wang, W. C., Chen, H. F., & Jin, K. Y. (2015). Item Response Theory Models for Wording Effects in Mixed-Format Scales. Educational and Psychological Measurement, 75(1), 157–178. https://doi.org/10.1177/0013164414528209