Development and validation of the evaluation and selection criteria scale for coaches Factor structure, validity and reliability
Article Sidebar
Main Article Content
Abstract
The purpose of this study was to develop and provide initial validation of a scale designed to identify the evaluation and selection criteria of 585 coaches selected to work in 237 amateur sports clubs in Attica, Greece. The development of the scale was based on the job analysis of coaching and the review of the evaluation of coaching performance. The criterion of KMO (.934) and Bartlett’s test of Sphericity test (13338.366, df 406, p < .00001) confirmed that the requirements for factor analysis were met. EFA revealed a scale of 29 items and identified six (6) factors interpreting the 73.396% of the overall variance: (1) results of coaching on athletes, (2) personal achievements of the coach, (3) design and implementation of coaching (4) competition management (5) psychological support of the athletes and (6) commitment to the club. CFA was used to test the accuracy of the construct revealed by EFA. The findings of this study support the factorial structure of the scale and its psychometric qualities in a Greek sample suggesting that the scale is valid for identifying the evaluation and selection criteria employed from amateur sports clubs to select their coaches.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Each author warrants that his or her submission to the Work is original and that he or she has full power to enter into this agreement. Neither this Work nor a similar work has been published elsewhere in any language nor shall be submitted for publication elsewhere while under consideration by Journal of Human Sport and Exercise (JHSE). Each author also accepts that the JHSE will not be held legally responsible for any claims of compensation.
Authors wishing to include figures or text passages that have already been published elsewhere are required to obtain permission from the copyright holder(s) and to include evidence that such permission has been granted when submitting their papers. Any material received without such evidence will be assumed to originate from the authors.
Please include at the end of the acknowledgements a declaration that the experiments comply with the current laws of the country in which they were performed. The editors reserve the right to reject manuscripts that do not comply with the abovementioned requirements. The author(s) will be held responsible for false statements or failure to fulfill the above-mentioned requirements.
This title is licensed under a Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0).
You are free to:
Share — copy and redistribute the material in any medium or format.
Adapt — remix, transform, and build upon the material.
The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms:
-
Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
-
NonCommercial — You may not use the material for commercial purposes.
-
ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Notices:
- You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
- No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material.
How to Cite
References
Abraham, A. & Collins, D. (2011). Taking the Next Step. Ways Forward for Coaching Science. Quest, 63, 366-384. https://doi.org/10.1080/00336297.2011.10483687
Amorose, A. J., & Horn, T. S. (2001). Pre- to post-season changes in the intrinsic motivation of first year college athletes: Relationships with coaching behavior and scholarship status. J Appl Sport Psychol, 13(4), 355-373. https://doi.org/10.1080/104132001753226247
Antunes, J. Soares, J. Rodrigues, and Velosa (2020). "Performance appraisal criteria of coaches according to the age group of the athletes and the level of sports competition," Advances in Physical Education, vol. 10, no. 04, pp. 391-409. https://doi.org/10.4236/ape.2020.104032
Armstrong, M., & Taylor, S. (2023). Armstrong's handbook of human resource management practice: A guide to the theory and practice of people management. Kogan Page Publishers.
Behrendt, P., & Greif, S. (2022). Success Factors in the Coaching Process. In International Handbook of Evidence-Based Coaching: Theory, Research and Practice (pp. 877-888). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-81938-5_72
Bentler, P. M. (1990). Comparative Fit Indexes in Structural Models. Psychological Bulletin, 107, 238-246. https://doi.org/10.1037/0033-2909.107.2.238
Bentler, P. M. (1995). EQS Structural Equations Program Manual. Los Angeles, CA: BMDP Statistical Software.
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588-606. https://doi.org/10.1037/0033-2909.88.3.588
Bentler, P. M., & Chou, C. (1987). Practical issues in structural modeling.Sociological Methods & Research, 16(1), 78-117. https://doi.org/10.1177/0049124187016001004
Boardley, I. D., Kavussanu, M., & Ring, C. (2008). Athletes' perceptions of coaching effectiveness and athlete-related outcomes in rugby union: An investigation based on the coaching efficacy model. The Sport Psychologist, 22(3), 269-287. https://doi.org/10.1123/tsp.22.3.269
Bollen, K.A. (1989). Structural Equations with Latent Variables. John Wiley and Sons, Inc., New York. https://doi.org/10.1002/9781118619179
Browne, M.W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K.A. Bollen & J.S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage Publications, Inc.
Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage.
Byrne, R. M. J. (1989). Suppressing valid inferences with conditionals. Cognition, 31, 61-83. https://doi.org/10.1016/0010-0277(89)90018-8
Cassidy, T., Potrac, P., & Rynne, S. (2023). Understanding sports coaching: The pedagogical, social and cultural foundations of coaching practice. Routledge. https://doi.org/10.4324/9781003184348
Chan, J. T. & Mallet, C. J. (2011). The Value of Emotional Intelligence for High Performance Coaching. International Journal of Sports Science & Coaching, 6(3), pp. 315-328. https://doi.org/10.1260/1747-9541.6.3.315
Cooper, D., & Allen, J. B. (2018). "The Coaching Process of the Expert Coach: A Coach Led Approach." Sports Coaching Review 7, no. 2: 142-70. https://doi.org/10.1080/21640629.2017.1361168
Corsby, C. L. T. (2024). Coaching practice as discovering performance: the wild contingencies of coaching. Sports Coaching Review, 13(1), 37-59. https://doi.org/10.1080/21640629.2023.2275394
Côté, J. Salmela, J., Trudel, P., Baria, A. and Russell, S., (1995). The Coaching Model: A Grounded Assessment of Expert Gymnastic Coaches Knowledge, Journal of Sport and Exercise Psychology, 17(1), 1-17. https://doi.org/10.1123/jsep.17.1.1
Côté, J., & Gilbert, W. (2009). An integrative definition of coaching effectiveness and Development and empirical tests. The Leadership Quarterly, 22(6), 1146-1164. https://doi.org/10.1260/174795409789623892
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334. https://doi.org/10.1007/BF02310555
Cushion, C. J., Armour, K. M., & Jones R. L., 2003. Coach Education and Continuing Professional Development: Experience and Learning to Coach. Quest, 55 (3): 215-30. https://doi.org/10.1080/00336297.2003.10491800
Cushion, C., & Harvey, S., & Muir, B., & Nelson, L. (2012) Developing the Coach Analysis and Intervention System (CAIS): Establishing validity and reliability of a computerised systematic observation instrument, J SPORT SCI, 30:2, 201-216. https://doi.org/10.1080/02640414.2011.635310
Davis, L. (1992). Instrument review: Getting the most from your panel of experts. Applied Nursing Research, 5, 194-197. https://doi.org/10.1016/S0897-1897(05)80008-4
Davis, L., Jowett, S., & Sörman, D. (2022). The importance of positive relationships for coaches' effectiveness and well-being. International Sport Coaching Journal, 10(2), 254-265. https://doi.org/10.1123/iscj.2021-0065
Gershkowitz, B. D., Hillert, C. J., & Crotty, B. H. (2021). Digital coaching strategies to facilitate behavioral change in type 2 diabetes: a systematic review. The Journal of Clinical Endocrinology & Metabolism, 106(4), e1513-e1520. https://doi.org/10.1210/clinem/dgaa850
Gilbert, W. & Côté, J. (2013). Defining Coaching Effectiveness: A Focus on Coaches' Knowledge. In: Potrac, P., Gilbert, W. and Denison, J., Eds., Routledge Handbook of Sports Coaching, Routledge, Abingdon, 147-159. eBook ISBN9780203132623
Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1995). Multivariate data analysis. Englewood Cliffs, NJ: Prentice-Hall.
Hamidi, M., & Memari, Z. (2014). Determining the Explanatory Model of Iranian Elite Sport Coach Selection Criteria. Sport Management Studies, 6(24), 31-58.
Horn, T. S. (2008). Coaching effectiveness in the sport domain. In T. S. Horn (Ed.), Advances in sport psychology (3rd ed.), pp. Human Kinetics.
Horton, P. (2015). The role of the coach. In Nash, C. (Ed.) Practical Sports Coaching. Routledge: Abingdon, UK, pp. 3-15.
Hoyle, R.H., & Panter, A.T. (1995). Writing about structural equation models. In R.H. Hoyle (Eds.), Structural equation modeling: Concepts, issues and applications (pp. 158-176). Thousand Oaks, CA: Sage. https://doi.org/10.52846/jskm/37.2021.1.1
Hu, L., & Bentler, P.M. (1999). Cut off criteria for the fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. https://doi.org/10.1080/10705519909540118
Jowett, S. (2017). Coaching Effectiveness: The Coach-Athlete Relationship at its Heart. Current Opinion in Psychology. 16. https://doi.org/10.1016/j.copsyc.2017.05.006
Jowett, S., & Arthur, C. (2019). Effective coaching: The links between coach leadership and coach-athlete relationship-From theory to research to practice. In M. H. Anshel, T. A. Petrie, & J. A. Steinfeldt (Eds.), APA handbook of sport and exercise psychology: Sport psychology (pp. 419-449). American Psychological Association. https://doi.org/10.1037/0000123-022
Kelloway, E. K. (1998). Using LISREL for structural equation modeling: A researcher's guide. Sage Publications, Inc.
Kline, P. (1994). An Easy Guide to Factor Analysis. Abingdon-on-Thames: Routledge.
Kline, R.B. (1998). Principles and practice of structural equation modeling. New York: Guilford Press.
Kramers, S., Turgeon, S., Bean, C., Sabourin, C., & Camiré, M. (2020). Examining the roles of coaching experience and coach training on coaches' perceived life skills teaching. International Journal of Sports Science & Coaching, 15(4), 576-583. https://doi.org/10.1177/1747954120922367
Lara-Bercial, S., & Mallett, C. (2016). The practices and developmental pathways of professional and Olympic serial winning coaches. International Sport Coaching Journal, 3(3), 221-239. https://doi.org/10.1123/iscj.2016-0083
Lara-Bercial, S., Duffy, P., and Harrington, M. (2013). International Sport Coaching Framework 1.2. Champaign, IL: Human Kinetics. ISBN: 9781450471275
Lara-Bercial, S., North, J., Hämäläinen, K., Oltmanns, K., Minkhorst, J., & Petrovic, L. (2017). The European Sport Coaching Framework. Human Kinetics: Champaign, IL.
Litwin, M.S. (1995). How to Measure Survey Reliability and Validity. Sage Publications, Inc., Thousand Oaks, CA. https://doi.org/10.4135/9781483348957
Lyle, J. W. B. (2002). Sports coaching concepts: a framework for coaches' behaviour. (London, Routledge).
Lyle, J., & Cushion, C. (2017). Sports coaching concepts: A framework for coaches' practice. London: Routledge. https://doi.org/10.4324/9780203126424
MacLean, J. (2001). Performance appraisal for sport and recreation managers. Champaign, IL: Human Kinetics.
MacLean, J. (2017). Performance management, In Hoye, R., & Parent, M. M. (Eds.), The SAGE Handbook of Sport Management (pp. 160-180), London: SAGE. https://doi.org/10.4135/9781473957961.n10
MacLean, J., & Chelladurai, P. (1995). Dimensions of coaching performance: Development of a scale. Journal of Sport Management, 9, 194-207. https://doi.org/10.1123/jsm.9.2.194
MacLean, J., & Zakrajsek, D. (1996). Factors considered important for evaluating Canadian university athletic coaches. Journal of Sport Management, 10, 446-462. https://doi.org/10.1123/jsm.10.4.446
Mageau, G.A.& Vallerand, R.J. (2003). The coach-athlete relationship: a motivational model. J. Sports Sci., 21, pp. 883-904. https://doi.org/10.1080/0264041031000140374
Mardia, K.V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57, 519-530. https://doi.org/10.1093/biomet/57.3.519
Martens, R. (2012). Successful Coaching (4th ed.). Champaign, IL. Human Kinetics.
McAuley, E, Duncan, T., & Tammen, V. V. (1989). Psychometric properties of the intrinsic motivation inventory in a competitive sport setting: A confirmatory factor analysis. Research Quarterly for Exercise and Sport, 60, 48-58. https://doi.org/10.1080/02701367.1989.10607413
Millar, P., Clutterbuck, R., & Doherty, A. (2020). Understanding the adoption of long-term athlete development in one community sport club. Managing Sport and Leisure, 25(4), 259-274. https://doi.org/10.1080/23750472.2020.1713197
Neelis, L., Faucett, A., & Thompson, M. (2020). Quality Sport Coaching: The Role of the National Standards for Sport Coaches. Strategies, 33(6), 7-13. https://doi.org/10.1080/08924562.2020.1812328
Nelson, L. J. (2010). Thesis: Understanding Coach Learning. Loughborough: Loughborough University. Retrieved from [Accessed 2024, July 12]: https://repository.lboro.ac.uk/articles/Understanding_coach_learning/9608861
North, J. (2009). The coaching workforce 2009-2016. Leeds, UK: Sports Coach.
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.
Nunnally, J. C., & Bernstein, I. C. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
Nunnally, J.C. (1978). Psychometric theory. 2nd Edition, McGraw-Hill, New York.
O'Boyle, I. (2014). Determining Best Practice in Performance Monitoring and Evaluation of Sport Coaches: Lessons from the Traditional Business Environment. International Journal of Sports Science & Coaching, 9, 233-246. https://doi.org/10.1260/1747-9541.9.1.233
Papadimitriou, D. (2005). The Management of Sport Organizations, Athens, Kleidarithmos, pages 350.
Perkins, P., & Hahn, A. (2019). Factors Underpinning at Least Three Years of Participant Adherence to a Community-Focused Modified Boxing Program. Open Journal of Social Sciences, 7, 298-331. https://doi.org/10.4236/jss.2019.72023
Perkins, P., Hahn, A., Keegan, R., & Collis, I. (2014). Why Do Community-Based Athletes Choose to Participate in a Modified, Low-Risk form of Boxing? An Interpretative Phenomenological Analysis. Quest Journals of Research in Humanities and Social Science, 2, 60-69. https://doi.org/10.9790/9467-2116069
Polit, D. F., & Beck, C. T. (2006). The content validity index: are you sure you know what's being reported? Critique and recommendations. Research in nursing & health, 29(5), 489-497. https://doi.org/10.1002/nur.20147
Predoiu, R., Predoiu, A., Cosma, G., Bota, A., & Mitrache, G. (2021). Contributions to the shaping of the successful coach personality profile. Journal of Sport & Kinetic Movement, 1(37), 3-13.
Rhind, D. J. A., & Jowett, S. (2010). Relationship maintenance strategies in the coach-athlete relationship: The development of the COMPASS model. J Appl Sport Psychol, 22(1), 106-121. https://doi.org/10.1080/10413200903474472
Rupp, M. T., & Segal, R. (1989). Confirmatory factor analysis of a professionalism scale in pharmacy. Journal of Social and Administrative Pharmacy, 6, 31-38.
Saunders M., Lewis P., Thornhill A. (2012). Research Methods for Business Students (6th edition), Pearson Education Limited.
Schempp, P., McCullick, B., & Mason, I. (2006). The Development of Expert Coaching. In R. L. Jones (Ed.), The Sports Coach as Educator: Reconceptualising Sports Coaching (pp. 145-161). London: Routledge.
Smith, R.E., & Smoll, F.L. (2017). Coaching Behavior and Effectiveness in Sport and Exercise Psychology. https://doi.org/10.1093/acrefore/9780190236557.013.188
Spector, P. E. (1992). Summated Rating Scale Construction: An Introduction. Newbury Park, CA: Sage. https://doi.org/10.4135/9781412986038
Stewart, L. J., Palmer, S., Wilkin, H., & Kerrin, M. (2020). Toward a model of coaching transfer: Operationalizing coaching success and the facilitators and barriers to transfer. Coaching Researched: A Coaching Psychology Reader, 379-407. https://doi.org/10.1002/9781119656913.ch20
Stodter, A., & Cushion, C. J. (2019). Evidencing the impact of coaches' learning: Changes in coaching knowledge and practice over time. J Sport Sci, 37(18), 2086-2093. https://doi.org/10.1080/02640414.2019.1621045
Sullivan, P., Rhind, D., & Jowett, S. (2014). Communication. In A. Papaioannou & D. Hackfort (Eds.), Routledge Companion to Sport and Exercise Psychology: Global Perspectives and Fundamental Concepts (pp. 559-570). Routledge.
Tabachnick, B.G. and Fidell, L.S. (2006). Using multivariate statistics. (5th ed.) Boston: Allyn and Bacon.
Taylor, T., & Doherty, A., & McGraw, P. (2015). Managing people in sport organizations: A strategic human resource management perspective. Second edition. Routledge. https://doi.org/10.4324/9781315881881
Thelwell, R. C., Wagstaff, C. R. D., Chapman, M. T., & Kenttä, G. (2017). Examining coaches' perceptions of how their stress influences the coach-athlete relationship. J Sport Sci, 35(19), 1928-1939. https://doi.org/10.1080/02640414.2016.1241422
Tinsley, H. E. A., & Tinsley, D. J. (1987). Uses of factor analysis in counseling psychology research. Journal of Counseling Psychology, 34(4), 414-424. https://doi.org/10.1037/0022-0167.34.4.414
Tucker, L. R., Koopman, R. F., & Linn, R. L. (1969). Evaluation of factor analytic research procedures by means of simulated correlation matrices. Psychometrika, 34(4, Pt. 1), 421-459. https://doi.org/10.1007/BF02290601
Vella, S., & Gilbert, W. (2014). Coaching young athletes to positive development: Implications for coach training. In A. R. Gomes, R. Resende & A. Albuquerque (Eds.), Positive Human Functioning From a Multidimensional Perspective: Promoting High Performance (Vol. 3, pp. 83-105). New York: Nova Science.
Vella, S., Oades. L. G., & Crowe, T. P. (2010). The application of coach leadership models to coaching practice: Current state and future directions. International Journal of Sports Science and Coaching, 5, 425-434. https://doi.org/10.1260/1747-9541.5.3.425
West, L. (2016). Coach-athlete communication: Coaching style, leadership characteristics, and psychological outcomes. Master of Education in Human Movement, Sport, and Leisure Studies Graduate Projects. 16. Retrieved from [Accessed 2024, July 12]: https://scholarworks.bgsu.edu/hmsls_mastersprojects/16
West, S.G., Finch, J.F., & Curran, P.J. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R.H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp.56-75). Thousand Oaks, CA: Sage.
Zhang, C., Starczewski, A. P., Lakens, D., & IJsselsteijn, W. A. (2018). A decision-making perspective on coaching behavior change: a field experiment on promoting exercise at work. In Persuasive Technology: 13th International Conference, PERSUASIVE 2018, Waterloo, ON, Canada, April 18-19, 2018, Proceedings 13 (pp. 87-98). Springer International Publishing. https://doi.org/10.1007/978-3-319-78978-1_7
Zhang, Q., Hou, B., Wang Y., & Xiao, Y. (2014). A comprehensive model for evaluation of sport coaches' performance. International Journal of Engineering and Innovative Technology, 3(9), 265-271. Retrieved from [Accessed 2024, July 12]: https://www.ijeit.com/Vol%203/Issue%209/IJEIT1412201403_43.pdf