Testing the validity of 360-video for analysing visual exploratory activity in soccer
DOI:
https://doi.org/10.51224/SRXIV.515Keywords:
immersive, scan frequency, women's football, visual perception, virtual reality, simulationAbstract
Extended reality (XR) technologies present new opportunities to measure sports performance in immersive and representative environments. Viewed through head-mounted displays (HMDs), 360-video offers the opportunity to capture visual exploratory activity (VEA) using representative stimuli in controlled scenarios. This study aimed to i) assess the construct and face validity of a 360-video simulation for capturing VEA in women’s soccer and ii) understand players’ perceptions of acceptability and tolerability of the simulation. Footage was recorded using a stationary GoPro 360 Max camera at eye height in six pitch locations. VEA was measured by the number of ‘scans’ away from the ball before the ball reached the 360-video camera. Eleven sub-elite women’s soccer players and eleven novices viewed 40 soccer videos in a HMD, with videos ending after a pass from a teammate. Upon receiving the pass, participants verbalised and acted an action response. Participants answered open-ended questions on acceptability, physical fidelity, and tolerability. Results supported construct and face validity, with good acceptability, tolerability, and physical fidelity. Soccer players (Mdn = 0.31 scans/s) had significantly higher scan frequencies than novices (Mdn = 0.06 scans/s, p < 0.001) and generated significantly more detailed responses per trial (p < 0.001). 360-video offers a valid and acceptable method for capturing VEA and has potential to offer new measures for talent identification processes. Future work should focus on efficacy of 360-video for skill development.
Metrics
References
Aksum, K. M., Brotangen, L., Bjørndal, C. T., Magnaguagno, L., & Jordet, G. (2021). Scanning activity of elite football players in 11 vs. 11 match play: An eye-tracking analysis on the duration and visual information of scanning. Plos one, 16(8), e0244118. https://doi.org/10.1371/journal.pone.0244118
Aksum, K. M., Pokolm, M., Bjørndal, C. T., Rein, R., Memmert, D., & Jordet, G. (2021). Scanning activity in elite youth soccer players. Journal of Sports Sciences, 39(21), 2401–2410. https://doi.org/10.1080/02640414.2021.1935115
Barbour, B., Sefton, L., Bruce, R. M., Valmaggia, L., & Runswick, O. R. (2024). Acute psychological and physiological benefits of exercising with virtual reality. Plos one 19(12): e0314331. https://doi.org/10.1371/journal.pone.0314331
Birckhead, B., Khalil, C., Liu, X., Conovitz, S., Rizzo, A., Danovitch, I., ... & Spiegel, B. (2019). Recommendations for methodology of virtual reality clinical trials in health care by an international working group: iterative study. JMIR mental health, 6(1), 1-14. https://mental.jmir.org/2019/1/e11973/
Bright, E., Vine, S., Wilson, M. R., Masters, R. S. W., and McGrath, J. S. (2012). Face validity, construct validity and training benefits of a virtual reality turp simulator. Int. J. Surg, 10(3), 163–166. https://doi.org/10.1016/j.ijsu.2012.02.012
Chertoff, D. B., Goldiez, B., & LaViola, J. J. (2010). Virtual Experience Test: A virtual environment evaluation questionnaire. In 2010 IEEE virtual reality conference (VR), 103-110. doi:10.1109/VR.2010.5444804
Cicchetti, D. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. https://doi.org/10.1037/1040-3590.6.4.284
Cohen, J. (1992). Statistical power analysis. Current directions in psychological science, 1(3), 98-101. https://doi.org/10.1111/1467-8721.ep10768783
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale,
NJ: Erlbaum.
de Jong, L. M., Gastin, P. B., Angelova, M., Bruce, L., & Dwyer, D. B. (2020). Technical determinants of success in professional women’s soccer: A wider range of variables reveals new insights. PloS one, 15(10), 1-12. https://doi.org/10.1371/journal.pone.0240992
de Jong, L. M. S., Gastin, P. B., Bruce, L., & Dwyer, D. B. (2022). Teamwork and performance in professional women’s soccer: A network-based analysis. International Journal of Sports Science & Coaching, PloS one 15(10): e0240992 https://doi.org/10.1177/17479541221092355
Dicks, M., Button, C. and Davids, K. (2010). Examination of gaze behaviors under in situ and video simulation task constraints reveals differences in information pickup for perception and action. Atten. Percept. Psychophys, 72, 706–720. https://doi.org/10.3758/APP.72.3.706
Dipple, J. W., Bruce, L., & Dwyer, D. B. (2022). Identifying the optimal characteristics of ball possession and movement in elite women’s soccer. International Journal of Performance Analysis in Sport, 22(4), 594-603. https://doi.org/10.1080/24748668.2022.2101837
Discombe, R. M., Bird, J. M., Kelly, A., Blake, R. L., Harris, D. J., & Vine, S. J. (2022). Effects of traditional and immersive video on anticipation in cricket: A temporal occlusion study. Psychology of Sport and Exercise, 58, 102088. https://doi.org/10.1016/j.psychsport.2021.102088
Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior research methods, 39(2), 175-191. https://doi.org/10.3758/BF03193146
Feist, J., Datson, N., Runswick, O. R., Harkness-Armstrong, A., & Pocock, C. (2024). Visual exploratory activity in elite women’s soccer: an analysis of the UEFA Women’s European Championship 2022. International Journal of Sport and Exercise Psychology, 1-23. https://doi.org/10.1080/1612197X.2023.2300386
Harris, D. J., Bird, J. M., Smart, P. A., Wilson, M. R., & Vine, S. J. (2020). A framework for the testing and validation of simulated environments in experimentation and training. Frontiers in Psychology, 11:605, 1-10. https://doi.org/10.3389/fpsyg.2020.00605
Harris, D. J., Buckingham, G., Wilson, M. R., Brookes, J., Mushtaq, F., Mon-Williams, M., & Vine, S. J. (2021). Exploring sensorimotor performance and user experience within a virtual reality golf putting simulator. Virtual Reality, 25, 647-654. https://doi.org/10.1007/s10055-020-00480-4
Höner, O., Dugandzic, D., Hauser, T., Stügelmaier, M., Willig, N., & Schultz, F. (2023). Do you have a good all-around view? Evaluation of a decision-making skills diagnostic tool using 360-videos and head-mounted displays in elite youth soccer. Frontiers in Sports and Active Living, 5, 1-11. https://doi.org/10.3389/fspor.2023.1171262
Jordet, G., Aksum, K. M., Pedersen, D. N., Walvekar, A., Trivedi, A., McCall, A., Ivarsson, A., & Priestley, D. (2020). Scanning, Contextual Factors, and Association With Performance in English Premier League Soccerers: An Investigation Across a Season. Frontiers in Psychology, 11, 1–16. https://doi.org/10.3389/fpsyg.2020.553813
Jordet, G., Bloomfield, J., & Heijmerikx, J. (2013). The Hidden Foundation of Field Vision in English Premier League (EPL) Soccer Players. MIT Sloan Sports Analytics Conference, Boston.
Kittel, A., Larkin, P., Cunningham, I., & Spittle, M. (2020). 360 virtual reality: a SWOT analysis in comparison to virtual reality. Frontiers in Psychology, 11, 1-5. https://doi.org/10.3389/fpsyg.2020.563474
Kittel, A., Larkin, P., Elsworthy, N., Lindsay, R., & Spittle, M. (2020). Effectiveness of 360 virtual reality and match broadcast video to improve decision-making skill. Science and Medicine in Football, 4(4), 255-262. https://doi.org/10.1080/24733938.2020.1754449
Kittel, A., Larkin, P., Elsworthy, N., & Spittle, M. (2021). Transfer of 360 virtual reality and match broadcast video-based tests to on-field decision-making. Science and Medicine in Football, 5(1), 79-86. https://doi.org/10.1080/24733938.2020.1802506
Kittel, A., Larkin, P., Elsworthy, N., & Spittle, M. (2019). Using 360 virtual reality as a decision-making assessment tool in sport. Journal of science and medicine in sport, 22(9), 1049-1053. https://doi.org/10.1016/j.jsams.2019.03.012
Kittel, A., Spittle, M., Larkin, P., & Spittle, S. (2023). 360° VR: Application for exercise and sport science education. Frontiers in Sports and Active Living, 5, 1-6. https://doi.org/10.3389/fspor.2023.977075
Kubayi, A., & Larkin, P. (2020). Technical performance of soccer teams according to match outcome at the 2019 FIFA Women’s World Cup. International Journal of Performance Analysis in Sport, 20(5), 908–916. https://doi.org/10.1080/24748668.2020.1809320
Lindsay, R., Spittle, S., & Spittle, M. (2023). Skill adaption in sport and movement: Practice design considerations for 360 VR. Frontiers in Psychology, 14, 1-5. https://doi.org/10.3389/fpsyg.2023.1124530
O'Donoghue, P. (2013). Statistics for sport and exercise studies: An introduction. Routledge.
O’Donoghue, P., & Beckley, S. (2023). Possession tactics in the UEFA women’s EURO 2022 soccer tournament. International Journal of Performance Analysis in Sport, 23(1), 48-64. https://doi.org/10.1080/24748668.2023.2206273
McGuckian, T. B., Cole, M. H., Chalkley, D., Jordet, G., & Pepping, G. J. (2019). Visual exploration when surrounded by affordances: frequency of head movements is predictive of response speed. Ecological Psychology, 31(1), 30-48. https://doi.org/10.1080/10407413.2018.1495548
McGuckian, T. B., Cole, M. H., Jordet, G., Chalkley, D., & Pepping, G. J. (2018). Don’t turn blind! The relationship between exploration before ball possession and on-ball performance in association soccer. Frontiers in Psychology, 9, 1–13. https://doi.org/10.3389/fpsyg.2018.02520
Murphy, C. P., Jackson, R. C., & Williams, A. M. (2019). Informational constraints, option generation, and anticipation. Psychology of Sport and Exercise, 41, 54-62. https://doi.org/10.1016/j.psychsport.2018.11.012
Murphy, C. P., Jackson, R. C., & Williams, A. M. (2018). The role of contextual information during skilled anticipation. Quarterly Journal of Experimental Psychology, 71(10), 2070–2087. https://doi.org/10.1177/1747021817739201
Musculus, L., Bäder, J., Sander, L., & Vogt, T. (2021). The influence of environmental constraints in 360-videos on decision making in soccer. Journal of Sport and Exercise Psychology, 43(5), 365-374. https://doi.org/10.1123/jsep.2020-0166
Pagé, C., Bernier, P. M., & Trempe, M. (2019). Using video simulations and virtual reality to improve decision-making skills in basketball. Journal of sports sciences, 37(21), 2403-2410. https://doi.org/10.1080/02640414.2019.1638193
Panchuk, D., Klusemann, M. J., & Hadlow, S. M. (2018). Exploring the effectiveness of immersive video for training decision-making capability in elite, youth basketball players. Frontiers in psychology, 9, 1-9. https://doi.org/10.3389/fpsyg.2018.02315
Pedersen, A. V., Aksdal, I. M., & Stalsberg, R. (2019). Scaling demands of soccer according to anthropometric and physiological sex differences: a fairer comparison of men’s and women’s soccer. Frontiers in psychology, 10, 1-11. https://doi.org/10.3389/fpsyg.2019.00762
Pokolm, M., Rein, R., Müller, D., Nopp, S., Kirchhain, M., Aksum, K. M., ... & Memmert, D. (2022). Modeling Players’ Scanning Activity in Football. Journal of Sport and Exercise Psychology, 44(4), 263-271. https://doi.org/10.1123/jsep.2020-0299
Roca, A., Ford, P. R., McRobert, A. P., & Williams, A. M. (2013). Perceptual-cognitive skills and their interaction as a function of task constraints in soccer. Journal of Sport and Exercise Psychology, 35(2), 144-155. https://doi.org/10.1123/jsep.35.2.144
Roca, A., Ford, P. R., McRobert, A. P., & Williams, A. M. (2011). Identifying the processes underpinning anticipation and decision-making in a dynamic time-constrained task. Cognitive processing, 12, 301-310. https://doi.org/10.1007/s10339-011-0392-1
Runswick, O. R. (2023). Player Perceptions of Face Validity and Fidelity in 360-Video and Virtual Reality Cricket. Journal of Sport and Exercise Psychology, 45(6), 347-354. https://doi.org/10.1123/jsep.2023-0122
Runswick, O. R., Rawlinson, A., Datson, N., & Allen, P. M. (2022). A valid and reliable test of technical skill for vision impaired football. Science and Medicine in Football, 6(1), 89–97. https://doi.org/10.1080/24733938.2021.1885725
Swann, C., Moran, A., & Piggott, D. (2015). Defining elite athletes: Issues in the study of expert performance in sport psychology. Psychology of sport and exercise, 16, 3-14. https://doi.org/10.1016/j.psychsport.2014.07.004
Taupin, M, L., Romeas, T., Juste, L., & Labbé, D. R. (2023). Exploring the effects of 3D-360-videoVR and 2D viewing modes on gaze behavior, head excursion and workload during a boxing specific anticipation task. Frontiers in Psychology, 14, 1-12. https://doi.org/10.3389/fpsyg.2023.1235984
Wirth, M., Kohl, S., Gradl, S., Farlock, R., Roth, D., & Eskofier, B. M. (2021). Assessing visual exploratory activity of athletes in virtual reality using head motion characteristics. Sensors, 21(11), 3728. https://doi.org/10.3390/s21113728
Witmer, B. G., Jerome, C. J., & Singer, M. J. (2005). The factor structure of the presence questionnaire. Presence: Teleoperators & Virtual Environments, 14(3), 298-312. https://doi.org/10.1162/105474605323384654
Wood, G., Wright, D. J., Harris, D., Pal, A., Franklin, Z. C., & Vine, S. J. (2021). Testing the construct validity of a soccer-specific virtual reality simulator using novice, academy, and professional soccer players. Virtual Reality, 25, 43-51. https://doi.org/10.1007/s10055-020-00441-x
Downloads
Additional Files
Posted
Categories
License
Copyright (c) 2025 James Feist, Naomi Datson, Ollie Runswick, Chris Pocock (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
