Challenges with Confidence Intervals for Sport Injury Burden, other Ratio Measures and Clustered data
An evaluation of recent practices
DOI:
https://doi.org/10.51224/SRXIV.546Keywords:
confidence interval, bootstrap, standard error, injury burden, injury incidenceAbstract
Several studies investigating injury burden have used “standard” formulae for injury rates when calculating their 95% confidence intervals. However, this may have led to artificially narrow confidence intervals because the authors’ calculations did not account for (1) violations of important underlying assumptions, and (2) the same athlete having multiple injuries. Although previous authors have recommended appropriate methods such as bootstrapping to solve the first challenge, there is little guidance for sport medicine researchers on how to implement bootstrapping given the complexity of data in our field. The purposes of this article are (1) to illustrate when the “standard” formulae for injury rate confidence intervals can be used in sport medicine research, (2) why the standard formulae for injury rate confidence intervals are inappropriate when estimating injury burden and (3) provide more detailed instructions on how to use bootstrapping for confidence intervals in the context of any sport medicine study that includes repeated measures.
Metrics
References
A. Vickers. Interpreting data from randomized trials: the Scandinavian prostatectomy study illustrates two common errors. Nat Clin Pract Urol 2005;2(9):404-5. doi:doi: 10.1038/ncpuro0294
S. Senn. Error point: The importance of knowing how much you don’t know. In: Mayo DG, editor. Error statistics philosophy, 2020.
J.P. Vandenbroucke, E. von Elm, D.G. Altman et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration. PLoS Medicine 2007;4(10):e297. doi:doi: 10.1371/journal.pmed.0040297
S. Greenland, S.J. Senn, K.J. Rothman et al. Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations. Eur J Epidemiol 2016;31(4):337-50. doi:doi: 10.1007/s10654-016-0149-3
D. Altman, D. Machin, T. Bryant et al. Statistics with confidence. 2nd ed: John Wiley & Sons, 2006. pages.
S. Williams, J.W. Shaw, C. Emery et al. Adding confidence to our injury burden estimates: is bootstrapping the solution? British journal of sports medicine 2024;58(2):57-58. https://doi.org/10.1136/bjsports-2023-107496
I. Shrier. The strategic assessment of risk and risk tolerance (StARRT) framework for return to play decision making. British Journal of Sports Medicine 2015;49:1311-1315. https://doi.org/10.1136/bjsports-2014-094569
G.T. LaFlair, J. Egbert, L. Plonsky. A practical guide to bootstrapping descriptive statistics, correlations, t tests, and ANOVAs. Advancing quantitative methods in second language research: Routledge, 2015:46-77.
D.B. Rubin. The bayesian bootstrap. The annals of statistics 1981:130-134. https://www.jstor.org/stable/2240875
• [10] I. Shrier, R.J. Steele, B. Rich et al. Analyses of injury count data: some do’s and some don’ts. Am J Epidemiol 2009;170:1307-1315. DOI: 10.1093/aje/kwp265
S. WilliamsJ.W. Shaw. Bootstrapping Burden CIs. https://osf.io/shrnj/files/osfstorage
. Last accessed: 2025-03-13
B. EfronR. Tibshirani. Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy. Stat Sci 1986;1(1):54-75.
B. Efron. Nonparametric estimates of standard error: the jackknife, the bootstrap and other methods. Biometrika 1981;68(3):589-599.
H.T. Thai, F. Mentré, N.H. Holford et al. A comparison of bootstrap approaches for estimating uncertainty of parameters in linear mixed‐effects models. Pharmaceutical Statistics 2013;12(3):129-140. https://doi.org/10.1002/pst.1561
D. Altman, S.M. Gore, M.J. Gardner et al. Statistical guidelines for contributors to medical journals. In: Altman D, Machin D, Bryant T, Gardner M, editors. Statistics with confidence. 2nd ed: John Wiley & Sons, 2006:171-190.
A. Severiano, J.A. Carrico, D.A. Robinson et al. Evaluation of jackknife and bootstrap for defining confidence intervals for pairwise agreement measures. PLoS One 2011;6(5):e19539. doi:10.1371/journal.pone.0019539
C.-F.J. Wu. Jackknife, bootstrap and other resampling methods in regression analysis. Ann Stat 1986;14(4):1261-1295. DOI: 10.1214/aos/1176350142
R.J. TibshiraniB. Efron. An introduction to the bootstrap. Monographs on statistics and applied probability 1993;57(1):1-436.
K. Knight. Mathematical statistics. Unites States: Chapman & Hall/CRC, 1999. pages.
K.L. Sainani, D.N. Borg, A.R. Caldwell et al. Call to increase statistical collaboration in sports science, sport and exercise medicine and sports physiotherapy. British Journal of Sports Medicine 2021;55(2):118-122. https://doi.org/10.1136/bjsports-2020-102607
Downloads
Posted
Versions
- 2025-05-28 (2)
- 2025-05-08 (1)
Categories
License
Copyright (c) 2025 Ian Shrier, Franco M. Impellizzeri, Avinash Chandran, Sean Williams, Joseph W. Shaw, Russell J. Steele (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
