Participant identification, selection and recruitment
DOI:
https://doi.org/10.51224/SRXIV.509Keywords:
research methods, participant identification, participant selection, participant recruitment, sample size, Effect size, ethicsAbstract
Research in the sports and exercise sciences usually depends on participants volunteering their time and effort and taking on some element of risk. For researchers, it is key to recruit a sample of participants that is appropriate for the research question at hand and to ensure that the participants are suitably informed, comfortable, motivated, compensated and protected. Achieving the recruitment of a good sample of participants for any research question involves a number of theoretical, statistical, ethical and inter-personal factors. In this chapter, we discuss many of these factors from the early stages of designing a study and considering which population to study, through to sample size planning, sampling and recruitment, and communication with potential participants. We discuss current practice and evidence and provide recommendations and reference to other helpful resources with the aim to inform researchers of the many intricacies of these processes and the importance of considering them in the planning stages of any research project.
Metrics
References
ABT, G., BOREHAM, C., DAVISON, G., JACKSON, R., NEVILL, A., WALLACE, E. & WILLIAMS, M. 2020. Power, precision, and sample size estimation in sport and exercise science research. J Sports Sci, 38, 1933-1935. doi: 10.1080/02640414.2020.1776002
AUGUSTINE, E. F., DORSEY, E. R., HAUSER, R. A., ELM, J. J., TILLEY, B. C. & KIEBURTZ, K. K. 2016. Communicating with participants during the conduct of multi-center clinical trials. Clin Trials, 13, 592-596. doi: 10.1177/1740774516665596
BACKHOUSE, S. H., BIDDLE, S. J. & WILLIAMS, C. 2007. The influence of water ingestion during prolonged exercise on affect. Appetite, 48, 193-8. doi: 10.1016/j.appet.2006.08.064
BADER, C., COSSIN, S., MAILLARD, A. & BÉNARD, A. 2018. A new approach for sample size calculation in cost-effectiveness studies based on value of information. BMC Med Res Methodol, 18, 113. doi: 10.1186/s12874-018-0571-1
BAYER, A. & TADD, W. 2000. Unjustified exclusion of elderly people from studies submitted to research ethics committee for approval: descriptive study. BMJ, 321, 992-3. doi: 10.1136/bmj.321.7267.992
BORG, D. N., BACH, A. J. E., O'BRIEN, J. L. & SAINANI, K. L. 2022. Calculating sample size for reliability studies. PM R, 14, 1018-1025. doi: 10.1002/pmrj.12850
BRACH, M., DE BRUIN, E. D., LEVIN, O., HINRICHS, T., ZIJLSTRA, W. & NETZ, Y. 2023. Evidence-based yet still challenging! Research on physical activity in old age. Eur Rev Aging Phys Act, 20, 7. doi: 10.1186/s11556-023-00318-3
CALDWELL, A. & VIGOTSKY, A. D. 2020. A case against default effect sizes in sport and exercise science. PeerJ, 8, e10314. doi: 10.7717/peerj.10314
CALDWELL, A. R. & CHEUVRONT, S. N. 2019. Basic statistical considerations for physiology: The journal Temperature toolbox. Temperature (Austin), 6, 181-210. doi: 10.1080/23328940.2019.1624131
CHALMERS, I. 1999. People are "participants" in research. Further suggestions for other terms to describe "participants" are needed. BMJ, 318, 1141. doi: 10.1136/bmj.318.7191.1141a
COHEN, J. 1988. Statistical power analysis for the behavioral sciences L. Erlbaum Associates.
COOKE, R. & JONES, A. 2017. Recruiting adult participants to physical activity intervention studies using sport: a systematic review. BMJ Open Sport Exerc Med, 3, e000231. doi: 10.1136/bmjsem-2017-000231
COSTELLO, J. T., BIEUZEN, F. & BLEAKLEY, C. M. 2014. Where are all the female participants in Sports and Exercise Medicine research? Eur J Sport Sci, 14, 847-851. doi: 10.1080/17461391.2014.911354
CUMMING, G. 2012. Understanding The New Statistics: Effect Sizes, Confidence Intervals, and Meta-Analysis, New York, Routledge. doi: 10.4324/9780203807002
DATSON, N., LOLLI, L., DRUST, B., ATKINSON, G., WESTON, M. & GREGSON, W. 2022. Inter-methodological quantification of the target change for performance test outcomes relevant to elite female soccer players. Sci Med Footb, 6, 248-261. doi: 10.1080/24733938.2021.1942538
ELLIOTT-SALE, K. J., MINAHAN, C. L., DE JONGE, X., ACKERMAN, K. E., SIPILA, S., CONSTANTINI, N. W., LEBRUN, C. M. & HACKNEY, A. C. 2021. Methodological Considerations for Studies in Sport and Exercise Science with Women as Participants: A Working Guide for Standards of Practice for Research on Women. Sports Med, 51, 843-861. doi: 10.1007/s40279-021-01435-8
GARTLEHNER, G., HANSEN, R. A., NISSMAN, D., LOHR, K. N. & CAREY, T. S. 2006. Criteria for Distinguishing Effectiveness From Efficacy Trials in Systematic Reviews. Rockville (MD). https://www.ncbi.nlm.nih.gov/pubmed/20734508
GODLOVITCH, G. 2003. Age discrimination in trials and treatment: old dogs and new tricks. Monash Bioeth Rev, 22, 66-77. doi: 10.1007/BF03351398
GODWIN, M., RUHLAND, L., CASSON, I., MACDONALD, S., DELVA, D., BIRTWHISTLE, R., LAM, M. & SEGUIN, R. 2003. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol, 3, 28. doi: 10.1186/1471-2288-3-28
GORDON, B. G. 2020. Vulnerability in Research: Basic Ethical Concepts and General Approach to Review. Ochsner J, 20, 34-38. doi: 10.31486/toj.19.0079
GYURE, M. E., QUILLIN, J. M., RODRIGUEZ, V. M., MARKOWITZ, M. S., CORONA, R., BORZELLECA, J., JR., BOWEN, D. J., KRIST, A. H. & BODURTHA, J. N. 2014. Practical Considerations for Implementing Research Recruitment Etiquette. IRB, 36, 7-12. https://www.ncbi.nlm.nih.gov/pubmed/25684834
HAMMOND, S. P. & COOPER, N. J. 2011. Participant information clips: a role for digital video technologies to recruit, inform and debrief research participants and disseminate research findings. Int J Soc Res Methodol, 14, 259-270. doi: 10.1080/13645579.2010.530029
HECKSTEDEN, A., KELLNER, R. & DONATH, L. 2022. Dealing with small samples in football research. Sci Med Footb, 6, 389-397. doi: 10.1080/24733938.2021.1978106
HEDGES, L. V. 2008. What Are Effect Sizes and Why Do We Need Them? Child Dev Perspect, 2, 167-171. doi: 10.1111/j.1750-8606.2008.00060.x
HOPKINS, W. G., HAWLEY, J. A. & BURKE, L. M. 1999. Design and analysis of research on sport performance enhancement. Med Sci Sports Exerc, 31, 472-85. doi: 10.1097/00005768-199903000-00018
HOPKINS, W. G., MARSHALL, S. W., BATTERHAM, A. M. & HANIN, J. 2009. Progressive statistics for studies in sports medicine and exercise science. Med Sci Sports Exerc, 41, 3-13. doi: 10.1249/MSS.0b013e31818cb278
JOSEPH, R. P., KELLER, C. & AINSWORTH, B. E. 2016. Recruiting Participants into Pilot Trials: Techniques for Researchers with Shoestring Budgets. Calif J Health Promot, 14, 81-89. https://www.ncbi.nlm.nih.gov/pubmed/28090193
KRUGMAN, S. 1986. The Willowbrook hepatitis studies revisited: ethical aspects. Rev Infect Dis, 8, 157-62. doi: 10.1093/clinids/8.1.157
LAKENS, D. 2013. Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Front Psychol, 4, 863. doi: 10.3389/fpsyg.2013.00863
LAKENS, D. 2022a. Improving Your Statistical Inferences. doi: 10.5281/zenodo.6409077
LAKENS, D. 2022b. Sample Size Justification. Collabra Psychol, 8. doi: 10.1525/collabra.33267
LENZA, M. 2004. Controversies surrounding Laud Humphreys’ tearoom trade: an unsettling example of politics and power in methodological critiques. Int J Sociol Soc Policy, 24, 20-31. doi: 10.1108/01443330410790858
LIAMPUTTONG, P. 2017. The science of words and the science of number. In: LIAMPUTTONG, P. (ed.) Research methods in health: foundations of evidence-based practice. 3 ed. South Melbourne: Oxford University Press.
LONG, C. R., STEWART, M. K., CUNNINGHAM, T. V., WARMACK, T. S. & MCELFISH, P. A. 2016. Health research participants' preferences for receiving research results. Clin Trials, 13, 582-591. doi: 10.1177/1740774516665598
LONG, C. R., STEWART, M. K. & MCELFISH, P. A. 2017. Health research participants are not receiving research results: a collaborative solution is needed. Trials, 18, 449. doi: 10.1186/s13063-017-2200-4
MACRAE, K. D. 1989. Pragmatic versus explanatory trials. Int J Technol Assess Health Care, 5, 333-9. doi: 10.1017/s0266462300007406
MANOHAR, N., MACMILLAN, F., Z. STEINER, G. & ARORA, A. 2018. Recruitment of Research Participants. In: LIAMPUTTONG, P. (ed.) Handbook of Research Methods in Health Social Sciences. Singapore: Springer Singapore. doi: 10.1007/978-981-10-2779-6_75-1
MCCALLUM, J. M., AREKERE, D. M., GREEN, B. L., KATZ, R. V. & RIVERS, B. M. 2006. Awareness and knowledge of the U.S. Public Health Service syphilis study at Tuskegee: implications for biomedical research. J Health Care Poor Underserved, 17, 716-33. doi: 10.1353/hpu.2006.0130
MCCRUM, C., VAN BEEK, J., SCHUMACHER, C., JANSSEN, S. & VAN HOOREN, B. 2022. Sample size justifications in Gait & Posture. Gait Posture, 92, 333-337. doi: 10.1016/j.gaitpost.2021.12.010
MCKAY, B., CORSON, A., VINH, M. A., JEYARAJAN, G., TANDON, C., BROOKS, H., HUBLEY, J. & CARTER, M. J. 2023. Low Prevalence of A Priori Power Analyses in Motor Behavior Research. J Mot Learn Dev, 11, 15-28. doi: 10.1123/jmld.2022-0042
MESQUIDA, C. & LAKENS, D. 2024. Is the effect large enough to matter? Why exercise physiologists should interpret effect sizes meaningfully: a reply to Williams et al. (2023). J Physiol, 602, 241-242. doi: 10.1113/jp285901
MESQUIDA, C., MURPHY, J., LAKENS, D. & WARNE, J. 2022. Replication concerns in sports and exercise science: a narrative review of selected methodological issues in the field. R Soc Open Sci, 9, 220946. doi: 10.1098/rsos.220946
MITCHELL, L., RATCLIFF, J., BURKE, L. M. & FORSYTH, A. 2024. Engaging athletes as research participants. A document analysis of published sport science literature. Eur J Sport Sci, 24, 1442-1451. doi: 10.1002/ejsc.12198
NATIONAL COMMISSION FOR THE PROTECTION OF HUMAN SUBJECTS OF BIOMEDICAL AND BEHAVIORAL RESEARCH. 1979. The Belmont report: Ethical principles and guidelines for the protection of human subjects of research. U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES. https://www.hhs.gov/ohrp/regulations-and-policy/belmont-report/read-the-belmont-report/index.html
NATIONAL INSTITUTES OF HEALTH. 2016. Guiding principles for ethical research: Pursuing potential research participants protections. https://www.nih.gov/health-information/nih-clinical-research-trials-you/guiding-principles-ethical-research
PREOBRAZENSKI, N., MCCAIG, A., TURNER, A., KUSHNER, M., PACITTI, L., MENDOLIA, P., MACDONALD, B., STOROSCHUK, K., BOUCK, T., ZAZA, Y., LU, S. & GURD, B. J. 2024. Risk of bias in exercise science: A systematic review of 340 studies. iScience, 27, 109010. doi: 10.1016/j.isci.2024.109010
RHEA, M. R. 2004. Determining the magnitude of treatment effects in strength training research through the use of the effect size. J Strength Cond Res, 18, 918-20. doi: 10.1519/14403.1
ROBINSON, M. A., VANRENTERGHEM, J. & PATAKY, T. C. 2021. Sample size estimation for biomechanical waveforms: Current practice, recommendations and a comparison to discrete power analysis. J Biomech, 122. doi: 10.1016/j.jbiomech.2021.110451
ROTHMAN, K. J., GALLACHER, J. E. & HATCH, E. E. 2013. Why representativeness should be avoided. Int J Epidemiol, 42, 1012-4. doi: 10.1093/ije/dys223
SCHUCH, F. B., VANCAMPFORT, D., RICHARDS, J., ROSENBAUM, S., WARD, P. B. & STUBBS, B. 2016. Exercise as a treatment for depression: A meta-analysis adjusting for publication bias. J Psychiatr Res, 77, 42-51. doi: 10.1016/j.jpsychires.2016.02.023
SCHULZ, R., LANGEN, G., PRILL, R., CASSEL, M. & WEISSGERBER, T. L. 2022. Reporting and transparent research practices in sports medicine and orthopaedic clinical trials: a meta-research study. BMJ Open, 12, e059347. doi: 10.1136/bmjopen-2021-059347
SHALOWITZ, D. I. & MILLER, F. G. 2008. Communicating the results of clinical research to participants: attitudes, practices, and future directions. PLoS Med, 5, e91. doi: 10.1371/journal.pmed.0050091
SWINTON, P. A., SHIM, J. S. C., PAVLOVA, A. V., MOSS, R., MACLEAN, C., BRANDIE, D., MITCHELL, L., GREIG, L., PARKINSON, E., TZORTZIOU BROWN, V., MORRISSEY, D., ALEXANDER, L. & COOPER, K. 2023. What are small, medium and large effect sizes for exercise treatments of tendinopathy? A systematic review and meta-analysis. BMJ Open Sport Exerc Med, 9, e001389. doi: 10.1136/bmjsem-2022-001389
TENAN, M. & CALDWELL, A. 2022. Confidence Intervals and Smallest Worthwhile Change Are Not a Panacea: A Response to the International Society of Physiotherapy Journal Editors. Commun Kinesiol, 1. doi: 10.51224/cik.2022.45
THOMAS, J. R., LOCHBAUM, M. R., LANDERS, D. M. & HE, C. 1997. Planning significant and meaningful research in exercise science: estimating sample size. Res Q Exerc Sport, 68, 33-43. doi: 10.1080/02701367.1997.10608864
TWOMEY, R., YINGLING, V., WARNE, J., SCHNEIDER, C., MCCRUM, C., ATKINS, W., MURPHY, J., ROMERO MEDINA, C., HARLLEY, S. & CALDWELL, A. 2021. The Nature of Our Literature: A Registered Report on the Positive Result Rate and Reporting Practices in Kinesiology. Commun Kinesiol, 1. doi: 10.51224/cik.v1i3.43
U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES, OFFICE FOR HUMAN RESEARCH PROTECTIONS. (2018). Federal policy for the protection of human subjects (2018 Common Rule), 45 CFR 46 (rev. 2018). U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES. https://www.hhs.gov/ohrp/regulations-and-policy/regulations/45-cfr-46/index.html
WALTON, C. C., GWYTHER, K., GAO, C. X., PURCELL, R. & RICE, S. M. 2024. Evidence of gender imbalance across samples in sport and exercise psychology. Int Rev Sport Exerc Psychol, 17, 1337-1355. doi: 10.1080/1750984x.2022.2150981
WITHAM, M. D. & MCMURDO, M. E. 2007. How to get older people included in clinical studies. Drugs Aging, 24, 187-96. doi: 10.2165/00002512-200724030-00002
WORLD MEDICAL ASSOCIATION. 2024. WMA Declaration of Helsinki – Ethical Principles for Medical Research Involving Human Participants. https://www.wma.net/policies-post/wma-declaration-of-helsinki/
Downloads
Posted
Categories
License
Copyright (c) 2025 Christopher McCrum, Christoph Schneider, Zachary Zenko (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
