Injury Risk Estimation Expertise: Assessing the ACL Injury Risk Estimation Quiz

Erich J. Petushek, Edward T. Cokely, Paul Ward, John J. Durocher, Sean J. Wallace, Gregory D. Myer

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Background:Available methods for screening anterior cruciate ligament (ACL) injury risk are effective but limited in application as they generally rely on expensive and time-consuming biomechanical movement analysis. A potentially efficient alternative to biomechanical screening is skilled movement analysis via visual inspection (ie, having experts estimate injury risk factors based on observations of athletes’ movements).
Purpose:To develop a brief, valid psychometric assessment of ACL injury risk factor estimation skill: the ACL Injury Risk Estimation Quiz (ACL-IQ).
Study Design:Cohort study (diagnosis); Level of evidence, 3.
Methods:A total of 660 individuals participated in various stages of the study, including athletes, physicians, physical therapists, athletic trainers, exercise science researchers/students, and members of the general public in the United States. The ACL-IQ was fully computerized and made available online (www.ACL-IQ.org). Item sampling/reduction, reliability analysis, cross-validation, and convergent/discriminant validity analyses were conducted to refine the efficiency and validity of the assessment.
Results:Psychometric optimization techniques identified a short (mean time, 2 min 24 s), robust, 5-item assessment with high reliability (test-retest: r = 0.90) and high test sensitivity (average difference of exercise science professionals vs general population: Cohen d = 2). Exercise science professionals and individuals from the general population scored 74% and 53% correct, respectively. Convergent and discriminant validity was demonstrated. Scores on the ACL-IQ were best predicted by ACL knowledge and specific judgment strategies (ie, cue use) and were largely unrelated to domain-general spatial/decision-making ability, personality, or other demographic variables. Overall, 23% of the total sample (40% of exercise science professionals; 6% of general population) performed better than or equal to the ACL nomogram.
Conclusion:This study presents the results of a systematic approach to assess individual differences in ACL injury risk factor estimation skill; the assessment approach is efficient (ie, it can be completed in <3 min) and psychometrically robust. The results provide evidence that some individuals have the ability to visually estimate ACL injury risk factors more accurately than other instrument-based ACL risk estimation methods (ie, ACL nomogram). The ACL-IQ provides the foundation for assessing the efficacy of observational ACL injury risk factor assessment (ie, does simple skilled visual inspection reduce ACL injuries?). The ACL-IQ can also be used to increase our understanding of the perceptual-cognitive mechanisms underlying injury risk assessment expertise, which can be leveraged to accelerate learning and improve performance.
LanguageEnglish
Pages1640-1647
Number of pages8
JournalAmerican Journal of Sports Medicine
Volume43
Issue number7
Early online date30 Apr 2015
DOIs
Publication statusPublished - 1 Jul 2015

Fingerprint

Anterior Cruciate Ligament
Wounds and Injuries
Exercise
Nomograms
Aptitude
Psychometrics
Athletes
Population
Anterior Cruciate Ligament Injuries
Physical Therapists
Discriminant Analysis
Reproducibility of Results
Individuality
Sports
Cues
Personality
Decision Making
Cohort Studies
Research Personnel
Demography

Cite this

Petushek, E. J., Cokely, E. T., Ward, P., Durocher, J. J., Wallace, S. J., & Myer, G. D. (2015). Injury Risk Estimation Expertise: Assessing the ACL Injury Risk Estimation Quiz. American Journal of Sports Medicine, 43(7), 1640-1647. https://doi.org/10.1177/0363546515580791
Petushek, Erich J. ; Cokely, Edward T. ; Ward, Paul ; Durocher, John J. ; Wallace, Sean J. ; Myer, Gregory D. / Injury Risk Estimation Expertise : Assessing the ACL Injury Risk Estimation Quiz. In: American Journal of Sports Medicine. 2015 ; Vol. 43, No. 7. pp. 1640-1647.
@article{73a2e4bbc4e74bcbb7ddf3aa5ffec0e3,
title = "Injury Risk Estimation Expertise: Assessing the ACL Injury Risk Estimation Quiz",
abstract = "Background:Available methods for screening anterior cruciate ligament (ACL) injury risk are effective but limited in application as they generally rely on expensive and time-consuming biomechanical movement analysis. A potentially efficient alternative to biomechanical screening is skilled movement analysis via visual inspection (ie, having experts estimate injury risk factors based on observations of athletes’ movements).Purpose:To develop a brief, valid psychometric assessment of ACL injury risk factor estimation skill: the ACL Injury Risk Estimation Quiz (ACL-IQ).Study Design:Cohort study (diagnosis); Level of evidence, 3.Methods:A total of 660 individuals participated in various stages of the study, including athletes, physicians, physical therapists, athletic trainers, exercise science researchers/students, and members of the general public in the United States. The ACL-IQ was fully computerized and made available online (www.ACL-IQ.org). Item sampling/reduction, reliability analysis, cross-validation, and convergent/discriminant validity analyses were conducted to refine the efficiency and validity of the assessment.Results:Psychometric optimization techniques identified a short (mean time, 2 min 24 s), robust, 5-item assessment with high reliability (test-retest: r = 0.90) and high test sensitivity (average difference of exercise science professionals vs general population: Cohen d = 2). Exercise science professionals and individuals from the general population scored 74{\%} and 53{\%} correct, respectively. Convergent and discriminant validity was demonstrated. Scores on the ACL-IQ were best predicted by ACL knowledge and specific judgment strategies (ie, cue use) and were largely unrelated to domain-general spatial/decision-making ability, personality, or other demographic variables. Overall, 23{\%} of the total sample (40{\%} of exercise science professionals; 6{\%} of general population) performed better than or equal to the ACL nomogram.Conclusion:This study presents the results of a systematic approach to assess individual differences in ACL injury risk factor estimation skill; the assessment approach is efficient (ie, it can be completed in <3 min) and psychometrically robust. The results provide evidence that some individuals have the ability to visually estimate ACL injury risk factors more accurately than other instrument-based ACL risk estimation methods (ie, ACL nomogram). The ACL-IQ provides the foundation for assessing the efficacy of observational ACL injury risk factor assessment (ie, does simple skilled visual inspection reduce ACL injuries?). The ACL-IQ can also be used to increase our understanding of the perceptual-cognitive mechanisms underlying injury risk assessment expertise, which can be leveraged to accelerate learning and improve performance.",
keywords = "ACL injury risk, injury prediction, movement analysis, expertise, psychometric, validation, reliability, test development",
author = "Petushek, {Erich J.} and Cokely, {Edward T.} and Paul Ward and Durocher, {John J.} and Wallace, {Sean J.} and Myer, {Gregory D.}",
year = "2015",
month = "7",
day = "1",
doi = "10.1177/0363546515580791",
language = "English",
volume = "43",
pages = "1640--1647",
journal = "American Journal of Sports Medicine",
issn = "0363-5465",
publisher = "SAGE Publications Inc.",
number = "7",

}

Petushek, EJ, Cokely, ET, Ward, P, Durocher, JJ, Wallace, SJ & Myer, GD 2015, 'Injury Risk Estimation Expertise: Assessing the ACL Injury Risk Estimation Quiz', American Journal of Sports Medicine, vol. 43, no. 7, pp. 1640-1647. https://doi.org/10.1177/0363546515580791

Injury Risk Estimation Expertise : Assessing the ACL Injury Risk Estimation Quiz. / Petushek, Erich J.; Cokely, Edward T.; Ward, Paul; Durocher, John J.; Wallace, Sean J.; Myer, Gregory D.

In: American Journal of Sports Medicine, Vol. 43, No. 7, 01.07.2015, p. 1640-1647.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Injury Risk Estimation Expertise

T2 - American Journal of Sports Medicine

AU - Petushek, Erich J.

AU - Cokely, Edward T.

AU - Ward, Paul

AU - Durocher, John J.

AU - Wallace, Sean J.

AU - Myer, Gregory D.

PY - 2015/7/1

Y1 - 2015/7/1

N2 - Background:Available methods for screening anterior cruciate ligament (ACL) injury risk are effective but limited in application as they generally rely on expensive and time-consuming biomechanical movement analysis. A potentially efficient alternative to biomechanical screening is skilled movement analysis via visual inspection (ie, having experts estimate injury risk factors based on observations of athletes’ movements).Purpose:To develop a brief, valid psychometric assessment of ACL injury risk factor estimation skill: the ACL Injury Risk Estimation Quiz (ACL-IQ).Study Design:Cohort study (diagnosis); Level of evidence, 3.Methods:A total of 660 individuals participated in various stages of the study, including athletes, physicians, physical therapists, athletic trainers, exercise science researchers/students, and members of the general public in the United States. The ACL-IQ was fully computerized and made available online (www.ACL-IQ.org). Item sampling/reduction, reliability analysis, cross-validation, and convergent/discriminant validity analyses were conducted to refine the efficiency and validity of the assessment.Results:Psychometric optimization techniques identified a short (mean time, 2 min 24 s), robust, 5-item assessment with high reliability (test-retest: r = 0.90) and high test sensitivity (average difference of exercise science professionals vs general population: Cohen d = 2). Exercise science professionals and individuals from the general population scored 74% and 53% correct, respectively. Convergent and discriminant validity was demonstrated. Scores on the ACL-IQ were best predicted by ACL knowledge and specific judgment strategies (ie, cue use) and were largely unrelated to domain-general spatial/decision-making ability, personality, or other demographic variables. Overall, 23% of the total sample (40% of exercise science professionals; 6% of general population) performed better than or equal to the ACL nomogram.Conclusion:This study presents the results of a systematic approach to assess individual differences in ACL injury risk factor estimation skill; the assessment approach is efficient (ie, it can be completed in <3 min) and psychometrically robust. The results provide evidence that some individuals have the ability to visually estimate ACL injury risk factors more accurately than other instrument-based ACL risk estimation methods (ie, ACL nomogram). The ACL-IQ provides the foundation for assessing the efficacy of observational ACL injury risk factor assessment (ie, does simple skilled visual inspection reduce ACL injuries?). The ACL-IQ can also be used to increase our understanding of the perceptual-cognitive mechanisms underlying injury risk assessment expertise, which can be leveraged to accelerate learning and improve performance.

AB - Background:Available methods for screening anterior cruciate ligament (ACL) injury risk are effective but limited in application as they generally rely on expensive and time-consuming biomechanical movement analysis. A potentially efficient alternative to biomechanical screening is skilled movement analysis via visual inspection (ie, having experts estimate injury risk factors based on observations of athletes’ movements).Purpose:To develop a brief, valid psychometric assessment of ACL injury risk factor estimation skill: the ACL Injury Risk Estimation Quiz (ACL-IQ).Study Design:Cohort study (diagnosis); Level of evidence, 3.Methods:A total of 660 individuals participated in various stages of the study, including athletes, physicians, physical therapists, athletic trainers, exercise science researchers/students, and members of the general public in the United States. The ACL-IQ was fully computerized and made available online (www.ACL-IQ.org). Item sampling/reduction, reliability analysis, cross-validation, and convergent/discriminant validity analyses were conducted to refine the efficiency and validity of the assessment.Results:Psychometric optimization techniques identified a short (mean time, 2 min 24 s), robust, 5-item assessment with high reliability (test-retest: r = 0.90) and high test sensitivity (average difference of exercise science professionals vs general population: Cohen d = 2). Exercise science professionals and individuals from the general population scored 74% and 53% correct, respectively. Convergent and discriminant validity was demonstrated. Scores on the ACL-IQ were best predicted by ACL knowledge and specific judgment strategies (ie, cue use) and were largely unrelated to domain-general spatial/decision-making ability, personality, or other demographic variables. Overall, 23% of the total sample (40% of exercise science professionals; 6% of general population) performed better than or equal to the ACL nomogram.Conclusion:This study presents the results of a systematic approach to assess individual differences in ACL injury risk factor estimation skill; the assessment approach is efficient (ie, it can be completed in <3 min) and psychometrically robust. The results provide evidence that some individuals have the ability to visually estimate ACL injury risk factors more accurately than other instrument-based ACL risk estimation methods (ie, ACL nomogram). The ACL-IQ provides the foundation for assessing the efficacy of observational ACL injury risk factor assessment (ie, does simple skilled visual inspection reduce ACL injuries?). The ACL-IQ can also be used to increase our understanding of the perceptual-cognitive mechanisms underlying injury risk assessment expertise, which can be leveraged to accelerate learning and improve performance.

KW - ACL injury risk

KW - injury prediction

KW - movement analysis

KW - expertise

KW - psychometric

KW - validation

KW - reliability

KW - test development

UR - https://us.sagepub.com/en-us/nam/the-american-journal-of-sports-medicine/journal201672#description

U2 - 10.1177/0363546515580791

DO - 10.1177/0363546515580791

M3 - Article

VL - 43

SP - 1640

EP - 1647

JO - American Journal of Sports Medicine

JF - American Journal of Sports Medicine

SN - 0363-5465

IS - 7

ER -