Assessing Model Fit: Caveats and Recommendations for Confirmatory Factor Analysis and Exploratory Structural Equation Modeling

John L. Perry, Adam R. Nicholls, Peter Clough, Lee Crust

Research output: Contribution to journalArticle

49 Citations (Scopus)

Abstract

Despite the limitations of overgeneralizing cutoff values for confirmatory factor analysis (CFA; e.g., Marsh, Hau, & Wen, 2004), they are still often employed as golden rules for assessing factorial validity in sport and exercise psychology. The purpose of this study was to investigate the appropriateness of using the CFA approach with these cutoff values for typical multidimensional measures. Furthermore, we ought to examine how a model could be respecified to achieve acceptable fit and explored whether exploratory structural equation modeling (ESEM) provides a more appropriate assessment of model fit. Six multidimensional measures commonly used in sport and exercise psychology research were examined using CFA and ESEM. Despite demonstrating good validity in previous research, all eight failed to meet the cutoff values proposed by Hu and Bentler. ESEM improved model fit in all measures. In conclusion, we suggest that model misfit in this study demonstrates the problem with interpreting cutoff values rigidly. Furthermore, we recommend ESEM as a preferred approach to examining model fit in multidimensional measures.
LanguageEnglish
Pages12-21
Number of pages10
JournalMeasurement in Physical Education and Exercise Science
Volume19
Issue number1
DOIs
Publication statusPublished - 13 Jan 2015
Externally publishedYes

Fingerprint

Statistical Factor Analysis
Wetlands
Research
Sports Psychology

Cite this

@article{98fbff36f2b945439e24f2ae76d6eeef,
title = "Assessing Model Fit: Caveats and Recommendations for Confirmatory Factor Analysis and Exploratory Structural Equation Modeling",
abstract = "Despite the limitations of overgeneralizing cutoff values for confirmatory factor analysis (CFA; e.g., Marsh, Hau, & Wen, 2004), they are still often employed as golden rules for assessing factorial validity in sport and exercise psychology. The purpose of this study was to investigate the appropriateness of using the CFA approach with these cutoff values for typical multidimensional measures. Furthermore, we ought to examine how a model could be respecified to achieve acceptable fit and explored whether exploratory structural equation modeling (ESEM) provides a more appropriate assessment of model fit. Six multidimensional measures commonly used in sport and exercise psychology research were examined using CFA and ESEM. Despite demonstrating good validity in previous research, all eight failed to meet the cutoff values proposed by Hu and Bentler. ESEM improved model fit in all measures. In conclusion, we suggest that model misfit in this study demonstrates the problem with interpreting cutoff values rigidly. Furthermore, we recommend ESEM as a preferred approach to examining model fit in multidimensional measures.",
keywords = "Psychometrics, Measurement, Cutoff values, Modification indices",
author = "Perry, {John L.} and Nicholls, {Adam R.} and Peter Clough and Lee Crust",
year = "2015",
month = "1",
day = "13",
doi = "10.1080/1091367X.2014.952370",
language = "English",
volume = "19",
pages = "12--21",
journal = "Measurement in Physical Education and Exercise Science",
issn = "1091-367X",
publisher = "Routledge",
number = "1",

}

Assessing Model Fit : Caveats and Recommendations for Confirmatory Factor Analysis and Exploratory Structural Equation Modeling. / Perry, John L.; Nicholls, Adam R.; Clough, Peter; Crust, Lee.

In: Measurement in Physical Education and Exercise Science, Vol. 19, No. 1, 13.01.2015, p. 12-21.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Assessing Model Fit

T2 - Measurement in Physical Education and Exercise Science

AU - Perry, John L.

AU - Nicholls, Adam R.

AU - Clough, Peter

AU - Crust, Lee

PY - 2015/1/13

Y1 - 2015/1/13

N2 - Despite the limitations of overgeneralizing cutoff values for confirmatory factor analysis (CFA; e.g., Marsh, Hau, & Wen, 2004), they are still often employed as golden rules for assessing factorial validity in sport and exercise psychology. The purpose of this study was to investigate the appropriateness of using the CFA approach with these cutoff values for typical multidimensional measures. Furthermore, we ought to examine how a model could be respecified to achieve acceptable fit and explored whether exploratory structural equation modeling (ESEM) provides a more appropriate assessment of model fit. Six multidimensional measures commonly used in sport and exercise psychology research were examined using CFA and ESEM. Despite demonstrating good validity in previous research, all eight failed to meet the cutoff values proposed by Hu and Bentler. ESEM improved model fit in all measures. In conclusion, we suggest that model misfit in this study demonstrates the problem with interpreting cutoff values rigidly. Furthermore, we recommend ESEM as a preferred approach to examining model fit in multidimensional measures.

AB - Despite the limitations of overgeneralizing cutoff values for confirmatory factor analysis (CFA; e.g., Marsh, Hau, & Wen, 2004), they are still often employed as golden rules for assessing factorial validity in sport and exercise psychology. The purpose of this study was to investigate the appropriateness of using the CFA approach with these cutoff values for typical multidimensional measures. Furthermore, we ought to examine how a model could be respecified to achieve acceptable fit and explored whether exploratory structural equation modeling (ESEM) provides a more appropriate assessment of model fit. Six multidimensional measures commonly used in sport and exercise psychology research were examined using CFA and ESEM. Despite demonstrating good validity in previous research, all eight failed to meet the cutoff values proposed by Hu and Bentler. ESEM improved model fit in all measures. In conclusion, we suggest that model misfit in this study demonstrates the problem with interpreting cutoff values rigidly. Furthermore, we recommend ESEM as a preferred approach to examining model fit in multidimensional measures.

KW - Psychometrics

KW - Measurement

KW - Cutoff values

KW - Modification indices

UR - http://www.tandfonline.com/toc/hmpe20/current

U2 - 10.1080/1091367X.2014.952370

DO - 10.1080/1091367X.2014.952370

M3 - Article

VL - 19

SP - 12

EP - 21

JO - Measurement in Physical Education and Exercise Science

JF - Measurement in Physical Education and Exercise Science

SN - 1091-367X

IS - 1

ER -