Sample size and statistical conclusions from tests of fit to the Rasch model according to the Rasch Unidimensional Measurement Model (RUMM) program in health outcome measurement

Forskningsoutput: TidskriftsbidragArtikelPeer review

105 Citeringar (Scopus)

Sammanfattning

Sample size is a major factor in statistical null hypothesis testing, which is the basis for many approaches to testing Rasch model fit. Few sample size recommendations for testing fit to the Rasch model concern the Rasch Unidimensional Measurement Models (RUMM) software, which features chi-square and ANOVA/F-ratio based fit statistics, including Bonferroni and algebraic sample size adjustments. This paper explores the occurrence of Type I errors with RUMM fit statistics, and the effects of algebraic sample size adjustments. Data with simulated Rasch model fitting 25-item dichotomous scales and sample sizes ranging from N=50 to N=2500 were analysed with and without algebraically adjusted sample sizes. Results suggest the occurrence of Type I errors with N≥500, and that Bonferroni correction as well as downward algebraic sample size adjustment are useful to avoid such errors, whereas upward adjustment of smaller samples falsely signal misfit. Our observations suggest that sample sizes around N=250 to N=500 may provide a good balance for the statistical interpretation of RUMM fit statistics studied here with respect to Type I errors and under the assumption of Rasch model fit within the examined framed of reference (i.e., about 25 item parameters well targeted to the sample).

OriginalspråkEngelska
Sidor (från-till)416-431
Antal sidor15
TidskriftJournal of Applied Measurement
Volym17
Nummer4
StatusPublicerad - 2016

Nationell ämneskategori

  • Hälsovetenskap (303)

Fingeravtryck

Fördjupa i forskningsämnen för ”Sample size and statistical conclusions from tests of fit to the Rasch model according to the Rasch Unidimensional Measurement Model (RUMM) program in health outcome measurement”. Tillsammans bildar de ett unikt fingeravtryck.

Citera det här