Standard

Modeling multiple item context effects with generalized linear mixed models : Disentangling item position effects, block position effects, and domain order effects. / Rose, Norman; Nagy, Gabriel; Nagengast, Benjamin; Frey, Andreas; Becker, Michael.

In: Frontiers in Psychology, Vol. 10, 248, 25.02.2019, p. 1-13.

Research output: Contribution to journalJournal articleResearchpeer-review

Harvard

APA

Vancouver

Author

Rose, Norman ; Nagy, Gabriel ; Nagengast, Benjamin ; Frey, Andreas ; Becker, Michael. / Modeling multiple item context effects with generalized linear mixed models : Disentangling item position effects, block position effects, and domain order effects. In: Frontiers in Psychology. 2019 ; Vol. 10. pp. 1-13.

BibTeX

@article{33c520c6253a43baad32490c1e18ac92,
title = "Modeling multiple item context effects with generalized linear mixed models: Disentangling item position effects, block position effects, and domain order effects",
abstract = "Item context effects refer to the impact of features of a test on an examinee's item responses. These effects cannot be explained by the abilities measured by the test. Investigations typically focus on only a single type of item context effects, such as item position effects, or mode effects, thereby ignoring the fact that different item context effects might operate simultaneously. In this study, two different types of context effects were modeled simultaneously drawing on data from an item calibration study of a multidimensional computerized test (N = 1,632) assessing student competencies in mathematics, science, and reading. We present a generalized linear mixed model (GLMM) parameterization of the multidimensional Rasch model including item position effects (distinguishing between within-block position effects and block position effects), domain order effects, and the interactions between them. Results show that both types of context effects played a role, and that the moderating effect of domain orders was very strong. The findings have direct consequences for planning and applying mixed domain assessment designs.",
keywords = "domain order effects, generalized linear mixed models, item context effects, item position effects, multidimensional item response theory",
author = "Norman Rose and Gabriel Nagy and Benjamin Nagengast and Andreas Frey and Michael Becker",
year = "2019",
month = feb,
day = "25",
doi = "10.3389/fpsyg.2019.00248",
language = "English",
volume = "10",
pages = "1--13",
journal = "Frontiers in Psychology",
issn = "1664-1078",
publisher = "Frontiers Media S.A.",

}

RIS

TY - JOUR

T1 - Modeling multiple item context effects with generalized linear mixed models

T2 - Disentangling item position effects, block position effects, and domain order effects

AU - Rose, Norman

AU - Nagy, Gabriel

AU - Nagengast, Benjamin

AU - Frey, Andreas

AU - Becker, Michael

PY - 2019/2/25

Y1 - 2019/2/25

N2 - Item context effects refer to the impact of features of a test on an examinee's item responses. These effects cannot be explained by the abilities measured by the test. Investigations typically focus on only a single type of item context effects, such as item position effects, or mode effects, thereby ignoring the fact that different item context effects might operate simultaneously. In this study, two different types of context effects were modeled simultaneously drawing on data from an item calibration study of a multidimensional computerized test (N = 1,632) assessing student competencies in mathematics, science, and reading. We present a generalized linear mixed model (GLMM) parameterization of the multidimensional Rasch model including item position effects (distinguishing between within-block position effects and block position effects), domain order effects, and the interactions between them. Results show that both types of context effects played a role, and that the moderating effect of domain orders was very strong. The findings have direct consequences for planning and applying mixed domain assessment designs.

AB - Item context effects refer to the impact of features of a test on an examinee's item responses. These effects cannot be explained by the abilities measured by the test. Investigations typically focus on only a single type of item context effects, such as item position effects, or mode effects, thereby ignoring the fact that different item context effects might operate simultaneously. In this study, two different types of context effects were modeled simultaneously drawing on data from an item calibration study of a multidimensional computerized test (N = 1,632) assessing student competencies in mathematics, science, and reading. We present a generalized linear mixed model (GLMM) parameterization of the multidimensional Rasch model including item position effects (distinguishing between within-block position effects and block position effects), domain order effects, and the interactions between them. Results show that both types of context effects played a role, and that the moderating effect of domain orders was very strong. The findings have direct consequences for planning and applying mixed domain assessment designs.

KW - domain order effects

KW - generalized linear mixed models

KW - item context effects

KW - item position effects

KW - multidimensional item response theory

U2 - 10.3389/fpsyg.2019.00248

DO - 10.3389/fpsyg.2019.00248

M3 - Journal article

VL - 10

SP - 1

EP - 13

JO - Frontiers in Psychology

JF - Frontiers in Psychology

SN - 1664-1078

M1 - 248

ER -

ID: 964883