• Gabriel Nagy
  • Oliver Lüdtke
  • Olaf Köller
  • Jörg-Henrik Heine
Translated title of the contributionIRT scaling of the tests in PISA longitudinal assessment 2012/2013 : Impact of test context effects on the growth estimate
This paper deals with the item response theory scaling of the tests in PISA longitudinal assessment 2012/2013. It presents analyses testing longitudinal measurement invariance of achievement tests in the domains of mathematics, science and reading comprehension. The analyses showed that conventional approaches of investigating longitudinal measurement invariance revealed no indication of meaningful violations of time-invariant item difficulties. On the other hand, taking into account complex booklet effects, extended analyses indicated the existence of test context effects due to the effect of item positioning. At both measurement points the PISA tests were affected by position effects; these effects being especially noteworthy and increasing over the time points in the group of nonacademic track schools. The findings of the presented study were used to derive corrections in order to counteract distortions of the results by the selective sample dropout as well as the increase in position effects. The limitations of these corrections are discussed.
Original languageGerman
JournalZeitschrift für Erziehungswissenschaft
IssueSuppl. 2
Pages (from-to)229-258
Number of pages30
StatePublished - 06.2017

    Research areas

  • Methodological research and development - PISA study , Sample dropout, Item Response Theory, Text Context Effects

ID: 715807