• Frank Goldhammer
  • Ulf Kröhne
  • Yvonne Keßel
  • Martin Senkbeil
  • Jan Marten Ihme
Translated title of the contributionDiagnosing ICT literacy : Multiple-choice vs. simulation-based tasks
ICT literacy suggests a performance-based assessment by means of tasks presenting interactive (simulated) computer environments and requiring responses by means of mouse and/or keyboard. However, assessment procedures like self-ratings or paper-based performance measures are still commonly used. The present study compares the psychometric properties of simulation-based (SIM) tasks with parallel multiple-choice (MC) tasks that make use of screenshots of software applications. The MC tasks, developed for the National Educational Panel Study (NEPS), reflect the skill to select and retrieve digital information and to perform basic operations (access). In a random groups design, 405 grade 9 students completed the computer-based access items as MC tasks or as SIM tasks as well as the simulation-based Basic Computer Skills (BCS) test. Results show that the majority of MC tasks and SIM tasks differ in difficulty and loading. Consistent convergent validity is indicated by comparably high correlations of the two test forms with BCS.
Original languageGerman
Pages (from-to)10-21
Number of pages12
StatePublished - 2014

    Research areas

  • Educational assessment/measurements - ICT literacy, multiple-choice tasks, simulation-based tasks, measurement invariance, convergent validity

ID: 494883