Browsing CEMO Centre for Educational Measurement by Author "Frey, Andreas"

Now showing items 1-19 of 19

  • A multilevel study of position effects in PISA achievement tests: Student- and school-level predictors in the German tracked school system 
    Nagy, Gabriel; Nagengast, Benjamin; Frey, Andreas; Becker, Michael; Rose, Norman (Journal article / Tidsskriftartikkel / AcceptedVersion; Peer reviewed, 2018)
    Position effects (PE) cause decreasing probabilities of correct item responses towards the end of a test. We analysed PEs in science, mathematics and reading tests administered in the German extension to the PISA 2006 study ...
  • An optimized Bayesian hierarchical two-parameter logistic model for small-sample item calibration 
    König, Christoph; Spoden, Christian; Frey, Andreas (Journal article / Tidsskriftartikkel / AcceptedVersion; Peer reviewed, 2019)
    Accurate item calibration in models of item response theory (IRT) requires rather large samples. For instance, [Formula: see text] respondents are typically recommended for the two-parameter logistic (2PL) model. Hence, ...
  • Convergent Evidence for the Validity of a Performance-Based ICT Skills Test 
    Engelhardt, Lena; Naumann, Johannes; Goldhammer, Frank; Frey, Andreas; Wenzel, Franziska; Hartig, Katja; Horz, Holger (Journal article / Tidsskriftartikkel / AcceptedVersion; Peer reviewed, 2019)
    The goal of this study was to investigate sources of evidence of convergent validity supporting the construct interpretation of scores on a simulation-based information and communication technology (ICT) skills test. The ...
  • Development and Evaluation of a Framework for the Performance-Based Testing of ICT Skills 
    Engelhardt, Lena; Naumann, Johannes; Goldhammer, Frank; Frey, Andreas; Horz, Holger; Hartig, Katja; Wenzel, S. Franziska C. (Journal article / Tidsskriftartikkel / PublishedVersion; Peer reviewed, 2021)
    This paper addresses the development of performance-based assessment items for ICT skills, skills in dealing with information and communication technologies, a construct which is rather broadly and only operationally ...
  • Effects of COVID-19-Related School Closures on Student Achievement-A Systematic Review 
    Hammerstein, Svenja; König, Christoph; Dreisörner, Thomas; Frey, Andreas (Journal article / Tidsskriftartikkel / PublishedVersion; Peer reviewed, 2021)
    The COVID-19 pandemic led to numerous governments deciding to close schools for several weeks in spring 2020. Empirical evidence on the impact of COVID-19-related school closures on academic achievement is only just emerging. ...
  • Evaluating Different Equating Setups in the Continuous Item Pool Calibration for Computerized Adaptive Testing 
    Born, Sebastian; Fink, Aron; Spoden, Christian; Frey, Andreas (Journal article / Tidsskriftartikkel / PublishedVersion; Peer reviewed, 2019)
    The increasing digitalization in the field of psychological and educational testing opens up new opportunities to innovate assessments in many respects (e.g., new item formats, flexible test assembly, efficient data ...
  • Experimental validation strategies for heterogeneous computer-based assessment items 
    Engelhardt, Lena; Goldhammer, Frank; Naumann, Justus D; Frey, Andreas (Journal article / Tidsskriftartikkel / SubmittedVersion, 2017)
    Computer-based assessments open up new possibilities to measure constructs in authentic settings. They are especially promising to measure 21st century skills, as for instance information and communication technologies ...
  • Heuristic constraint management methods in multidimensional adaptive testing 
    Born, Sebastian; Frey, Andreas (Journal article / Tidsskriftartikkel / SubmittedVersion, 2017)
    Although multidimensional adaptive testing (MAT) has been proven to be highly advantageous with regard to measurement efficiency when several highly correlated dimensions are measured, there are few operational assessments ...
  • Implementing three CATs within eighteen months 
    Spoden, Christian; Frey, Andreas; Bernhardt, Raphael (Journal article / Tidsskriftartikkel / PublishedVersion; Peer reviewed, 2018)
    The development of a computerized adaptive test is considered a labor-intensive and time-consuming endeavor. This paper illustrates that this does not have to be the case—by demonstrating the steps taken, the decisions ...
  • Kompetenzorientierte elektronische Hochschulklausuren im Studium des Lehramts 
    Spoden, Christian; Frey, Andreas; Fink, Aron; Naumann, Patrick (Chapter / Bokkapittel / PublishedVersion; Peer reviewed, 2020)
    Es wird ein Konzept für kompetenzorientierte E-Klausuren vorgestellt, das gekennzeichnet ist durch (1) die Operationalisierung kompetenzorientierter Lernziele, (2) eine kriteriumsorientierte Testwertinterpretation, (3) die ...
  • Kompetenzorientierte individualisierte Hochschulklausuren und deren prüfungsrechtliche Einordnung 
    Frey, Andreas; Spoden, Christian; Fink, Aron; Born, Sebastian (Journal article / Tidsskriftartikkel / PublishedVersion; Peer reviewed, 2020)
    Written exams in higher education are highly relevant for students, because success in their studies and access to the labour market depend on the exam results. But typical written exams do not do justice to this high ...
  • Kriteriumsorientiertes adaptives Testen mit der KAT-HS-App 
    Fink, Aron; Spoden, Christian; Frey, Andreas; Naumann, Patrick (Journal article / Tidsskriftartikkel / PublishedVersion; Peer reviewed, 2021)
    Zusammenfassung. In dieser Softwareinformation werden die Möglichkeiten zur Konstruktion, Administration und Auswertung kriteriumsorientierter, computerisierter adaptiver und nicht-adaptiver Tests mit der R-basierten ...
  • Methodological challenges of international student assessment 
    Frey, Andreas; Hartig, Johannes (Chapter / Bokkapittel / AcceptedVersion; Peer reviewed, 2020)
    International large-scale assessments are very successful. One key factor of this success is their rigorous methodological and psychometric basis. Because education systems worldwide are subject to rapid changes, international ...
  • Modeling multiple item context effects with generalized linear mixed models 
    Rose, Norman; Nagy, Gabriel; Nagengast, Benjamin; Frey, Andreas; Becker, Michael (Journal article / Tidsskriftartikkel / PublishedVersion; Peer reviewed, 2019)
    Item context effects refer to the impact of features of a test on an examinee's item responses. These effects cannot be explained by the abilities measured by the test. Investigations typically focus on only a single type ...
  • Person misfit, test anxiety, and test-taking motivation in a large-scale mathematics proficiency test for self-evaluation 
    Spoden, Christian; Fleischer, Jens; Frey, Andreas (Journal article / Tidsskriftartikkel / AcceptedVersion; Peer reviewed, 2020)
    Personal characteristics such as test anxiety or test-taking motivation might weaken the validity of results that are obtained in proficiency tests for school (self-) evaluation. Person fit statistics make it possible to ...
  • Response time-based treatment of omitted responses in computer-based testing 
    Frey, Andreas; Spoden, Christian; Goldhammer, Frank; Wenzel, Franziska (Journal article / Tidsskriftartikkel / AcceptedVersion; Peer reviewed, 2018)
    A new response time-based method for coding omitted item responses in computer-based testing is introduced and illustrated with empirical data. The new method is derived from the theory of missing data problems of Rubin ...
  • Scaling properties of pain intensity ratings in paediatric populations using the Faces Pain Scale-revised: Secondary analyses of published data based on the item response theory 
    Avian, Alexander; Messerer, Brigitte; Frey, Andreas; Meissner, Winfried; Weinberg, Annelie; Ravekes, William; Berghold, Andrea (Journal article / Tidsskriftartikkel / SubmittedVersion, 2018)
    Background The Faces Pain Scale-revised (FPS-r) has been developed as an interval scale. For other pain measurement instruments, several studies found evidence for and against an interval level of measurement. Object ...
  • The benefits of fixed item parameter calibration for parameter accuracy in small sample situations in large-scale assessments 
    König, Christoph; Khorramdel, Lale; Yamamoto, Kentaro; Frey, Andreas (Journal article / Tidsskriftartikkel / AcceptedVersion; Peer reviewed, 2020)
    Large‐scale assessments such as the Programme for International Student Assessment (PISA) have field trials where new survey features are tested for utility in the main survey. Because of resource constraints, there is a ...
  • Umgang mit Itempositionseffekten bei der Entwicklung computerisierter adaptiver Tests 
    Frey, Andreas; Bernhardt, Raphael; Born, Sebastian (Journal article / Tidsskriftartikkel / SubmittedVersion, 2017)
    In computerized adaptive testing (CAT), item parameter estimates are assumed to be known and valid for all the positions that items can be presented on in the test. This assumption is problematic since item parameter ...