• English
    • Norsk
  • English 
    • English
    • Norsk
  • Administration
View Item 
  •   Home
  • Øvrige samlinger
  • Høstingsarkiver
  • CRIStin høstingsarkiv
  • View Item
  •   Home
  • Øvrige samlinger
  • Høstingsarkiver
  • CRIStin høstingsarkiv
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Experimental validation strategies for heterogeneous computer-based assessment items

Engelhardt, Lena; Goldhammer, Frank; Naumann, Justus D; Frey, Andreas
Journal article; SubmittedVersion
View/Open
AS5567022923407361509739577003_content_1.pdf (342.7Kb)
Year
2017
Permanent link
http://urn.nb.no/URN:NBN:no-67603

CRIStin
1532230

Metadata
Show metadata
Appears in the following Collection
  • CEMO Centre for Educational Measurement [152]
  • CRIStin høstingsarkiv [15984]
Original version
Computers in Human Behavior. 2017, 76, 683-692, DOI: http://dx.doi.org/10.1016/j.chb.2017.02.020
Abstract
Computer-based assessments open up new possibilities to measure constructs in authentic settings. They are especially promising to measure 21st century skills, as for instance information and communication technologies (ICT) skills. Items tapping such constructs may be diverse regarding design principles and content and thus form a heterogeneous item set. Existing validation approaches, as the construct representation approach by Embretson (1983), however, require homogenous item sets in the sense that a particular task characteristic can be applied to all items. To apply this validation rational also for heterogeneous item sets, two experimental approaches are proposed based on the idea to create variants of items by systematically manipulating task characteristics. The change-approach investigates whether the manipulation affects construct-related demands and the eliminate-approach whether the test score represents the targeted skill dimension. Both approaches were applied within an empirical study (N = 983) using heterogeneous items from an ICT skills test. The results show how changes of ICT-specific task characteristics influenced item difficulty without changing the represented construct. Additionally, eliminating the intended skill dimension led to easier items and changed the construct partly. Overall, the suggested experimental approaches provide a useful validation tool for 21st century skills assessed by heterogeneous items.
 
Responsible for this website 
University of Oslo Library


Contact Us 
duo-hjelp@ub.uio.no


Privacy policy
 

 

For students / employeesSubmit master thesisAccess to restricted material

Browse

All of DUOCommunities & CollectionsBy Issue DateAuthorsTitlesThis CollectionBy Issue DateAuthorsTitles

For library staff

Login
RSS Feeds
 
Responsible for this website 
University of Oslo Library


Contact Us 
duo-hjelp@ub.uio.no


Privacy policy