Hide metadata

dc.date.accessioned2018-10-04T14:32:12Z
dc.date.available2019-02-05T23:31:28Z
dc.date.created2017-12-27T17:57:34Z
dc.date.issued2017
dc.identifier.citationEngelhardt, Lena Goldhammer, Frank Naumann, Justus D Frey, Andreas . Experimental validation strategies for heterogeneous computer-based assessment items. Computers in Human Behavior. 2017, 76, 683-692
dc.identifier.urihttp://hdl.handle.net/10852/65068
dc.description.abstractComputer-based assessments open up new possibilities to measure constructs in authentic settings. They are especially promising to measure 21st century skills, as for instance information and communication technologies (ICT) skills. Items tapping such constructs may be diverse regarding design principles and content and thus form a heterogeneous item set. Existing validation approaches, as the construct representation approach by Embretson (1983), however, require homogenous item sets in the sense that a particular task characteristic can be applied to all items. To apply this validation rational also for heterogeneous item sets, two experimental approaches are proposed based on the idea to create variants of items by systematically manipulating task characteristics. The change-approach investigates whether the manipulation affects construct-related demands and the eliminate-approach whether the test score represents the targeted skill dimension. Both approaches were applied within an empirical study (N = 983) using heterogeneous items from an ICT skills test. The results show how changes of ICT-specific task characteristics influenced item difficulty without changing the represented construct. Additionally, eliminating the intended skill dimension led to easier items and changed the construct partly. Overall, the suggested experimental approaches provide a useful validation tool for 21st century skills assessed by heterogeneous items.en_US
dc.languageEN
dc.titleExperimental validation strategies for heterogeneous computer-based assessment itemsen_US
dc.typeJournal articleen_US
dc.creator.authorEngelhardt, Lena
dc.creator.authorGoldhammer, Frank
dc.creator.authorNaumann, Justus D
dc.creator.authorFrey, Andreas
cristin.unitcode185,18,7,0
cristin.unitnameCentre for Educational Measurement
cristin.ispublishedtrue
cristin.fulltextpreprint
cristin.qualitycode1
dc.identifier.cristin1532230
dc.identifier.bibliographiccitationinfo:ofi/fmt:kev:mtx:ctx&ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.jtitle=Computers in Human Behavior&rft.volume=76&rft.spage=683&rft.date=2017
dc.identifier.jtitleComputers in Human Behavior
dc.identifier.volume76
dc.identifier.startpage683
dc.identifier.endpage692
dc.identifier.doihttp://dx.doi.org/10.1016/j.chb.2017.02.020
dc.identifier.urnURN:NBN:no-67603
dc.type.documentTidsskriftartikkelen_US
dc.source.issn0747-5632
dc.identifier.fulltextFulltext https://www.duo.uio.no/bitstream/handle/10852/65068/1/AS5567022923407361509739577003_content_1.pdf
dc.type.versionSubmittedVersion


Files in this item

Appears in the following Collection

Hide metadata