A Study on the Role of Item Response Theory in the Development of Computerized Adaptive Testing
Keywords:
computerized adaptive testing (cat), item response theory (IRT), systematic literature review, assessment efficiency, machine learningAbstract
The paradigm shift in educational assessment from conventional testing to Computerized Adaptive Testing (CAT) based on Item Response Theory (IRT) offers significant measurement efficiency, but presents complexities related to validity and integration of new technologies. This study aims to analyze trends, methodologies, and the role of IRT in the development and validation of CAT through the Systematic Literature Review (SLR) approach. Following the PRISMA protocol, data were collected from the Scopus database with a publication year range of 2020–2025 and analyzed using an NVivo-assisted thematic approach to 12 selected articles. The results show that there has been an evolution of research focus from just the efficiency of reducing question items to the integration of multimodal data, such as the incorporation of machine learning and physiological signals for ability estimation. Although CAT has been shown to drastically improve test efficiency without reducing reliability, challenges related to test safety (item preknowledge) and item bias (Differential Item Functioning) are still major obstacles. It is concluded that the future of CAT development depends on a balance between algorithm efficiency, multidimensional data integration, and system resilience to validity threats to create fair and transparent assessments.
Published
Issue
Section
Copyright (c) 2025 Muhammad Gibran Alif Prasetya, Arif Widiyatmoko, Dyah Rini Indriyanti, Dwi Ratna Dewi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International. that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
