Closed formula of test length required for adaptive testing with medium probability of solution

Abstract

Purpose

Based on the general formula, which depends on the length and difficulty of the test, the number of respondents and the number of ability levels, this study aims to provide a closed formula for the adaptive tests with medium difficulty (probability of solution is p = 1/2) to determine the accuracy of the parameters for each item and in the case of calibrated items, determine the required test length given number of respondents.

Design/methodology/approach

Empirical results have been obtained on computerized or multistage adaptive implementation. Simulation studies and classroom/experimental results show that adaptive tests can measure test subjects’ ability to the same quality over half the test length compared to linear versions. Due to the complexity of the problem, the authors discuss a closed mathematical formula: the relationship between the length of the tests, the difficulty of solving the items, the number of respondents and the levels of ability.

Findings

The authors present a closed formula that provides a lower bound for the minimum test length in the case of adaptive tests. The authors also present example calculations using the formula, based on the assessment framework of some student assessments to show the similarity between the theoretical calculations and the empirical results.

Originality/value

With this formula, we can form a connection between theoretical and simulation results.

Citation

T. Kárász, J., Széll, K. and Takács, S. (2023), "Closed formula of test length required for adaptive testing with medium probability of solution", Quality Assurance in Education, Vol. 31 No. 4, pp. 637-651. https://doi.org/10.1108/QAE-03-2023-0042