Outcome 3. Concept Inventory Validation (2024/2025)
At this stage, the primary goal is to ensure the accuracy and effectiveness of the CI tools.
This requires the application of standard validation and reliability methods to assess the items that represent the target content. Validity, one of the principal considerations, assesses the extent to which both evidence and theory support the interpretation of item scores for the intended purpose of the CI. It also determines the degree of confidence with which we can rely on the test results within specific circumstances [44]. Reliability is another essential component of the CI tool to ensure that the assessment consistently measures students’ understanding of the targeted concepts. It determines whether the CI is functioning effectively. A properly functioning instrument generates consistent scores, with related items assessing the same construct, resulting in reliable and reproducible outcomes [45]. To achieve the accuracy and reproducibility of CI instruments, we will employ appropriate validation and reliability methods systematically, encompassing all relevant content and representing the target construct we aim to assess [46].
The validation process for CI instruments will integrate several psychometric properties, including content validity, construct validity, criterion validity, internal consistency,
and reliability tests [45, 47]. Furthermore, item statistics, such as item difficulty and item discrimination, are integral to this process. These steps collectively contribute to a comprehensive and best-practice approach for CI development.