CampusLearn
← EDU 221 Educational Measurement and Evaluation

Principles of Test Construction and Item Analysis

Notes

The Test Construction Process Effective classroom tests must possess high validity and reliability. Test validity refers to whether a test accurately measures the specific learning outcomes it claims to assess, while reliability refers to the consistency and dependability of the test results across different administrations. The central instrument for securing content validity is the Table of Specifications, often referred to as a test blueprint. A test blueprint maps out curriculum content areas against target cognitive domains derived from Bloom's Revised Taxonomy, including remembering, understanding, applying, analyzing, evaluating, and creating. By determining the exact weighting of topics and cognitive levels before writing test items, educators ensure balanced curricular coverage and prevent over-concentration on low-level recall items. Item Analysis Procedures Item analysis is a statistical review of individual test items to evaluate their difficulty and discriminative power. The Item Difficulty Index, denoted as p, measures the proportion of test takers who answer an item correctly. The index ranges from 0.00 to 1.00, where items with difficulty indices between 0.30 and 0.70 are considered optimal for general achievement tests. The Item Discrimination Index, denoted as D, measures an item's capability to differentiate between high-achieving and low-achieving learners. Discrimination index ranges from negative 1.00 to positive 1.00. A value of 0.30 and above denotes good discrimination, while a negative index indicates serious flaws, such as ambiguous wording or incorrect marking keys that mislead top learners. Practical Example Madam Amina, a Chemistry teacher at Garissa High School, conducts item analysis on a multiple-choice mock test taken by eighty Form Four candidates. She ranks the test scripts from highest to lowest and isolates the upper twenty-seven percent (twenty-two students) and the lower twenty-seven percent (twenty-two students). On Question 12, dealing with the contact process in Industrial Chemistry, eighteen students in the upper group and six students in the lower group answer correctly. Madam Amina calculates the Item Difficulty by adding correct responses from both groups (twenty-four) and dividing by the total students in both groups (forty-four), obtaining a p-value of 0.55, which represents ideal item difficulty. She calculates the Item Discrimination by subtracting lower group correct responses from upper group correct responses (eighteen minus six equals twelve) and dividing by the size of one subgroup (twenty-two), yielding a discrimination index of positive 0.55. Because D is well above 0.30, Madam Amina retains this item for future Kenya Certificate of Secondary Education preparation banks.

Quiz

1. What does an Item Discrimination Index of -0.35 indicate about a test question?

2. What is the primary function of a Table of Specifications in educational testing?

3. If an item has an Item Difficulty Index of 0.95, how should a classroom teacher interpret this item?

Sign in to submit and securely grade your quiz.