Scribd
Upload
36 views2 pages

U-L Method for Item Analysis

The document outlines procedures for item analysis using the U-L method which involves scoring tests, separating scores into top and bottom groups, tallying responses, converting tallies to frequencies and proportions, computing difficulty and discrimination indices, and using the indices to determine if items should be retained, revised, or rejected.

Uploaded by

yo bin
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
36 views2 pages

U-L Method for Item Analysis

The document outlines procedures for item analysis using the U-L method which involves scoring tests, separating scores into top and bottom groups, tallying responses, converting tallies to frequencies and proportions, computing difficulty and discrimination indices, and using the indices to determine if items should be retained, revised, or rejected.

Uploaded by

yo bin
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

Item Analysis Procedures

(Using the U-L Method)

1. Score the test and arrange the scores from highest to lowest.
2. Separate the top 27% and the bottom 27%.
3. Prepare a tally sheet to enter the number of cases from each group who got the item right
for each of the items.
4. Convert the tallies to Frequencies and then to Proportions

Frequency: is the number of candidates in the Upper and Lower Achiever groups who
answer the item correctly.

Proportion: is frequency divided by the number of HA or LA

5. Compute the difficulty level (Df) of each item by getting the average of the proportions
of the two groups

Proportion HA + Proportion LA
Df =
2
6. Compute the discrimination index (Ds) of each item by taking the difference between
the proportions of the two groups.

Ds = (Proportion HA) – (Proportion LA)

Ds index is the measure of extent to which a test item discriminating or differentiates


trainees who do not know well on the overall test. Negative value means that the item has
low discrimination

7. Decide whether to retain/accept, revise, reject/discard an item based on the two-pronged


values of the Df and Ds.

IMO Model Course 3.12 Assessment, Examination and Certification of Seafarers

Page 1 of 2
INTERPRETATION of RESULT:

Range of Difficulty Index (Df)

0 - 20 Very Difficult
0.21 – 0.40 Difficult
0.41 – 0.60 Moderately Difficult
0.61 – 0.80 Easy
0.81 – 1.00 Very Easy

Range of Discrimination Index (Ds)

-1.0 – -.60 Questionable


-0.59 – -0.22 Not Discriminating
-0.21 – 0.20 Moderately Discriminating
0.21 – 0.60 Discriminating
0.61 – 1.00 Very Discriminating

Interpretation of the difficulty and discrimination indices

Difficulty index Discrimination index Action / Remarks


Not discriminating Reject
Very Difficult/ Moderately discriminating Revise
Difficult Discriminating /
Retain
Very discriminating
Not discriminating Revise
Moderately discriminating Revise
Moderate Difficult
Discriminating /
Retain
Very discriminating
Not discriminating Reject
Easy Moderately discriminating Revise
Very Easy Discriminating /
Revise
Very discriminating

IMO Model Course 3.12 Assessment, Examination and Certification of Seafarers

Page 2 of 2

You might also like