Professional Education 6

(Assessment in Learning 1)

Test Development Process

The Test Development Process involves several phases, each of which plays a critical
role in creating effective and reliable assessments. Let's discuss each phase
comprehensively and provide examples for a better understanding.

1. Planning Phase:

The Planning Phase is the foundational step in test development, where the goals and
parameters of the assessment are established.

Key Elements:

a. Objectives and Importance:

Clearly define the purpose of the test. Is it for formative assessment, summative
assessment, or diagnostic purposes?

The importance of defining objectives is to ensure that the assessment aligns with the
educational goals.

Example: If a school is designing a mid-term math assessment, the objective might be to

evaluate students' understanding of specific math concepts covered in the first half of
the semester.

b. Target Audience:

Identify the group of individuals who will take the test.

Understanding the target audience helps tailor the test to their needs and
characteristics.

Example: For a standardized college admission test, the target audience might be high
school graduates seeking admission to undergraduate programs.

c. Test Blueprint:

Create a blueprint that outlines the test's structure and content coverage.

The blueprint ensures that the test includes questions that represent the entire
curriculum or subject matter.

To ensure the preparation of a good test, a test blueprint is commonly set up in a two-
way table of specification (TOS) that basically spells out WHAT will be tested and
HOW it will be tested to obtain the information needed. What covers two aspects:
content area ( i.e. subject matter) being covered and the target learning outcomes( i.e.
competencies). These two aspects should sample the intended curriculum standards for
the subject or course. how it specifies the test format, i.e. the type of assessment
question or task to be used and the item distribution to attain an effective and balanced
sampling of skills to be tested.

Example: For a history test, the blueprint might specify the number of questions on
different historical eras or regions.

d. Test Specifications:

Define the detailed specifications for the test, including question formats and time
constraints.

Test specifications guide item development by setting the boundaries for question types
and content areas.

Example: Test specifications for a standardized English language proficiency test might
specify the use of multiple-choice and writing formats and allocate specific times for
each section.

Sample TOS/Test Blueprint

Table 1. A simple One -way TOS for a Language test

Objectives/Skills Number of Test Items

1. Identify the statements with errors 10
in verb use.
2. Supply the correct verb forms in a 10
paragraph
3. Prepare a news article reporting a 20
past school activity
Total Items / Points 40
 Table 2. A simple Two -way TOS for a Language test

Content Outcome/Skill Test Format Number of

Items/Points
A. Verb usage 1. Identify Objective 10
the (Multiple-
statements choice)
with
errors in
verb use
2. Supply Objective 10
the (Multiple-
Correct choice)
verb
forms in a
Paragraph
B. Communicative 3. Prepare a Performance 20
Writing news
article
reporting
a past
school
activity
Total Points 40

2. Item Construction Phase:

The Item Construction Phase focuses on creating test questions that align with the test
blueprint and specifications.

Key Elements:

a. Item Formats:

Choose the most appropriate item formats, such as multiple-choice, true-false, essay, or
performance-based questions.

Selecting the right format ensures that questions effectively assess the intended
knowledge or skills.
Example: In a biology exam, multiple-choice questions might be used to test factual
knowledge, while essay questions assess critical thinking skills.

b. Item Writing Guidelines:

Develop questions that are clear, unbiased, and aligned with the test's objectives.

Well-constructed items improve the validity and reliability of the assessment.

Example: When writing a multiple-choice question, avoid double negatives and use
clear, concise language.

c. Item Difficulty and Discrimination:

Create items with appropriate difficulty levels, ensuring they can differentiate between
high and low performers.

This is crucial for generating valuable test data.

Example: In a physics test, an item assessing understanding of Newton's laws should be

of moderate difficulty and discriminate well between students who have mastered the
topic and those who haven't.

d. Cognitive Levels:

Align items with the desired cognitive levels, such as Bloom's Taxonomy.

Assessing the correct cognitive level ensures that the test measures the depth of
knowledge or skills intended.

Example: In a chemistry test, create items that not only ask students to recall facts
(lower level) but also to analyze chemical reactions (higher level).

3. Review Phase:

The Review Phase involves validation and quality assurance processes to ensure the
reliability and validity of the test.
Key Elements:

a. Peer Review:

Have other educators or peers review the test for clarity, fairness, and relevance.

Peer review helps identify and rectify potential issues in the assessment.

Example: Multiple teachers review a history test to ensure that the questions are free
from bias and match the curriculum.

b. Expert Review:

Subject matter experts evaluate the test items to ensure they align with the content and
cognitive level.

Expert review guarantees that the test accurately assesses the knowledge or skills it is
designed to measure.

Example: In a medical licensing exam, practicing doctors review the questions to ensure
they align with current medical practices.

c. Pilot Testing:

Administer a small-scale test to a representative group to identify any issues.

Pilot testing helps identify and address any problems before a full-scale
implementation.

Example: A school conducts a pilot test of a new standardized math assessment with a
group of students to identify any confusing or ambiguous questions.

d. Item Analysis:

Analyze the performance of each question in the real test administration.

Item analysis helps identify items that are too easy, too hard, or do not discriminate
well between test-takers.

Example: After conducting a standardized science test, item analysis reveals that one
question was answered correctly by almost all students, indicating it may need to be
revised.
The Test Development Process is a systematic approach that ensures that assessments
are valid, reliable, and serve their intended purpose. Each phase plays a crucial role in
achieving these goals and requires careful planning, thoughtful item construction, and
thorough review processes.

Assessment Activity

To test your understanding of the Test Development Process, complete the following
activity:

Scenario: You are tasked with developing a final science test for Grade 9. The test
should assess their understanding of biology concepts, including cell structure and
functions.

Activity:

Planning Phase: Outline the objectives, and target audience, and create a Simple two-
way test blueprint/ test specifications for this biology test.

Item Construction Phase: Create ten multiple-choice questions and one short essay
question that align with your test blueprint and specifications.

Review Phase: Imagine that you are conducting a peer review. Identify and suggest
improvements for one of the multiple-choice questions you created in the Item
Construction Phase.

- Reflect on the entire test development process and summarize the importance of
each phase in ensuring the quality of the assessment.

Congratulations! You've completed this self-learning module on the Test Development

Process. Remember that effective assessments play a crucial role in education and
beyond, and following a systematic approach is essential to their success.