LA - The test construction process

Phase 1

Establishing the purpose

The administration usually does this

Usually a structuralist paradigm=most practical

Phase 2:

Planning

Coming up with the test specifications (TDS)

Who will be qualified and allowed to construct, administer, and check

proctor

invigilator (in british english)

Test specifications

Official statement about what the test should test and how it tests them
what are the different sections and how much percentage do they take up?

What kind of tests?

Test syllabus

external, can be shared

Phase 3

Item construction

Based on test specifications

Item Baking

a collection of test items

Phase 4

Administration

Coordination with specific agencies

Pilot testing

testing to see if there are any issues with the test and data
items must not be included in the final

Phase 5

Checking

Activity = dividing the work
who should check what

Phase 6

Analysis

Analysis and consultation with experts
Statistical tools

Phase 7

Reporting

Oral discussion

Submission of final report

Versions of final report

Stem

the question, command, or statement. Gives direction in which option to pick

Choices/alternatives/Options

the part of the item from which to choose from.

Key

The correct option

Distractors

The incorrect options

Paraphrase tests

Could be a test of grammatical structure

True or false tests

One of the most widely used for reading comprehension

Scoring is straightforward and quick

Can be constructed easily and quickly = allows for more tasks

Formative Assessment

Checking for understanding is also known as

Projects and Performances

Show how student understand the lesson, in a differentiated way

Item Difficulty and Item Discriminability

Two useful indices for analyzing test results

Item Difficulty

sed for assessing how difficult an item is

Item Difficulty

d = no of correct responses / total no of test takers

Item discriminability

Used for assessing how good an item is in showing good performers vs poor performers.

Item discriminability

D= No of correct (high group) / No of correct (high group + low group)