Tests and Errors

Test developer

qualified and credible experts with training in the field of research and statistics

Test User

test buyers and administrations who are trained in the use of psychological assessment tools

Test taker

individuals who undergo assessment

Society at large

elected representatives who help with legislation regarding test development, test administration and test interpretation

Other parties

organizations, companies, and governmental agencies who sponsor the development of tests, companies who offer test scoring or interpretation services

Standardization

Same instructions, procedures, time limit, and scoring rules

real differences

Without standardization: we cannot determine the __ ____ between individuals or simply differences in testing conditions

Halo Effect

a cognitive bias/mental shortcut” the tendency to make conclusions about someone based on a general impression (general → specific)

General Standoutishness

A cognitive bias/mental shortcut: the tendency to make a conclusion about someone based on one characteristic that “stand out” (specific → general)

Cross-cultural differences

Misinterpreting and/or nonverbal cues because of differences in culture

Lack of interviewer’s skills

Interviewer lacks training and skills needed to conduct a proper interview

Interviewee’s dishonesty

Discomfort in sharing personal details, hesitation to disclose information; outright lies

Interviewee’s memory

Memory issues that prevent individuals from disclosing accurate information

Test situation

issues with the environment in which tests are administered; impacts test performance

Language of the Test

Unfamiliarity with the language, wording, or cultural implications of a test; will lead to inaccurate scores

Characteristics of the test administrator

Test administrator’s qualities affecting test-taker behaviors and performance

Characteristics of the Test Taker

Test taker’s mood, health, perceptions, or attitudes about the test

Expectations of the test administrator

Favoritism; expectations to succeed or fail

Rosenthal effect

high expectations lead to improved performance

Lack of Training

Test administrator not knowing procedures; unstandardized testing

Test Score Theory

The observed test score that we see from tests results is a sum of a true test score and error