Psychological Measurement and Test Development

These flashcards cover key concepts from the lecture on psychological measurement and test development, focusing on Classical Test Theory (CTT) and Item Response Theory (IRT), as well as other related topics in psychometrics.

CTT

Classical Test Theory, a framework for understanding measurement error and reliability in tests.

IRT

Item Response Theory, a framework that models the relationship between test items and the latent traits they measure, which can be applied in various testing scenarios.

Reliability

The consistency of scores on a test, often examined through standard error of measurement (SEM) in CTT and information functions in IRT.

Validity

The extent to which a test measures what it claims to measure, assessed in IRT by the variability of scores based on attribute variability.

Item Characteristic Curve (ICC)

A graphical representation in IRT indicating the probability of a correct response based on the individual's ability level.

Dichotomous Items

Items with two response options, often analyzed using the three-parameter logistic model (3PL) in IRT.

Polytomous Items

Items with multiple response options, analyzed using models like the graded response model (GRM) in IRT.

Test Equating

The process of linking scores from different test forms to ensure comparability across administrations.

Differential Item Functioning (DIF)

Analysis of whether different groups respond differently to specific test items, impacting fairness in testing.

Psychometrics

The field of study focused on the theory and technique of psychological measurement, including the development and evaluation of tests.

Cognitive Diagnosis Models (CDMs)

Models used in formative assessment to analyze test responses and provide feedback on students' learning progress.

Iterative Test Development Process

The cyclical nature of creating tests involving phases like concept analysis, item production, and evaluation.

Item Discrimination

A measure of how well an item differentiates between different levels of test-takers' abilities, indicated by the steepness of the ICC.

Item Facility

The ease with which test-takers can answer an item correctly, often illustrated by the point of inflection in an item's curve.

Guessing Parameter

The baseline probability of answering an item correctly based solely on guessing, reflected in an item response function.