Test Construction

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/64

encourage image

There's no tags or description

Looks like no tags are added yet.

65 Terms

1
New cards

The extent to which a test measures what it claims to measure.

Validity

2
New cards

The consistency or stability of test scores across time, forms, or raters.

Reliability

3
New cards

The degree to which a test measures the theoretical construct it is intended to assess.

Construct Validity

4
New cards

The extent to which a test represents all facets of the construct being measured.

Content Validity

5
New cards

The extent to which a test's scores are related to an external criterion.

Criterion-Related Validity

6
New cards

How well test scores predict future outcomes.

Predictive Validity

7
New cards

How well test scores correlate with other measures of the same construct administered at the same time.

Concurrent Validity

8
New cards

The consistency of scores when the same test is administered to the same individuals at two different points in time.

Test-Retest Reliability

9
New cards

The degree of agreement among different raters or evaluators.

Inter-Rater Reliability

10
New cards

The extent to which items within a test measure the same construct, often assessed using coefficients like Cronbach’s alpha.

Internal Consistency

11
New cards

The process of administering a test under consistent conditions and using established norms to interpret scores.

Standardization

12
New cards

Reference scores derived from a standardization sample, used for comparing individual test performance.

Norms

13
New cards

The original, untransformed score obtained directly from a test.

Raw Score

14
New cards

A transformed score that allows comparison across tests or populations, often using standard deviations and means.

Scaled Score

15
New cards

An estimate of the amount of error inherent in an individual’s test score.

Standard Error of Measurement (SEM)

16
New cards

The process of evaluating individual test items for their difficulty, discrimination, and overall contribution to test quality.

Item Analysis

17
New cards

The proportion of test-takers who answer a test item correctly; used to assess how easy or hard the item is.

Item Difficulty

18
New cards

The degree to which an item differentiates between high and low performers on the overall test.

Item Discrimination

19
New cards

When a test is too easy, leading many test-takers to achieve near-perfect scores, limiting the ability to distinguish among higher abilities.

Ceiling Effect

20
New cards

When a test is too difficult, causing many test-takers to score near the lowest possible score, limiting the ability to distinguish among lower abilities.

Floor Effect

21
New cards

The extent to which a test appears to measure what it is supposed to measure, based on superficial inspection.

Face Validity

22
New cards

A statistical method used to identify underlying dimensions or factors within a set of test items.

Factor Analysis

23
New cards

A common scaling method in survey research where respondents rate their level of agreement with statements.

Likert Scale

24
New cards

A theoretical concept or trait that a test aims to measure (e.g., intelligence, anxiety).

Construct

25
New cards

Systematic errors in test scores that unfairly favor one group over another.

Bias

26
New cards

When test items have different levels of difficulty for different groups, despite equal ability levels.

Differential Item Functioning (DIF)

27
New cards

A measure of variability that indicates the average difference between test scores and the mean score.

Standard Deviation (SD)

28
New cards

A score that indicates the percentage of scores in a norm group that fall below a given score.

Percentile Rank

29
New cards

A standardized score that represents the number of standard deviations a raw score is from the mean.

Z-Score

30
New cards

A standardized score with a mean of 50 and a standard deviation of 10.

T-Score

31
New cards

A measure of reliability obtained by correlating scores on two halves of a test.

Split-Half Reliability

32
New cards

A testing method where the difficulty of questions is adjusted based on the test-taker’s responses.

Adaptive Testing

33
New cards

Preliminary testing of a new test on a small sample to identify issues before full-scale implementation.

Pilot Testing

34
New cards

The ability of a test to correctly identify individuals who have a specific condition or trait.

Sensitivity

35
New cards

The ability of a test to correctly identify individuals who do not have a specific condition or trait.

Specificity

36
New cards

A model used to analyze test items based on their difficulty, discrimination, and guessing parameters.

Item Response Theory (IRT)

37
New cards

An unobservable characteristic or quality inferred from test performance.

Latent Trait

38
New cards

Occurs when a test reflects the values, norms, and knowledge of a particular culture, making it unfairly advantageous for individuals from that culture and disadvantageous for those from others.

Cultural Bias

39
New cards

When the construct being measured is defined or operationalized differently across groups, resulting in invalid comparisons.

Construct Bias

40
New cards

Arises when test items are more relevant or familiar to certain groups than others, leading to an uneven playing field.

Content Bias

41
New cards

Happens when the sample used to standardize the test does not accurately represent the broader population, leading to skewed norms.

Sampling Bias

42
New cards

A tendency of test-takers to respond in a particular way, regardless of their true feelings or abilities.

Response Bias

43
New cards

Answering in a manner perceived to be socially acceptable.

Social Desirability Bias

44
New cards

Tendency to agree with statements regardless of their content.

Acquiescence Bias

45
New cards

Preferring extreme options on scales (e.g., always selecting 'strongly agree' or 'strongly disagree').

Extreme Response Bias

46
New cards

Avoiding extreme options and choosing middle responses instead.

Central Tendency Bias

47
New cards

When test items or interpretations favor one gender over another, often stemming from stereotypes or unbalanced representation.

Gender Bias

48
New cards

Occurs when the language of the test is more accessible to certain groups, disadvantaging non-native speakers or those with limited vocabulary.

Language Bias

49
New cards

The risk that individuals may underperform on a test due to anxiety about confirming negative stereotypes about their social group.

Stereotype Threat

50
New cards

When raters or evaluators give undue weight to an initial piece of information (e.g., first impressions or early responses) when assessing performance.

Anchoring Bias

51
New cards

When the evaluator's positive impression of one characteristic influences their evaluation of other characteristics, leading to skewed judgments.

Halo Effect

52
New cards

The opposite of the halo effect, where a negative impression of one characteristic negatively influences evaluation of others.

Horn Effect

53
New cards

The tendency to favor information or interpretations that confirm pre-existing beliefs or hypotheses.

Confirmation Bias

54
New cards

Overweighting recent or easily recalled events or information when interpreting test responses or patterns.

Availability Bias

55
New cards

Occurs when a test predicts outcomes differently for different groups, even when scores are the same.

Differential Prediction Bias

56
New cards

Variations in test performance caused by differences in how the test is administered (e.g., paper vs. computer, group vs. individual).

Mode of Administration Bias

57
New cards

When the testing environment disproportionately impacts certain groups, such as noise levels, location, or other situational factors.

Ecological Bias

58
New cards

When a rater consistently scores individuals more favorably than warranted.

Leniency Bias

59
New cards

When a rater consistently scores individuals more harshly than warranted.

Severity Bias

60
New cards

Unconscious attitudes or stereotypes that influence judgments and decisions without the evaluator being aware of them.

Implicit Bias

61
New cards

When overlapping social categories (e.g., race, gender, socioeconomic status) lead to compounded disadvantages in testing.

Intersectionality Bias

62
New cards

Advantages given to individuals who are more familiar with test-taking strategies, regardless of their actual knowledge or ability.

Test-Wiseness Bias

63
New cards

When test content or interpretations are more appropriate for certain age groups, disadvantaging others (e.g., younger or older individuals).

Age Bias

64
New cards

Biases stemming from cognitive limitations, such as overgeneralization or faulty logic in interpreting test results.

Cognitive Bias

65
New cards

Errors that arise from the measurement tool itself, leading to systematic overestimation or underestimation of true scores.

Measurement Bias