Week 4 (Test Bias vs Test Fairness)

How does culture influence health-related behaviours?

It shapes beliefs, attitudes, symptom expression, and help-seeking behaviours.

What role does culture play in treatment or intervention strategies?

It affects acceptance and compliance.

Culture _________________ test performance

inevitably influences

How is culture linked to test development?

Culture is embedded in how psychological tests are conceptualized and created.

What is a common strategy used in creating "culture-free" tests?

Using non-verbal items.

Why are "culture-free" tests still culturally biased?

They often reflect Western assumptions.

Are test-taking skills universal?

No — they are culturally learned.

Concern with test bias has arisen out of ____________________?

A broad social concern with equitable treatment of special groups in this society

Why is test bias a controversial issue?

Because we value equality, yet psychological tests measure differences, suggesting unequal abilities.

What is observed in average psychological test scores across ethnic groups?

Ethnic groups, such as African Americans, often score lower on average than white individuals.

African Americans typically score lower on IQ tests compared to whites (U.S.) by

About 15 points on average

What is the central debate regarding group differences in test scores?

Whether differences are due to environmental (e.g. SES) or biological (e.g. genetic) factors.

Why are intelligence tests criticized?

They are misnamed and were not originally intended to measure intelligence.

Early IQ tests reflected the biases of?

their creators, favoring individuals with certain cultural and educational backgrounds.

What do critics say intelligence tests actually reflect?

Cultural background more than innate ability.

Why are individuals from different cultural backgrounds seen as disadvantaged in testing?

Because they are penalized by culturally biased content and norms.

What do critics argue IQ scores for Black Americans and low SES groups reflect?

Characteristics of the test rather than the test-taker.

Test bias and test fairness are often used interchangeably but ___________

Are not the same.

What is test bias?

A statistical concept assessed through validation studies, not opinions.

Test bias refers to?

the differential validity of test scores for groups (e.g., age, education, culture, race, sex).

When does test bias exist?

When a test’s interpretation or implications differ for a specific subgroup compared to others.

Test bias is _______________ that differentially influences scores for identified groups.

systematic error in the measurement process

What is differential validity?

When test scores have different meanings for different groups of people.

What might a low score on a receptive vocabulary test mean for non-English-speaking children?

Poor English-speaking ability, not necessarily a language deficit in their native language.

What does a low score on the same test mean for English-speaking children?

A true deficit in receptive language.

What does the vocabulary test example illustrate?

That the same score can reflect different issues depending on the child's language background — showing differential validity.

What is a common criticism regarding test content and cultural bias?

Tests often favor white, middle-class cultural knowledge, disadvantaging others.

Why might some test items be unfair to minority groups?

They require knowledge not equally accessible due to cultural or educational differences.

What happens when responses are culturally appropriate but don’t match test norms?

They may be marked wrong due to cultural mismatch with test developers.

How can wording in test items contribute to bias?

May reduce comprehension for minority groups.

Does removing biased items (as judged by experts) reduce score gaps between ethnic groups?

No — score gaps often persist, suggesting deeper issues.

What is Differential Item Functioning (DIF) analysis?

A method to identify test items that function differently across demographic groups with similar ability.

How does DIF analysis work?

Comparing item responses among groups with equivalent total scores; biased items are removed and tests rescored.

What has research shown about the role of biased items in score differences?

Limited evidence supports that item bias alone explains score differences — but content still warrants investigation.

What does criterion validity assess?

How well a test predicts relevant outcomes (e.g., SAT predicting college GPA).

What defines an unbiased test in criterion validity?

It predicts outcomes equally well for all subgroups.

What statistical method is used to assess predictive validity?

Regression analysis using the equation: Y = bX + a.

What does it mean if two groups have parallel regression lines but different intercepts?

There is intercept bias — one group is over- or under-predicted.

What does it mean if regression slopes differ between groups?

There is slope bias (differential validity)— the test predicts well for one group but poorly for another.

What can the use of a combined regression line lead to?

Systematic overprediction or underprediction for a subgroup.

When does construct validity bias occur?

When a test measures different constructs for different groups or measures the same construct with unequal accuracy.

What indicates no bias in construct validity?

Same factor structure and similar rank order of item difficulty across groups (Items that are hardest/ easiest for one group are also so for other).

What is test fairness concerned with?

Social values and philosophies of test use, rather than just statistics.

What are the three main philosophies of test fairness?

Unqualified Individualism, Qualified Individualism, and Quotas.

What is Unqualified Individualism?

Selection based only on test scores; best-performing individuals are chosen. Demographics may be used if they improve predictive accuracy.

What is a criticism of Unqualified Individualism?

It may unintentionally overemphasize demographic factors, distorting fairness.

What is Qualified Individualism?

Selection based strictly on test scores, without using demographic information.

What is a key issue with Qualified Individualism?

It ignores demographic factors that might correct systemic disadvantages or prediction errors.

What are Quotas in test fairness?

Separate selection procedures used for different demographic groups to match population ratios.

What is a major criticism of using Quotas?

Selected individuals may not have the highest test scores overall.

Are any of the three test fairness approaches universally correct?

No — all have ethical criticisms and trade-offs; there's no definitive right or wrong.

Why involve minority group representatives in test development?

To ensure cultural relevance and fairness through co-design.

What is the purpose of sensitivity reviews by expert panels?

To identify and address potentially biased or unfair test items.

How can test items be monitored for fairness?

Through routine statistical analysis for group differences.

Why is rigorous training for test developers and scorers important?

To ensure all test-takers have an equal opportunity to demonstrate their abilities.

How can fairness be supported for individuals with disabilities or health needs?

By providing appropriate testing accommodations.