Chapter 4: Reliability - Psych assessment

Assumption #1

Psychological Traits & States Exist

Assumption #1 - Info

Traits Vs. States

• traits are somewhat stable overtime

• How do we measure this?

  • Longitudinal study, correlation)

• Same for different ages?

Just think p 132 - Is the strength of a particular psychological trait the same across all situations or environments

• tend to be present across all situations

  • May be context dependent

• States fluctuate over time

  • Often context dependable

• Constructs have both states and traits

Assumption #2

Psychological Traits & States can be quantified and measured

Assumption #2 - Info

• consider domain behaviors and attitudes

  • Consider romantic satisfaction

  • at a minimum

    • Which romantic relationships or populations '

    • possible behaviors

    • possible attitudes or ways of thinking

Assumption #3

Test-related behavior predicts non-test related behavior

Assumption #3 - Info

Consider romantic satisfaction

• likelihood of breakup, marriage, complaining, parenting, alternative monitoring, how well couple solves problems etc.

Assumption #4

Tests and other measurement techniques have strengths and weaknesses

Assumption #4 - Info

• Single tests are rarely sufficient

  • common criticisms from novices

    • SAT example: doesn’t matter if it doesn’t measure persistency or grit

  • Assessors should

    • consider test utility for a specific purpose with a specific population

Assumption #5

Various sources of error are part of the assessment process

Assumption #5 - Info

Classical Test Theory

• OS = TS+E (observed score=true score+error)

• Sources of error

  • test user

  • test taker

  • situation

  • chance

• Error is normative

Assumption #6

Testing and measurement can be conducted in a fair and unbiased manner

Assumption #6 - info

• test developers strive to be fair

• test notes are more political than psychometric

• Consider appropriateness for specific groups

Assumption #7

Testing and Assessment benefit society

Assumption #7 - Info

Just think p136…

• How else might a world without tests or other assessment procedures be different from the world today?

Stratified Sampling

Sampling that includes different subgroups, or strata, from the population

Random Sampling

Every member of the population has an equal opportunity of being included in a sample

Stratified-Random Sampling

Combines random sampling and stratified samples