lecture #5 - the beast of bias

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/36

flashcard set

Earn XP

Description and Tags

chapter #6

37 Terms

1
New cards

raw score distribution

  • shape individual observations in your sample


2
New cards

sampling distribution

  • distribution of a statisti

  • across many hypothetical repeated samples


3
New cards

homoscedasticity/homogeneity of variance

  • samples should come from populations with the same variance

  • can affect:

    • parameters

    • nhst


4
New cards

assessing homogeniety of variance

  • graphs

  • levene’s tests

    • if variances in different groups are the same


5
New cards

solutions

  • robust tested

    • welch’s t

    • welch’s f

  • adjusted se


6
New cards

how to read levene’s test

  • evaluates null that group variances are equal

  • small p → evidence that the variances differ

  • does not tell you whether the difference is important

  • large samples = trivial variance differences statistically signifiant


7
New cards

reading the homogeneity figure: left panel

  • each group has similar vertical spread

  • group means differ

  • variability is comparable


8
New cards

reading the homogeneity figure: right panel

  • vertical spread changes across groups

  • later groups = more variable than earlier groups


9
New cards

independence

  • errors in model shouldn’t be related to each other


10
New cards

boxplots and outlier flags

  • uses iqr range

  • values more than 1.5 x iqr below q1 or above q3 are often flagged as outliers


11
New cards

spotting normality (4)

  • test observed data

    • central limit theorem

    • graphical displays

    • value of skews/kurtosis

    • kolmogrov-smirnov test


12
New cards

central limit theorem

  • if n> 30, the sampling distribution is normal anyway


13
New cards

graphical displays

  • p-p plot (or q-q plot)

  • histogram


14
New cards

values of skew/kurtosis

  • 0 in a normal distribution

  • convert to z (by dividing value by SE)


15
New cards

q-q plot

  • asks whether observed quantiles follow the pattern expected under normality

  • systematic curvature is more informative tiny random deviations


16
New cards

kolmogrov-smirnov test


  • test if data differs from a normal distribution

  • don’t use:

    • in large samples → small differences will be significant

    • in small samples → large differences won’t be significant


17
New cards

how to read q-q plot scales: approx. normal

  • points lie close to the reference line without systematic curvature


18
New cards

how to read q-q plot scales: positive skew

  • points show a characteristic bend bc the upper tail extends farther than a normal distribution would predict


19
New cards

how to read q-q plot scales: negative skew

  • curvature appears in the opposite direction


20
New cards

how to read q-q plot scales: heavy tails

  • both ends depart from the reference line

  • more extreme observations than expected under normality


21
New cards

how to read q-q plot scales: light tails

  • ends bend in the opposite pattern

  • fewer extreme observations than expected


22
New cards

residual plots: assumptions met

  • residuals form an unstructured cloud around zero

  • roughly constant vertical spread


23
New cards

residual plots: heteroscedasticity

  • spread increases or decreases with fitted values

  • fan/funnel pattern


24
New cards

residual plots: non-linearity

  • avg resiudal follows a curve

  • straight line model systematically misses part of the relationship


25
New cards

residual plots: both problems

  • curved mean pattern plus changing dspread


26
New cards

reducing bias

  • analyse with robust methods

  • trim the data

  • windsorizing

  • transform the data


27
New cards

analyse with robust methods

  • bootstrapping

  • methods based on medians and trims


28
New cards

trim the data

  • delete a certain amount of scores from the extremes


29
New cards

windsorizing

  • substitute outliers with the highest value that isn’t an outlier


30
New cards

transform the data

  • applying mathematical function to the scores


31
New cards

log transformation (log (xᵢ)

  • reduce positive skew

  • compresses large values much more than small values


32
New cards

square root transformation (√xᵢ)

  • also reduces positive skew

  • stabilizing variance

  • compresses high values but more gently


33
New cards

reciprocal transformation (1/xᵢ)

  • divi 1 by each sore

  • reduce impact of large scores

  • reverse the scores

  • compresses large values

  • can reverse ordering depending on the exact formula used


34
New cards

should you transform?

  • identify the actual problem

  • whether chosen model is robust to that problem at your sample size

  • if transforming, choose method that makes sense

  • check model again after transforming

  • report what you did


35
New cards

trimming the data

  • removes a fixed percentage of observations from each tail before calculating a statistic

  • trimmed mean is less sensitive to extreme obs


36
New cards

sd

  • spread of individual scores

  • if n goes se will go down → if ss gets larger, se will decrease


37
New cards

se of the mean

  • s/ √n