Final Exam Review Material

every CPG has

at least 1 systematic review

what are the characteristics to consider when review CPG results

less than 5 years old?

sponsoring organization producing an objective sumarry?

topic relevant?

info efficient to access?

depth of info apply to my needs?

full text available?

what are the 4 different kinds of reliability

internal consistency

test-retest reliability

intra-rater reliability

inter-rater reliability

internal consistency

items/survey related

test-retest reliability

about the reliability of the test itself

intra-rater reliability

one rater measuring multiple times

inter-rater reliability

many raters doing the same test on the same subject

what are the 3 types of validity

content

criterion

construct

what is the type of content validity we talked about

face validity

what are the 2 types of criterion validity we talked about

concurrent

predictive

what are the 3 types of construct validity

known groups

convergent

discriminant

what test is used for internal consistency

Cronbach alpha

a Cronbach alpha score close to 0 indicates

items do not correlate

low internal consistency

a Cronbach alpha score closer to 1 indicates

positive correlation

high internal consistency

continuous data includes

interval or ratio data

continuous data is tested for reliability using

ICC (intraclass correlation coefficient)

ordinal data is tested for reliability using

spearman’s rho

nominal data is tested for reliability using

Kappa

internal consistency is tested for reliability using

Cobach’s alpha score

content validity

includes all the characteristics that an outcome measure is trying to measure

(are they really measuring what I want it to measure)

what is used to establish content validity

Delphi method

face validity

informal

(hey it looks good to me!)

criterion validity

compares to another

either the gold standard or reference standard

concurrent validity

comparing at the same point in time (my test to the gold standard)

predictive validity

comparing to something measures in the future

(how good is my test as predicting that this is gonna happen)

known groups validity

doing one test on more than one group with known differences

(testing how much 3 year olds vs 83 year olds want to play)

convergent validity

like criterion but for abstract concepts

comparing 2 measures at the same time

discriminant validity

taking 2 measures that dont relate at all and assessing

(measuring curisoty vs resilience in people)

what is used to determine outcome measure validity

Spearman’s Rho

a spearman’s rho of 0 means

no association

a spearman’s rho if -1 or +1 means

perfect association

what correlation would you suspect for a convergent validity

positive

what correlation would you expect for discriminant validity

negative

known groups is the only group

without validity

floor effect

unable to differentiate the lowest scores

(the scale only goes down to a 0 but u have to rate lower bc bro is chopped)

ceiling effect

unable to differentiate the highest scores

(shawty is a 12 but the scale only goes up to a 10)

what indicates the presence of floor or ceiling effect

percentage of participants having a max or min score

single subject research

quantitative

small number of participants and following each intensively

A

measurement of baseline or treatment withdrawal

B

intervention

C,D, etc

comparison interventions

in visual analysis, what must the data present to be significant

2 consecutive data points above or below the 2 SD line

qualitative research is looking for

themes and patterns

what are the 3 common qualitative research designs

phenomenology

ethnography

grounded theory

phenomenology

lived experiences

ethnography

culture based on direct observation

grounded theory

develop a theory to explain the phenomena of interest

member checking

a tool to enhance trustworthiness

data is returned to the participants to check for accuracy and resonance