Research Question Quiz 1

When do you choose ICC

Quantitative Data

When do you use Kappa

is chosen when you need to assess the agreement between two or more raters for categorical variables.

What is intra-rater relatbility?

The stability of data recorded by one rater across two or more trials

What is Inter-rater relability?

The degree of agreement or consistency in ratings given by different raters assessing the same phenomenon or set of data.

Variation between two or more raters measuring the same subjects

How do we solve inter-rater reliability?

• All raters evaluate at the same time

• videotaped the subjects’ performance

• Use one rater in a study

  • Limited generalizability

How to solve Intra-rater relibability?

• Blind evalutor

  • Score remains unknown

• Standardization

  • Develop grading criteria

What is content validity?

Estabilshes that the multiple items that makeup a questionnaire, inventory or scale adequately sample to universe of content that defines the construct being measured

What is criterion-related validity?

Establishes the coorespondence between a target test and a reference or gold standar of the same contstruct

What are the two types of criterion-related validity?

• Concurrent Validity

• Predictive Validity

What is Concurrent Validity?

The extent to which the target test correlates with a reference standard taken at relatively the same time

What is Predictive Validity?

The extent to which the target test can predict a future reference standard