Reason for accepting or rejecting instruments and tools based on Psychometric Properties (PA)

What does it mean if the reliability coefficient value is .90 above?

Excellent

What does it mean if the reliability coefficient value is .80 - .89?

Good

What does it mean if the reliability coefficient value is .70 - .79?

Adequate

What does it mean if the reliability coefficient value is .70 below?

Limited use of applicability

What is the range of the reliability coefficient value when in the clinical setting?

.90 - .95

What does it mean if the validity coefficient value is .35 above?

Very beneficial

What does it mean if the validity coefficient value is .21 - .35?

Likely to be useful

What does it mean if the validity coefficient value is .11 - .20?

Depends on circumstances

What does it mean if the validity coefficient value is .11 below?

Unlikely to be useful

If level of difficulty is very difficult, what is the item difficulty range?

0.0 - 0.19

If level of difficulty is difficult, what is the item difficulty range?

0.20 - 0.39

If level of difficulty is average/moderately difficult, what is the item difficulty range?

0.40 - 0.60

If level of difficulty is easy, what is the item difficulty range?

0.61 - 0.79

If level of difficulty is very easy, what is the item difficulty range?

0.80 - 1.0

If the range in item discrimination is .40 above, what is the verbal description?

Very good item

If the range in item discrimination is .30 - .39, what is the verbal description?

Good item

If the range in item discrimination is .20 - .29, what is the verbal description?

Fair Item

If the range in item discrimination is .09 - .19, what is the verbal description?

Poor item

In Inter-item Reliability index, if the internal consistency is excellent, what is its Cronbach’s Alpha?

a ≥ 0.9

In Inter-item Reliability index, if the internal consistency is good, what is its Cronbach’s Alpha?

0.9 > a ≥ 0.8

In Inter-item Reliability index, if the internal consistency is acceptable, what is its Cronbach’s Alpha?

0.8 > a ≥ 0.7

In Inter-item Reliability index, if the internal consistency is questionable, what is its Cronbach’s Alpha?

0.7 > a ≥ 0.6

In Inter-item Reliability index, if the internal consistency is poor, what is its Cronbach’s Alpha?

0.6 > a ≥ 0.5

In Interrater Reliability Coefficient what is the range when it is excellent according to Cicchetti and Sparrow?

0.75 - 1.0

In Interrater Reliability Coefficient what is the range when it is good according to Cicchetti and Sparrow?

0.6 - 0.75

In Interrater Reliability Coefficient what is the range when it is fair according to Cicchetti and Sparrow?

0.4 - 0.6

In Interrater Reliability Coefficient what is the range when it is poor according to Cicchetti and Sparrow?

0.0- 0.4

In Interrater Reliability Coefficient what is the range when it is excellent according to Fleiss?

0.75 - 1.0

In Interrater Reliability Coefficient what is the range when it is fair to good according to Fleiss?

0.4 - 0.75

In Interrater Reliability Coefficient what is the range when it is poor according to Fleiss?

0.0 - 0.4

In Interrater Reliability Coefficient what is the range when it is substantial according to Landis and Koch?

0.6 - 0.8

In Interrater Reliability Coefficient what is the range when it is moderate according to Landis and Koch?

0.4 - 0.6

In Interrater Reliability Coefficient what is the range when it is fair according to Landis and Koch?

0.2 - 0.4

In Interrater Reliability Coefficient what is the range when it is slight according to Landis and Koch?

0.0 - 0.2

In Interrater Reliability Coefficient what is the range when it is poor according to Landis and Koch?

Below 0.0

In Interrater Reliability Coefficient what is the range when it is excellent according to Regier et. al?

0.8 - 1.0

In Interrater Reliability Coefficient what is the range when it is very good according to Regier et. al?

0.6 - 0.8

In Interrater Reliability Coefficient what is the range when it is good according to Regier et. al?

0.4 - 0.6

In Interrater Reliability Coefficient what is the range when it is questionable according to Regier et. al?

0.2 - 0.4

In Interrater Reliability Coefficient what is the range when it is unacceptable according to Regier et. al?

0.0 - 0.2

p-value: p > 0.10

Weak or no evidence

p-value: 0.05 < p ≤ 0.10

Moderate evidence

p-value: 0.01 < p ≤ 0.05

Strong evidence

p-value: p ≤ 0.01

Very strong evidence

P-Value ≤ ∞

Reject null hypothesis

P-Value ≥ ∞

Accept null hypothesis