Hypothesis Testing

What is the first step in the p value approach of hypothesis testing?

state the null and alternative hypotheses

What is the second step in the p value approach of hypothesis testing?

Select the decision criteria or significance level, denoted by alpha

what is the third step in the p value approach of hypothesis testing?

Determine the one tailed or two tailed p value

What is the fourth step in the p value approach to hypothesis testing?

Comparing the p value with the significance level

What is the final step of the p value approach in hypothesis testing?

if the p value is less than or equal to the significance level, reject the null hypothesis, otherwise, do not reject

What is the significance level?

The probability of rejecting a true null hypothesis; type I error

What does the significance level denote?

The point at which the difference observed is not due to chance, but rather due to the fact that the null hypothesis is not true

What does a lower significance level mean?

Fewer false discoveries

Which of the following would have the smallest significance level value?

1 in 1000 studies showing false positives

3 multiple choice options

T/F: the significance level is a set value that must be followed every time

FALSE; the significance value is arbitrary, by convention it is recognized as 0.05

What is the p value?

The probability that the result obtained was due to chance if the null hypothesis is true

if the p value is ___ than the significance level, we reject the null hypothesis

less than or equal

if the p value is ___ the significance level, we fail to reject the null hypothesis

more than

The p value dost NOT measure the size of an effect or its ____, only how incompatible the data is with the assumption of ___

importance, no effect

What p value has the highest level of evidence?

p value less than or equal to 0.001

What p value has a very strong level of evidence?

P value less than or equal to 0.01

What p value has a strong level of evidence?

0.01 < p value < 0.05

What p value has some level of evidence?

0.05 < p value < 0.1

What p value has weak to no levels of evidence?

p value greater than 0.1

How can a p value of 0.05 be interpreted?

There is a 5% chance of seeing the desired outcome even if the treatment does nothing

How can you find the p value from a t statistic?

You can use a table or use excel, but as pharmacists, we don't really care because we have people that do that for us

What is a benefit to having larger sample sizes?

They can produce smaller p values, even if the actual difference between the groups is minimal

What is the first step in the critical value approach to hypothesis testing?

state the null and alternative hypotheses

What is the second step in the critical value approach to hypothesis testing?

select the decisions criteria or significance value

What is the third step in the critical value approach to hypothesis testing?

Determining the critical value due to teh direction of the hypothesis

What is the fourth step in the critical value approach to hypothesis testing?

obtain a sample of the target population

What is the fifth step in the critical value approach to hypothesis testing?

Determining the test statistic that corresponds to the mean of the sample

What is the final step in the critical value approach to hypothesis testing?

comparing the calculated test statistic with the critical value to make the decision to reject or fail to reject the null hypothesis

What is the critical value?

A threshold on a statistical distribution that determines the boundary between failing to reject and rejecting the null hypothesis

How can you find the degrees of freedom (DF)?

subtracting 1 from the sample size

What is a test statistic?

A measure of how closely the observed data matches the distribution expected under the null hypothesis, with more extreme values indicating stronger evidence against the null hypothesis

If the confidence interval is -0.2 to 1.3, what is the outcome of the hypothesis test?

Fail to reject the null hypothesis because the confidence interval includes 0

If the confidence interval is -1.3 to -0.6, what is the outcome of the hypothesis test?

Reject the null hypothesis because the confidence interval does not include 0

If the confidence interval is 0.5 to 2.8, what is the outcome of the hypothesis test?

Reject the null hypothesis because the confidence interval does not include 0