Inquizitive Chapter 5 (my version)

A measure's ability to remain consistent is referred to as _____. But this concept can be broken down in nuanced ways. For example, _____ refers to how uniform results will be after repeated use of a measure. In addition, _____ refers to how stable results from a measure will be when the measure is used by multiple administrators. Finally, a question with _____ will generate similar answers regardless of how it is worded.

-reliability

-test-retest reliability

-interrater reliability

-internal reliability

Match each example to the correct type of measure.

Observational

Physiological

Self-report

-Records behaviors or traces of behaviors

-Records biological information from a living thing

-Records participants' own views of themselves

In measurement, _____ refers to a measure's ability to accurately represent the variable the researcher is investigating. But this concept is made up of many different facets. _____ is the extent to which a given measure appears to be measuring the variable in question. _____ evaluates how well a measure taps into all aspects of particular variable. _____ represents how well a measure relates to actual behavior.

-validity

-face validity

-content validity

-criterion validity

Farah is sending an e-mail survey to people from many different areas throughout the United States. She asks participants about their zip codes to keep track of the areas they are from.

Which of the following descriptors apply to the variable in Farah's study?

Applicable:

self-report

categorical

operational

Non-Applicable:

ordinal

quantitative

observational

conceptual

Label each question with the correct validity.

Criterion validity:

Does the measure correlate with relevant behaviors?

face validity:

Is the measure a plausible operationalization of the conceptual variable?

Convergent validity:

Is the measure strongly correlated with theoretically similar constructs?

Content validity:

Does the measure include all aspects of the conceptual variable?

Discriminant validity:

Is the measure not as strongly correlated with theoretically different constructs?

Label each question with the correct type of reliability.

interrater reliability:

Do all of the raters who are observing behaviors agree about the number of behaviors they see?

test-retest reliability:

Are the same people responding to a measure in a consistent manner across multiple time points?

internal reliability:

Are people responding in a consistent manner to all of the items on a 10-item scale?

Dr. Nolan gives his new anxiety measure to a group of colleagues who are anxiety experts. They agree that the questions on the measure appear to assess anxiety symptoms. This suggests that Dr. Nolan's measure has ? validity. He also establishes ? by demonstrating that his new measure does not strongly correlate to a measure of depression. Dr. Nolan then gives his measure to two groups, one consisting of people who have been diagnosed with anxiety and one consisting of people who have been determined by a psychologist not to have anxiety. Here he is employing ? to test ? validity

- face

- discriminant validity

- the known groups paradigm

- criterion

Teresa is creating a new measure on hyperactivity in children. She has read some research stating that understanding energy level and the ability to focus is key to understanding hyperactivity. However, Teresa's measure of hyperactivity only contains items about diet and exercise.

With what type of validity may Teresa's measure have a problem?

face validity

Hewlett is attempting to measure spatial intelligence. He creates a specialized task to measure spatial ability and recognition and uses it along with other measures. His data show that the results from his new task are highly correlated with measures of other constructs, like memory and language intelligence.

With what type of validity may Hewlett's measure have a problem?

discriminant validity

Rebecca is conducting a study on stress in which she is measuring the levels of cortisol (a hormone that denotes a stress response in the body) in participants after they complete a difficult task. In this case, a reading of zero would mean no cortisol.

Which of the following descriptors apply to the variable "cortisol" in Rebecca's study?

Applicable:

ratio

quantitative

physiological

operational

not applicable:

self-report

ordinal

categorical

Label each example with the type of validity with which it may have an issue.

Discriminant validity:

Xia is creating a measure of conscientiousness. She wants to ensure that her scale doesn't instead assess concern for social desirability.

Face validity:

Santiago is a leading researcher on video game addiction. He finds that the items on a new survey on game addiction do not seem to assess game addiction in a reasonable way.

convergent validity:

Karin is concerned because her new scale on extroversion does not correlate with a well-established extroversion scale.

Criterion validity:

Some colleges no longer require SAT or ACT scores. A major reason they have done this is because there is a low correlation between these scores and students' first-year GPA.

Content validity:

An online IQ test consists of the primary task of choosing the correct definitions for a series of words. Josiane, an authority on IQ, is concerned that it doesn't test other things that are part of IQ, such as problem solving or visual-spatial ability.

Identify the true and false statements about the relationship between reliability and validity.

true:

Establishing reliability in a measure is not sufficient for validity.

A measure can be very reliable but not very valid.

false:

A measure that is reliable will always be valid.

The validity of a measure is the same as its reliability.

Omar has developed an intervention to improve the relationship between parents and their preschool-aged children. To evaluate the effectiveness of his intervention, Omar video-records parents interacting with their children and has two research assistants score the level of warmth in each interaction. Omar then compares the two sets of scores to examine ? reliability. He finds a high positive correlation of ? between the two raters' scores. If the observers were rating a categorical variable, Omar could have also looked at the ? statistic.

- interrater

- r = .87

- kappa

Identify the true and false statements about this table representing a five-item measure.

true:

This measure has low internal reliability.

One item in this scale is skewing the AIC.

false:

This measure has a Cronbach's alpha above .80.

This measure has low interrater reliability.

The measurement of internal reliability is called, which is a computation of the number of items on a scale and the 80 A value of .or higher is considered to have acceptable internal reliability for self-report measures.

-Cronbach's alpha

-average inter-item corrlation

-.80

Lorenzo is studying aggression in children. He administers a questionnaire to some children that asks them about their feelings of aggression. Lorenzo then runs a statistical test to determine how consistent the responses are to different items on the questionnaire. This test is examining ? reliability, and the statistic that represents this type of reliability is ?

internal

Cronbach's alpha