Quiz 2

Probability sampling

unbiased

convenience sampling

biased

Systematic sampling

unbiased

purposive sampling

biased

snowball sampling

biased

stratified random sampling

unbiased

An (blank) is the entire group of people that a researcher is interested in

population

while an (blank) is the smaller subset that entire group that researchers study

Sample

An (blank) is conducted when a researcher investigates the entire group of people they are interested in

Census

If a study's sample is not generalizable to the rest of the population, we would say that the study has (blank) validity that is (blank)

1st blank(external)

2nd blank(poor)

These are the results of a BuzzFeed poll about superstitions with 29,000 participants. To whom can we likely generalize the results of this poll?

The 29,000 participants of the Buzzfeed poll

When a study uses (blank), each members of a population has an equal chance of being selected.

random sampling

(blank) occurs when researchers randomly sample subsets of the population and then use all individuals within the subsets

Cluster sampling

(blank) is often used to elect participants to represent, in an unbiased way, subsets of the population that are not larger enough to be accurately measured.

oversampling

All three of these techniques are (blank) sampling techniques

representative

Heejin wants to study the coping strategies used by partners of patients with breast cancer. She recruits participants by posting flyers about her study in the waiting rooms of several cancer treatment centers. Since she does not have enough participants, she then asks her participants to tell other partners of breast cancer patients about her study.

Which of the following sampling methods does Heejin use in her study?

Method(s) Used

Purposive sampling

Snowball sampling

Heejin wants to study the coping strategies used by partners of patients with breast cancer. She recruits participants by posting flyers about her study in the waiting rooms of several cancer treatment centers. Since she does not have enough participants, she then asks her participants to tell other partners of breast cancer patients about her study.

Which of the following sampling methods does Heejin use in her study?

Not Method(s) Used

Systematic sampling

Convenience sampling

Which of the following samples would be representative of the population of American teenagers?

Representative

-A cluster sample of 1,00 teenagers from around the United States

-An oversample of 1,250 U.S. teenagers.

Which of the following samples would be representative of the population of American teenagers?

Not Representative

-A snowball sample of 1,500teenagers from around the United States

-A quota sample of 1,250 U.S. teenagers

-A purposive sample of 4,00 U.S. Teenagers

Thora is considering whether the reports from a sample of drivers who have reported accidents on a navigation app are accurate. Identify the true and false statements about this sample of drivers.

True Statements

-The sample was obtained through self-selection

-IN this case, the sampling method does not affect the accuracy of the report.

Thora is considering whether the reports from a sample of drivers who have reported accidents on a navigation app are accurate. Identify the true and false statements about this sample of drivers.

False Statements

-This group of drivers is a representative sample

-This sample consists of drivers who likely have the same personality traits as other drivers who have not reported accidents on the app.

Mikhail is examining the level of workplace satisfaction for a multinational company with 10 offices around the world. He initially planned on studying every single member of the company, but due to budgetary restraints, he is only able to recruit participants from 3 offices. He randomly selects 3 out of the 10 total offices and then randomly selects 50 employees from each office to complete his survey.

the components of Mikhail's study.

EX: Every single employee

population

Mikhail is examining the level of workplace satisfaction for a multinational company with 10 offices around the world. He initially planned on studying every single member of the company, but due to budgetary restraints, he is only able to recruit participants from 3 offices. He randomly selects 3 out of the 10 total offices and then randomly selects 50 employees from each office to complete his survey.

the components of Mikhail's study

Ex: multistage sampling

sampling method

Mikhail is examining the level of workplace satisfaction for a multinational company with 10 offices around the world. He initially planned on studying every single member of the company, but due to budgetary restraints, he is only able to recruit participants from 3 offices. He randomly selects 3 out of the 10 total offices and then randomly selects 50 employees from each office to complete his survey.

the components of Mikhail's study.

Ex: employees who take part in Mikhail's study

sample

Jalon conducts a study to investigate whether anonymity affects the reported political opinions of college students. He recruits 156 participants from psychology classes and divides them into two groups. He asks the first group for their opinions about political issues and tells them that their responses will be completely anonymous. He asks the second group for their political opinions but does not tell them whether or not their opinions will be kept anonymous.

Ex: Psychology students

sample

Jalon conducts a study to investigate whether anonymity affects the reported political opinions of college students. He recruits 156 participants from psychology classes and divides them into two groups. He asks the first group for their opinions about political issues and tells them that their responses will be completely anonymous. He asks the second group for their political opinions but does not tell them whether or not their opinions will be kept anonymous.

Ex: Convenience sampling

Sampling method

Jalon conducts a study to investigate whether anonymity affects the reported political opinions of college students. He recruits 156 participants from psychology classes and divides them into two groups. He asks the first group for their opinions about political issues and tells them that their responses will be completely anonymous. He asks the second group for their political opinions but does not tell them whether or not their opinions will be kept anonymous.

Ex; College students

population

Multistage sampling example

Researchers select children at three different elementary schools at random by birth date

Convenience sampling example

Dr. Khan asks his intro psych students to fill out a survey on sleep quality and stress after class.

Simple random sampling example

Researchers choose students at random by selecting the last digit of their student IDs.

Systematic sampling example

A researcher approaches every fifth shopper who walks into a grocery store

oversampling example

A survey interested in comparing prisoners to non-prisoners includes prisoners as 10% of its sample, even though they only make up 2.5% of the total population.

Cluster sampling example

Researchers select five hospitals at random and survey all the nurses in each hospital.

quota sampling example

Researchers conducting an online survey collect 50 men and 50 women in order to have equal gender representation.

what are all of the sampling techniques that use meaningful categories from the population (e.g., demographics) and involve recruiting a certain number of participants from each of the categories in the population

Over- sampling

quota-sampling

stratified random sampling

Karim is investigating the well-being of health care workers in his county during the COVID-19 pandemic. He notes that the health care workers in his county consist of 15% physicians, 50% nurses, and 35% administrative staff. He is considering several different sampling techniques for his study.

Cluster sampling

-Karim could randomly select five hospitals from his county and recruit all of the health cares workers from those five hospitals.

Karim is investigating the well-being of health care workers in his county during the COVID-19 pandemic. He notes that the health care workers in his county consist of 15% physicians, 50% nurses, and 35% administrative staff. He is considering several different sampling techniques for his study.

multistage sampling

Karim could randomly select five hospitals from his county and then randomly elect 50 health care workers from each of the selected hospitals.

Karim is investigating the well-being of health care workers in his county during the COVID-19 pandemic. He notes that the health care workers in his county consist of 15% physicians, 50% nurses, and 35% administrative staff. He is considering several different sampling techniques for his study.

Oversampling

Karim is concerned that 15 physicians might not give him a precise statistical estimate, so he could recruit more physicians and then adjust the results later.

Karim is investigating the well-being of health care workers in his county during the COVID-19 pandemic. He notes that the health care workers in his county consist of 15% physicians, 50% nurses, and 35% administrative staff. He is considering several different sampling techniques for his study.

Quota sampling

Karim could visit a local hospital and pass out his survey t health care workers that walk by until he reaches his goal of 15 physicians, 50 nurses, and 35 administrative staff

Karim is investigating the well-being of health care workers in his county during the COVID-19 pandemic. He notes that the health care workers in his county consist of 15% physicians, 50% nurses, and 35% administrative staff. He is considering several different sampling techniques for his study.

Stratified random sampling

Karim could randomly select 15 physicians, 50 nurses, and 35 administrative staff for his sampling of 100 participants.

A researcher at a nearby university wants to look at what teachers in a certain school district think about new policy changes. The researcher makes a list of all the schools in the district and uses a random number generator to select five schools from the district. Then the researcher interviews every teacher at each of those five schools. The researcher is using __________ __________ in this study.

Cluster sampling

The campus safety committee has asked Professor Ibrahim to study bicycling on his campus. He trains two observers to rate the safety behaviors of cyclists at various locations around campus. He randomly selects 10 observation locations from the places where bicycles can be ridden on campus and randomly selects five 1-hour durations for each location. He has his observers make observations at each of the 10 places for each of the five durations. Dr. Ibrahim is using _________________ .

multistage sampling

Scenario 1: A college administrator knows that 30% of the students at her college are from out of state, and she wants to make sure that she maintains this proportion in her survey about admission practices at the college. She has a list of all the out-of-state and in-state students and randomly selects 30 students from the out-of-state list and 70 students from the in-state list. She is using

Stratified random sampling

Scenario 2: The directors of an annual community concert want to learn the musical preferences of the audience. The directors choose 2 and 6 from a random number generator and place a survey card on every sixth seat beginning with the second seat. All the cards are returned as the audience leaves. They are using

Systematic sampling

Identify the samples as either biased or unbiased.

Biased Sample (s)

-Dr. lin recruit participants from her psychology class and then randomly assigns them to one of three conditions.

Ami randomly selects phone numbers for a telephone survey and then asks the people she calls to recruit additional participants

.

Zeynep posts advertisements for a study and then recruits every sixth person who contacts her.

Identify the samples as either biased or unbiased

Unbiased sample(s)

Travis randomly selects 15 major universities and then randomly selects 15 students from each of those universities.

Nasir selects telephone numbers from a random-digit dialer and then asks for the youngest male in the house who is at least 18.

Identify the true and false statements about generalizability and external validity.

True statements

A random sample of 1,000 people is enough to generalize to a population of 100 million people.

Identify the true and false statements about generalizability and external validity

False Statements

External validity is always the highest priority in every type of claim.

-if a finding does not generalize to other populations, it is invalid

-A larger sample is always ore representative than a small sample.

Which of the following approaches increase external validity in a study?

Correct answers

-Using a representative sample

-Using a probability sampling technique

Which of the following approaches increase external validity in a study?

Incorrect Answer(s)

-Using random assignment

-Increasing the sample size

Dr. Lawrence is the director of Counseling Services at her university. She is planning to conduct a survey of 100 students to see how aware they are of the counseling services that the university offers. She wants the proportion of men and women in her sample to reflect the proportion at the university as a whole (55% women and 45% men). Dr. Lawrence plans to stand in the student center and ask people to participate until she has given the survey to 55 women and 45 men.

Identify the true and false statements about Dr. Lawrence's study.

True statements

-Dr.Lawrence is using quota sapling

-Dr.Lawrence's study will have poor external validity

Dr. Lawrence is the director of Counseling Services at her university. She is planning to conduct a survey of 100 students to see how aware they are of the counseling services that the university offers. She wants the proportion of men and women in her sample to reflect the proportion at the university as a whole (55% women and 45% men). Dr. Lawrence plans to stand in the student center and ask people to participate until she has given the survey to 55 women and 45 men.

Identify the true and false statements about Dr. Lawrence's study.

False Statements

-Dr.Lawrence is using a representative sample

-Dr.Lawrence is using stratified random sampling

Identify the true and false statements about Internet-based samples.

True statements

-Internet-based samples might consist of people who have stronger opinions than those who do not post their opinions online

.

The external validity of an Internet-based survey sample depends on how the sample is recruited.

Identify the true and false statements about internet-based samples

False Statements

Samples of people who have rated a specific product online are generally representative of the whole population of people who purchased the product.

Internet-based survey samples are always biased through self-selection.

Identify the true and false statements about selecting research participants.

True Statements

Random assignment is only used in experimental designs.

Convenience sampling is the most commonly used sampling technique.

Identify the true and false statements about selecting research participants

False Statements

Combining sampling techniques increases bias.

Self-selection is a form of unbiased sampling.

Bre is the president of a national organization of LGBTQIA rights in the United States. He wants to survey 1,000 members of his organization about their position on several political issues. He knows that transgender people make up only 5% of his organization, but he wants to make sure their views are accurately represented. He decides to randomly sample 100 transgender members and then adjust the final results so that transgender people are weighted to reflect their actual proportion of the organization.

Identify the true and false statements about Bre's study.

True statements

-Bre is using a representative sample

-Bre is using oversampling

Bre is the president of a national organization of LGBTQIA rights in the United States. He wants to survey 1,000 members of his organization about their position on several political issues. He knows that transgender people make up only 5% of his organization, but he wants to make sure their views are accurately represented. He decides to randomly sample 100 transgender members and then adjust the final results so that transgender people are weighted to reflect their actual proportion of the organization.

Identify the true and false statements about Bre's study.

False Statements

Bre's study will have poor external validity.

Bre is using cluster sampling.

Which of the following research approaches enhance either internal or external validity?

Enhance Internal validity

-experimental design

-random assignment

Which of the following research approaches enhance either internal or external validity?

Enhance External validity

-Random sampling

-Probability sampling

Identify the true and false statements about probability and nonprobability sampling techniques.

True Statements

Probability sampling techniques are a priority for frequency claims.

Only probability sampling techniques lead to externally valid results.

Identify the true and false statements about probability and nonprobability sampling techniques.

False Statements

Both probability and nonprobability sampling techniques allow researchers to generalize their results to the population of interest.

Nonprobability sampling techniques lead to larger sample sizes

Ex: all registered voters in Texas

population of interest

Ex: simple random sampling

Sampling method

Ex: 634 registered voters

sample

Dr. Jiménez is interested in how differing amounts of light affect how people perceive color. She finds participants for her study by making an announcement in the psychology classes she teaches at her university. After running the study, she asks each participant to tell their friends to sign up for her study.

Identify the true and false statements about Dr. Jiménez's study.

True statements

-Dr.jimenez is testing a causal claim

-Dr. JImenez has a non probability simple

Dr. Jiménez is interested in how differing amounts of light affect how people perceive color. She finds participants for her study by making an announcement in the psychology classes she teaches at her university. After running the study, she asks each participant to tell their friends to sign up for her study.

Identify the true and false statements about Dr. Jiménez's study.

False Statements

A larger sample would help increase generalizability for Dr. Jiménez's study.

External validity is the highest priority for Dr. Jiménez's study.

Identify the advantages of using panels for polling.

advantages

-You can avoid the problem of unanswered phone calls

- you can track how participants opinions change over time.

Identify the advantages of using Internet panels for polling.

Not Advantages

-You don't have to use random sampling to get externally valid results

-Everyone has internet access to respond to the polls.

Which of the following are reasons why it is important for frequency claims to use random sampling?

Reasons

Frequency claims make statements about a population.

External validity is a priority for frequency claims.

Which of the following are reasons why it is important for frequency claims to use random sampling?

Not Reasons

Frequency claims make stronger statements than association or causal claims.

Random sampling requires fewer resources than random assignment.

The student government at a college is interested in determining how important intercollegiate sports are to the students. Because all students have e-mail accounts, the student government can send a survey to all the students at the college. About 50% of the students respond.

What is the most likely bias in this sample?

self-selection

Snowball Sampling scenario example

Jada is working on a study focused on attention span in children and notices that 11-year-old boys are underrepresented in her sample. After her 11-year-old brother participates in her study, she asks him to distribute flyers about the study to his male classmates and soccer team. Jada is using

Purposive sampling scenario example

Dr. Saetang is conducting a study on the experience of being a racial minority on a college campus. He goes to the Asian Student Association, Black Student Union, and Hispanic Student Group on his campus to recruit Asian, Black, and Hispanic participants for his study. Dr. Saetang is using

Which of the following descriptions are relevant to probability or nonprobability samples?

Relevant to Probability Samples

-unbiased sample

-externally valid sample

-representative sample

Which of the following descriptions are relevant to probability or nonprobability samples?

Relevant to Nonprobability Samples

-Nonrandom sample

-Self-selected sample

Researchers are planning an exit poll of the gubernatorial (governor) election to examine the attitudes of registered voters in DeKalb County in the state of Georgia.

Which of the following methods for the exit poll would lead to results that would generalize to the population of interest?

Correct answer(s)

calling a randomly selected list of phone numbers of registered voters in DeKalb County

recruiting every third voter leaving the polls in all precincts of DeKalb County

Researchers are planning an exit poll of the gubernatorial (governor) election to examine the attitudes of registered voters in DeKalb County in the state of Georgia.

Which of the following methods for the exit poll would lead to results that would generalize to the population of interest?

Incorrect Answer(s)

Recruiting voters from three precincts close to one another in DeKalb County

approaching young voters leaving the polls in all precincts of DeKalb County

External validity is especially important for supporting (blank) claims

frequency

The external validity, or generalizability, of a claim is based on the

sampling method

What kind of sample is best for external validity?

a sample where each member of the population has an equal chance of being selected

Type the term that best answers the question.

What type of validity is most important to consider when creating a poll or survey?

construct

Respondents are asked to choose a number corresponding to how much they agree in _____ questions. Respondents can provide as much or as little information as they would like in _____ questions, while _____ questions ask people to choose between two or more options.

-Likert scale

-opened-ended questions

-forced choice

When observers' knowledge of the research hypothesis influences how they record their observations, _____ occurs. When participants change their behavior based on perceived expectations from the observer, it is called _____. When people change their behavior based on the presence of someone else, this is known as _____.

-observer bias

-observer effects

-reactivity

When the wording or order of a survey or poll question influences respondents' answers, its construct validity is weakened. For instance, a question with wording that encourages one response is called a _____ question. An unnecessarily complicated question that is _____ will be cognitively difficult and confusing to respondents. And researchers cannot be sure which part of the question people are responding to in a _____ question—a question that poses two questions.

-leading

-negatively worded

-double-barreled question

Determine whether or not the following would be considered observational research.

observational research:

-counting the number of people who walk through a busy convenience store

-recording how often students use the word literally in conversations with each other

not observational research:

-observing the blood pressure of 50 patients via the records of a local health clinic

-asking people whom they voted for as they leave a local polling station

Match the response types to the appropriate surveys.

socially desirable responding:

-there have been occasions where I have taken advantage of someone

fence sitting:

-I feel furious

acquiescence:

-in most ways my life is close to ideal

Determine whether or not the following apply to this question.

What mental health problems are you currently experiencing?

applies:

-open-ended

-leading

does not apply:

-negatively worded

-forced choice

-Likert scale

Match each example to the correct term.

reactivity:

-Small children stop and stare at the experimenter taking notes in the room.

observer effects:

-A participant is unusually polite because he thinks the study is about social interactions.

observer bias:

-Researchers interpret prisoners' behavior as more aggressive than college students' behavior even though the behavior is identical.

Match each question type to the appropriate example.

leading:

-what is your opinion on background checks for firearms?

negatively worded question:

-there is never a reason to be late for work

double-barreled question:

-how often are you late or absent from work?

Match each question format to the appropriate example.

semantic differential format:

-how would you rate yourself on the following scales

open-ended format:

-what do you remember about your first date

forced-choice format:

-I sometimes try to get even rather than forgive and forget

Likert scale format:

-How much do you agree with the statement below

Sort the statements as either true or false.

true:

-Questions that come earlier in a survey may affect how later questions are answered.

false:

-Even if respondents try to be completely honest, it is impossible for them to respond accurately enough to provide meaningful data on a survey.

-The main drawback of open-ended questions is that people often write things that are illegible.

-How a question is worded has little to do with how it is answered.

Read the scenario and determine whether or not the strategies are helpful for this survey.

DeAndre is observing consumers' behavior in a store to understand the effect that a going-out-of-business sale has on customer purchases. He walks around the store with a notebook, jotting down notes, but after a while he begins to notice that when people see him writing, they put down the object they are looking at and walk away.

helpful strategy:

-count the number of items the consumers buy based on receipts obtained from the store.

-dress like an employee of the store

unhelpful strategy:

-create a codebook of shopping behaviors

-use a masked design

Sort the statements as either true or false.

true:

-Observational research can be used for more than just frequency claims.

-Observational research can provide information that cannot be accurately self-reported.

false:

-Observational research always provides richer data than what can be collected from surveys.

-High interrater reliability means the information recorded was accurate.

Read the scenario and determine whether or not the strategies are helpful for this survey.

Roy is surveying parents about the health of their children. He is worried that participants will want to be seen as excellent parents and will claim that their children exercise all the time and always eat healthy.

helpful strategy:

-Remind the participants that they are anonymous.

-Add items to identify those who answer in socially desirable ways.

unhelpful strategy:

-Add reverse-worded items.

-Eliminate the neutral option.

Read the scenario and determine whether or not the strategies are helpful for this survey.

Marla has created an intervention to help children improve their social skills and wants to test it against another, similar intervention to see if it is more effective. In the final part of the study, children are brought into a room to play with other children, and their social behavior is recorded. Marla is concerned that she will unconsciously perceive the children who participated in her intervention as more social.

helpful strategy:

-Create a codebook to carefully map out social behaviors.

-Use observers who have no knowledge of which children are in which group.

unhelpful strategy:

-Observe the children from behind a one-way mirror.

-Sit in the room long enough so that the children forget she is there.

Determine whether or not the following apply to this survey.

Illegal immigrants should never be let into the United States.

applies:

-Likert scale

-negatively worded

does not apply:

-double-barreled

-forced-choice

-semantic differential

Sort the statements as either true or false.

true:

-Even strikingly vivid flashbulb memories can be inaccurate.

-When people are unsure of certain behaviors, they often create reasons for them rather than say they don't know.

false:

-Most people are accurate in describing why they act in the ways they do.

-How confident people are in their accuracy is positively correlated with how accurate they are.

In general, a measure's ability to remain consistent is referred to as

reliability

But this concept can be broken down in nuanced ways. For example,

Test-retest reliability