Research methods exam 2

0.0(0)
Studied by 2 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/121

encourage image

There's no tags or description

Looks like no tags are added yet.

122 Terms

1
New cards

Where do ideas for research questions come from?

  • discussions

  • practicum supervisors

  • current events

  • clinic observations

  • publications

  • ongoing projects

  • collaboration


2
New cards

what is the purposes of organizing ideas for questions?

helps to think about the IMPACT the research could have

provides options

3
New cards

Criteria used to evaluate quantitative data

  • internal validity

  • external validity

  • reliability

  • objectivity

answers: “What” and “when”


4
New cards

criteria used to evaluate qualitative data

  • credibility (trustworthiness)

  • transferability

  • dependability

  • confirmability

answers “why” and “how” and “how come”


5
New cards

common types of quantitative research

  • descriptive

  • correlational

  • causal-comparative/ quasi-experimental

  • experimental


6
New cards

common types of qualitative research

  • historical

  • meta-analysis

  • narrative- focuses in on a specific event

  • grounded theory- where you build a new theory from real-world data instead of starting with a guess or a pre-existing idea

  • phenomenology- general experiences over-time

  • case study

bolded=used the most

7
New cards

qualitative research steps

  1. identify- general research question

  2. choose- main methods, sites, subjects

  3. determine- methods of data documentation

  4. decide- on various aspects for collecting data

  5. clarify- researchers’ roles

  6. evaluate- study’s ethical implications

  7. collect- data saturation

  8. interpret- data by identifying concepts and theories

  9. revise

  10. collect and verify

  11. complete

  12. present


8
New cards

steps of quantitative research

  1. make- observations about an unclear or new phenomenon

  2. investigate- current theory surrounding phenomenon

  3. hypothesize- an explanation for observations

  4. predict- outcomes based on the hypothesis

  5. formulate- plan to test prediction

  6. collect and process- data

  7. verify

  8. make

  9. present


9
New cards

Thesis statement

succinct summary about the central points of your research

  • blue-print for readers


10
New cards

hypothesis

testable statement, prediction

  • not all research needs an hypothesis


11
New cards

research questions

exploratory questions

  • all research has research questions


12
New cards

how to form a good research question

  • fills a gap and is relevant

    • addresses gaps in existing knowledge

    • builds upon existing knowledge

    • relevant to GC

  • reasonable scope

    • addresses a piece of an important issue without taking on too much

    • feasibility

  • clear and specific

    • concise- clear and brief summary of what the project is about

    • precise- states the who and the what


13
New cards

focusing on the basic questions before creating the research question

  1. what: what is the problem that the research will address?

    1. who: 3 current, peer-reviewed references that support the presence of the problem

  2. how, where, and when: describe the impact of the problem

    1. who: 3 current, peer-reviewed references that support the impact of the problem that the research proposes

  3. why: identify the conceptual basis for the problem. What does the literature outline as the cause of the problem?

    1. who: 3 current, peer-reviewed references that support the conceptual basis of the problem and describe the nature of that support


14
New cards

practical considerations for a thesis

  • time

    • 15 months, with 3-6 months tops to focus on data collection

  • cost

    • $1,000

    • reasonable costs

  • available data sources


15
New cards

bloom’s taxonomy

clear, measurable verbs that accurately reflect the purpose and scope of your research aim

  • remember is the bottom, create is the top


<p>clear, measurable verbs that accurately reflect the purpose and scope of your research aim</p><ul><li><p>remember is the bottom, create is the top</p></li></ul><p></p>
16
New cards

simple formula to coming up with a research questions

action verb+ what you are studying+ in whom/where+ relevant outcome or relationship

17
New cards

mixed methods

integrates qualitative and quantitative evidence

18
New cards

mult-method

uses multiple methods without necessarily integrating findings into one analysis

19
New cards

multimodal

Uses different forms of data or expression, including visual and interactional approaches

20
New cards

positionality

how our identities, experiences, values, and professional backgrounds shape our perspectives

21
New cards

reflexivity

ongoing practice of critically examining these influences and responding to them throughout research

22
New cards

mixed methods designs→ explanatory sequential

Quant+qual= explain results

23
New cards

mixed methods designs→ exploratory sequential

qual+quant= extend findings

24
New cards

mixed methods designs→ convergent

quant+qual= bring findings together

25
New cards

survey is the ___ of your study

method

26
New cards

questionnaire is the data collection _____

instrument

27
New cards

cross-sectional could be the _______

study design

28
New cards

_____ could be quant, qual, multi-method, or part of mixed-method study

methodology

29
New cards

pros of surveying

  • ease of distribution

  • low cost

  • familiar format

  • feasible to describe characteristics of larger populations

  • ability to focus on very specific topic in a targeted manner

  • opportunity to reach a larger population than other methods (if online)


30
New cards

cons of surveying

  • low response rate

  • recall bias

  • self-report or hypothetical scenarios or future actions can lead to inaccurate conclusions

  • data may depend on cognitive load to complete


31
New cards

pros & cons of using open ended questions in surveys

pros: enables broader responses that might be impossible to obtain with close-ended questions

cons: coding answers for analysis

32
New cards

pros & cons of using close ended questions in surveys

pros: uniformity of responses; more easily processed/analyzed

cons: may miss capturing important/critical opinions, or broader range of responses

33
New cards

pros & cons of using multi-method questions in surveys

contains both open and closed questions

pros: able to capture more robust opinions/answers, in addition to standardizing portions of the data

cons: additional analysis; need to word open-ended questions appropriately or you may not get additional data

34
New cards

how to collect and report demographic data?

  1. use the demographic survey question only if you plan to do something meaningful with the data

  2. tell users the why and how

  3. stick with checkboxes for the answer options, and enable multi-select

  4. make your survey more inclusive with ‘other’

  5. make demographic questions optional


35
New cards

types of scales: interval

order, constant unit

  • ex: incomes: $20,000-29,999, $30,000-$39,999


36
New cards

types of scales: ordinal

answers with a natural order to categories; differences between categories vary and cannot be quantified

  • Ex: not likely, somewhat likely, very likely


37
New cards

types of scales: nominal

answers with categories that are unranked, unordered

  • ex: Blood type: A, B, AB, O


38
New cards

likert scales

ordinal

  1. label all anchors

  2. offer balanced options

  3. beware of extremes (always, never)

  4. be careful w/ neutral options (neither agree nor disagree)

  5. be careful with “don’t know” and “not applicable”


39
New cards

rules when doing interview surveys

  • interviewers must be neutral in appearance and actions

    • personal opinions and interviewer presence (head nods, etc) should have no effect on respondents’ choice of answers

  • interviewers must be adequately trained

    • familiar with the questionnaire

    • follow question order and wording exactly

    • record responses exactly how they were given

  • interviewers can use probes

    • elaboration on an incomplete or ambiguous response

    • probes→ neutral

    • all interviewers should use same probes

  • avoid interview surveys that elicit sensitive info


40
New cards

tips when using surveys

  • make questions clear

  • provide reference frames

    • make sure all respondents are thinking about the same time and place

  • avoid double-barrel questions (ask one question at a time)

  • short questions are best

  • avoid negative & double-negative questions

  • use vocab for target population

  • avoid questions using leading, emotional, or evocative language


41
New cards

scale anchor

defining what a scale variable means

ex: 5= very likely, 1= never

42
New cards

survey design summary

  1. define what you want to measure

  2. write clear, specific, unbiased questions and response options

  3. identify the target population and appropriate sampling strategy

  4. pretest the questionnaire, including with intended respondents

  5. consider validity, reliability, accessibility, and response bias


43
New cards

common types of quantitative research

  • descriptive

  • correlational

  • causal-comparative/Quasi-experimental

  • experimental


44
New cards

why do we sample?

not feasible to study entire population

use statistics to make inferences about population parameters

access can determine population/sample as well as scope of your project

45
New cards

sampling types: probability-based

random

  • study conclusions apply to entire population

  • better for quantitative studies



46
New cards

sampling types: non-probability

non-random

  • cannot be applied beyond the sample

  • encouraged for qualitative studies


47
New cards

sampling: population

all members of some group defined by specific criteria

  • report criteria to audience


48
New cards

sampling: parameters

quantitative characteristics of a population

ex: mean age of all patients in clinic

49
New cards

sampling: sample

subgroup of target population (study participants)

50
New cards

sampling: statistics

quantitative characteristics of a sample

51
New cards

probability-based: simple random sampling

create a list of possible participants, select using random process

each member and each sample must have an equal chance of being selected

  • produces unbiased sample


52
New cards

probability-based: stratified random sampling

statistical method where a researcher divides a larger population into smaller, non-overlapping groups—called strata—based on shared characteristics (such as age, income, department, or education level), and then randomly selects participants from each subgroup

  • take a few individuals from ALL of the groups.


53
New cards

probability-based: cluster sampling

a probability sampling method where you divide a large population into smaller, mutually exclusive groups called clusters (such as schools, neighborhoods, or workplaces), and then randomly select entire clusters to collect data from

  • take ALL of the individuals from a FEW of the groups.


54
New cards

nonprobability sampling: convenience samples

already have access to sample or quick access

55
New cards

nonprobability sampling: purposeful samples

selected based on ability to provide valid data

56
New cards

how to collect & report demographic data

  1. use demographic survey questions only if you plan to do something meaningful with the data

  2. tell users “why'“ and “how”

  3. use checkboxes for the answer option & enable multi-select

  4. make questions optional


57
New cards

limitations of demographic data on surveys

  • self-identification- may not capture complexities of individual identities

  • subjectivity- can be influenced by personal interpretation and societal pressures

  • limited options- may not cover full range of backgrounds and identities

  • ambiguity and overgeneralization- oversimplify diversity

  • ethical considerations- privacy, stereotyping, discrimination

  • intersectionality


58
New cards

why include comparison groups using publicly available data?

  • determines whether sample differs from relevant population

  • helps to identify potential selection bias of differences in sample composition

  • strengthens interpretation of demographic or other descriptive findings

  • may eliminate the time, cost, and participant burden of recruiting an internal comparison group


59
New cards

considerations when using publicly available data as a comparison group

  • population comparability

  • variable alignment

  • time & geography

  • sampling methods

  • available variables

  • statistical weight


60
New cards

concerns with pre-existing data sets

ethical considerations

  • historical inaccuracies and categorization limits

  • Small N, identifiability risk

  • lack of consent for secondary use

equity considerations

  • deficit-based reporting and stigmatization

  • power dynamics and data ownership

  • the “othering” of minoritized groups


61
New cards

cleaning & transforming data is not…

changing or making up data

62
New cards

options for missing data

  • omit entire case

    • can be seen as ignoring data

    • biased estimates, inaccurate conclusions

  • omitting single variable

  • replace single variable with highly correlated variable for analysis

  • substitution methods (mean, median, mode)

    • produces biased means, reduce variability in responses


63
New cards

what do to when there is missing data

check for problematic participants

check for problematic patterns

64
New cards

descriptive statistics

  • describes chunk of raw data

  • helps with organizing, understanding data in a meaningful way

  • ex: summary stats, graphs, tables


65
New cards

inferential statistics

  • small sample of data to draw inferences about the larger population, outcome, or probability

  • representative sample/random

  • large enough sample size

  • ex: hypothesis tests. CI, regression


66
New cards

summary statistics

explains data which is already known, to summarize sample


67
New cards

3 key components of qualitative research

  • context

  • researcher is instrument

  • depth over breadth


68
New cards

limitations of qualitative research

  • time, cost

  • access

  • lack of generalizability

  • lack of reproducibility→ every group is different based on context

  • small sample sizes


69
New cards

3 methods of data collection for qualitative research

  1. participant observation

  2. interviewing/focus group

  3. document analysis→ field notes→ constant comparison, TRIANGULATE DATA


70
New cards

qualitative data collection: field notes

on-site observations, notes from phone calls

71
New cards

interpretivism

no “true reality”, facts and meanings are socially constructed

72
New cards

uses of qualitative research in GC

tool in understanding health behavior, program utilization, program and product development

  • improving engagement

  • health services

  • programming

  • evaluation

  • health communication

  • better understanding of rare or stigmatized conditions

  • patient experience- VUS


73
New cards

qualitative research is…

participant led

74
New cards

triangulation

comparing interviews, observation, and documents to build a more complete and credible understanding

  • form of quality control→ trustworthiness


75
New cards

Reflexivity in qualitative research (validity testing)

ensures trustworthiness

  • aware of biases & how much they influence data

  • easier with teams

  • biases can change over time


76
New cards

Statistical analysis considerations

  • sample size

  • descriptive statistics used to summarize characteristics of the sample

  • methods used to compare certain groups of patients

  • graphs

  • multivariate models (establish association)

  • statistical significance level

  • software


77
New cards

point estimates are used to quantify

  • averages

  • variability

  • proportions

  • risk


78
New cards

confidence intervals…

  • must be presented with every estimate

95% CI means that we are 95% confident that the calculated confidence interval will cover the true target value for which it was constructed


79
New cards

question to ask when comparing two or more groups

do the observed proportion estimates reflect a difference in the population?


80
New cards

null hypothesis

H0: no difference in population values

81
New cards

alternative hypothesis

HA, population values are different

82
New cards

type I error

false positive

83
New cards

type II error

false negative

84
New cards

p-value

probability of obtaining that observed difference by chance alone

  • less than 0.05= reject null and conclude that there is a significant difference

  • represents <5% chance of obtaining those results by chance assuming no treatment difference


85
New cards

things to keep in mind regarding p-values

  • small p-value only indicates that treatment effect is nonzero

  • p-value is sensitive to sample size

  • statistical significance does not equal clinically significant

  • non-significant p-value DOES NOT mean the treatment effect is 0


86
New cards

two-sided tests

HA states that the population values simply differ

87
New cards

one sided tests

HA specifies a direction of effect

88
New cards

tests for comparing the means of continuous measurements between groups

  • independent sample t-test (2 independent groups)

  • paired t-test (2 dependent groups… measures before and after intervention)

  • ANOVA (more than 2 independent groups)

relies on distributions having bell-shaped curve

based on differences between means (SD)


89
New cards

nonparametric tests for comparing the medians of continuous measurements between groups

require milder assumptions, deal w/ rankings of measurements instead of measurements themselves

  • wilcoxon rank sum test (2 independent groups)

  • signed rank test (2 dependent groups)

  • kruskal-wallis ( more than 2 independent groups)


90
New cards

methods for comparing categorical variables

  • chi-square test

  • Fisher’s exact test for association


91
New cards

quantifying risk differences: relative risk

RR= chances of event in control group/chances of event in experimental group

92
New cards

quantifying risk differences: odds ratio

OR= odds (in control group)/ odds (in experimental group)

where

odds= probability (event)/ 1-probability (event)

93
New cards

RR=1

probabilities of the event in control and experimental are identical

94
New cards

RR>1

increased risk of the even among those in control group compared to patients in experimental group

95
New cards

RR<1

decreased risk of event among control patients compared to experimental group

96
New cards

true or false: interpretation for RR is similar to that of OR

true

97
New cards

Relative risk reduction notation: CER

chances of even in control group

98
New cards

Relative risk reduction notation: EER

chances of event in experimental group

99
New cards

relative risk reduction equation

RRR= (CER-EER)/CER

100
New cards

absolute risk reduction equation

ARR= CER-EER