1/20
A set of 21 vocabulary flashcards covering literature review concepts, study validity, research methodologies, qualitative appraisal, and annotated bibliographies.
Reliability
The consistency and dependability of a measurement tool or method: does it produce stable, repeatable results under the same conditions?
Validity
How accurately a study measures what it claims to measure and how applicable its findings are: internal validity (accuracy of the study) and external validity (applicability to the real world).
Test-retest reliability
Taking the same test/measurement and retesting later, expecting similar results.
Alternate / parallel reliability
Two different versions of the same tool produce comparable results.
Inter-rater reliability
The correlation between two people independently assessing the same thing.
Internal validity
Whether a study's results are truly caused by the tested factors and not other influences; depends on controlling extraneous variables and eliminating alternative explanations.
External validity
Whether study results apply to other people, settings, and times in the real world.
Attrition (as a threat)
Participant dropout during a study, which can bias results if those who leave differ systematically from those who stay.
Regression to the mean
Extreme scores at baseline tend to drift closer to average on retesting, independent of any intervention.
Confounding variable
An outside factor related to both the exposure and outcome that can distort the apparent relationship between them.
Self-selection bias
Participants who choose to enroll (e.g., volunteers) differ systematically from those who don't, limiting generalizability.
The Evidence Pyramid (low to high quality)
Background info/expert opinion → case reports → case series → cohort studies → non-randomized trials → RCTs → critically appraised literature/guidelines → systematic reviews → meta-analyses.
M.A.A.R.I.E. Framework
Method, Assignment, Assessment, Results, Interpretation, Extrapolation — a structured way to walk through a study from population to conclusions. (Interpretation = conclusions for study participants; Extrapolation = conclusions for other populations.)
Research Design vs. Methodology vs. Methods
Design = the overall plan/structure (the "what"); Methodology = the underlying rationale/philosophy (the "why"); Methods = the actual tools used (surveys, interviews, lab tests).
The 3-pass reading strategy
Pass 1: Orient (question, design, main finding, ~5–10 min). Pass 2: Understand (methods, figures/tables, key evidence). Pass 3: Critique & connect (assumptions, limitations, implications) — for key papers.
Three questions to ask at each figure/table
What am I looking at? What is the pattern? Does it support the authors' claim?
Qualitative research strengths
Flexible/adaptable, participants' own words, examines individual variation, open-ended (can pursue new data), smaller samples, compelling content.
Saturation (in qualitative research)
Adding new cases/participants until no new themes emerge.
Key concepts for reviewing qualitative research
Trustworthiness, coherence, representativeness of results, testimonial validity, applicability/transferability, replicability — plus structured vs. unstructured interviews, research team training, and appropriate limitations.
Abstract vs. Annotation
Abstract: written by the authors, describes purpose/methods/results/conclusions. Annotation: written by you, adds evaluation, relevance to your question, and connection to other literature — copying the abstract is NOT an annotation.
Annotated bibliography structure
Summary (question/methods/findings) → Evaluation (strengths/limitations) → Relevance (why it matters to your question) → Connection (how it relates to other literature).