1/34
Comprehensive practice flashcards defining foundational concepts in null hypothesis significance testing, effect sizes, statistical errors, regression models, mediation, and moderation.
Null Hypothesis Significance Testing (NHST)
A four-step inferential framework consisting of specifying null and alternative hypotheses, selecting a significance threshold (α), calculating test statistics with their associated p-values, and determining whether to reject or fail to reject the null hypothesis.
p-value
The probability of obtaining sample results at least as extreme as the observed data, assuming that the null hypothesis is true.
Effect Size
A standardized metric that quantifies the magnitude or strength of an association or experimental effect, which is not directly dependent on sample size.
Cohen's d
A standardized effect size metric for assessing mean group differences (categorical IV and continuous DV), with benchmarks of 0.2 for small, 0.5 for medium, and 0.8 for large effects.
Pearson's r
A standardized correlation coefficient and effect size metric evaluating the linear relationship between two continuous variables, ranging from −1 to +1, with benchmarks of 0.1 for small, 0.3 for medium, and 0.5 for large associations.
Meta-analysis
A quantitative research method that synthesizes standardized effect sizes across all available published studies in the literature to estimate an overall effect size.
Type I Error (α)
A false positive error occurring when a researcher rejects the null hypothesis when it is actually true in reality, with the decision criterion typically set at α=.05.
Type II Error (β)
A false negative error occurring when a researcher fails to reject the null hypothesis when an actual effect or relationship exists in reality.
Statistical Power (1−β)
The probability of detecting a statistically significant effect when that effect truly exists in reality, which increases as the criterion α, sample size, and effect size increase (typically targeted at .80).
Nominal Variable
A categorical level of measurement that sorts observations into distinct, non-ordered qualitative classifications.
Ordinal Variable
A categorical level of measurement with at least three distinct categories that possess an inherent order or ranking in magnitude, but lack equal intervals between adjacent points.
Interval Variable
A continuous level of measurement characterized by equal distances between adjacent scale points across the scale, but lacking an absolute, true zero.
Ratio Variable
A continuous level of measurement that features equal intervals between scale points and an absolute, true zero that signifies the complete absence of the property being measured.
Likert Scale
A rating format that is ordinal in theory, but is practically treated as an interval variable in psychological research when it contains more than three response options.
Replication Crisis
A methodological crisis in social and psychological sciences underscored by an Open Science Collaboration project where only 36% of 100 examined studies successfully replicated.
File-Drawer Problem
A systemic publication bias where researchers and journals selectively publish statistically significant results while non-significant, null findings remain unwritten or locked away in file drawers.
p-hacking
The misuse of data analysis techniques—such as testing multiple comparisons without corrections, stopping data collection once p<.05, or selectively excluding participants and covariates—to artificially generate statistically significant results.
Pre-registration
The open-science practice of officially documenting and publishing hypotheses, study design, stopping rules, and statistical analyses prior to data collection to prevent p-hacking.
z-score
A standardized score indicating the exact number of standard deviations a raw score lies above or below the mean, computed as z=sdx−xˉ.
Centering
The mathematical transformation of subtracting the mean from each raw score (C=x−xˉ), shifting the mean to zero while preserving the original measurement scale units.
Unstandardized Regression Coefficient (b)
The regression slope parameter representing the predicted change in the dependent variable in raw units for every 1-unit increase in the independent variable.
Standardized Regression Coefficient (β)
The regression slope parameter representing the predicted change in the dependent variable in standard deviation units for every 1-standard deviation increase in the independent variable.
Regression Intercept
The predicted value of the dependent variable when all independent variables in the regression model are equal to zero.
Cronbach's Alpha (α)
A measure of internal consistency reliability ranging from 0 to 1, calculated from the number of items and their average inter-item correlation, where values between .65 and .79 are acceptable and values above .80 are good.
Multiple Regression
A statistical analysis that predicts a single continuous dependent variable using multiple independent variables simultaneously, determining each variable's unique contribution while controlling for the others.
Partial Correlation
A correlation quantifying the unique linear association between two variables after statistically removing the shared variance of a third confounding variable from both.
Prospective Change Analysis
A longitudinal regression technique that predicts a dependent variable at Time 2 while controlling for its baseline level at Time 1, isolating true changes over time from baseline stability.
Mediator
An intervening variable that explains the underlying causal mechanism or pathway through which an independent variable influences a dependent variable, addressing 'how' or 'why' an effect occurs.
Moderator
A variable that alters, qualifies, or changes the direction or strength of the relationship between an independent variable and a dependent variable, addressing 'when' or 'for whom' an effect occurs.
Indirect Effect
The specific mediated pathway linking the independent variable to the dependent variable through a mediator, quantified statistically as the product of the regression coefficients a⋅b.
Sobel Test
A classical significance test used in mediation analysis to assess whether the reduction in the direct effect of an IV on a DV after adding the mediator is statistically significant.
Bootstrapping (in Mediation)
A non-parametric resampling procedure with replacement that creates an empirical sampling distribution to calculate confidence intervals and test the significance of the indirect effect (a⋅b).
Main Effect
The overall effect of a single predictor variable on the dependent variable, averaged across all levels of the other predictor or moderator variables in the model.
Interaction Effect
A statistical effect occurring when the relationship between an independent variable and a dependent variable differs depending on the level of a moderator variable, reflected visually by non-parallel lines.
Simple Slopes Analysis
A statistical decomposition technique conducted after detecting a significant interaction to calculate and test the significance of the IV-DV slope at specific representative levels of the moderator (typically −1 SD, Mean, and +1 SD).