Empiricism: Knowledge based on observation.
Basic vs. Applied Research:
Basic = understanding fundamental principles.
Applied = solving real-world problems.
Sections of an empirical article:
Abstract, Introduction, Method, Results, Discussion, References.
Research > Personal Experience: Controlled, systematic, less biased.
Frequency Claim: Describes rate or level.
Association Claim: Relationship between variables.
Causal Claim: One variable causes another.
Conceptual vs. Operational Definitions:
Conceptual = idea or theory.
Operational = how it’s measured/tested.
Three ethical principles:
Respect for persons: Informed consent.
Beneficence: Do no harm.
Justice: Fairness in participant selection.
Reliability:
Test-retest, Interrater, Internal.
Validity:
Face, Content, Criterion, Convergent, Discriminant.
Response sets: Tendency to respond in patterned ways.
Observer bias: Researcher's expectations skew results.
Reactivity: Participant behavior changes when observed.
Probability Sampling: Random, representative.
Non-Probability Sampling: Convenience, quota.
Examples: Cluster, Stratified, Snowball, etc.
Problems with causal conclusions:
Directionality Problem
Third-variable Problem
Statistical Validity Concerns: Sample size, effect size, outliers, restriction of range.
Cross-sectional: Different variables, same time.
Autocorrelations: Same variable, different time.
Cross-lag: Different variables, different times (→ helps determine temporal precedence).
Regression equation: Y = a + bX
Y = outcome variable
X = predictor variable
a = intercept, b = slope
Purpose: Controls for third variables.
Interpretation:
Look at Beta coefficients (β), p-values, and confidence intervals.
Validity Supported: Internal validity, if third variables are ruled out.
Regression helps with covariance and third variables, but random assignment in experiments is still superior for causal claims.
Independent Variable (IV): Manipulated.
Dependent Variable (DV): Measured.
Causal Criteria:
Covariance
Temporal Precedence
Internal Validity
Independent-groups:
Posttest-only, Pretest/Posttest.
Within-groups:
Repeated-measures, Concurrent measures.
Design Confounds
Selection Effects: Use random assignment.
Order Effects (within-groups): Use counterbalancing.
Full: All possible sequences.
Partial: Some sequences.
Latin Square: Ensures each condition appears in each position.
Demand Characteristics
Systematic vs. Unsystematic Variability
Control Variable: Holds constant to isolate IV effect.
Cohen’s d: Effect size.
Confidence Interval:
If CI includes 0 → Not significant.
If CI excludes 0 → Significant.
Observer bias: Use masked/blind design.
Demand characteristics: Participants guess study purpose.
Placebo effects: Use double-blind placebo control group.
Regression to the Mean
Attrition: Participant drop-out.
Testing Effects: Familiarity with test.
Instrumentation
History
Maturation
➡ Solutions: Comparison groups, counterbalancing, posttest-only design.
Too little between-groups variability:
Ceiling/floor effects
Poor manipulation/measurement
Too much within-groups variability:
Measurement error
Individual differences
Situation noise
➡ Solutions:
Improve reliability of measures
Increase sample size
Use within-groups design
Power = Probability of detecting an effect if one exists.
Increased by minimizing within-group variability and increasing sample size.
Match study designs to examples (e.g., pretest/posttest, repeated measures).
Understand how to read regression tables.
Know which validity is being addressed in examples.
Be able to identify confounds in experimental scenarios.
Recognize types of correlations in longitudinal studies.
Memorize key definitions AND examples.
Prepare your 3x5 notecard with formulas, definitions, and diagrams!