Research Methods in Psychology - Definitive Study Notes

Learning Targets & Core Competencies

• Apply psychological perspectives, theories, concepts, and research findings to a scenario.

• Explain how cultural norms, expectations, and circumstances, as well as cognitive biases apply to behavior and mental processes.

• Determine the type of research design(s) used in a given study.

• Evaluate the appropriate use of research design elements in experimental methodology.

• Evaluate the appropriate use of research design elements in non-experimental methodologies.

• Evaluate whether a psychological research scenario followed appropriate ethical procedures.

• Identify psychology-related concepts in descriptions or representations of data.

• Calculate and interpret measures of central tendency, variation, and percentile rank in a given data set.

• Interpret quantitative or qualitative inferential data from a given table, graph, chart, figure, or diagram.

• Propose a defensible claim.

• Provide reasoning that is grounded in scientifically derived evidence to support, refute, or modify an established or provided claim, policy, or norm.

Foundations of Psychological Science

• Definition of Psychology: Psychology is defined strictly as the science of behavior AND mental processes.

• Observability vs. Non-tangibility:

  • The brain and behavior can be studied directly because they are observable.

  • The mind and thoughts are not tangible, making them considerably harder to study.

• Nature of Psychological Proof: Psychological research seeks scientifically derived evidence to explore theories and phenomena, recognizing that many aspects of psychology will likely never be definitively proven. Any and all attempts to better understand psychology contribute to its status as a science.

The Scientific Attitude & Critical Thinking

• The Scientific Attitude: Composed of three core components:

  • Curiosity

  • Skepticism

  • Humility

• Core Principle: "The rat is always right!" (Evidence overrides personal assumptions).

• Critical Thinking: A thinking style that prepares individuals to think harder and smarter by:

  • Examining assumptions

  • Appraising the source

  • Discerning hidden biases

  • Evaluating evidence

  • Assessing conclusions

• Critical Thinking Application (Media Scenario):

  • When encountering an interesting media post, maintain skepticism and fact-check before believing or sharing.

  • Key analytical questions include: Are there other posts that support this? Who posted it? What do they have to gain from posting it? How might the subject feel about this post if they are not the author or photographer?

  • Applying critical thinking supports psychology as a science because theories must undergo thorough investigation to be considered valid.

Obstacles & Cognitive Biases in Psychological Research

• Hindsight Bias: The tendency to believe, after learning an outcome, that one would have foreseen it (commonly summarized as the "I knew it all along!" phenomenon).

• Overconfidence: The tendency to overestimate one's knowledge, intellect, or ability.

  • Gambler's Fallacy: A specific manifestation of overconfidence defined as the tendency to overestimate the occurrence of patterns in random data.

• Perceiving Order in Random Events: The innate human inclination to find meaning in random sequences as a mechanism to make sense of the world.

  • Coin Flip Example: If a coin is flipped $5$ times and lands on heads every time, the probability of the $6\text{th}$ flip landing on heads remains exactly a $50/50$ shot (or a probability of $0.50$).

• Illusory Correlation: The tendency to perceive a relationship between two variables where no actual relationship exists.

  • Examples: Superstitions and athletes' pregame rituals.

The Scientific Method & Theory Development

• Psychological Theories: Integrated sets of principles that organize observations and generate hypotheses. These hypotheses are tested and replicated to confirm, reject, or modify theoretical conclusions.

• Step-by-Step Scientific Method:

  1. Observe: Observe some aspect of the universe.

  2. Develop a Theory: Formulate a general explanation of a phenomenon consistent with initial observations.

  3. Formulate a Hypothesis: Derive an educated, testable prediction or guess.

     • Null Hypothesis: A hypothesis stating that variables are not connected or that there is no significant difference between specified populations (with any observed difference being attributed strictly to sampling or experimental error).

  4. Test Predictions: Conduct empirical research or experiments. Crucial to this step are operational definitions (exact, explicit specifications of how research variables are measured and procedures are conducted).

  5. Evaluate Results: Share findings with peer reviewers who provide additional insights, critiques, and perspectives.

  6. Modify Theory: Adjust theoretical frameworks in light of experimental findings.

  7. Replicate: Conduct the research a second time to ensure the consistency and reliability of results. Replication is confirmation.

Research Methods & Methodological Strategies

• Three Primary Research Approaches:

  • Descriptive Methods: Focus on describing behaviors through case studies, surveys, or naturalistic observations.

  • Correlational Methods: Focus on associating different factors or variables.

  • Experimental Methods: Focus on manipulating variables to establish explicit cause-and-effect relationships.

Descriptive Research Methodologies & Biases

• Case Studies:

  • Definition: A descriptive technique in which one individual or group is studied in depth to reveal universal underlying principles.

  • Historical Contributions: Have illuminated the impacts of brain damage, the developmental scope of children's minds, and demonstrations of animal intelligence.

  • Advantages: Delivers exhaustive, in-depth information on a limited number of subjects; illustrates general principles that can apply broadly.

  • Disadvantages: Can be misleading if the individual studied is atypical or underrepresented; risks overgeneralizing results to the broader population.

• Naturalistic Observation:

  • Definition: Observing and recording behavior in naturally occurring environments without manipulating or controlling the situation.

  • Advantages: Noninvasive nature ensures subjects are more likely to display authentic, natural behavior; serves as a rich source of ideas for future research.

  • Disadvantages: Highly time-consuming and expensive; subjects may alter their behavior if they notice the observer; observers risk misinterpreting subject actions.

• Surveys:

  • Definition: A technique used to gather self-reported attitudes, beliefs, or behaviors of a target group, typically via structured questioning.

  • Advantages: Enables rapid data collection from large samples; highly cost-effective; versatile administration options (online, paper, in-person).

  • Disadvantages: Susceptible to poor question wording; participants may supply inaccurate or untruthful responses (misinformation effect); frequently suffers from low response rates.

• Obstacles and Biases in Descriptive Methodology:

  • Social Desirability Bias: The tendency for respondents to answer untruthfully to gain approval or project positive character traits.

  • Self-Report Bias: The tendency for participants to intentionally or unintentionally alter outcomes, act unrealistically, try to please the researcher, or deliberately challenge the research hypothesis.

  • Sampling Bias: A flawed sampling process where researchers target specific participants to artificially favor their hypothesis, or fail to gather a representative sample, producing skewed results.

  • Wording Effects (Framing): The phrasing or presentation of questions altering respondent interpretations and skewing data.

  • Population: The entire target group to which research findings are intended to apply.

  • Sample: A representative subset of individuals selected from the broader population to participate in research.

  • Representative / Random Sample: A sample in which every member of a population has an equal chance of selection, ensuring fair demographic representation.

Correlational Research & Relationships

• Correlation Coefficient ($r$-value): A quantitative index measuring the statistical relationship between two variables, ranging along a continuum from $-1.0$ to $+1.0$, traditionally visualized on scatter plots.

  • Values closer to $+1.0$ or $-1.0$ represent strong statistical relationships.

  • Values closer to $0.0$ indicate weak or nonexistent statistical relationships.

• Directionality of Correlations:

  • Positive Correlation ($+1.0$): Variables move concurrently in the same direction.

    • Example 1: Increased study time correlates with higher academic grades.

    • Example 2: Fewer school absences correlate with fewer disciplinary referrals.

  • Negative Correlation ($-1.0$): Variables move inversely in opposite directions.

    • Example 1: Increased school absences correlate with lower academic grades.

    • Example 2: Reduced sleep duration correlates with an increased rate of motor vehicle accidents.

• Core Imperative: CORRELATION DOES NOT EQUAL CAUSATION.

  • Predictable co-variation between variables does not imply that one variable causes the other.

  • Ice Cream and Crime Metaphor: Ice cream sales positively correlate with violent crime rates; however, ice cream consumption does not induce criminal behavior (both are mediated by warm weather).

  • Shoe Size and Vocabulary Metaphor: Shoe size positively correlates with vocabulary knowledge in developing humans; however, losing a foot in an alligator attack will not result in a loss of language capabilities.

  • Freakonomics Case Study: Historical correlation observed between ice cream consumption and polio outbreaks.

Illusory Correlation & Regression Toward the Mean

• Illusory Correlation Details: Visualizing false connections between unrelated occurrences accounts for non-scientific behaviors like gambling strategies and personal superstitions.

  • Athlete Scenario: An athlete wears a specific pair of footwear during an unexpected victory, subsequently deeming them "lucky shoes" and attributing causality to the footwear.

• Regression Toward the Mean: The statistical phenomenon where extreme, atypical, or unusual scores/events naturally gravitate back toward their baseline average upon re-testing or subsequent evaluation.

  • Academic Scenario: A student who consistently earns high marks ($A$ grades) unexpectedly fails an examination; upon retaking the test, their score naturally regresses back upward toward their typical high average.

Experimental Methodology & Variables

• Core Purpose of Experiments: Experiments serve as the sole research design capable of isolating true cause-and-effect relationships by deliberately manipulating variables of interest while holding extraneous factors constant.

• Primary Structural Components:

  • Hypothesis: A explicit, testable prediction detailing the expected relationship between experimental variables.

  • Independent Variable (IV): The experimental factor that is actively manipulated, altered, or controlled by the experimenter.

  • Dependent Variable (DV): The outcome factor that is measured or observed to evaluate the effects of manipulating the independent variable.

  • Experimental Group: The sub-group of participants exposed to the active treatment or manipulated independent variable.

  • Control Group: The sub-group of participants that does not receive the manipulated variable, serving as a baseline metric.

  • Single-Blind Study: A control procedure where participants remain unaware of whether they are in the experimental or control group, though researchers know.

  • Double-Blind Study: An experimental control procedure in which neither the participants nor the research staff know which group has received the active treatment or a placebo, effectively eliminating participant and researcher bias.

  • Placebo: An inactive, inert substance or sham procedure administered to the control group to mirror the administration of the independent variable.

Sampling Strategies & Experimental Assignment

• Random Sample: Selection method ensuring every individual in a target population possesses an equal probability of being chosen for inclusion.

• Representative Sample: A carefully structured subset of a population reflecting the proportional characteristics and demographics of the overall population.

• Random Assignment: Assigning participants to experimental and control groups entirely by chance, minimizing baseline differences between groups and controlling for confounding variables.

• Convenience Sampling: A non-probability sampling technique selecting participants based on easy availability and proximity to the researcher.

Experimental Identification Exercises

1. Public Television and Reading Skills:

   • Scenario: Developmental psychologists evaluate if exposing children to public television improves reading capabilities.

   • Independent Variable (IV): Exposure to public television.

   • Dependent Variable (DV): Reading skills performance.

2. Reinforcement and Assembly Line Productivity:

   • Scenario: Behavioral psychologists test whether reinforcing comments increase assembly line workplace productivity.

   • Independent Variable (IV): Presence of reinforcing comments.

   • Dependent Variable (DV): Level of assembly line productivity.

3. Parental Treatment of Siblings:

   • Scenario: Comparative psychologists examine if younger siblings receive better treatment from parents relative to older siblings.

   • Independent Variable (IV): Sibling birth order position (younger vs. older).

   • Dependent Variable (DV): Quality/degree of parental treatment.

4. Psychotherapy and Emotional Health:

   • Scenario: A clinical psychologist investigates if receiving psychotherapy impacts the likelihood of future emotional issues.

   • Independent Variable (IV): Receipt of psychotherapy treatment.

   • Dependent Variable (DV): Likelihood of experiencing future emotional problems.

5. Alcohol Consumption and Driving Reaction Time:

   • Scenario: Behavioral researchers test if alcohol consumption degrades driving reaction time.

   • Independent Variable (IV): Level of alcohol consumption.

   • Dependent Variable (DV): Reaction time while driving.

6. Workspace Changes and Employee Morale:

   • Scenario: Industrial psychologists evaluate how modifications to physical workspace impact employee morale.

   • Independent Variable (IV): Modifications made to the workspace.

   • Dependent Variable (DV): Employee morale scores.

Methodological Pitfalls & Experimental Validity

• Placebo Effect: Experimental results driven purely by participant expectations, where behavioral or physiological changes occur simply because the participant believes they received an active substance or treatment.

• Confounding Variables: Uncontrolled external factors other than the intentional independent variable that systematically influence or alter the dependent variable.

• Experimenter Bias: A systematic error occurring when researchers selectively notice, record, or interpret data supporting their hypothesis while ignoring contradictory evidence.

• Validity: The precise extent to which an experimental test or design accurately measures or predicts what it claims to evaluate.

Comparative Matrix of Research Methodologies

• Descriptive Method:

  • Primary Purpose: Observe and record natural behavior.

  • Setting: Administered in any setting.

  • Manipulated Factors: None ($0$ variables manipulated).

  • Advantages: Cost-effective and straightforward; generates foundational hypotheses for future studies.

  • Disadvantages: Time-intensive and costly; complete lack of variable control; observer presence can skew participant behavior.

• Correlational Method:

  • Primary Purpose: Detect naturally occurring statistical patterns and relationships.

  • Setting: Administered in any setting.

  • Manipulated Factors: None ($0$ variables manipulated).

  • Advantages: Generates ideas and theoretical hypotheses for future experimental investigation.

  • Disadvantages: Incapable of establishing causality; leads to erroneous causal assumptions.

• Experimental Method:

  • Primary Purpose: Explore and demonstrate exact cause-and-effect relationships.

  • Setting: Laboratory settings or tightly controlled artificial environments.

  • Manipulated Factors: The specific independent variable(s) under investigation.

  • Advantages: Establishes definitive causality; allows tight control over confounding factors.

  • Disadvantages: Highly expensive and time-consuming; extraneous outside variables can occasionally distort results.

Specialized Research Designs

• Twin Studies:

  • Purpose: Disentangle environmental influences (nurture) from genetic factors (nature).

  • Monozygotic Twins: Identical twins sharing $100\%$ of genetic material; represents the strongest methodological twin design.

  • Dizygotic Twins: Fraternal twins sharing $50\%$ of genetic material; yields no more genetic insight than standard full siblings.

• Cross-Sectional Studies:

  • Purpose: Capture a "snapshot" of data by evaluating different age cohorts or groups simultaneously at a single point in time.

  • Characteristics: Fast, inexpensive, highly suited for needs assessments and initial hypothesis generation.

  • Limitations: Weak in determining longitudinal causality or tracking individual progression over extended developmental periods.

• Longitudinal Studies:

  • Purpose: Re-evaluate and observe the exact same cohort over extended spans (weeks, months, years, or decades) to measure changes, developmental trends, and long-term impacts.

  • Applications: Essential across clinical medicine, psychology, and sociology for understanding disease progression, aging, and broad social transformations through surveys and biological measures.

Qualitative vs. Quantitative Methodology

• Quantitative Research: Collects, analyzes, and produces numerical data (e.g., standardized test scores, Likert scales, structured survey results).

• Qualitative Research: Relies on descriptive, narrative analysis that cannot be reduced to numerical units (e.g., open-ended clinical case studies, rich interview transcriptions).

APA Ethical Guidelines & Institutional Review

• Institutional Review Board (IRB): All psychological research designs must receive formal approval from an institutional review panel prior to implementation.

• Human Participant Protections:

  • Voluntary Participation: Participants must engage willingly without coercion.

  • Informed Consent: Potential subjects must receive comprehensive information regarding study protocols to make an educated choice regarding participation, maintaining the freedom to withdraw at any point without penalty.

  • Confidentiality: Participant identity and personal data must be kept strictly private and secure.

  • Debriefing: Post-experiment explanation detailing the study's true purpose, overall results, and revealing any necessary deception used during testing.

  • Harm Mitigation: Absolute protection from long-term physical or psychological harm.

• Animal Subject Protections:

  • Animal subjects must receive humane treatment, high-quality housing, and proper physiological care.

  • If a research procedure permanently diminishes an animal's quality of life, the animal must be humanely euthanized.

Scientific Integrity & Research Application

• Integrity Standards: Intentional misrepresentation, falsification, or fraudulent reporting of scientific data results in immediate exile from the scientific community.

• Social Impact of Fake Science: Unsubstantiated claims cause real-world societal harm. Readers must scrutinize publication sources for peer-reviewed credibility and verify primary citations.

• Academic Citation Norms: Proper citation of external literature serves as a critical courtesy to primary authors while validating the scientific foundation of new research.

Statistical Literacy & Data Interpretation

• Evaluating Unsubstantiated Media Claims: Sensationalist media headlines lacking empirical backing typically rely on raw estimation rather than measurement:

  • Example Estimations: "$1\text{ million}$ teenage pregnancies," "$2\text{ million}$ homeless seniors," or "$3\text{ million}$ alcohol-related accidents."

• Relative vs. Absolute Risk Distortion Case Study (1990s British Media):

  • Media Event: British news agencies published reports claiming a specific oral contraceptive pill increased the risk of blood clots and strokes by $100\%$.

  • Behavioral Fallout: Mass panic led thousands of women to immediately cease taking the pill, resulting in widespread unwanted pregnancies and subsequent abortions.

  • Statistical Reality: The actual absolute risk increase was from $1\text{ in }7000$ women to $2\text{ in }7000$ women. While a $100\%$ relative increase, the true absolute risk increase was only $1\text{ in }7000$

Descriptive Statistics & Graphical Data

• Descriptive Statistics: Quantitative measures utilized to organize, summarize, and describe the characteristics of a specific data set.

• Histograms: Bar graphs presenting data points organized into designated numerical intervals (bins).

• Measures of Central Tendency:

  • Mean: The arithmetic average calculated by summing all scores and dividing by the total count of scores.

  • Median: The exact physical midpoint in a distribution when scores are arranged in numerical order.

  • Mode: The most frequently occurring score in a distribution.

• Percentile Rank: The percentage of scores in a distribution that fall below a specific score.

  • Academic Example: Earning a score at the $90\text{th}$ percentile indicates you outperformed exactly $90\%$ of all individuals who took the exam.

  • Height Example: Standing at the $80\text{th}$ percentile for height means you are taller than $80\%$ of your age peers (meaning only $20\%$ are taller than you).

• Measures of Variation:

  • Range: The total distance between the highest score and the lowest score in a dataset.

  • Standard Deviation: The calculated average distance of individual scores away from the mean of the distribution.

Distributions & Skewness

• Normal Distribution: A symmetrical, bell-shaped distribution curve where the majority of scores cluster near the central mean, with fewer scores falling into outer extremes.

• Skewed Distribution: An asymmetrical distribution curve created when scores cluster heavily at one end of the scale.

• Positive Skew (Right Skew):

  • Contains a long tail extending toward the higher values on the right side of the distribution.

  • Mathematical order of central tendency: $\text{Mode} < \text{Median} < \text{Mean}$.

• Negative Skew (Left Skew):

  • Contains a long tail extending toward the lower values on the left side of the distribution.

  • Mathematical order of central tendency: $\text{Mean} < \text{Median} < \text{Mode}$.

• Visual Direction Rule: "Follow the tail!" (The direction of the distribution's tail dictates whether the skew is positive or negative).

Inferential Statistics & Decision Criteria

• Inferential Statistics: Numerical methodologies that determine whether sample findings can be generalized to draw conclusions about a broader target population.

• Generalizability Criteria:

  • Representative samples are far superior to biased or unrepresentative samples.

  • Large sample sizes are far superior to small sample sizes.

  • Multiple empirical studies/estimates are superior to single observations.

• Meta-Analysis: A comprehensive statistical procedure that synthesizes and analyzes data from multiple independent studies to derive an overall conclusion.

• Statistical Significance ($p$-value):

  • Definition: The statistical likelihood that an observed experimental outcome occurred due to the manipulation of the independent variable rather than pure random chance.

  • Standard Threshold: Results are considered statistically significant when the probability value is $p \le 0.05$

  • Interpretation: A value of $p \le 0.05$ indicates there is at most a $5\%$ likelihood the results occurred by chance, giving researchers $95\%$ confidence that the independent variable caused the change in the dependent variable.

• Effect Size: A quantitative metric indicating the absolute strength of the relationship between two variables. Larger effect sizes demonstrate that changes in one variable explain a larger portion of variance in the other.

Mathematical Foundations & Reference Formulas

• Kinematic & Physical Expressions:

  • $F = b h$

  • $F = m a$

  • $Q = m c \Delta T$

• Calculus & Function Limits:

  • $\lim_{\Delta y \rightarrow 0}$

  • $f(x) = (x - x_1)(x_2)$

  • $f(x + \Delta y)$

  • $h = \sqrt{\alpha}$

  • $\int \text{erf}(x)\,dx$

  • $e^x$

• Trigonometric Sum Formulas:

  • $\cos(\alpha) + \cos(\beta)$

  • $\sin(\alpha) + \sin(\beta) = 2 \sin\left(\frac{\alpha + \beta}{2}\right) \cos\left(\frac{\alpha - \beta}{2}\right)$

References & Citations

• AP Psychology Material: College Board. AP Psychology – AP Students. College Board.

• Myers Textbook (11th Ed): Myers, David G. and Nathan DeWall. Exploring Psychology. 11th edition. 2019. New York: Worth.

• Myers Textbook (12th Ed): Myers, David G. and Nathan DeWall. Psychology. 12th edition. 2018. New York: Worth.

• Weiten Textbook: Weiten, Wayne. Psychology: Themes and Variations. 10th edition. 2017. Belmont, CA: Wadsworth, Cengage Learning.