Unit 0 Research Methods Mini-Test Study Guide

Experimental Research Principles and Variables

• Experimental Research Definition: A rigorous research methodology in which an investigator directly manipulates one or more factors (independent variables) to observe the precise effect on a behavior or mental process (dependent variable), while controlling extraneous factors through techniques such as random assignment. Experimental research is unique because it is the only research design capable of establishing direct cause-and-effect relationships.
• Independent Variable (IV): The experimental factor that is directly manipulated, altered, or controlled by the experimenter to test its specific impact on an outcome. It represents the hypothesized cause in a causal relationship.
• Dependent Variable (DV): The factor that is measured, observed, or recorded by the researcher to evaluate the effect of the independent variable. It represents the hypothesized outcome or effect, which changes in response to manipulations of the independent variable.
• Operational Definitions: Explicit, clear, and standardized statements detailing the exact operations, procedures, tools, and precise measurements used to define abstract research variables.
  • Purpose: Ensures that unobservable or abstract psychological constructs (such as "aggression," "intelligence," "anxiety," or "memory performance") are quantifiable, measurable, and perfectly replicable by independent researchers.
  • Example: Defining "academic performance" operationally as "the numerical score obtained on a 50-item standardized multiple-choice examination" rather than leaving it as a vague concept like "how smart a student is."
• Control Group: The comparison baseline group of participants in an experiment who do not receive the experimental treatment or manipulation, or who receive a baseline version of the independent variable. It provides a baseline for evaluating the true effectiveness of the treatment.
• Experimental Group: The group of participants in an experiment who are exposed to the independent variable, active manipulation, or specific condition being tested.
• Random Selection: A sampling procedure ensuring that every individual within a specified target population has an equal, non-zero probability of being chosen to participate in the study.
  • Purpose: Produces a representative sample that reflects the demographic and individual characteristics of the broader population, thereby maximizing external validity and generalizability.
• Representative Sample: A carefully selected subgroup of a population that accurately mirrors the key demographic, social, and individual characteristics (such as age, sex, ethnicity, and socioeconomic status) of the target population as a whole.
• Random Assignment: The technique of placing selected participants into either the experimental group or the control group entirely by chance (such as through a random number generator or a coin flip).
  • Purpose: Minimizes pre-existing individual differences between groups prior to the intervention, thereby controlling for participant-relevant confounding variables (e.g., baseline intelligence, motivation, personality) and maximizing internal validity.
• Confounding Variables (Extraneous Variables): Any uncontrolled or extraneous factors other than the independent variable that vary systematically across conditions, potentially causing an observed change in the dependent variable and rendering causal conclusions invalid.
  • Situational Confounds: Environmental factors such as room temperature, ambient noise, lighting, or time of day.
  • Participant Confounds: Pre-existing individual differences such as intelligence, fatigue, prior experience, or baseline emotional states.

Experimental Controls, Blinding, and the Placebo Effect

• Single-Blind Experiment: An experimental design in which the participants are kept completely unaware (blind) of whether they are receiving the active experimental treatment or a baseline/placebo treatment, while the researchers remain aware of group assignments.
  • Purpose: Eliminates participant expectancy bias, social desirability bias, and demand characteristics.
• Double-Blind Experiment: An experimental design in which both the research participants and the experimenters/staff who interact with them or evaluate the outcomes are kept completely unaware (blind) of condition assignments.
  • Purpose: Eliminates both participant expectancy bias and experimenter bias (unintentional behavioral cues, differential treatment, or subjective rating biases by researchers).
• Placebo: An inert, inactive, or sham substance, intervention, or procedure (such as a sugar pill, saline solution, or sham therapy) designed to mimic an active treatment without containing any active medicinal or therapeutic properties.
• Placebo Effect: A observable change, improvement, or physiological/psychological response in a participant resulting entirely from their conscious expectation or belief in the efficacy of a treatment, rather than from any active properties of the intervention itself.

Correlational Research and Statistical Coefficients

• Correlational Research: A non-experimental research design that measures the mathematical degree of relationship or statistical association between two or more naturally occurring variables without manipulating them.
  • Fundamental Axiom: Correlation indicates relationship, direction, and predictive strength, but correlation does not equal causation. An observed relationship between two variables does not prove that one variable causes the other, as unmeasured third variables may be responsible.
• Positive Correlation: A relationship between two variables in which both variables move in the same numerical direction. As the value of one variable increases, the value of the other variable increases; as one decreases, the other decreases.
  • Example: The relationship between time spent studying and overall exam scores.
• Negative Correlation: A relationship between two variables in which they move in inverse or opposite directions. As the value of one variable increases, the value of the other variable decreases.
  • Example: The relationship between time spent playing video games and academic performance scores.
• Illusory Correlation: The cognitive perception of a statistical relationship or association between two variables where no actual relationship exists, or where the relationship is far weaker than believed.
  • Mechanism: Frequently driven by confirmation bias, selective recall, or vivid pairing of rare events (e.g., believing that joint pain reliably predicts rain).
• Correlation Coefficient ($r$): A standardized statistical measure that quantifies both the direction and numerical strength of a linear relationship between two quantitative variables.
  • Mathematical Boundaries: The coefficient value $r$ strictly ranges from $-1.00$ to $+1.00$.
  • Sign / Direction: A positive sign ($r > 0$) indicates a positive correlation, whereas a negative sign ($r < 0$) indicates a negative correlation.
  • Absolute Value / Strength: The magnitude of the absolute value ($|r|$) represents relationship strength. A value of $|r| = 1.00$ denotes a perfect linear relationship, values from $|r| = 0.70$ to $|r| = 0.90$ denote strong relationships, values from $|r| = 0.30$ to $|r| = 0.60$ denote moderate relationships, and $r = 0.00$ denotes complete absence of a linear relationship.
• Scatterplots: Two-dimensional graphs that display paired numerical values of two variables for individual data points along a horizontal X-axis and a vertical Y-axis.
  • Evaluating Direction: Points sloping upward from left to right indicate a positive correlation; points sloping downward from left to right indicate a negative correlation; a scattered cloud with no linear trend indicates zero correlation.
  • Evaluating Strength: The closer the individual data points cluster along a straight line of best fit, the stronger the underlying correlation.

Descriptive Research Methods

• Descriptive Research: Research methodologies structured to systematically observe, describe, and document behaviors, attitudes, or mental processes as they exist, without manipulating variables or determining cause-and-effect relationships.
• Naturalistic Observation: A descriptive research technique involving the direct systematic observation and recording of subjects' natural behavior in their natural environment without intervention, interaction, or manipulation by the observer.
  • Strengths: High ecological validity; provides authentic, spontaneous context and real-world behavior.
  • Limitations: Total lack of control over extraneous variables; risk of observer bias; inability to determine causality; risk of participant reactivity (Hawthorne effect) if subjects realize they are being monitored.
• Case Study: An exhaustive, in-depth, and detailed qualitative investigation of a single individual, small group, or specific situation over an extended period, utilizing interviews, observations, psychometric testing, and medical records.
  • Strengths: Generates rich narrative data; provides unique insights into rare, complex, or ethically unrepeatable conditions (e.g., unique neurological brain injuries like Phineas Gage).
  • Limitations: Extremely low generalizability (external validity); findings from a single subject cannot be assumed to apply to the broader population; highly vulnerable to researcher bias.

Data Collection Techniques and Survey Pitfalls

• Surveys: A data collection methodology in which a representative sample of individuals responds to a structured set of written or oral questions regarding their opinions, attitudes, beliefs, or self-reported behaviors.
• Likert Scales: A standardized psychometric rating scale commonly used in questionnaires, allowing respondents to indicate their relative degree of agreement or disagreement with a statement along a symmetrical numerical continuum.
  • Structure: Typically utilizes 5-point or 7-point response continua, such as $1 = \text{Strongly Disagree}$, $2 = \text{Disagree}$, $3 = \text{Neutral}$, $4 = \text{Agree}$, and $5 = \text{Strongly Agree}$.
• Structured Interviews: A quantitative data collection method in which an interviewer administers a fixed, standardized set of predetermined questions to every respondent in an identical order without deviating from the script.
  • Strengths: High reliability, standardization, comparability, and structural control across data collectors.
• Potential Pitfalls in Survey Research:
  • Wording Effects: Subtle changes in the phrasing, wording, framing, or ordering of survey questions that dramatically alter how respondents interpret and answer them (e.g., framing an issue as "not allowing" vs. "prohibiting").
  • Social Desirability Bias: The tendency for survey respondents to answer questions in a manner that will be viewed favorably by others, leading to over-reporting of desirable traits/behaviors (e.g., exercise, charity) and under-reporting of undesirable traits/behaviors (e.g., substance use, prejudice).
  • Response Bias: Systemic tendencies for participants to respond inaccurately, dishonestly, or uncritically (e.g., agreeing with all statements regardless of content, known as acquiescence bias).

Major Psychological Perspectives

• Evolutionary Perspective: Analyzes behavior, cognition, and emotional processes in terms of their adaptive value and functional contributions to survival and reproductive success over human evolutionary history, grounded in principles of Natural Selection.
• Cognitive Perspective: Focuses on mental processes—specifically how human beings perceive, process, store, retrieve, organize, and use information, language, memory, problem-solving, and reasoning.
• Psychodynamic Perspective: Grounded in the foundational work of Sigmund Freud; emphasizes the powerful influence of unconscious drives, inner instinctual conflicts, early childhood experiences, and hidden motives on human behavior and personality development.
• Behavioral Perspective: Focuses strictly on observable, quantifiable behaviors and the environmental learning processes—such as classical conditioning, operant conditioning, reinforcement, and punishment—that shape, maintain, and alter behavior, explicitly rejecting unobservable mental states.
• Sociocultural Perspective: Examines how behavior, mental processes, and identity are shaped by social environments, cultural expectations, group dynamics, social norms, ethnicity, and historical contexts across diverse societies.
• Biological (Neuroscience) Perspective: Explains psychological phenomena through underlying anatomical, physiological, genetic, and chemical mechanisms, focusing on brain structure, neural networks, neurotransmitters, hormones, and genetics.
• Humanistic Perspective: Emphasizes conscious human experience, individual potential, personal growth, self-actualization, free will, agency, and the inherent human drive toward fulfilling one's potential.

Test Reliability and Research Validity

• Reliability: The consistency, stability, and dependability of a measuring instrument or test across repeated applications or across different observers.
  • Test-Retest Reliability: The consistency of results obtained when the exact same test is administered to the same group of individuals at two different points in time.
  • Inter-Rater Reliability: The level of agreement or consistency between independent observers or raters who evaluate or score the same set of behaviors or responses.
  • Internal Consistency: The degree to which all individual items on a single test measure the same underlying construct or domain.
  • Alternate-Form Reliability: The consistency of results between two different, equivalent versions of the same test.
• Validity: The extent to which a test, instrument, or experimental design accurately measures or accomplishes what it claims or intends to evaluate.
  • Internal Validity: The degree of experimental rigor ensuring that observed changes in the dependent variable are uniquely and indisputably caused by the independent variable, free from confounding variables.
  • External Validity: The extent to which experimental findings can be generalized beyond the immediate laboratory setting to real-world environments, distinct populations, and different times.
  • Construct Validity: The extent to which an operationalized test or measurement accurately captures the theoretical construct it was designed to measure.
  • Face Validity: The superficial appearance or extent to which a measurement instrument seems "on the surface" to measure what it purports to measure.
  • Predictive Validity: The degree to which a test score accurately forecasts or predicts a future performance, outcome, or behavior (e.g., standardized college entrance tests predicting first-year grade point average).
• Interrelationship: High reliability is a necessary prerequisite for validity; however, reliability alone does not guarantee validity. A scale that systematically overstates weight by $10\,\text{lbs}$ is highly reliable (consistent) but invalid (inaccurate).

Cognitive Biases in Research

• Cognitive Bias: A systematic, predictable deviation from objective, rational, or logical judgment and decision-making in human cognitive processing.
• Confirmation Bias: The cognitive tendency to actively search for, interpret, favor, and recall information that confirms or supports pre-existing beliefs, hypotheses, or expectations, while actively ignoring, discounting, or misinterpreting contradictory evidence.
• Hindsight Bias: The cognitive tendency for individuals to overestimate their ability to have predicted an event after the outcome is already known, commonly described as the "I-knew-it-all-along" phenomenon.
• Overconfidence Bias: The tendency for individuals to overestimate the accuracy, precision, or reliability of their own knowledge, judgment, beliefs, and performance relative to actual objective benchmarks.