Experimental Design

The primary objective of experimental design is to establish a rigorous framework for identifying cause-and-effect relationships between variables.
An experiment involves the systematic manipulation of one or more variables to observe the resulting impact on a specific outcome, while simultaneously controlling for potential confounding factors.
The foundational pillars of a true experiment are manipulation, control, and random assignment.

Independent Variable (IV): This represents the factor that the researcher deliberately manipulates or changes to observe its effect. It is the hypothesized "cause" in the relationship being studied. In factorial designs, an experiment may have multiple independent variables, often referred to as factors.
Dependent Variable (DV): This is the outcome or response being measured by the researcher. It is the hypothesized "effect" that depends on the variations in the independent variable.
Control Variables: These are specific factors that are intentionally held constant throughout the experiment. By ensuring these variables do not change, researchers can be more confident that the observed changes in the dependent variable are solely due to the manipulation of the independent variable.
Extraneous Variables: These are any variables that are not of interest to the researcher but could potentially affect the results of the study. If these variables are not properly controlled, they can become confounding variables.
Confounding Variables: A subset of extraneous variables that correlate (directly or inversely) with both the independent and dependent variables. They provide alternative explanations for the experimental results, thereby threatening the internal validity of the study.

Hypothesis Formulation: Every experimental design begins with a testable prediction.
Null Hypothesis ( $H_0$ ): This hypothesis posits that there is no statistically significant relationship or difference between the experimental groups. Any observed differences are attributed to chance or sampling error.
Alternative Hypothesis ( $H_1$ ): This hypothesis predicts that the manipulation of the independent variable will result in a significant effect on the dependent variable.
Significance Level ( $\alpha$ ): The threshold used to determine whether to reject the null hypothesis. The standard convention in most scientific disciplines is $\alpha = 0.05$ , meaning there is a $5\%$ risk of concluding a difference exists when it actually does not (Type I Error).
p-Value: The probability of obtaining the observed results, or more extreme results, assuming the null hypothesis is true. A result is considered statistically significant if the p-value is less than the predetermined alpha level ( $p < 0.05$ ).
Type I Error ( $\alpha$ ): Occurs when the researcher incorrectly rejects a true null hypothesis (a "false positive").
Type II Error ( $\beta$ ): Occurs when the researcher fails to reject a false null hypothesis (a "false negative").

Internal Validity: This refers to the degree of confidence that the causal relationship being tested is trustworthy and not influenced by other factors or variables. High internal validity implies that the experimental design has successfully eliminated confounding variables.
External Validity: This refers to the extent to which the results of a study can be generalized to other settings (ecological validity), other people (population validity), or over time (historical validity).
Construct Validity: This assesses whether the operational definitions and measures used in the study actually represent the theoretical concepts they are intended to measure.
Reliability: This is the measure of consistency and stability. An experimental procedure is considered reliable if repeating the study under identical conditions yields similar results over time.

Between-Subjects Design (Independent Measures): In this design, different groups of participants are assigned to different levels of the independent variable. This ensures that the experience of one condition does not influence the performance in another, though it requires a larger number of participants to account for individual differences.
Within-Subjects Design (Repeated Measures): The same participants are exposed to all levels or conditions of the independent variable. While this controls for individual differences (using participants as their own control), it is susceptible to order effects.
Counterbalancing: A technique used in within-subjects designs to combat order effects (such as practice effects or fatigue) by varying the order in which participants experience the different experimental conditions.
Random Assignment: The process of assigning participants to experimental or control groups purely by chance. This is crucial for ensuring that groups are equivalent at the start of the study, thereby minimizing the impact of participant-related confounding variables.
Factorial Design: A sophisticated design that allows researchers to study the effects of two or more independent variables simultaneously. For example, a $2 \times 2$ factorial design examines two independent variables, each with two levels, resulting in four distinct experimental conditions.

Single-Blind Study: A procedure where the participants do not know whether they are in the experimental group or the control group. This is used to prevent participant expectations or demand characteristics from influencing the results.
Double-Blind Study: A rigorous procedure where neither the participants nor the research staff interacting with them know which participants belong to the experimental or control groups. This is the gold standard for eliminating both participant bias and researcher expectancy bias.
Placebo Effect: A phenomenon where participants experience an improvement or change in their condition simply because they believe they are receiving a treatment. To control for this, the control group is often given a placebo (an inert substance or mock treatment).
Ethical Compliance: All experimental designs must adhere to ethical standards, including obtaining informed consent, providing a thorough debriefing, ensuring participant anonymity or confidentiality, and receiving approval from an Institutional Review Board (IRB).