Psychology Research Methods and Statistical Concepts

Critical Thinking

Thinking that does not blindly accept arguments and conclusions. Rather, it examines assumptions, appraises the source, discerns hidden biases, evaluates evidence, and assesses conclusions.

Hindsight Bias

The tendency to believe, after learning an outcome, that one would have foreseen it. (Also known as the "I-knew-it-all-along" phenomenon).

Peer Reviewers

Other scientists who are experts in the field evaluate submitted research, providing constructive criticism and ensuring scientific rigor before publication.

Theory

An explanation using an integrated set of principles that organizes observations and predicts behaviors or events.

Hypothesis

A testable prediction, often implied by a theory.

Operational Definition

A carefully worded statement of the exact procedures (operations) used in a research study. For example, human intelligence may be operationally defined as what an intelligence test measures.

Replication

Repeating the essence of a research study, usually with different participants in different situations, to see whether the basic finding extends to other participants and circumstances.

Case Study

A descriptive technique in which one individual or group is studied in depth in the hope of revealing universal principles.

Naturalistic Observation

A descriptive technique of observing and recording behavior in naturally occurring situations without trying to manipulate or control the situation.

Survey

A descriptive technique for obtaining the self-reported attitudes or behaviors of a particular group, usually by questioning a representative, random sample of the group.

Social Desirability Bias

The tendency of survey respondents to answer questions in a manner that will be viewed favorably by others, often overreporting desirable behaviors and underreporting undesirable ones.

Self

Report Bias - A general term referring to inaccuracies or distortions in data collected from self-report measures (like surveys), often due to factors like social desirability bias, memory errors, or lack of insight.

Sampling Bias

A flawed sampling process that produces an unrepresentative sample.

Random Sample

A sample that fairly represents a population because each member has an equal chance of inclusion.

Population

All those in a group being studied, from which samples may be drawn. (Note: Except for national studies, this does not refer to a country's whole population).

Correlation

A measure of the extent to which two factors vary together, and thus of how well either factor predicts the other.

Correlation Coefficient

A statistical index of the relationship between two things (from -1.00 to +1.00).

Variable

Anything that can vary and is feasible and ethical to measure.

Scatterplot

A graphed cluster of dots, each of which represents the values of two variables. The slope of the points suggests the direction of the relationship between the two variables. The amount of scatter suggests the strength of the correlation (little scatter indicates high correlation).

Illusory Correlation

Perceiving a relationship where none exists, or perceiving a stronger-than-actual relationship.

Regression Toward the Mean

The tendency for extreme or unusual scores or events to fall back (regress) toward the average.

Experiment

A research method in which an investigator manipulates one or more factors (independent variables) to observe the effect on some behavior or mental process (the dependent variable). By random assignment of participants, the experimenter aims to control other relevant factors.

Experimental Group

In an experiment, the group exposed to the treatment, that is, to one version of the independent variable.

Control Group

In an experiment, the group not exposed to the treatment; contrasts with the experimental group and serves as a comparison for evaluating the effect of the treatment.

Random Assignment

Assigning participants to experimental and control groups by chance, thus minimizing preexisting differences between the different groups.

Single

Blind Procedure - A procedure in which the research participants are unaware of whether they are in the experimental or control group, but the research staff are aware.

Double

Blind Procedure - An experimental procedure in which both the research participants and the research staff are ignorant (blind) about whether the research participants have received the treatment or a placebo. Commonly used in drug-evaluation studies.

Placebo Effect

Experimental results caused by expectations alone; any effect on behavior caused by the administration of an inert substance or condition, which the recipient assumes is an active agent.

Independent Variable (IV)

In an experiment, the factor that is manipulated; the variable whose effect is being studied.

Confounding Variable

In an experiment, a factor other than the independent variable that might produce an effect.

Experimenter Bias

A phenomenon that occurs when a researcher's expectations or preferences about the outcome of a study influence the results. It can be conscious or unconscious and can lead to unintentional cues or errors in data collection or interpretation.

Dependent Variable (DV)

In an experiment, the outcome that is measured; the variable that may change in response to manipulations of the independent variable.

Validity

The extent to which a test or experiment measures or predicts what it is supposed to.

Quantitative Research

Research that focuses on collecting and analyzing numerical data, often using statistical methods to generalize findings from a sample to a larger population.

Qualitative Research

Research that focuses on understanding experiences, perspectives, and meanings, often through methods like interviews, observations, or case studies, yielding rich descriptive data rather than numerical data.

Informed Consent

Giving potential participants enough information about a study to enable them to choose whether they wish to participate.

Debriefing

The postexperimental explanation of a study, including its purpose and any deception, to its participants.

Descriptive Statistics

Numerical data used to measure and describe characteristics of groups. Includes measures of central tendency and measures of variation.

Histogram

A bar graph depicting a frequency distribution.

Mode

The most frequently occurring score(s) in a distribution.

Mean

The arithmetic average of a distribution, obtained by adding the scores and then dividing by the number of scores.

Median

The middle score in a distribution; half the scores are above it and half are below it.

Percentile Rank

The percentage of scores in a distribution that fall below a particular score.

Skewed Distribution

A representation of scores that lack symmetry around their average value.

Range

The difference between the highest and lowest scores in a distribution.

Standard Deviation

A computed measure of how much scores vary around the mean score.

Normal Curve

A symmetrical, bell-shaped curve that describes the distribution of many types of data; most scores fall near the mean (about 68 percent within one standard deviation of it) and fewer and fewer near the extremes.

Inferential Statistics

Numerical data that allow one to generalize—to infer from sample data the probability of something being true of a population.

Meta

Analysis - A statistical procedure for analyzing the results of multiple studies to arrive at an overall conclusion.

Statistical Significance

A statistical statement of how likely it is that an obtained result occurred by chance.

Effect Size

The magnitude of a relationship between two or more variables, or the magnitude of a difference between two or more groups. It indicates the practical significance of a research finding.