Unit 0: Research Methods and Data Interpretation

Random Sample (Representative)

Sample that fairly represents a population becuase each member has an equal chance of inclusion.

Hindsight Bias

Tendency to believe after learning an outcome that one would have foreseen it.

Overconfidence

Being more confident then correct; people think that hindsight is so obvious.

Perceiving order in random events

Finding patterns in disconnected events.

Critical Thinking

Thinking that does not blindly accept arguments and conclusions.

3 Elements of the Scientific Attitude

Curiosity, skepticism, humility

Theory

Explanation using organized information and observations to predict behaviors and events. (Supported by evidence)

Hypothesis

Testable prediction (Constructed before any research is done)

Operational Definition

Statement of procedures that identifies how variables will be measured; makes replication possible.

Replication

The process of repeating the essence of a research study, usually with different participants in different situations, to see wether the basic finding extends to other participants and circumstances.

Population

All cases in the group being studied from which samples may be drawn.

Sample

A subset of the population

Case Study

In-depth investigation; collect lengthy, detailed information about a persons background.

Survey

Use questionnaires to gather information on feelings, opinions, and behavior patterns.

Naturalistic Observation

Studying subjects without intervening directly.

Longitudinal Study

Study same group of people over an extended time period.

Cross-Sectional Study

Studies different age groups at the same time (developmental life span changes).

Structured Interviews

Interviews in which all applicants are asked the same set of standardized questions.

Correlation

A measure of the relationship between two variables (how well either factor predicts the other)

Scatterplot

Graphed cluster of dots

Positive (direct)

Two sets of scores rise or fall together.

Negative (inverse)

Two sets of scores relate inversely, one set goes up, other goes down.

Illusory Correlations

Perceived but nonexistent correlation; we notice and recall instances that confirm our belief that a correlation exists.

Random Assignment

Assigns participants to experimental and control groups by chance; minimizes preexisting differences between those assigned to different t groups.

Independent Variable

Manipulated Variable

Dependent Variable

Measured Outcome

Confounding Variables (extraneous)

Factor other than the independent variable that might affect the experiment.

Experimental Group

Group exposed to one version of the independent variable.

Control Group

Group not exposed to the treatment; comparison to experiment.

Experimental Bias

A mistake in the design of an experiment that makes a particular result more likely.

Single Blind Study

Participants are uninformed about what treatment, if any, they are receiving.

Double Blind Study

Both participants and experimenters are blind about wether the participants have received the treatment or a placebo.

Central Tendency

Helps to know something about the amount of variation in the data.

Mean

Arithmetic average; sensitive to extreme scores.

Median

Midpoint, 50th percentile; middle number in the data.

Mode

Most frequently occurring scores in distribution; can have multiple modes or no modes.

Positive Skewed Distribution

Distribution is lopsided positively; lots of low numbers.

Negatively Skewed Distribution

Distribution is lopsided negatively; lots of high numbers.

Range

Difference between highest and lowest scores in distribution.

Standard Deviation

Average distance of scores around mean; square root of variance.

Reliability

Test that yields consistent results from one time and place to another (test-retest).

Validity

Test that measures what it is set out to measure.

Inferential Statistics

Numerical data that allows one to generalize (infer) from sample data the probability of something being true of a population.

Statistical Significance

Statistical statement of how likely it is that an obtained result occurred by chance.

Meta-Analysis

A “study of studies” that combines the findings of multiple studies to arrive at a conclusion.

Effect Size

What you expect results to be with data or product.

Descriptive Statistics

Organize, summarize, describe data, frequently use graphs or charts.

Informed Consent

Ethical principle that research participants to be told enough to enable them to choose whether they wish to participate.

Do no harm

Protect

Confidentiality & Anonymity

Treat information about individual participants confidentially.

Deception & Debriefing

Post experimental explanation of study, including its purpose and any deceptions, to its participants.

Peer Review

Evaluation of scientific, academic, or professional work by others working in the same field.

Falsifiable

Capable of being disproved.

Self Report Bias

The tendency of individuals to provide inaccurate or biased information about themselves.

Representative Sample

A sample that accurately reflects the characteristics of the population as a whole.

Subject Bias

A subjects behavior changes due to believed expectations of experiment.

Demand Characteristics

Cues in an experiment that tell the participant what behavior is expected (winking, small talk, etc).

Placebo Effect

Improvement resulting from the mere expectation of improvement (fake pill).

Qualitative Research

Research that relies on what is seen in field or naturalistic settings more than on statistical.

Quantitative Research

Research that collects and reports data primarily in numerical form.

Variables

Any measurable conditions, events, characteristics, or behaviors that are controlled or observed in a study.

Regression Towards the Mean

The tendency for extreme or unusual scores to fall back (regress) toward their average.

Sampling Bias

A flawed sampling process that produces an unrepresentative sample.

Wording Effects

When a specific word used in a question affects how respondents answer the question or the order of the questions.

Treatment of animals

Researchers must ensure the “comfort, health, and humane treatment” of animals and minimize “infection, illness, and pain.”

IRB approval

The determination of the IRB that the clinical investigation has been reviewed and may be conducted at an institution within the constraints set forth by the IRB and by other institutional and federal Requirements.

Percentile Rank

The percentage of scores below a specific score in a distribution of scores.

Correlational Method

Two different variables are observed to determine wether there is a relationship between them.

Non-Experimental Method

Relationships are studied by making observations or measures of the variables of interest.

Experimental Method

A method of investigation used to demonstrate cause-and-effect relationships by purposely manipulating one factor thought to produce change in another factor.

Third variable problem

The concept that a correlation between two variables may stem from both being influenced by some third variable.

Bimodal

Distributions with two modes (2 peaks).