SPE 525: Measurement & Exp design

3 goals of science

Description

Prediction

Control

Goals of science/type of research studies

How to become a consumer of science

High quality research

Peer reviewed

Objective measurement

Replication

Experimental control

Data-based conclusions

Transparent methods

Weak evidence

Limited review

Inconsistent measurement

Few replications

Limited control

Overstated conclusions

Missing details

Pseudoscience

No scientific review

Anecdotes only

Cannot be replicated

No control of variables

Extraordinary claims

“Trust me bro” evidence

Evidence-based practices include…

Replication

High-quality research

Peer review

What makes a practice evidence-based?

Group designs vs single-case vs combination

What do single case research designs aim to answer?

How do we know that something we did cause behavior change?

This is done by analyzing changes in the dependent variable and based on manipulation of the independent variable

Single Case research designs (SCRD) might ask questions about…

• whether or not an intervention changes a bx

• Whether one intervention changes up behavior, more or faster than another

• Which parts of an intervention produce greater or faster behavior change

• How much of an intervention leads to greater or faster behavior change

What are the four types of single Case research questions?

• demonstration = does it work?

• Comparison = which works better?

• Component analysis = which part works?

• Parametric analysis = how much is needed?

Single-case research design (SCRD) is only concerned with intervention research so your question has to be one of the four questions

• does x change y?

• Does w change x or change y more?

• Which part of x changes y more?

• How much of x changes y more?

Independent variable (IV)

Has to do with intervention

The variable in an experiment that is manipulated or changed by the researcher

Dependent variable (DV)

Has to do with the behavior

The thing you’re measuring in a study

Demonstration SCRD question

Does the IV change the DV?

Comparison SCRD question

Does IV1 or IV2 change the DV more?

Component SCRD question

What part of the IV changes the DV more?

Parametric SCRD question

How much of the IV changes the DV more?

Single case research designs (SCRD)

• each individual serves as both the control and the experimental group

• Data is collected and analyze the floor treatment during the baseline and during treatment/during intervention rather than after

• Changes to behavior during the intervention suggest the treatment/intervention was the source of those changes. But it is not conclusive without verification and replication.

Group designs

• use statistical analysis to compare two or more groups

• They have an experimental group in a control group (think to psychology undergrad)

• Analysis is conducted after treatment to measure any changes

• Changes in the experimental, but not the control group suggest that the intervention or treatment was the source of those changes

Experimental control

We want to be able to say with confidence that it is our intervention that is controlling the behavior

What is functional relation?

The establishment of experimental control there is a functional relation between the intervention and the behavior

Baseline logic involves what type of analysis of data?

Visual analysis to determine if there is prediction and more importantly replication