1/43
Looks like no tags are added yet.
What components should be included in an operational definition?
clear, objective, and complete/conscise manner. (pg.70)
Describe the difference between Direct and indirect measures
Direct assessments are procedures that provide measurable and validated info about the learner’s behavior. Indirect assessments obtain data from recollection, reconstruction, or subjective events.
Define and list example of permanent product measures
Measuring behavior after it has occurred by observing the effects the behavior produced on the environment. Example: a completed test
Define rate of response and provide an example
a ratio of count per observation time, calculated by dividing the total number of responses emitted by the duration of the observation period. 10 instances of SIB in 2 hour session would = 5 SIB per hr
Describe percentage measure and when it would be appropriate vs not appropriate
A proportion, expressed as a number of parts per 100. Appropriate during discrete trials. It is not appropriate to assess the development of proficiency or fluency
Define the measure of duration and provide an example
The amount of time from the onset to the end point of a response. Ex: measuring how long a client’s tantrum is.
Define the measure of latency and provide an example
The elapsed time between the onset of stimulus and the initiation of a subsequent response. Ex: having a 7:00 AM alarm and waiting 30 seconds before hitting snooze. The response latency is 30 secs.
Define the measure of inter-response time (IRT) and provide an example
The amount of time that elapses between two consecutive instances of a response class. EX: answering question #1 at 7:12 and question #2 at 7:22, making the IRT 10 mins.
Describe the difference between Continuous and Discontinuous measurement
Continuous detects all instances of the target behavior during the observation period whereas discontinuous is any form of measurement in which some instances of response class(es) may not be detected.
Describe the difference between Partial and whole interval
Partial-Interval Recording: The observer records whether the target behavior occurred at any time during the interval (tends to overestimate occurrence).
Whole-Interval Recording: The observer records whether the target behavior occurred throughout the entire interval (tends to underestimate occurrence).
Momentary time sampling: Describe and provide example
A measurement method in which the presence or absence of behavior is recorded precisely at specified time intervals (e.g., exactly at the 60-second mark).
Example: Looking up at the student every 2 minutes and recording whether they are writing at that exact instant.
Define trials to criterion
A measure of the number of response opportunities needed for a person to achieve a predetermined level of performance or accuracy.
Define cost-benefit analysis
A systematic approach to evaluating the relative costs (time, effort, resources) versus the benefits (outcomes,effectiveness) of a measurement system or intervention procedure.
Describe training duration measure
The total amount of time required for a learner to achieve a specific mastery criterion or training objective.
Describe the difference between a measure of validity vs reliability
Validity: The extent to which data obtained from measurement procedures directly reflect what they are intended to measure
Reliability: The extent to which a measurement procedure yields the same value when brought into repeated contact with the same state of nature
Two observers independently collect data and agree on 95% of intervals. What concept does this demonstrate, and why is it important?
Interobserver Agreement (IOA). It demonstrates data trustworthiness, helps detect observer drift, and reduces the likelihood of observer bias.
Give an example of data collection that is reliable but invalid
Measuring the circumference of a student's head every single day when the target behavior of interest is reading fluency
Define Interobserver agreement (IOA)
The degree to which two or more independent observers report the same observed values after measuring the same events.
Why is IOA important to measure?
To establish the credibility and trustworthiness of data, evaluate new observers, detect observer drift, and ensure data are not biased.
Define Total count IOA
The percentage of agreement between the total number of responses recorded by two observers, calculated by dividing the smaller count by the larger count and multiplying by 100.
Define Mean count‑per‑interval IOA
The average percentage of agreement between the counts reported by two observers across a series of smaller time intervals.
Define Exact count‑per‑interval IOA (most stringent for counts)
The percentage of total intervals in which two observers recorded the exact same count.
Define Trial‑by‑trial IOA
Agreement score based on comparing the observers' counts or discrete responses on a trial-by-trial basis across discrete opportunities
Define Total duration IOA
Percentage of agreement computed by dividing the shorter total duration by the longer total duration and multiplying by 100.
Define Mean duration‑per‑occurrence IOA
An evaluation of duration agreement on a response-by-response basis, averaging the duration ratios for each occurrence.
Define Interval‑by‑interval (total interval) IOA
Percentage of intervals in which two observers recorded the same occurrence or non-occurrence of behavior across all intervals.
Define Scored‑interval IOA
IOA calculated only for intervals in which at least one observer recorded the occurrence of the target behavior.
Define Unscored‑interval IOA
IOA calculated only for intervals in which at least one observer recorded the non-occurrence of the target behavior.
What variables are important when selecting a measurement system?
Sensitivity, validity, reliability, logistical constraints and the behavioral dimension of interest.
What are equal-interval line graphs vs non-equal (logarithmic scale) graph
Equal-Interval Line Graph: A graph where a distance of a given length on any axis represents the same absolute amount of change.
Non-Equal (Logarithmic Scale) Graph: A graph (such as the Standard Celeration Chart) where scale divisions are scaled logarithmically, so equal vertical distances represent proportional (multiplicative/divisive) changes.
Define bar graphs and describe their potential weakness
A simple, versatile graphic format for summarizing behavioral data using vertical or horizontal bars to display discrete sets of data that are not related by a common underlying dimension by time. Weakness: It does not allow for analysis of variability, trend, or temporal sequence across sessions within a condition.
Define and give an example of cumulative records
A type of graph where the cumulative number of responses emitted is plotted on the vertical axis over time, where each response adds to the previous total. EX: Skinner's operant conditioning chamber graphs tracking cumulative lever presses
Which graph type best displays changes in behavior over sessions in a single-case design, and why?
Equal-Interval Line Graph: Because it clearly displays the relationship between the independent and dependent variables across time, allowing visual analysis of level, trend, and variability session-by-session.
On a cumulative record, what does a steep slope versus a flat line indicate about behavior?
Steep Slope: High rate of responding.
Flat Line: Zero rate of responding.
In terms of graphical analysis, define Level
Level: The value on the vertical axis around which a series of data points converge; evaluated by examining the mean,median, or range.
In terms of graphical analysis, define Trend
Trend: The overall direction taken by the data path (e.g., increasing, decreasing, zero trend).
In terms of graphical analysis, define Variability
The extent to which data "bounce around" or show different values within a condition; the frequency and degree to which multiple measures yield different outcomes.
In terms of graphical analysis, define Immediacy of effect
Immediacy of Effect: The degree to which behavior changes as soon as an independent variable is introduced or withdrawn.
In terms of graphical analysis, define Overlap
The percentage of data points in one condition that overlap or intersect with data points in the previous (or adjacent) condition.
In terms of graphical analysis, define Consistency
The degree to which similar outcomes are obtained across similar experimental conditions.
Define Procedural integrity (treatment fidelity)
The extent to which an independent variable is implemented as planned and intended.
What does Accuracy mean with regards to procedural integrity?
Whether the intervention steps and procedures were executed correctly according to the written protocol.
What does dosage mean with regards to procedural integrity?
The frequency, duration, or magnitude with which the intervention procedures are delivered.
List ways to measure procedural integrity
Direct observation, permanent product review of intervention records, self-reports, role-playing/behavioral rehearsals, and video recording reviews.