Direct Behavioral Assessment — Comprehensive Notes (Lecture Transcript)

Direct Behavioral Assessment — Comprehensive Notes (Lecture Transcript)

Direct vs Indirect Assessment

• Assessment aims: observe and measure behavior as it occurs in the natural environment. Direct assessment involves watching the behavior in real time where it happens.
• Indirect assessment (contrast): information gathered through interviews, reports from others, self-reports, questionnaires, etc. Not observing the behavior directly.
• Key distinction: Direct assessment yields observations of the behavior as it occurs; indirect relies on others’ or the subject’s reports and perspectives.

Advantages of Direct Assessment

• Primary advantage: more accurate information about the target behavior because data come from actual observations in context.
• Observers record behavior as it naturally occurs, reducing reliance on memory or secondhand reports.

Disadvantages of Direct Assessment

• Time-consuming: recording directly can require substantial observer time, especially for sporadic or infrequent behaviors.
• Observer training: observers must be trained and familiar with target behaviors and recording methods; inadequate training increases recording error.
• Limitations for covert behaviors: internal thoughts, feelings, or covert processes are not directly observable; indirect assessment is needed to capture those facets.

Direct assessment is the focus when planning and evaluating behavior change, with indirect forms providing supplementary information.

Operationalizing Target Behavior (Part One of Project)

• When addressing an excess (behavior occurs too often): you must specify a replacement (deficit) behavior to occur instead. Define exactly what the target behavior looks like in observable terms.
• When addressing a deficit (behavior occurs too infrequently): focus on increasing the target behavior. Operationalize what a successful occurrence looks like.
• Dual goals and replacement: Always consider a replacement behavior for excess; operationalize both the target behavior and the replacement.
• Examples from transcript:
  • Reducing time spent on streaming platforms (e.g., Twitch, YouTube): define what counts as the target behavior (watching sessions) and a replacement behavior (reading for pleasure).
  • Increasing reading for pleasure: define what a reading session is (e.g., 30-minute session sitting with a book).
• Session definition: to compare across observations, define what constitutes a “session” (e.g., a reading session) so observers know when to count a behavior as occurring.
• What to include in Part One:
  • Clear description of target behavior(s) and replacement behavior(s)
  • How observers would recognize the behavior when it occurs
  • Goals for behavioral change (target and replacement)
  • Rationale for choosing the target and replacement
  • Basic information about prior attempts to modify the behavior (if any)
• Length and formatting guidance:
  • The description should be between half-page and a full page long for clarity.
  • Double-space the document (for readability and track changes).
  • Font: Times New Roman or Arial (12 pt acceptable).
  • Tracking changes is encouraged to show edits.
• What’s not included in Part One:
  • Details about how you will change the behavior or which reinforcers you will use (these appear in a later step – baseline report).
  • Complete intervention plan specifics yet; focus is on definition, goals, observation targets, and rationale.
• Previous attempts (contextual data):
  • If you’ve tried to modify the behavior before, summarize general information about those attempts (not necessarily dates).
  • These data help evaluate what approaches have or have not worked in the past.

Direct Assessment: Concepts and Characteristics of Behavior

• Observed data are categorized along several potential characteristics. The transcript emphasizes that, for many projects in this course, the most common target is the Amount of a behavior.
• The three broad categories of behavior characteristics discussed:
  1) Amount (Quantity of behavior)
  2) Topography (Form or shape of the behavior)
  3) Intensity (Strength or force of the behavior)
  4) Stimulus control (How well a stimulus evokes the behavior)
  5) Latency (Time between stimulus and response)
  6) Quality (Subjective degree of how well the behavior is done)
• While Amount is often the primary target, all categories are described to show what might be measured and how data can be represented.

Amount (Quantity) of a Behavior

• Amount refers to excess or deficit in how much a behavior is performed.
• Two main facets:
  • Frequency: the number of instances the behavior occurs in a given period.
  • Duration: how long the behavior lasts within a given period.
• Frequency details:
  • Also called the rate: e.g., "10 times per hour".
  • Useful for behaviors where the count of occurrences matters (excess or deficit).
• Duration details:
  • How long the behavior lasts; a behavior’s duration may indicate a problem if too long or too short.
  • Relative duration concept: portion of a period spent performing the behavior vs. time available.
  • Example: gym-going sessions scheduled four times a week for one hour each, but actual exercise time within those sessions may be minimal if a lot of time is spent in dressing room or chatting.
  • Relative duration = (duration of target behavior within the observation window) / (total observation window length).
• Examples of relative duration issues:
  • You may arrive at the gym four times a week for 1 hour each, but spend most of that hour socializing rather than exercising, so relative duration of actual exercise is low.
• Data sheet example (Kathy, figure skating):
  • Shows both frequency (number of jumps/spins) and duration (time spent practicing jumps/spins).
  • Observations can reveal that although time spent on jumps and spins is similar, more jumps may be performed than spins within the same time window.
  • Annotations may note time spent not actively jumping (e.g., chatting or resting) during a session.

Topography (Form) of a Behavior

• Topography refers to the form or movements involved in performing a behavior.
• Examples:
  • Driving: hand position and posture (e.g., keeping hands at ten and two, not holding a cellphone).
  • Swimming: form components of the backstroke; a checklist can specify body and limb positions.
  • Handwriting: stroke order and letter formation; staying within writing lines; pen grip.
  • Typing: whether one uses touch typing versus hunt-and-peck.
• Visual tools for topography: behavioral checklists (e.g., backstroke checklist) and functional assessment forms can capture the required moving parts.
• “Topography” is often handled via specialized checklists and observation protocols; the transcript notes that topography can be less straightforward to measure, so observers use targeted checklists to systematically capture the movement components.

Intensity (Force or Magnitude of a Response)

• Intensity describes how hard or forcefully a behavior is performed.
• Examples:
  • Loudness of speech
  • Weight lifted in strength training
• Measurement approaches depend on the behavior:
  • Objective tools: decibel meters for loudness; grip meters for grip strength.
  • Subjective tools: Likert-type scales for perceived intensity (e.g., stress intensity rated 1–10).
• The transcript describes a study where subjective stress intensity is rated by participants (1 to 10), while other physiological measures (cortisol, skin conductance) and observational data are collected.

Stimulus Control (Stimulus-Elicited Behavior) and Latency

• Stimulus control: degree to which a stimulus reliably elicits the target behavior; aim is to have the behavior occur in the presence of the stimulus and not occur in its absence.
• Examples: dog sit command; giving a specific instruction to a group or pet; classroom instructions (e.g., test-day protocol) should reliably elicit the requested behavior.
• Goal: establish a strong correlation between the stimulus and the response, often quantified by percentages or ratios of correct responses to total opportunities.
• Latency: the time between stimulus onset and the initiation of the response.
• Examples:
  • End-of-class cue should prompt packing up once the cue is given; a long latency indicates poor stimulus control or procrastination.
  • In a racing start, the time from starting sound to action (jumping in the water or starting to run).
• Latency is relevant to studying habits (reducing delay between instruction and action) and general self-regulation tasks.
• Applying stimulus control and latency: decide on a target latency or acceptable percentage of correct responses after a stimulus, and measure whether your behavior meets that criterion.
• Practical note: stimulus control can be evaluated using percentages or ratios; the required strength of correlation is a design choice (e.g., aim for 100% or a practical threshold like 90%).

Quality (How Well a Behavior Is Performed)

• Quality tends to be more subjective and relates to how well the behavior is executed.
• It often depends on meeting the standards implied by topography or duration (i.e., does the form meet a standard? Is the effort adequate?).
• In practice, quality is often anchored to the other characteristics (topography, duration, etc.).
• When focusing on quality, you should still frame it in terms of the underlying measurable characteristics (e.g., is the topography correct? Is the timing appropriate?).

Direct Assessment: Data Collection Strategies (Measurement Methods)

• The instructor emphasizes starting with the most data-rich method and then moving to less data-rich methods as needed:
  • Continuous recording: record every instance of the behavior during a specified time segment (the most data-intensive approach).
  • Example: one-minute intervals (60 seconds) in a fixed observation period; record whether the behavior occurred during each interval.
  • Rationale: best for variable-duration behaviors where the occurrence and duration may change across time.
  • Interval recording: a broad category including partial interval and whole interval recording. It is easier to implement than continuous recording and is often used when monitoring multiple sessions.
  • Interval length example: 60 seconds (one minute).
  • Partial interval recording: mark the behavior as “occurring” if it happened at any point during the interval. A single interval can be marked as the behavior occurring even if it happened only briefly.
  • Whole interval recording: mark the behavior as “occurring” only if it lasts for the entire interval. If the behavior does not last the entire interval, the interval is counted as non-occurring.
  • Practical note: partial interval recording is common; whole interval is used when duration is critical (to ensure the behavior lasts over the interval).
• Interval recording rationale:
  • Easier implementation than continuous observation, especially when monitoring long observation periods or when resources are limited.
  • Useful for estimating both frequency and duration, depending on the interval type used and what you want to capture.
• Example observations and data collection in practice:
  • A sample data sheet might track frequency (count of jumps/spins) and duration (time spent practicing each component) for a student in a skating practice session.
  • Data interpretation can reveal how practice time is allocated between different components (e.g., jumps vs spins) and whether time allocations align with performance needs.

Graphing Data: Frequency vs Cumulative Graphs

• Frequency graphs (the standard for this course):
  • X-axis represents observation sessions or time periods.
  • Y-axis represents the count of occurrences (frequency) of the target behavior within each period.
  • Data points reflect the total number of instances per period; lines connect the data points to show trends across sessions.
  • Use baseline (pre-intervention) and treatment (intervention) phases to illustrate changes in the target behavior.
• Cumulative graphs (less common in this course, but informative):
  • Each data point represents the running total of occurrences up to that session, including all prior sessions.
  • The line never goes down; it either rises or stays flat.
  • The slope indicates the rate of change: a steeper slope means a faster accumulation of occurrences; a flat slope indicates the behavior is not occurring more over time.
  • Benefits: easier to compare multiple behaviors or conditions; provides a clear view of overall change over time.
• Practical note: although cumulative graphs can be informative, the course emphasizes sticking with basic frequency graphs for project work to avoid misinterpretation and axis scaling issues when combining different measures.
• Worked examples mentioned:
  • Kathy’s figure skating data: frequency of jumps/spins across sessions, with notes on duration and time not spent performing the targeted actions.
  • Portland Public School example: reductions in disruptions under a behavior-mod program using praise as a replacement behavior; baseline vs treatment data displayed on a standard frequency graph.
  • Comparison of frequency vs cumulative graph: same data display in both formats to illustrate how the interpretation differs between a running total (cumulative) and per-period counts (frequency).
• Graph reading tips:
  • Baseline shows the target behavior before intervention; treatment shows data after intervention begins.
  • Observe whether the treatment phase produces the desired change (e.g., decreased disruptions or increased target behavior).
  • When tracking multiple components or conditions, consider using separate graphs to avoid confounding y-axes; combining different measures on a single graph can be confusing if the units differ.

Two-graph Approach for Excess and Replacement Behaviors

• For excess behaviors with a replacement, you may consider two separate graphs: one for the excess behavior (target) and one for the replacement behavior.
• Rationale: separate graphs avoid axis-scale confusion when the measures are not directly comparable (e.g., counts vs time spent).
• Alternative (less preferred in class): some instructors may allow two behaviors on the same graph, but it can be messy if measures use different units. If attempted, ensure axes are clearly labeled and interpretable.

Topography and Other Recording Tools

• When focusing on topography, use checklists or functional assessment forms to capture the form and sequence of the behavior.
• Examples of topography checklists: backstroke movement checklist; football tackle components; handwriting or typing form checklists.
• These tools help standardize what observers should look for and facilitate consistency across observers and sessions.

Stimulus Control, Latency, and Quality in Practice

• Stimulus control measurement: track how reliably a cue or stimulus elicits the target behavior and how reliably it is suppressed when the cue is absent. You can quantify this with simple percentages or ratios of correct responses out of opportunities.
• Latency measurement: measure how long after a stimulus the response occurs; shorter latency indicates better stimulus control or improved response timing.
• Quality measurement: often a more subjective judgment about how well the behavior was performed; to improve objectivity, tie quality to observable features (e.g., topography, duration, precision).

Project Implementation Notes and Instructor Guidance

• Part One submission: focus on defining behaviors, justifying choices, and describing how observers will recognize the target and replacement behaviors.
• Part Two progression: will involve conducting a baseline (direct assessment) and then monitoring treatment effects over time.
• Data display recommendations: use basic frequency graphs; consider using separate graphs for baseline and treatment when dealing with an excess vs replacement scenario.
• General classroom notes:
  • A quick quiz on stimulus control may occur during the lecture.
  • If questions arise about Part One submissions, students are encouraged to reach out to the instructor for clarification; instructor plans to be available after class for follow-up discussions.

Summary of Core Concepts to Remember

• Direct assessment yields higher-quality data than indirect assessment but is more time-intensive and requires trained observers.
• When reducing an excess, define a replacement behavior and operationalize both behaviors clearly.
• Key behavioral characteristics to consider and how they can be measured: Amount (frequency, rate, duration, relative duration), Topography, Intensity, Stimulus control, Latency, and Quality.
• Frequency graphs are the standard for project data visualization; cumulative graphs provide a running total and different interpretive insights but are less emphasized for this course.
• Interval recording offers practical data collection options (partial vs whole interval) and reduces the need for continuous monitoring, particularly for long observation windows.
• Observable, objective definitions and checklists help ensure reliability and validity of data across observers and sessions.
• Formatting and documentation expectations (double-spaced, 12-point font, clear session definitions, and a separation of target vs replacement when appropriate) facilitate readability and assessment.

LaTeX-ready formulas to know and apply

• Rate (Frequency per time):
  $r = \frac{N}{t}$
  where N is the number of occurrences and t is the observation time.
• Relative duration:
  $ext{Relative duration} = \frac{ ext{duration of target within interval}}{T_{ ext{interval}}}$
• Latency (response time after stimulus):
  $L = t<em>{ ext{response}} - t</em>{ ext{stimulus}}$
• Basic idea of frequency graph data point:
  • Each data point equals the total number of instances in the corresponding observation period.
• Interval recording definitions:
  • Partial interval: mark occurrence if the behavior happened at any time during the interval.
  • Whole interval: mark occurrence only if the behavior lasted for the entire interval.

Key examples referenced in lecture

• Watching Twitch/YouTube vs reading for pleasure: define sessions, e.g., one reading session equals 30 minutes of reading with the book in hand.
• Driving: aim for proper topography (hands on wheel, not texting) and measurement via checklist and observation.
• Gym example: distinguishing between duration of being present in gym vs actual exercise time within that period (relative duration).
• Figure skating data: interpreting jumps vs spins within a given training session and the impact of time allocation on task outcomes.
• Classroom example: using a behavior modification program to reduce disruptions through praise as a replacement behavior.

Quiz/Practice reminder

• Expect a quick quiz on stimulus control concepts and related measurement approaches during or after this lecture.