Research Methods Module 1 Notes

Chapter 3: Role of Assessment in Applied Behavior Analysis

Role of Assessment in Applied Behavior Analysis (1 of 2)

  • Definition and Purpose of Behavioral Assessment

    • Behavioral assessment includes both indirect and direct procedures such as interviews, checklists, and tests to identify and define specific target behavior.

    • Goal of Behavioral Assessment:

    • To identify environmental variables related to increases or decreases of target behavior.

    • To discover the function that behavior serves in an individual's environment.

Phases of Behavioral Assessment

  • Screening: Initial assessment to determine concerns.

  • Defining and Quantifying Problems: Establishing clear outcome criteria.

  • Pinpointing Target Behaviors: Identifying specific behaviors for intervention.

  • Monitoring Progress: Tracking changes in behavior over time.

  • Following Up: Evaluating the effectiveness of interventions.

Role of Assessment in Applied Behavior Analysis (2 of 2)

  • Preassessment Considerations

    • Address two fundamental questions before conducting an assessment:

    1. Who has the authority, permission, resources, and skills to assess and intervene with the client?

    2. What existing records or data can provide insights into past identification, treatment, and evaluation of the target behavior?

  • Applied Behavior Analysts Must:

    • Recognize the role of assessment within the four-stage continuum of assessment-planning-implementation-evaluation.

    • Acknowledge personal, social, and environmental factors that influence behavior.

Indirect Assessment

Indirect Assessment (1 of 4)

  • Methods Include:

    • Interviews, checklists, and rating scales are indirect assessment approaches.

    • Data obtained from these methods are based on recollections, reconstructions, and/or subjective, ordinal-scale ratings of events.

    • Formats: Include both open-ended and closed-ended questions.

Indirect Assessment (2 of 4)

  • Interviewing the Client

    • This is often the first and most vital step in identifying potential target behaviors.

    • Differences from Traditional Interviews:

    • Focus on specific "What" and "When" questions.

    • Emphasis on environmental conditions surrounding behavioral episodes.

Indirect Assessment (3 of 4)

  • Interviewing Significant Others

    • Significant others help describe the problem in specific terms regarding behaviors and associated environmental conditions.

    • Gather insights on the capacity and willingness of significant others to implement interventions.

    • Useful for selecting and defining target behaviors and identifying possible interventions.

Indirect Assessment (4 of 4)

  • Checklists and Rating Scales

    • A behavior checklist provides a description of specific behaviors and the conditions in which they occur.

    • A rating scale quantifies target behaviors of interest using an ordinal scale.

Direct Assessment

Direct Assessment (1 of 3)

  • Methods Include:

    • Tests and direct observations yield measurable and validated information about learner’s behavior:

    • Standardized Tests: Same questions and tasks using consistent procedures with identical scoring criteria.

    • Criterion-Referenced Assessment: Measures skill performance against recognized developmental milestones.

    • Curriculum-Based Assessment: Data pertains to tasks performed in response to planned lessons.

Direct Assessment (2 of 3)

  • Direct Observations

    • Involves repeated observations of client behavior in natural environments.

    • Useful for determining target behaviors to assess.

    • Basic Form of Direct Observation:

    • ABC/Anecdotal Observation:

      • Observer records a descriptive, temporally sequenced account of behaviors of interest, antecedent conditions, and consequences as they occur.

Direct Assessment (3 of 3)

  • Ecological Assessment:

    • Recognizes the complex interrelationships between environment and behavior.

    • Gathers extensive information about the person and their various living/work environments.

Defining Target Behaviors

  • Clarity in Target Behavior Definition:

    • Must be clear, objective, and concise for effective analysis.

    • Analysts should consider both functional and topographical implications.

Role and Importance of Target Behavior Definition in Applied Behavior Analysis

  • Consequences of Poor Definitions:

    • Lack of explicit definitions can hinder accurate measurement of response classes across studies.

    • Accurate definitions are essential to aggregate, compare, and interpret data.

  • Characteristics of Good Behavioral Definitions:

    • Operational: Provides complete information about behavior occurrence/non-occurrence.

    • Increases likelihood of accurate evaluations of program effectiveness.

Two Types of Behavior Definitions (1 of 2)

  • Function-based Definition:

    • Defines responses based on common effects on the environment.

    • Example: Hand mouthing is defined as any behavior resulting in "contact of fingers, hand, or wrist with mouth, lips, or tongue."

    • Focuses on outcomes rather than forms of behavior.

Two Types of Behavior Definitions (2 of 2)

  • Topography-based Definition:

    • Identifies target behavior by its shape or form.

    • Utilized when function is not easily observable or when undesirable variations occur alongside desired outcomes.

Writing Target Behavior Definitions

  • Characteristics of Effective Definitions:

    • Must be:

    • Objective: Based solely on observable characteristics.

    • Clear: Readable and unambiguous descriptions.

    • Complete: Specifies boundaries for inclusion/exclusion of instances.

Chapter 4: Measuring Behavior

  • Importance of Measurement:

    • Direct and frequent measurement is foundational for applied behavior analysis.

    • Measurement is used to assess effects of environmental arrangements on:

    • Acquisition

    • Maintenance

    • Generalization of socially significant behaviors.

Measurable Dimensions of Behavior

  • Three Fundamental Quantities:

    • Repeatability: Behaviors can occur repeatedly over time.

    • Temporal Extent: Every behavior instance has a duration.

    • Temporal Locus: Every behavior instance occurs at a specific point in time.

Measures Based on Repeatability

  • Definitions and Importance:

    • Count: A straightforward tally of behavior occurrences; however, may lack sufficient information for program analysis.

    • Rate: Number of responses per unit time (e.g., count per minute), one of the most widely used measures in behavior analysis.

Celeration

  • Definition: Celeration measures changes in response rates over time.

  • Terminology: Use acceleration (increasing rates) or deceleration (decreasing rates) to describe changes.

  • Standard Celeration Chart: Standard format for displaying celeration measures.

Measures Based on Temporal Extent

  • Duration: Basic measure from onset to endpoint of a behavior.

  • Types of duration measures:

    • Total Duration per Session: Cumulative time of engagement during an observation.

    • Duration per Occurrence: Time each instance of behavior occurs.

Measures Based on Temporal Locus

  • Temporal Locus Defined:

    • Refers to when a behavior occurs concerning other events.

    • Measures latency (time from stimulus onset to response) and interresponse time (IRT).

Latency

  • Definition: Measure of elapsed time from stimulus onset to target behavior response.

  • Reporting: Typically as mean, median, and range of latencies per observation period.

Interresponse Time (IRT)

  • Definition: Time between two consecutive instances of behavior.

  • Relevance: Shorter IRT is associated with higher response rates; longer IRT with lower rates.

Derivative Measures

  • Commonly Used Measures:

    • Percentage: Ratio formed by combining same dimensional quantities.

    • Trials-to-Criterion: Measures response opportunities required to meet a predetermined performance level.

Definitional Measures

  • Topography: Measures physical form or shape of behavior.

  • Magnitude: Relates to force or intensity of a response.

Methods for Measuring Behavior

  • Event Recording: Observing and recording frequency of behavior occurrences.

  • Timing: Encompasses duration, latency, and IRT measurements.

  • Time Sampling: Observing behavior at planned time intervals.

Time Sampling Methods

  • Whole-Interval Recording: Measure if behavior occurred throughout intervals.

  • Partial-Interval Recording: Record if behavior occurred at any time during the interval.

  • Momentary Time Sampling: Record occurrence at the moment intervals end.

  • Planned Activity Check (Placheck): Measures group behavior using head counts.

Measuring Behavior by Permanent Products

  • Definition: Observing changes in the environment after behavior occurrence.

  • Types of Products: Permanent products can be natural or contrived outcomes.

Chapter 5: Valid, Accurate, and Reliable Measurement

Measurement Qualities

  • Validity: Data is meaningful for the purpose for which measurement was conducted.

  • Accuracy: Data is correct as per measuring criteria.

  • Reliability: Consistency of measurement under repeated assessments.

Assessing Reliability of Measurement

  • Reliability Established Through:

    • Repeat measures yielding same results, with a focus on consistent observation patterns.

Interobserver Agreement to Assess Measurement

  • Interobserver Agreement (IOA): Measures consistency among observers.

    • Represents measurement quality, assessed by consensus among multiple observers.

Equations for Various Types of Interobserver Agreement (IOA)

  • Common Types and Their Equations:

    • Total Count: Average of IOA across intervals.

    • Exact Count-per-Interval: Agreement noted for each observation interval.

    • Interval-by-Interval: Proportion of agreed intervals over total observed intervals.

    • Scored-Interval: Ratio of intervals recording occurrence similarity.

    • Unscored-Interval: Consistency in non-occurrences across observers.

  • Each type of IOA indicator contributes to the overall strength and validity of behavioral measurement in practice, ensuring data-driven decision-making in applied behavior analysis.