MacNaul et al. 2021

Literature Review of Preference Assessment Stability

Authors & Date

Hannah MacNaul1, Catia Cividini‐Motta2, Shannon Wilson2, Hunter Di Paola2Date Received: 3 November 2020Accepted: 6 May 2021DOI: 10.1002/bin.1797

Abstract

The identification of effective reinforcers is crucial for the success of interventions designed to support individuals with disabilities. Preference assessments are systematic approaches that not only identify items preferred by an individual but also contribute to the development of tailored intervention strategies. However, the stability of these preferences over time remains under-researched. This current review synthesizes findings from 20 meticulously selected studies involving preference assessments that were conducted with an inter-assessment interval (IAI) of at least 24 hours, aimed at providing a comprehensive analysis of preference stability across repeated assessments. This review meticulously explores the influence of various factors, including the length of the IAI, the assessment format utilized (e.g., paired-stimulus versus multiple-stimulus), and the type of stimulus being assessed (e.g., leisure items, edible items, and social interactions) on preference stability. Findings from this analysis indicate that preference stability is notably highest when assessments are conducted with shorter IAIs, specifically in the range of 8–30 days, and when employing a paired-stimulus assessment format. The implications for practitioners are thoroughly discussed, along with comprehensive recommendations for future research endeavors to fill existing gaps in knowledge.

Keywords

Preference assessment, stability, reinforcer, stimuli

Introduction

Behavior-analytic programming relies heavily on the integration of effective reinforcing stimuli to not only foster appropriate skill development but also mitigate disruptive behavioral patterns. This reliance underscores the need for reliable methods to ascertain an individual's preferences.

Importance of Reinforcing Stimuli

Instructional methodologies such as discrete trial teaching, natural environment teaching, and incidental teaching leverage reinforcement as a robust foundation for skill acquisition. Furthermore, behavior reduction programs fundamentally depend on the identification and application of suitable reinforcing stimuli to effectively diminish maladaptive behaviors that can impede progress.

Preference Assessments

Preference assessments serve as vital tools for identifying the stimuli preferred by individuals, thus facilitating informed treatment planning. Despite their importance, these assessments are reportedly not utilized consistently across clinical practice. Historical and current research suggests that preferences may easily shift over time, underscoring the significance of understanding the intricate factors that can precipitate such changes.

Factors Influencing Preference Stability

Several factors have been proposed to influence the stability of preferences in a nuanced manner:

• The length of time between assessments (Inter-Assessment Interval - IAI).

• Events or circumstances occurring within intervals between assessments, which may alter perceptions of preferences.

• The types of stimuli utilized (e.g., leisure stimuli versus edible items) and the various formats of assessments employed (e.g., paired-stimulus versus single-stimulus formats).

Methodology

Search Procedures

An extensive and systematic search was conducted in electronic databases, including Eric (EBSCO), PubMed, and Web of Science, concentrating exclusively on scholarly articles related to preference assessment and stability. A total of 122 articles were initially identified, of which 51 underwent thorough title-abstract reviews. Ultimately, 20 articles met the stringent inclusion criteria established for this systematic review.

Inclusion Criteria

The studies included were required to have human subjects, be peer-reviewed publications written in English, and employ direct preference assessments conducted with a minimum of two assessments spaced at least 24 hours apart. Additionally, included studies calculated correlation coefficients to ascertain the stability of preferences in a robust manner.

Descriptive Synthesis

Characteristics evaluated in the selected studies encompassed critical aspects such as participant demographics, treatment settings, the frequency of preference assessments, and the diverse types of stimuli assessed.

Results

Participant Characteristics

The review encompassed a total of 155 participants, representing a diverse demographic with varying ages and diagnoses, including common conditions such as Autism Spectrum Disorder (ASD) and Attention Deficit Hyperactivity Disorder (ADHD).

Treatment Settings

The studies were conducted across a variety of settings, including clinical environments, educational institutions, and residential facilities, with clear delineations established for the literature review to aid in understanding context-specific dynamics.

Formats of Preference Assessments

The assessments utilized included several formats, such as single-stimulus, paired-stimulus, and multiple-stimulus formats, each with distinct methodologies, implementation strategies, and outcomes. The effectiveness of these formats varied significantly, influencing the reliability of findings.

Inter-Assessment Interval (IAI)

The studies were categorized based on differing IAIs, which were classified as follows:

• 7 days or less

• 8-30 days

• 31-180 days

• Over 181 daysFindings indicated that preference stability significantly improves with shorter IAI durations, affirmatively affirming the importance of the timing of assessments.

Stability Analysis

Correlation coefficients obtained from the studies revealed a direct relationship between the stability of preferences and the various IAIs and assessment methods employed, thereby providing valuable insights into optimal assessment practices.

Discussion

Key Findings

The analysis revealed that preference stability was maximized when assessments were performed at intervals of 8-30 days, and the paired-stimulus format yielded the most reliable and consistent results across the studies reviewed. Additionally, findings emphasize the substantial impact of temporal factors and access control procedures on the stability of preferences.

Practical Implications

Clinicians are urged to systematically incorporate preference assessments into their practice, emphasizing the urgent need to consider both IAI and format types to maximize the efficacy of treatment interventions.

Research Gaps

Future research endeavors should focus on exploring the stability of preference assessments conducted over extended intervals and across varied stimulus classes to deepen the understanding of dynamic preference patterns, thereby advancing the field more effectively.

Acknowledgments

The undertaking of this research study constituted a requisite for the first author's doctoral degree.

Ethical Statement

This study did not involve any human subjects, ensuring compliance with ethical research standards.

References

The review encompasses references from diverse studies contributing valuable insights into the landscape of preference assessments and their stability over time.