Ch 1 Notes Young:

I. General Principles and Skills

  • Overview analogy: Psychology offers many roles, but psychological assessment is the discipline’s “special forte.” Diagnostics and assessment methods are core to the field; the term “cookbook” is pejorative if it implies only rote steps; great practice teaches principles, not just recipes.
  • Principles in practice:
    • Understanding the why and how behind assessment steps enables improvisation and substitution when needed (e.g., substitute applesauce if eggs are unavailable).
    • Sequencing matters: planning the order of steps increases efficiency and data quality; enables data gathering across multiple data sources (at least three courses instead of one).
    • Time adds a “special ingredient”: enables observing development and change over time, and supports individualized interventions.
    • The book’s arc follows a clinical encounter: preparation phase, prediction phase (before/after sending measures), prescription and case formulation phase (intake/evaluation), and process/progress/outcome phase (feedback and treatment monitoring).
  • Case framework:
    • Uses Ty Lee as a case to illustrate concepts; cases are fictional/composite for teaching.
  • “Vital few” concept and prevalence focus:
    • Focus on the most frequent referral issues; broad issue coverage helps four of five clients in typical clinics.
    • Cross-cutting issues (e.g., sleep, cognitive functioning) are also important.
  • Modular design:
    • Later chapters are modular but share a common layout: clinical picture, diagnostic criteria, checklists/scales, interview strategies, progress/outcome tracking.
    • Starter kits emphasize free measures with strong psychometrics and evidence bases; goal is dissemination and implementation support.
  • Open pantry metaphor:
    • A shared online pantry of tools and tools’ versions stays stocked and up-to-date, improving implementation speed.
  • Starter tools and costs:
    • Starter kits combine broad measures with focused scales to cover the vital few; options include free tools but with caveats about norms and coverage.
  • Key takeaway: assessment processes aim to be efficient, adaptable, and evidence-based, leveraging a principled understanding of why steps work and how to adapt when needed.

Prediction: Gathering Data to Guide the Evaluation

  • Two common assessment scenarios:
    • Psychological evaluation for placement, neuropsychological testing after injury, or diagnostic workups (requires a written report with results and recommendations).
    • Therapy-focused assessment (no formal report; relies on session notes and treatment plan).
  • Strategy: collect information before the first session when possible.
    • Use questionnaires, rating scales, and risk-factor checklists ahead of time or in waiting rooms.
    • We offer starter menus or a core battery (see Table 1.2).
  • Broad-band measures (multi-construct):
    • ASEBA (Achenbach & Rescorla, 2001)
    • BASC (Reynolds & Kamphaus, 2015)
    • CASI (Gadow & Sprafkin, 1994, 1997) – DSM-aligned symptom mapping
    • All have parent, teacher, and youth versions (age/reading permitting) and normative data.
    • CASI emphasizes DSM symptom mapping, with less emphasis on broad norms.
  • Costs and access:
    • These measures are relatively affordable but differ in norms, coverage, and updates; original items for ASEBA predate DSM-III; autism and bipolar coverage were historically limited.
  • Starter menus and open resources:
    • The book promotes free options where possible and maintains a free online repository of measures and scoring guidance.
  • Prediction concepts:
    • Move beyond simple cutoff reliance to probabilistic thinking and diagnostic likelihood ratios (DLR).
    • The field traces probabilistic thinking back to Bayes (1763) and Meehl (1954) and emphasizes evidence-based medicine in choosing next steps.
  • The role of probability in prediction:
    • Use the clinic’s base rate (prior probability) and assessment results to update, via likelihood ratios, the probability of a given issue.
    • Tools may rely on sensitivity/specificity or direct likelihood ratios; modern practice often uses predictive probabilities and DLRs to guide decisions.
  • Basic equations to know:
    • Prior odds: Oprior=P(A)1P(A)O_{prior} = \frac{P(A)}{1 - P(A)}
    • Likelihood ratio (LR): LR=P(DataA)P(Data¬A)LR = \frac{P(Data|A)}{P(Data|\neg A)}
    • Posterior odds: O<em>post=O</em>priorLRO<em>{post} = O</em>{prior} \cdot LR
    • Posterior probability: P(AData)=O<em>post1+O</em>post=P(DataA)P(A)P(DataA)P(A)+P(Data¬A)(1P(A))P(A|Data) = \frac{O<em>{post}}{1 + O</em>{post}} = \frac{P(Data|A) P(A)}{P(Data|A) P(A) + P(Data|\neg A) (1 - P(A))}
  • Cross-informant assessment:
    • Youth assessments typically involve at least one adult informant (parent, teacher), plus the youth.
    • Informant perspectives can diverge due to age, insight, motivation, stress, or context.
    • Agreement across informants is often modest (correlations around r ≈ 0.28 in large meta-analyses); multiple informants provide complementary information.
    • When two or three informants agree on a problem, it is usually more serious; when only one informant signals a problem, detective-work is needed to form a robust case formulation.
  • Practical takeaway:
    • Use prediction tools to generate hypotheses; during the interview, test and revise hypotheses to guide case formulation and treatment planning.

Cross-Informant Assessment

  • Biggest difference in youth vs adults: informants beyond the client are common; gather data from parents, teachers, and the youth themselves.
  • Informant dynamics:
    • Age and cognitive development affect who can provide information and how.
    • Parents are often the payers and decision-makers, which influences treatment engagement.
    • Adolescent self-reports become more viable and informative with age; parents’ stress can bias reports, sometimes leading to over-reporting.
  • Agreement and its interpretation:
    • Correlations among informants tend to be modest; when 2–3 informants agree on a problem, it strengthens the case for that problem.
    • Divergence prompts a careful formulation to reconcile differing perspectives and contexts.
  • Strategies for discordance:
    • Use a scouting report approach: testing hypotheses during the interview to determine which informants’ views align with the client’s presenting problems and goals.
    • Tailor feedback to incorporate the informants’ perspectives while remaining client-centered.

Norms and Standardization

  • Purpose of norms:
    • Allow comparison of a client to a relevant reference group; identify what is typical/atypical.
  • Important features of norms:
    • Sample size must be large enough to stabilize estimates and permit subgroup analyses (e.g., by age, sex).
    • Age bands for behavioral/mood measures are typically broad (e.g., 5+ year bands) whereas cognitive measures often require finer age segmentation (e.g., 3-month segments).
    • Some measures have separate norms for males and females, reflecting differences in behavioral distributions.
  • Scaling approaches:
    • Standard scores: M=100,  SD=15M = 100, \; SD = 15 (typical for composite ability/achievement scores).
    • T scores: M=50,  SD=10M = 50, \; SD = 10 (common for behavior scales like ASEBA, BASC).
    • Z-scores: μ=0,  σ=1\mu = 0, \; \sigma = 1 (used in many statistics contexts).
  • Percentiles and their quirks:
    • Percentiles are intuitive but can be misleading in some distributions; standardized scores are often preferred for interpretation across tests.
  • Norm-concern checklist:
    • Does the client resemble the normative sample on key constructs?
    • If not, could the discrepancy bias the interpretation of the scores?
  • Risk and protective factors, moderators, and norms:
    • Collect risk factors (e.g., self-harm ideation/behavior, threats to others, abuse) to inform safety planning and case formulation.
    • Obtain family history and other contextual information to refine probabilistic inferences and tailor treatment.

Risk and Protective Factors and Moderators

  • Risk factors to screen routinely:
    • Self-directed violence (suicidal ideation/behavior)
    • Other-directed violence (homicidal ideation/plans; impulsive aggression with weapons access)
    • Abuse (physical, sexual, neglect)
  • Safety planning:
    • Each risk type requires a safety plan and reporting responsibilities; ask about sensitive content repeatedly and in different ways; understand clinic policies before asking.
  • Common risk-factor examples:
    • Prenatal drug exposure, head injury, exposure to disasters, family history of illness; these can alter likelihoods of various outcomes.
  • Family history and moderators:
    • Family patterns can guide hypotheses about heritability and environmental transmission; comorbidity and severity can be moderated by family context.
    • Moderators include: primary diagnosis (guides treatment choice), comorbidity (often reduces expected treatment gains), cognitive ability and age (affect response to cognitive-behavioral elements vs behavioral interventions).
  • Comorbidity considerations in formulation:
    • Do not over-diagnose multiple co-occurring conditions if they do not share onset; rather, identify primary problems driving most impairment and plan to address others as needed.
  • Challenges in obtaining family history:
    • Fathers often under-participate; indirect reports introduce bias; foster/adoptive circumstances limit access to biological histories; cultural and linguistic differences affect reporting and interpretation.
  • Developmental and cultural factors:
    • Developmental stage alters symptom presentation and base rates; puberty status can influence mood/sleep and risk behaviors.
    • Cultural beliefs shape interpretation of problems, parental roles, and willingness to engage in treatment.
  • Conceptual implications for treatment:
    • Moderators help decide which treatment components are likely to be most effective and help tailor interventions to individual clients.

Developmental History and Developmental Considerations

  • Significance of developmental history:
    • Helps determine whether problems are new or longstanding and whether changes align with significant events or developmental transitions.
  • Key guiding questions:
    • Are problems new or old?
    • Are problems present across settings or limited to one context?
    • Are there other explanations (medical, social, environmental) that could account for symptoms?
    • How does age/developmental stage affect baseline functioning and risk for certain disorders?
  • DSM-5 vs developmental framing:
    • DSM-5 moved away from a strict multi-axial system but encourages a holistic evaluation including social and biological factors.
  • Cross-cutting themes:
    • Trauma, bereavement, abuse, and other stressors are relevant across disorders (anxiety, mood, externalizing, substance use).
  • Puberty as a variable:
    • Pubertal development status can affect mood, social functioning, and risk behaviors; Petersen Pubertal Development Scale is a common, freely available measure for ages 8+.
  • Behavioral patterns and family dynamics:
    • Early parenting styles, coercive cycles, and family conflict interact with age-related developmental tasks and influence symptom emergence and treatment targets.

Cognitive Debiasing and Clinical Reasoning

  • Cognitive biases in clinical decision-making:
    • Heuristics can lead to errors; clinicians should use debiasing strategies to improve accuracy.
  • Debiasing strategies:
    • Maintain multiple competing hypotheses and test them against data.
    • Consider comorbidity and alternative explanations rather than locking onto a single diagnosis too early.
  • Application to assessment:
    • Use debugging techniques early in the interview to organize evidence and test competing hypotheses.
    • Employ structured or semi-structured approaches to improve reliability and reduce bias while maintaining clinical flexibility.

Prescription and Case Formulation

  • Role of the evaluation session:
    • The evaluation session (or early sessions) is the main course in the multi-course “meal” of treatment; it pulls together data, builds a case formulation, and guides subsequent actions.
  • Data integration:
    • Use intake data, test results, and interview findings to generate hypotheses about diagnoses and etiological factors.
    • Consider client preferences to personalize recommendations and increase engagement.
  • Focused, incremental assessments:
    • Add targeted instruments when needed to clarify specific questions (e.g., anxiety/depression details, mania screening if mood symptoms are present).
    • Some tools (e.g., attention measures) may be added only if the presenting problem warrants them; full cognitive batteries may be scheduled separately in some settings.
  • Interview structure:
    • Interviews can be fully structured, semistructured, or unstructured; fully structured interviews offer reliability but can feel rigid; hybrid approaches blend structure with clinician flexibility.
    • Younger children may require adaptations; adolescents require greater coverage of substance use, sexual activity, and mood issues.
  • Interview approaches in practice:
    • Start with a structured approach in training clinics, then expand to semistructured or module-based approaches as confidence grows.
    • Procedures may include computer-assisted structured interviews or clinician-led probing to confirm or adjust hypotheses.
  • Goals of interviewing:
    • Elicit the presenting problem in the client’s own words; translate into hypotheses; assess developmental history, contextual factors, diagnoses, and cognitive/cultural factors; plan next steps.

Focused, Incremental Assessments

  • Rationale for adding focused assessments:
    • Not every client needs every test; add instruments when they add incremental value, improve prediction of key outcomes, or refine treatment approach.
  • Examples of when to add focused assessments:
    • Internalizing problems: follow up with anxiety/depression specifics to refine treatment targets.
    • Depression concerns: add mania scales to distinguish mood disorder type (bipolar vs unipolar depression).
    • Autism spectrum concerns: add autism-specific measures if indicated.
  • Implementation considerations:
    • Some settings reserve more comprehensive cognitive/achievement testing for dedicated sessions.
    • In larger clinics, psychometric technicians may administer and score tests for clinician review.
  • In practice:
    • The data from focused assessments should be integrated with interview data to refine the case formulation and the treatment plan.

The Interview: Structure, Tools, and Tradeoffs

  • Objectives of the interview:
    • Obtain the presenting problem in the client’s own words, form hypotheses, and build a formulation to guide action.
    • Gather developmental history, contextual factors, diagnoses, cognitive/cultural considerations.
  • Practical constraints:
    • Interviews must also accommodate confidentiality, insurance, mandated reporting, and logistical details; time management is critical.
  • Interview formats:
    • Fully unstructured: flexible exploration, higher risk of missing comorbidity, more reliance on clinician experience.
    • Semistructured: balance coverage with flexibility; contains set content areas but allows follow-up questions.
    • Fully structured: standardized questions and procedures; high reliability; can be computer-administered but may feel impersonal.
  • Evidence on interview format:
    • Clients often prefer structured approaches and perceive them as more thorough; reliability is higher with structured methods.
  • Hybrid approaches:
    • Modules or content-based modules chosen based on initial hypotheses; computer-assisted interviews can be used for structure, with clinician probing to confirm/adjust diagnoses.
  • Special considerations for youth:
    • Meet with the child to understand concerns and motivation; observe interpersonal responses; substance-use discussions are more prominent with older youths.
  • Adolescent risk discussions:
    • Address sexual activity, substance use, impulsivity, mood, and risk behaviors; ensure confidentiality rules are clear before discussing sensitive topics.
  • Developmental considerations in interviewing:
    • Younger children may be less able to provide reliable self-report; rely on parent reports and direct observation; triangulate data across informants.

Developmental History (Expanded)

  • Guiding questions and decision rules:
    • Old vs. new problems: abrupt changes suggest mood symptoms, trauma, substance exposure, or new stressors; chronic symptoms suggest anxiety, ADHD, learning disorders, or personality factors.
    • Cross-setting consistency: problems across settings suggest a neurodevelopmental or biological basis; setting-specific problems point to environmental factors.
    • Alternative explanations: consider medical conditions, environmental stressors, trauma history; cross-disciplinary communication with pediatricians can be valuable.
    • Age and development: younger ages have different base rates and presentations; puberty adds new considerations (pubertal status and its relation to mood, sleep, risk behaviors).
  • Practical implications:
    • When multiple informants report similarly, it strengthens the case for a given issue; discrepant reports require careful interpretation and targeted follow-up.
    • Developmental history informs sequencing and treatment target prioritization; helps decide whether to address anxiety, mood disorders, ADHD, autism, or conduct problems first.
  • Environmental and family factors:
    • Family history can be informative; many problems run in families; history is often based on prior clinical diagnoses and may reflect biases.
    • Cultural and linguistic factors influence reporting and interpretation; clinicians should adapt language and framing to the family’s context.
  • Developmental transitions and family dynamics:
    • Transitions (e.g., moving to a new school, middle school) can increase stress and risk for relapse; plan for transition-related challenges.

Ethical and Legal Issues

  • Responsibility and consent:
    • Youth under 18 are usually under parental or caregiver custody; consent and assent processes are important; conflicts between youth and parent on problem focus can arise.
  • Insight and motivation concerns:
    • Some youths may lack insight (e.g., psychosis, bipolar), affecting engagement and raising ethical questions about continuation of treatment.
  • Cross-informant ethics:
    • Conflicting reports require careful, respectful handling; consider safety concerns and mandated reporting requirements.
  • Cross-informant and cultural considerations:
    • Expect differences in informants’ views due to stress, mood symptoms, or cultural norms; balance respect for family perspectives with clinical judgment.

Process, Progress, and Outcome Measurement

  • Why measure progress and process:
    • Embedding measurement into therapy improves decision-making, tracking, and outcomes; ongoing data help adjust treatment and plan for termination.
  • Goal measurement (nomothetic vs idiographic):
    • Nomothetic: benchmarks based on normative data or clinical data norms.
    • Idiographic: client-centered goal tracking; individual progress against personally meaningful targets.
  • Clinically significant change and MID:
    • Jacobson et al. (1999) framework for clinically significant change using external norms; minimally important difference (MID) framework (Streiner et al., 2015).
    • Freeman and Young provide guidance on applying benchmarks to commonly used scales and on case-level decision rules.
  • Progress measures: characteristics and examples
    • Should be brief, sensitive to change, easy to administer and score.
    • Examples: single-item “Top Problems” scales (0–10), daily mood charts, daily report cards for ADHD, ecological momentary assessment (EMA).
    • Higher alpha (Cronbach) is not necessarily better for progress measures; very long or very repetitive scales may be inappropriate for repeated use.
  • The Top Problems approach:
    • Clinician and client agree on 1–3 targets to track each session; use a simple 0–10 scale to rate each target.
    • Idiographic and engages client buy-in.
  • Process measures: what they track and why they matter
    • Focus on process indicators like appointment attendance, homework completion, and mood tracking adherence.
    • Use process measures to assess engagement and to diagnose concordance vs adherence issues.
  • Concordance vs adherence:
    • Concordance: alignment between client and clinician on goals and rationale.
    • Adherence: client’s actual engagement with treatment tasks.
    • Four quadrants (from Table 1.3): High concordance/high adherence, high concordance/low adherence, low concordance/high adherence, low concordance/low adherence. Each scenario has distinct implications for engagement strategies.
  • Practical use of process data:
    • If concordance is high but adherence is low, problem-solving is needed to improve execution (e.g., reminders, schedule adjustments).
    • If concordance is low, focus on psychoeducation, motivational strategies, and alignment of goals.
  • Long-term monitoring and termination planning:
    • Develop relapse prevention and maintenance plans; plan for milestones such as middle-school transition or major life events.
    • Termination can include a “care package” for future self, including strategies, reminders, and an ongoing self-monitoring plan.
  • Payment and access considerations (Appendix 1.1, The Fourth “P”: Payment):
    • Economic considerations influence sustainability and access; balance reach with service model (sliding scale, pro bono options, or private-pay strategies).
    • The profession faces changes in insurance, measurement-based care adoption, and competition from tech/automation.
    • Emphasize that assessment has high value and distinct skills that are not easily automated; maintain a human-centered approach with personalized care.

Goal Setting, Outcome, and Feedback Loops

  • Goal-setting practices:
    • Write goals to ensure alignment; choose nomothetic or idiographic approaches based on context and client needs.
  • Outcome feedback loops:
    • Use standardized benchmarks and case illustrations to communicate progress to clients and families.
  • Clinical vignettes and Wikiversity resources:
    • Case vignettes illustrate step-by-step application of measures and interpretation; Wikiversity pages provide additional tools and examples.

Conclusion (Summary of the Assessment Model)

  • The assessment model blends principles of evidence-based medicine with clinical science to improve the accuracy of formulations and the effectiveness of interventions.
  • A sequenced, modular approach helps clinicians work smarter, not harder, by prioritizing common issues (the vital few) and adapting to individual needs.
  • The model emphasizes multi-informant data, normative comparisons, risk assessment, and personalized decision-making, while acknowledging ethical, cultural, and developmental considerations.
  • The overarching goal is to enable better formulations, more effective treatments, and improved outcomes, while also supporting sustainable clinical practice through thoughtful resource management and ongoing professional development.

Appendix 1.1. The Fourth “P”: Payment

  • Economic landscape considerations for students and professionals:
    • Balancing reach, revenue, and service quality; multiple viable practice models exist (e.g., community-focused, sliding-scale clinics vs. private-pay concierge services).
    • Training clinics often use discounted services; supervised, quality outcomes remain strong.
  • Stocking the cabinet and practice management:
    • Treat the book as a shopping list for essential tools and a plan for specialty focus; Wikiversity aids ongoing access to tools and updates.
  • Time is money:
    • Scoping, scoring, and interpretation time costs matter; online resources help streamline the process.
  • Technology competition and future trends:
    • Big tech and machine learning may automate some routine tasks, but psychology’s human-centered, complex problem-solving remains a core strength.
  • Final takeaway:
    • Understanding assessment principles provides a competitive edge in delivering high-quality, personalized care that adapts to changing economic and technological landscapes.

Key Terms and Concepts to Remember

  • Evidence-Based Assessment (EBA)
  • Diagnostic and Statistical Manual of Mental Disorders (DSM-5)
  • International Classification of Diseases (ICD-11)
  • RDoC (Research Domain Criteria)
  • Norms, standardization, and scaling (Z-scores, T-scores, standard scores)
  • Cross-informant agreement and discrepancies
  • Base rate (prior probability) and predictive statistics
  • Diagnostic Likelihood Ratio (DLR) and Bayesian reasoning
  • Clinically significant change and MID
  • Adherence vs. concordance
  • Top Problems approach
  • EMA (ecological momentary assessment)
  • Starter menus and broad-band vs focused measures
  • Safety planning and risk assessment (self-harm, harm to others, abuse)
  • Developmental considerations (pubertal status, transitions)
  • Structured vs unstructured interviews (hybrid approaches)
  • Cognitive debiasing in clinical decision-making
  • The Fourth P: Payment (economic considerations in practice)