m1 lecture

Understanding Evaluation Assessment Tools

Importance of Understanding Assessment Tools

  • Knowing about assessment tools is crucial for determining:

    • Reliability

    • Validity

    • Suitability for a specific client or child

  • Even if not administering the tools personally, understanding how they work is vital for reporting and treatment decisions in various settings like home, school, or clinics.

Understanding Reports and Collaborating with Team

  • A wide network works with individuals with Autism Spectrum Disorders (ASD):

    • Caregivers

    • Parents

    • Therapists

    • Teachers

    • Providers

    • Paraprofessionals

    • Doctors

  • Important to comprehend reports from psychologists, teachers, and therapists:

    • Enables informed decision-making in respective roles.

  • Example applications:

    • Parents can use reports to make home decisions for their child.

    • Teachers can apply assessment results in classroom settings to better assist students.

Goals

  • Learn to read and interpret reports effectively.

  • Evaluate assessment tools for accuracy, reliability, and appropriateness.

  • Transform assessment results into applicable treatment plans.

Historical Context of Autism Diagnosis

Key Historical Figure: Leo Kanner

  • Documented autism in 1943.

  • Different labels have been applied over time, such as:

    • Autism

    • Asperger's disorder (now removed)

  • The Diagnostic and Statistical Manual (DSM) as a crucial resource:

    • Current version: DSM-5

    • Serves as the primary reference for autism diagnostic criteria.

Educational Definition: IDEA

  • IDEA stands for Individuals with Disabilities Education Act.

  • Provides an educational definition of autism that differs from diagnostic definitions.

  • Focuses on planning academically for students with autism in classroom settings.

Evaluation of Assessment Tools: Psychometric Properties

Key Concepts: Reliability and Validity

Reliability

  • Definition: The extent to which an assessment consistently measures a construct.

  • Good reliability coefficient: > 0.90.

  • Higher reliability indicates lower potential error in measurement.

    • Confidence intervals indicate the likelihood of an individual’s true score falling within a specified range.

    • Example: An IQ score of 100 with a confidence interval of 96 to 104 suggests a 95% likelihood that the true score falls within this range.

  • Factors influencing reliability:

    • Length of assessment: Longer tests tend to be more reliable due to more samples.

    • Suitability of tasks and questions for the individual’s experience.

    • Consistency in administration: Procedures must be exactly the same every time.

Validity

  • Definition: The degree to which a tool measures what it claims to measure.

  • Acceptable validity coefficient: ≥ 0.60.

    • Higher coefficients indicate better measurement accuracy.

  • Types of validity:

    • Face validity: Does the tool appear to measure what it claims?

    • Discriminant validity: Can it distinguish between those with and without the condition measured (e.g., autism)?

    • Content validity: Does it cover the pertinent material for the assessment?

    • Criterion-related validity: Do results correlate with other tasks measuring the same construct?

    • Construct validity: Does the tool accurately assess the theoretical construct it claims to measure?

  • Factors influencing validity:

    • Student’s reading and language abilities (may affect comprehension)

    • Emotional and behavioral issues on assessment day

    • Physical factors (e.g., tiredness, hunger) that may affect engagement

Using Assessment Results with Caution

  • Always verify the psychometric properties of tools used:

    • Reliable and valid assessment tools should be favored.

    • If psychometric properties fall below standard levels or haven’t been validated for the specific demographic, use results cautiously.

  • Common practice: Reports often indicate psychometric properties; if not, search online or consult academic resources.

Further Learning

  • Continue reading on various assessment tools throughout the semester.

  • Review tools broken down by their psychometric properties.

  • Choose a module and a specific tool for in-depth research, contributing to class discussions.

Contact

  • Queries regarding the materials can be addressed via email.