Comprehensive Program Evaluation of Starlight Psychotherapy

Overview of Starlight Psychotherapy

  • Presenters: Melissa, Andrea, and Nicole.
  • General Information:     - Organization Name: Starlight Psychotherapy.     - Founder: Caitlin, a Licensed Professional Counselor (LPC).     - Format: The practice is entirely telehealth-based.     - Service Areas: Licensed to provide therapeutic services in Pennsylvania (PA), New Mexico (NM), and Vermont (VT).     - Target Population: Primarily individuals who identify as queer, LGBTQ+, neurodiverse, and those who identify as polyamorous.

Agency Mission and Therapeutic Modalities

  • Mission Statement: "The agency's mission is to lead with compassion to provide excellent service backed by data-driven results."
  • Therapeutic Modalities Offered:     - EMDR (Eye Movement Desensitization and Reprocessing)     - IFS (Internal Family Systems)     - Polyvagal Theory     - DBT (Dialectical Behavior Therapy)     - ERP (Exposure and Response Prevention) for Obsessive-Compulsive Disorder (OCD)
  • Staff Philosophy: The counselors are noted as professionals who lead with compassion and maintain a specific passion for the marginalized populations they serve.

Clinical Measurement and Professional Development

  • Individual Client Progress Tracking: Progress is measured using specific assessment tools relevant to each client's individual needs. Examples mentioned include:     - GAD-7 (Generalized Anxiety Disorder-7)     - CSSRS (Columbia-Suicide Severity Rating Scale)
  • Professional Training and Stipends:     - All professionals at the practice receive a yearly stipend dedicated to further education to enhance their ability to serve the target population.     - There is typically one major annual training funded by the founder.     - In the current year, the staff completed the Gottman Level 1 training.

Identified Strengths and Challenges

  • Agency Strengths:     - High levels of therapist passion and concern for clinical effectiveness.     - Dedication to the client's best interests.     - Cultivation of a collaborative space where clients are encouraged to provide feedback on the effectiveness of their treatment.
  • Operational and Clinical Challenges:     - Difficulty in managing and closing the gap between what a client wants versus what they need and what they are receiving.     - Quote from the evaluation: "Unfortunately, the client might feel like they did not receive the help they wanted, but they received what they needed."     - Managing clients in crisis in a remote setting: This was initially a challenge, now addressed by providing dedicated crisis lines for each state (PA, NM, VT) where clients reside.

Survey Data and Statistical Findings

  • Survey Overview: The evaluation utilized a 10-question survey and received n=12n = 12 responses.
  • Telehealth Challenges:     - The majority of participants reported no challenges with telehealth, suggesting it is generally accessible.     - Specific challenges noted by a minority included technology issues or feeling slightly less connected during initial sessions.
  • Crisis Support Awareness:     - Approximately 50.0%50.0\% of clients felt supported by available resources during high stress.     - A few responses indicated a lack of awareness regarding specific crisis resources, identifying a gap for the action plan.
  • Client Satisfaction and Needs Met:     - 75.0%75.0\% (9/129/12) of participants reported their needs were fully met.     - Two individuals identified differing expectations (e.g., desiring more questions or more time).     - One individual cited technological issues.
  • Identity Affirmation:     - 91.6%91.6\% (11/1211/12) reported the therapist "always" affirms and understands their identity.     - 8.33%8.33\% (1/121/12) reported the therapist "often" understands their identity.
  • Collaboration and Autonomy:     - 91.0%91.0\% of participants felt at least somewhat involved in treatment decisions, indicating the promotion of autonomy.
  • Feedback Comfort Levels:     - 75.0%75.0\% felt "very comfortable" providing feedback.     - 25.0%25.0\% felt "somewhat comfortable," suggesting minimal hesitancy to provide criticism.
  • Areas for Improvement:     - 10/1210/12 said "nothing."     - Individual suggestions included improved contact/logistics with the therapist or changes to session structure/content.
  • Desired Services:     - Suggestions included group counseling opportunities for LGBTQ+ individuals and financial/insurance-related support.
  • Survey Completion Motivators:     - 33.0%33.0\%: Understanding how feedback is used.     - 25.0%25.0\%: Incentives.     - 25.0%25.0\%: Multiple reminders.     - 8.33% (approx. 1/12)8.33\% \text{ (approx. 1/12)}: Easier access to the technology.     - 8.33%8.33\%: Other (no details provided).

Proposed Action Plan

  • Title: Telehealth Crisis Readiness and Support Enhancement Program.
  • Goal: Integrate a structured intervention to improve client knowledge of crisis resources and increase perceived support during high-stress periods.
  • Primary Components:     - Crisis Resource List: Creation of a standardized list for each state (PA, NM, VT) within a 3-month timeframe.     - Staff Training: Brief training sessions focused on safety planning and specific crisis responses within telehealth settings.     - Digital Distribution: Use of the practice's telehealth system to provide digital resources to clients post-session.     - Administrative Management: Staff will assist in distributing resources and managing follow-up communication.
  • Projected Cost: Estimated to be relatively low.

Literature Review Findings

  • Cox et al. (2024): Highlights the importance of strong therapeutic connections in lowering suicide risk. Engagement and cooperation over time are shown to reduce suicidal desire.
  • Wasserman et al. (2021): Emphasizes that successful remote care requires appropriate training, continuous evaluation, and well-defined crisis preparedness. It stresses the importance of clinician confidence.
  • CAMS (Collaborative Assessment and Management of Suicidality): Discussed as an effective, client-centered approach that can be provided remotely to support assessment and treatment planning for individuals at risk of suicide.

Ethical and Cultural Considerations

  • Ethical Considerations:     - Prioritizing collaborative and least restrictive therapies (central to the CAMS model).     - Ensuring specialized training in distant/remote risk assessment and crisis intervention.     - Clear communication regarding confidentiality boundaries and crisis protocols to ensure informed consent in telehealth.
  • Cultural Considerations:     - Providing identity-affirming care is critical given the specific suicide risk differences in marginalized populations.     - Use of psychoeducation to reduce the stigma of seeking help across cultural groups.     - Cultivating a strong therapeutic alliance to build trust, which directly impacts treatment results for diverse populations.

Final Reflections on Evaluation

  • Positives:     - Collection of both quantitative and qualitative data provided a comprehensive understanding of agency efficacy.     - Survey results aligned with the agency's mission of compassionate, client-centered service.     - Excellent collaboration and response time from Starlight Psychotherapy during the evaluation.
  • Areas for Future Improvement:     - A larger sample size would strengthen the reliability and generalizability of findings.     - Acknowledgment of the limitations of self-reported data, as some clients may be hesitant to report negative feedback despite the results showing high satisfaction.