Comprehensive Program Evaluation of Starlight Psychotherapy
Overview of Starlight Psychotherapy
- Presenters: Melissa, Andrea, and Nicole.
- General Information:
- Organization Name: Starlight Psychotherapy.
- Founder: Caitlin, a Licensed Professional Counselor (LPC).
- Format: The practice is entirely telehealth-based.
- Service Areas: Licensed to provide therapeutic services in Pennsylvania (PA), New Mexico (NM), and Vermont (VT).
- Target Population: Primarily individuals who identify as queer, LGBTQ+, neurodiverse, and those who identify as polyamorous.
Agency Mission and Therapeutic Modalities
- Mission Statement: "The agency's mission is to lead with compassion to provide excellent service backed by data-driven results."
- Therapeutic Modalities Offered:
- EMDR (Eye Movement Desensitization and Reprocessing)
- IFS (Internal Family Systems)
- Polyvagal Theory
- DBT (Dialectical Behavior Therapy)
- ERP (Exposure and Response Prevention) for Obsessive-Compulsive Disorder (OCD)
- Staff Philosophy: The counselors are noted as professionals who lead with compassion and maintain a specific passion for the marginalized populations they serve.
Clinical Measurement and Professional Development
- Individual Client Progress Tracking: Progress is measured using specific assessment tools relevant to each client's individual needs. Examples mentioned include:
- GAD-7 (Generalized Anxiety Disorder-7)
- CSSRS (Columbia-Suicide Severity Rating Scale)
- Professional Training and Stipends:
- All professionals at the practice receive a yearly stipend dedicated to further education to enhance their ability to serve the target population.
- There is typically one major annual training funded by the founder.
- In the current year, the staff completed the Gottman Level 1 training.
Identified Strengths and Challenges
- Agency Strengths:
- High levels of therapist passion and concern for clinical effectiveness.
- Dedication to the client's best interests.
- Cultivation of a collaborative space where clients are encouraged to provide feedback on the effectiveness of their treatment.
- Operational and Clinical Challenges:
- Difficulty in managing and closing the gap between what a client wants versus what they need and what they are receiving.
- Quote from the evaluation: "Unfortunately, the client might feel like they did not receive the help they wanted, but they received what they needed."
- Managing clients in crisis in a remote setting: This was initially a challenge, now addressed by providing dedicated crisis lines for each state (PA, NM, VT) where clients reside.
Survey Data and Statistical Findings
- Survey Overview: The evaluation utilized a 10-question survey and received n=12 responses.
- Telehealth Challenges:
- The majority of participants reported no challenges with telehealth, suggesting it is generally accessible.
- Specific challenges noted by a minority included technology issues or feeling slightly less connected during initial sessions.
- Crisis Support Awareness:
- Approximately 50.0% of clients felt supported by available resources during high stress.
- A few responses indicated a lack of awareness regarding specific crisis resources, identifying a gap for the action plan.
- Client Satisfaction and Needs Met:
- 75.0% (9/12) of participants reported their needs were fully met.
- Two individuals identified differing expectations (e.g., desiring more questions or more time).
- One individual cited technological issues.
- Identity Affirmation:
- 91.6% (11/12) reported the therapist "always" affirms and understands their identity.
- 8.33% (1/12) reported the therapist "often" understands their identity.
- Collaboration and Autonomy:
- 91.0% of participants felt at least somewhat involved in treatment decisions, indicating the promotion of autonomy.
- Feedback Comfort Levels:
- 75.0% felt "very comfortable" providing feedback.
- 25.0% felt "somewhat comfortable," suggesting minimal hesitancy to provide criticism.
- Areas for Improvement:
- 10/12 said "nothing."
- Individual suggestions included improved contact/logistics with the therapist or changes to session structure/content.
- Desired Services:
- Suggestions included group counseling opportunities for LGBTQ+ individuals and financial/insurance-related support.
- Survey Completion Motivators:
- 33.0%: Understanding how feedback is used.
- 25.0%: Incentives.
- 25.0%: Multiple reminders.
- 8.33% (approx. 1/12): Easier access to the technology.
- 8.33%: Other (no details provided).
Proposed Action Plan
- Title: Telehealth Crisis Readiness and Support Enhancement Program.
- Goal: Integrate a structured intervention to improve client knowledge of crisis resources and increase perceived support during high-stress periods.
- Primary Components:
- Crisis Resource List: Creation of a standardized list for each state (PA, NM, VT) within a 3-month timeframe.
- Staff Training: Brief training sessions focused on safety planning and specific crisis responses within telehealth settings.
- Digital Distribution: Use of the practice's telehealth system to provide digital resources to clients post-session.
- Administrative Management: Staff will assist in distributing resources and managing follow-up communication.
- Projected Cost: Estimated to be relatively low.
Literature Review Findings
- Cox et al. (2024): Highlights the importance of strong therapeutic connections in lowering suicide risk. Engagement and cooperation over time are shown to reduce suicidal desire.
- Wasserman et al. (2021): Emphasizes that successful remote care requires appropriate training, continuous evaluation, and well-defined crisis preparedness. It stresses the importance of clinician confidence.
- CAMS (Collaborative Assessment and Management of Suicidality): Discussed as an effective, client-centered approach that can be provided remotely to support assessment and treatment planning for individuals at risk of suicide.
Ethical and Cultural Considerations
- Ethical Considerations:
- Prioritizing collaborative and least restrictive therapies (central to the CAMS model).
- Ensuring specialized training in distant/remote risk assessment and crisis intervention.
- Clear communication regarding confidentiality boundaries and crisis protocols to ensure informed consent in telehealth.
- Cultural Considerations:
- Providing identity-affirming care is critical given the specific suicide risk differences in marginalized populations.
- Use of psychoeducation to reduce the stigma of seeking help across cultural groups.
- Cultivating a strong therapeutic alliance to build trust, which directly impacts treatment results for diverse populations.
Final Reflections on Evaluation
- Positives:
- Collection of both quantitative and qualitative data provided a comprehensive understanding of agency efficacy.
- Survey results aligned with the agency's mission of compassionate, client-centered service.
- Excellent collaboration and response time from Starlight Psychotherapy during the evaluation.
- Areas for Future Improvement:
- A larger sample size would strengthen the reliability and generalizability of findings.
- Acknowledgment of the limitations of self-reported data, as some clients may be hesitant to report negative feedback despite the results showing high satisfaction.