Pink Book 91-123
STAGE 3: Implementing the Program - Overview and Launch Strategies
Core Objectives of Stage 3: * Preparing to launch and implement the health communication program. * Holding a press conference and maintaining media relations post-launch. * Managing the program during a crisis situation. * Managing implementation through monitoring and problem-solving. * Maintaining and sustaining partnerships. * Addressing common myths and misconceptions about the implementation phase.
Critical Questions to Ask and Answer: * How should we launch the program (e.g., kickoff event versus quiet launch)? * How should we develop and sustain media coverage, partner involvement, and audience interest? * How should we manage a press conference and work with the media during a crisis? * How can we ensure the program operates according to the designated plan? * How can process evaluation be used to identify if the intended audience is being reached? * Are intended audiences responding favorably to messages and materials? * Are we maintaining productive relationships with our partners?
Preparation for Implementation: * Before launching, planning must be finalized for distribution, promotion, and process evaluation. * A formal launch plan should be developed. * Sufficient quantities of materials must be produced. * Staff must be prepared and trained for upcoming tasks.
Program Launch Options: * Quiet Launch: Activities start on a limited basis in one geographic area or with one partner. This allows for adjustments before committing full resources. This is ideal for large-scale programs, new techniques, or new audiences. * Kickoff Event: Designed to create broad awareness and promote community involvement. It serves as a deadline to avoid lag time and fosters relationships with potential participants.
Kickoff Event Strategies: * Plan a dedicated celebration for the program's start. * Tie events to newsworthy happenings (e.g., The Great American Smokeout, Talk About Prescriptions Month, or major study results). * Link to community events (sporting events, church activities, mall promotions, or holidays). * Work with partners to fund events the audience already attends and that interest the media.
Enhancing Media Coverage for Launch: * Create a news "hook" or angle. * Use a checklist for pre-event, event, and post-event activities (e.g., room arrangements, speakers, expenditures, media kits, refreshments, transportation, and equipment). * Inform media in a timely fashion, avoiding conflicts with their existing schedules. * Contact specialized media: community newspapers, cable TV, radio, health trade press, foreign-language media, internet "zines," and websites. * Launch in multiple locales on the same date to increase newsworthiness. * Invite spokespeople who support the program and attract media interest. * Select locations connected to the message (e.g., youth centers for teens, grocery stores for nutrition, or neighborhoods where screening occurs).
Launch Checklist: * Are partners prepared? * Have reviewers and gatekeepers been invited? * Are staff and spokespeople trained? * Are program-related services (hotlines, screening facilities) in place? * Is the media contact list ready? * Are promotional materials (PSAs, media kits, leaflets) available in sufficient quantities? * Are reordering and tracking mechanisms in place? * Are local health professionals aware and prepared for client inquiries?
Media Relations: Press Conferences, Kits, and Continued Engagement
Holding a Press Conference: * A press conference alone is rarely enough; it must be tied to important news (study results, new statistics, or a comprehensive multi-organization program). * Incorporate representatives of the intended audience to tell compelling personal stories. * Invitations: Focus on local press and established relationships. Notify reporters to days in advance. Put major stories on wire service daybooks and call reporters the day before to pitch the importance. * Speakers: Select people with recognizable names. Provide briefing materials/knowledgeable staff for support. Include personal testimony from patients, physicians, and family members. Speakers must remain available for the entire day of the event. * Timing: Ideally held between Tuesday mid-morning and Thursday afternoon. Limit the event to minutes or less, prioritizing Q&A time. Remarks should be short, simple, and avoid scientific jargon. * Logistics: Arrange a room with a "mult box" for high-quality audio connection. Provide clear signs and parking information. Have staff available to distribute media kits and coordinate follow-up interviews.
Media Kit Essentials: * Press conference agenda and press release. * Local, state, and national statistics. * Background information and speaker biographies. * Reproducible copies of charts/graphs. * Copies of program materials/reports. * Contact name and phone number for verification. * Include broadcast-quality stock video (B-roll) for television reporters. * Provide materials in languages relevant to the invited media.
Maximizing Ongoing Media Coverage: * Know the specific coverage areas of different publications and reporters. * Understand the media market (e.g., Washington, DC, media may prefer regional/national slants over local ones). * Respond to info requests quickly (ideally within hour). * Be honest; if an answer is unknown, offer to find it quickly. * Interact personally with media rather than just sending releases. * Ask media for audience data, production help for segments/PSAs, or event co-sponsorships.
Maintaining Media Relations Post-Launch: * 1. Nurture relationships with key contacts (identify via staff, partners, PR firms, or library reference books). Update lists regularly to avoid incorrect titles/names. * 2. Develop a plan for periodic coverage including objectives, messages, promotional activities, and a contact schedule. * 3. Identify and train spokespeople (no more than ). Ensure vertical authority within the organization. Training should cover interviews, crisis management, and broadcast effectiveness. * 4. Track coverage to provide process evaluation data. Measure quantity (space/frequency), prominence (front page), slant (positive/negative), accuracy, and type (editorial/hard news). * 5. Capitalize on breaking news to offer expert opinions. Use negative events to highlight your organization's solutions (e.g., tobacco control activists using news of poison in grapes to mention substances in cigarettes).
Managing Implementation and Process Evaluation
Project Management Activities: * Monitoring activities, staff, and budget. * Periodic assessment of whether activities are on schedule, audiences are reached, and expenditures remain within budget. * Problem-solving (e.g., using forms for telephone operators to track inquiries and improve information delivery).
Process Evaluation Scope: * Assesses whether messages are delivered effectively and materials are distributed to the right people in correct quantities. * Tracks: program quality, partner involvement, outreach effectiveness, media response, intended audience participation, adherence to schedule/budget, and contractor activities.
Gathering Process Evaluation Information: * Activity tracking forms. * Monitoring public inquiries (volume and source). * Clipping services for media coverage. * Feedback cards or phone calls to broadcast stations. * Follow-up with gatekeepers (teachers, physicians). * Regular status reports from staff and partners. * Website traffic tracking and publication request reviews.
Examples of Process Evaluation Measures: * Dissemination: Airtime on radio/TV, readership of print coverage, quantities of materials distributed, number of speeches/events. * Response: Number of telephone, mail, or email inquiries; website visitors; participating organizations; feedback forms. * Audience: Demographic characteristics of those responding.
Case Study: National Cancer Institute Prostate Cancer Clinical Trial (2001): * Method: Media launch with national, local, and Spanish releases; video news release (VNR). * Evaluation: Nielsen SIGMA® encoding for VNR; tracking calls to ; LexisNexis for print; website traffic; study site surveys. * Findings: Nearly print and broadcast hits in the first month. Minority men called at rates roughly equivalent to their population proportion.
Measuring Audience Satisfaction: * Identifies participant characteristics (matching intended audience). * Measures reactions (ease of understanding, utility) and usage (read, passed on, saved). * Case Study: Regional Cancer Information Service (CIS): Found special promotions increased calls among African-American women but not men, leading to a shift away from PSAs for the male audience.
Making Adjustments: * Be flexible to unexpected events (printer delays, news preemption). * Flexibility is necessary for success; altering plans is acceptable if the situation changes.
Maintaining Partnerships and Addressing Myths
Strategies for Sustaining Partners: * Frequent two-way communication. * Periodically offer help and congratulate their accomplishments. * Involve them in events and process evaluation. * Provide formal (newsletters) or informal updates. * Give partners credit in news releases and share program materials/results.
Common Myths about Implementation: * Myth: People need the info, so they will request materials. Fact: Effective promotion is essential; "if you print it, they will come" is false. * Myth: Media is more trouble than it's worth. Fact: Relationships with journalists foster positive outcomes; media training prevents misinterpretation. * Myth: We can relax after the press conference. Fact: News longevity is short; health messages require repetition. * Myth: Partners do the work for us. Fact: Maintaining partnerships is labor-intensive; leadership and coordination are still required. * Myth: If not an immediate success, it's a failure. Fact: All change takes time; midcourse corrections are standard. * Myth: It is unseemly for government/nonprofits to spend on self-promotion. Fact: Promotion promotes the issue and message, lending credibility and helping recruitment.
STAGE 4: Assessing Effectiveness and Making Refinements
Outcome Evaluation Defined: * Identifies changes in knowledge, attitudes, or behavior resulting from the program. * Differs from process evaluation by focusing on effects rather than functioning. * Planning should begin before or shortly after launch.
Importance of Outcome Evaluation: * Justifies the program to management. * Provides evidence of success or need for resources. * Increases organizational support for health communication. * Encourages ongoing cooperative ventures.
Revising the Evaluation Plan (Questions to Ask): * What are the communication objectives? What should the audience think, feel, or do now versus before? * How is change expected to occur (slow or rapid)? * What are the measurable intermediate outcomes (steps toward behavior change)? * What changes are reasonable per year? * Can the evaluation method capture the scope of change?
Effectiveness Measures Examples: * Knowledge: NCI 5 A Day campaign increased awareness by percentage points. * Attitude: Surgeon General pamphlet on AIDS (1988) showed no change in CT resident attitudes. * Behavior: Pawtucket Heart Health worksite program participants lost an average of .
Evaluation Constraints: * Limited funds, staff time, or expertise. * Difficulty isolating program effects from "real world" influences. * Management perception of value. * Rule: It is better to do a small-scale evaluation well than a large-scale one poorly. Evaluation is useless if it lacks power to detect statistically significant change.
Outcome Evaluation Designs and Research Methods
Quantitative Research: Objective info from a large number of people using identical questions. Results are numerical ( awareness). Useful for measuring prevalence and generalizability.
Qualitative Research: Subjective reactions from small numbers via discussion. Useful for understanding why people react a certain way or identifying new concerns.
Statistical Power Example: A survey of people has a margin of error of approximately . A concludes change is significant only if it exceeds percentage points.
Evaluation Designs for Programs Not Delivered to the Entire Population: * Randomized Experiment: Random assignment to intervention or control groups. Measures pre- and post-intervention differences. Costly and time-consuming. * Quasi-experiment: Split based on existing exposure. Harder to prove causation.
Evaluation Designs for Programs Delivered to the Entire Population: * Before-and-After Studies: Information from the same members before and after. * Independent Cross-Sectional Studies: Information from different members before and after. * Panel Studies: Information collected multiple times from the same members. Helps sort effects of different exposure levels. * Time Series Analysis: Multiple pre- and post-intervention data points to project trends and compare to actual outcomes.
Steps for Conducting Outcome Evaluation and Reporting
Nine-Step Evaluation Process: 1. Determine what info the evaluation must provide (think about future decisions). 2. Define data to collect (knowledge, behavioral intentions, specific steps taken, awareness of logo, policy changes). 3. Decide on collection methods (observation, questionnaire, tally sheets). 4. Develop/pretest instruments (ensure they match evaluation questions). 5. Collect data (compare against Stage 1 baseline data). 6. Process data (enter into software). 7. Analyze data (use statistical techniques to find relationships). 8. Write the evaluation report. 9. Disseminate the report.
Cultural Competence in Evaluation: * Assumptions vary by culture. Use culturally competent evaluators. * Cultural groups may find focus groups or providing negative answers inappropriate. * People may be reluctant to provide info over the phone or to different cultures.
The Evaluation Report: * Benefits: Applies learning to future projects, shows accountability to funders, provides evidence of effectiveness. * User Considerations: Tailor for administrators, researchers, policymakers, partners, or the public. * Formats: Concise findings ( grade level), scientific/technical, visual (charts), or case studies. * Elements: Results, methods, chronology, theoretical basis, implications, recommendations, and barriers.
Dissemination and Recognition: * Release the report to prompt feedback and resource sharing. * Apply for awards (e.g., American Medical Writers Association, American Public Health Association, FDA consumer info awards). * Publish in professional journals or present at conferences.
Refining the Program and Evaluation Myths
Circular Process: The end of Stage 4 leads back to Stage 1.
Refinement Questions: * Have objectives shifted? Should the program end? * Is new health info available? Which activities succeeded or failed? * Which activities were most cost-effective?
Common Evaluation Myths: * Myth: We can't afford it. Fact: Useful evaluation fits any budget with creative thinking. * Myth: It's too complicated. Fact: Use university faculty, federal clearinghouses, or consultants. * Myth: It takes too long. Fact: Some evaluations take only a day; others run alongside implementation. * Myth: It's too risky/negative results are bad. Fact: No results is a worse problem. Learning why an attitude didn't change is valuable. * Myth: Affecting only is a failure. Fact: is often a major accomplishment; report results in proper context. * Myth: Results should be instant. Fact: Behavior change takes time; process evaluation shows short-term activity results first.