Program Articulation, Logic Models, and Program Theory

Course Context & Overview

• Course Codes: $STO\,603$, $SOC\,665$, $CLD\,665$
• Module Focus: Week $5$ — Program Articulation & Logic Models, Program Theory
• Core Topics:
  • Program Articulation & Logic Models
  • Program Theory / Theory of Change

Elements of the Program Development (PD) Model

• Planning Phase:
  • Public and stakeholder engagement
  • Issue identification
  • Finding and using secondary data
• Transition from Planning to Design:
  • Program articulation
  • Utilization of logic models as tools for program planning and design
• PD Process Cycle:
  • The overarching program development workflow transitions sequentially through five stages: Plan $\rightarrow$ Design $\rightarrow$ Implement $\rightarrow$ Evaluate $\rightarrow$ Report.

Progression from Issue Identification to Program Articulation

• Linear Alignment of Program Planning:
  • Issue Identification: Recognizing underlying problems or community needs.
  • Needs Assessments & Situation Analysis: Gathering primary and secondary data to understand contextual nuances.
  • Problem Statements & Plans of Action: Defining clear programmatic goals and formal response strategies.
  • Program Articulation & Design: Mapping out operational mechanics, resources, activities, and expected outcome hierarchies.

Program Articulation

• Definition: Program articulation is the process of developing a formal plan of action to address an identified need or opportunity.
• Required Elements of an Articulated Program Plan:
  • Situation Description: Detailed problem statement.
  • Programmatic Efforts: Specific interventions planned to address the issue.
  • Resources: Required staff, funding, equipment, materials, and partnerships.
  • Program Activities & Components: Core operational events and delivery systems.
  • Assumptions: Underlying hypotheses regarding how the program is expected to work.
  • Target Audience & Stakeholders: Explicit definition of participants reached and key affected entities.
  • Expected Outcomes: Multi-tiered targets (short-term, intermediate, long-term) and logical linkages between them.
  • Contextual Factors: Environmental, social, and political influences affecting success.
  • Timeline: Implementation schedule and milestone deadlines.

Logic Models: Definitions, Roles, and Foundations

• Definition (McCoy & Castner, $2020$): A planning tool and visual representation of resources available for a project, activities carried out to complete it, and expected outcomes or results.
• Primary Roles & Functions:
  • Visual diagram illustrating project flow and results measurement points.
  • Operational guide for program evaluation, management, and stakeholder communications.
  • Graphical or pictorial depiction of an intervention designed in response to a specific situation.
  • Representation of logical connections between resources invested, activities undertaken, and benefits/changes achieved.
• Theoretical Frameworks:
  • Synonymous with Program Theory (Weiss, $1998$) and Program's Theory of Action (Patton, $1997$).
  • Defined as a "plausible, sensible model of how a program is supposed to work" (Bickman, $1987$, p. $5$).
  • Explicitly portrays the underlying rationale of an intervention.
• Course Deliverables & Requirements:
  • Completion of the online logic model module at https://lmcourse.ces.uwex.edu/.
  • Assignment $2$ ($150$ points): Creation and detailed explanation of a logic model for a proposed or existing program.

Essential Components of a Logic Model

• A comprehensive logic model demonstrates logical connections across $6$ essential components:
  1. Situation Statement
  2. Inputs
  3. Outputs
  4. Outcomes
  5. Assumptions
  6. External Factors

Comprehensive Breakdown of Logic Model Components

Component 1: Situation Statement

• Purpose: Establishes the foundation for logic model development by explaining the precise issue the program is engineered to address.
• Core Analytical Questions Covered:
  • What is the problem/issue?
  • Why is this a problem, and what causes it?
  • For whom (individual, group, community) does this problem exist?
  • Who holds a stake in the problem or cares whether it is resolved?
  • What baseline knowledge, research, and experience exist regarding the issue and population?

Case Study Example: Rubber-Necked Guinea Fowl (RNGF) (Leech et al., $2004$)

• Baseline Problem: Private landowners manage land in ways harmful to Rubber-Necked Guinea Fowl ($\text{RNGF}$), causing population declines to unsustainable levels. Both federal and provincial governments designated the species as Endangered.
• Environmental Drivers:
  • Loss of native grassland foraging habitat due to rapid urbanization.
  • Insufficient large Douglas-fir ($\text{Pseudotsuga menziesii}$) trees in adjacent forested areas for nesting and roosting.
  • Conversion of native grass foraging areas in dry forest ecosystems to nonnative grasslands via cattle grazing and hydroseeding nonnative grass species.
  • High pressure from illegal poaching due to popularity as a game species.
• Policy & Stakeholder Context:
  • Federal and provincial legislation triggered creation of a recovery team to develop a recovery strategy and action plan.
  • Affected stakeholders: Urban developers, forest companies harvesting in the Interior Douglas-fir ($\text{IDF}$) biogeoclimatic zone, ranchers, and hunters.
• Information Gaps Requiring Research:
  • Minimum number of large Douglas-fir trees required to remain in forested habitats.
  • Specific native grass species critical for foraging.
  • Feasibility of utilizing native grass species in hydroseeding mixtures within $\text{RNGF}$ habitats.
• Engaged Collaborative Groups: Research community, municipal governments, non-governmental organizations ($\text{NGOs}$), First Nations, regional provincial offices (regional Ministry of Water, Land and Air Protection; Ministry of Forests), fish and game clubs, local timber firms, ranchers, and developers.

Component 2: Inputs (Resources)

• Definition: Tangible and intangible resources utilized by an organization or center to achieve its mission and accomplish program objectives.

• General Categories of Inputs:
  • Host institutional support: Facilities, software, operational policies, academic tenure, staffing, interdisciplinary potential, access to student or research populations, management oversight.
  • Operational assets: Time, funding, materials, equipment, technology, data, partners, collaborators, service systems, underlying theories, and past outcome data.
• Specific Inputs in $\text{RNGF}$ Case Study:
  • Staff time
  • Project funding
  • Partner organization support
  • Specialized research expertise
  • Volunteer hours

Component 3: Outputs

• Definition: Direct actions, methods, services, products, and participation metrics generated through the investment of inputs.

• Sub-Component 1: Activities (What We Do):
  • Internal tasks, procedures, and methods executed to deliver objectives and ensure quality.
  • Administrative actions, advisory meetings, research design, execution, training delivery, dissemination, technology transfer, and evaluation.
  • Artifacts produced: New/modified measurement instruments, research findings, databases, websites, training manuals, and standards.
• Sub-Component 2: Participation (Who We Reach):
  • Target demographics and volume of participants engaged.
  • Metrics: Student enrollment counts, gender breakdown of attendees, percentage of targeted community parents participating, satisfaction ratings.
• Outputs Breakdown in $\text{RNGF}$ Case Study:

Component 4: Outcomes

• Definition: The specific end-results, benefits, or changes attributable to program outputs. Represents what changes occur as a result of participation and serves as the primary measure of program success required by funders.
• Outcome Hierarchy (Three Tiers):
  1. Short-Term Outcomes (Initial / Learning - KASA/KOSA):
  • Focus: Demonstrated changes in Knowledge, Attitudes (Opinions), Skills, and Aspirations ($\text{KASA}$/$\text{KOSA}$).
  • $\text{RNGF}$ Short-Term Outcomes:
    • Ranchers gain increased knowledge regarding grazing management in $\text{RNGF}$ habitat.
    • Ranchers acquire the desire/aspiration to alter land practices to conserve critical $\text{RNGF}$ habitat.
    • Urban developers gain increased knowledge on executing construction without compromising $\text{RNGF}$ habitat.
  1. Intermediate Outcomes (Actions / Behavior):
  • Focus: Demonstrated modifications in practice, behavior, decision-making, policy adoption, or social action resulting from short-term learning.
  • $\text{RNGF}$ Intermediate Outcomes:
    • Decreased livestock grazing intensity in critical grassland habitat.
    • Decreased rate of urbanization within critical grassland habitat.
    • Improved retention of $\text{RNGF}$ habitat during active urban development projects.
  1. Long-Term Outcomes (Ultimate Impact / Conditions):
  • Focus: Measurable changes in Social, Economic, Environmental, or Civic ($\text{SEEC}$) conditions at the community, organizational, or ecosystem level.
  • $\text{RNGF}$ Long-Term Outcomes:
    • Increased formal protection of existing critical native grassland habitat.
    • Overall net increase in functional native grassland habitat.

Component 5: Assumptions

• Definition: Core principles, hypotheses, and underlying beliefs regarding how the program will work, human behavior, and operational dynamics.
• Key Rules for Assumptions:
  • Connect directly to the program's underlying theoretical framework.
  • Must be explicitly defined prior to program execution.
  • Should emanate from and be validated by baseline needs assessments, situation analyses, and past research.

Component 6: External Factors

• Definition: Surrounding environmental factors that interact with, influence, or are influenced by the program.
• Examples: Cultural milieu, climate conditions, economic structures, housing patterns, demographic trends, political environment, media coverage, evolving policies, and participant background experiences.
• Integration: Must be identified during needs assessment and factored into continuous program evaluation.

Complete Program Action Logic Model Framework

• The University of Wisconsin–Extension ($\text{UW-Extension}$, $2003$) framework illustrates the full conceptual flow from situation assessment through implementation and evaluation:

The "If-Then" Logical Progression Chain

• A logic model relies on causal "If-Then" relationships linking inputs through long-term impacts:
  • $\text{IF}$ resources ($\text{Inputs}$) are invested, $\text{THEN}$ program activities ($\text{Outputs}$) can be executed.
  • $\text{IF}$ activities ($\text{Outputs}$) are delivered, $\text{THEN}$ participants gain learning ($\text{Short-Term Outcomes}$).
  • $\text{IF}$ participants gain learning ($\text{Short-Term Outcomes}$), $\text{THEN}$ they adopt new practices/behaviors ($\text{Intermediate Outcomes}$).
  • $\text{IF}$ practices/behaviors change ($\text{Intermediate Outcomes}$), $\text{THEN}$ ultimate conditions change ($\text{Long-Term Outcomes}$).

$\text{RNGF}$ "If-Then" Chain Example

1. $\text{IF}$ staff time and funding are invested ($\text{Inputs}$), $\text{THEN}$ field tours on $\text{RNGF}$-friendly land management are conducted for private landowners ($\text{Activities}$).
2. $\text{IF}$ field tours are delivered ($\text{Activities}$), $\text{THEN}$ private landowners learn appropriate management techniques ($\text{Short-Term Outcome}$).
3. $\text{IF}$ landowners know how to manage land appropriately ($\text{Short-Term Outcome}$), $\text{THEN}$ they actively apply these techniques on their property ($\text{Intermediate Outcome}$).
4. $\text{IF}$ landowners apply better management practices ($\text{Intermediate Outcome}$), $\text{THEN}$ the total amount of suitable $\text{RNGF}$ habitat increases ($\text{Long-Term Outcome}$).

Criteria for Assessing Logic Model Quality

• Evaluation standards established by the University of Wisconsin–Madison specify $4$ criteria for logic model verification:
  1. Meaningful: The model represents actions that are valued and demonstrably worth doing.
  2. Plausible: The logical flow is sensible, rational, and supported by causal links.
  3. Doable: The plan is practical and achievable within available resources and operational constraints.
  4. Testable: Outcomes and process paths are clearly measurable and verifiable.

Program Theory & Theory of Change

• Definition: An explicit or implicit description of how and why a program works (or is expected to work) over time, detailing why specific activities lead to specific outcome chains.
• Core Functions of Program Theory:
  • Guides expectations on operational pathways and expected outcomes.
  • Explains necessary interventions required to bring about intended impacts.
  • Assists in formulating and prioritizing evaluation questions.
  • Directs selection of appropriate evaluation designs.
  • Frameworks the interpretation of empirical evaluation findings.
• Classification of Program Theories:
  • Implicit Theory: Unarticulated assumptions held informally by stakeholders; prone to internal conflicts; inferred from existing program structures and daily actions.
  • Explicit Theory: Formally documented and articulated prior to evaluation; established as a shared understanding across staff, managers, and stakeholders.