Kellogg Foundation: Intro to Logic Models (Ch. 1, pp. 1-14)

Logic model

A picture of how a program is supposed to work; also known as program theory.

Inputs

What you HAVE for a program (e.g., money, staff).

Activities

What you DO in a program.

Outputs

What you PRODUCE in a program, typically countable (e.g., number served).

Outcomes

How PEOPLE change as a result of a program, divided into short-term (1-3 years) and long-term (4-6 years).

Impact

How SYSTEMS or communities change as a result of a program, typically assessed over a period of 7-10 years.

Output ≠ Outcome

Output refers to 'did something' whereas Outcome refers to 'someone changed'.

Outcome ≠ Impact

Outcome refers to people changes while Impact refers to systems changes.

3 types of logic models

Theory (WHY it works), Outcomes (WHAT results), Activities (HOW to do it).

Define success BEFORE you evaluate

Decide what success looks like and how to measure it early during program design.

Definition of growth

Narrowly focused on Jobs + Productivity (J&P).

Big idea of evaluation

Evaluation can inform every stage of the policy process; it is not just a last step.

Policy

A law, regulation, procedure, administrative action, incentive, or voluntary practice.

Evaluation

The systematic collection of information to judge, improve, or inform decisions.

Formative evaluation

Conducted BEFORE implementation to identify problems and solutions.

Process evaluation

Conducted DURING implementation to assess if the program is being enacted as planned.

Outcome/Impact evaluation

Conducted AFTER implementation to determine if the policy worked and what caused the outcomes.

Primary data

Data that you collect yourself, such as surveys and interviews.

Secondary data

Data that someone else has collected, like national surveys or budget data.

Quantitative data

Numerical data; used for statistical analysis.

Qualitative data

Descriptive data; focuses on words and themes.

Context questions

Questions regarding the setting and conditions surrounding a program.

Content questions

Questions focused on the topic and specifics of what is being evaluated.

Engaging stakeholders

Involve stakeholders early and often when communicating evaluation results.