1/47
Looks like no tags are added yet.
CBA
method of monetizing social costs and benefits to decide between pursuing a policy or keeping status quo
Calculating net social benefit for CBA
NSB = B-C
Net present value CBA meaning and calculation
money today is worth more than money tomorrow because of interest and uncertainty, NPV = PV(B)-PV(C) this is where discounting comes in
3 types of CBA
ex ante: done before policy is pursued to decide if it’s a good idea
in media res: done during program/policy to decide if it should be continued
ex post: done after program is complete to see if it was a good idea, program evaluation
Why is CBA important?
required by some laws and for big regulatory actions
standardizes decision making
allows for efficient allocation of resources by ensuring economic benefits outweigh costs before starting a program
transparent basis for government decisions
encourages long-term planning/thinking
CBA critiques
pricing the priceless, can’t put a price on things with dignity
troubling tradeoffs, no distinction between who pays and who benefits
uncertainty, how to decide costs/benefits when probabilities of outcomes are unknown
distorting/dismissing future, not able to compare across generations
regulation costs get exaggerated
partisan bias impacts how we estimate or discount
Partisan bias
general tendency to think/act so as to favor your own group
Core ingroup favoritism
systematic tendency to seek out, believe, remember info that supports existing beliefs
3 types of response tendency
selective information seeking
selective info evaluation, how you determine what to believe
selective memory for information
What does Klein’s idea of “motivated math” refer to?
those who are smartest become dumbest/get problems wrong to avoid betraying political beliefs
those who follow politics most closely are likeliest to answer basic factual questions wrong (ie - is inflation increasing?)
Identity protective cognition
form of confirmation bias, we accept and interpret information to confirm our belonging/worldviews, we are identity-affirming more than we are truth-seeking
How to combat identity protective cognition
diversity of viewpoints in the room
self checking and awareness
intentionality
CEA (cost effectiveness analysis) meaning and formula
compare policies and programs by cost to achieve same outcome to identify cheapest way to realize a goal, CE = costs/effects (ie /lifesavedorincreaseinpoints/ spent on tutoring)
When to use CE instead of CBA
goal has been decided (CBA asks whether to take action at all)
comparing options with same intended outcome, CBA can have different outcomes
singular main outcome, CBA can have multiple
benefits are hard or not appropriate to monetize
when CBA isn’t legally required (it’s often mandated by exec order)
Precautionary principle
focuses on options and solutions when there is uncertainty about a proposed rule and it might cause substantial harm to act to prevent the harm, views inaction as a form of action
How is precautionary principle applied?
shift burden of proof, proponents of policy have to prove it’s safe rather than opponents having to prove it’s dangerous
advocates must consider if alternative options might achieve same outcome more safely
involve public in decision making process
Steps to apply precautionary principle
identify the threat and characterize the problem
identify what we do and don’t know about the threat
reframe the problem to describe necessary action
assess feasibility of alternatives, potential unintended consequences
decide course of action
follow up
Program vs policy evaluation
Program evaluation is about a specific intervention within a larger policy, policy evaluation is broader in scope and therefore often more difficult
Evidence act of 2019
requires that major agencies publish annual eval plan and learning agenda of questions to focus on in the coming year
what factors can influence a program/policy eval?
WHO you measure and WHEN
why is it important to clearly define success when doing evaluation?
different individuals come to policies with different priorities, responsibilities, interpretations - ie if we’re looking at whether a policy reduces waste we have to ask if we mean weight, volume, emissions, litter
What questions should you ask before doing an evaluation?
WHO will use the info?
WHY is it needed?
HOW will it be used?
evaluation steps
engage stakeholders
use logic model to describe problem
gather credible evidence
justify conclusions
ensure use and share lessons
Formative evaluation
evaluate main problem and find solutions, like policy analysis
process/implementation eval
whether program is being executed as planned, operational challenges
outcome eval
to what extent program achieves intended outcomes
impact eval
assess broader changes attributed directly to a specific intervention or a program over longer term
logic models
diagrams illustrating the underlying theory of how policy will or tried to achieve outcome, used to plan/implement/evaluate by providing clear relationship between inputs and outputs/outcomes
why learn about logic models?
they are pervasive and often required or encouraged by government agencies
theory approach logic model
focuses on underlying assumptions about how change occurs, why the program will work
activities approach logic model
emphasizes implementation process of going from inputs to outputs
outcomes approach logic model
focus on desired changes and impacts, how outputs lead to impacts for different time periods
logic model ingredients
planned work:
a. inputs/resources
b. activities done with the resources
intended results:
a. outputs: direct/quantifiable products of activities
b. outcomes: specific changes in participant behavior over short (less than three years) and long (4-6 years) terms
c. impact: broader changes in communities, orgs, and systems over long (7-10 yr) term
CBA - what is meant by “the burden is on regulators”?
you have to prove that your policy is better than the status quo, benefits exceed costs
What is CBA’s approach to harm?
CBA accepts some harm, below a certain threshold harm is a price worth paying if it means taking a cheaper option
How does future harm compare to present harm when doing CBA?
Future harm counts less, discounting shrinks delayed harm
How does the burden of proof shift between CBA and precautionary principle?
CBA says that the benefits must be proven to exceed the costs in order to take action to prevent harm whereas PP says you just have to have “reasonable doubt” about safety in order to take action to prevent harm
How does Perez’s argument extend to evaluation generally?
evaluation methods:
often assume interventions are gender-neutral, ignoring how different groups might be differently affected
rely on data that presume homogeneity among the target population
overlook missing data/data gaps
Perez’s proposals for solutions
gender disaggregated data
inclusion of women in clinical trials
reevaluation of standards
legislative or policy measures requiring gender impact assessments
what is Perez’s central argument?
policies designed by/for reference man ignore unique needs/situations/differences of women
this ignorance isn’t intentional/purposeful but resulted because women weren’t involved in planning
critique of policy eval and the data it uses to judge policies
policy analysis
research that seeks to determine which of several alternatives is the most desirable way to solve a public problem, looks to the future to determine future impacts of a policy or program, often done under time or resource constraints for a client
why is policy analysis important?
prevents poor decisions which saves time and money, allows for effective and informed decision making, facilitates transparency and accountability
why is Bardach’s eightfold path so foundational?
structured/clear process for confronting messy reality
facilitates clarity about goals and values
crafting a story/coherent narrative
builds intellectual/analytical humility
why does Bardach say policy analysis is “more art than science?”
each step requires human judgment, not formulaic
requires interpersonal skills, knowing audience and communicating
requires decisions to be made about framing, persuasion, storytelling
Should a problem statement embed solutions?
No, there should not be an implicit solution
ie instead of saying not enough shelters for homeless people you say too many homeless families
Formula for problem statement
describe most important causes of the problem in a few words
articulate core problem arising from gap between “as is” and “should be”
identify most important consequences
Constructing policy alternatives
should be actionable and specific, aligned with problem/context, include status quo, don’t include options you already know are blatantly unrealistic
sensitivity analysis
test how changes in assumptions impact CBA analysis, do this after you calculate NPV and before you finalize your recommendation