6 dimensions of the continuum of evidence of effectiveness

what is the continuum of evidence of effectiveness

provides information and aspects of best available research evidence; defines and clarifies standards

effect

ability for program, policy, or practice to reduce violence related outcomes; produces effects in short term, long term, or both.

why is effect important?

it tells whether the program, policy, or practice is having an impact on outcomes of interest

examples of effect

1. found to be effective (rooted in sound theory and evaluated in two well conducted studies)

2. some evidence of effectiveness

internal validity

extent to whether outcomes are attributed to program or if they are caused by something else

why is internal validity important?

it helps determine if outcome are really due to the program or practice; a high IV indicates that the program is actually producing results

example of internal validity

1. true experiment

2. quasi-experimental

3. non experimental

research design

design of research to evaluate a program determines how well the effectiveness is measured; measures, selection process, group allocation, and evaluation assessment

why is research design important?

a more rigorous research design indicates a higher internal validity

independent replication

involves replicating the program with participants independent of first iteration

why is independent replication important?

it is used to observe if a program, practice, or policy can be replicated and still be effective

examples of independent replication

1. program replication with evaluation replication

2. program replication w/o evaluation replication

3. some replication no evaluation

implementation guidance

ability of program or policy to have resources and materials to aid in implementation in a different setting

why is implementation guidance important?

if implementation guidance is not properly given, then programs are not likely to be established and conducted properly; this leads to low fidelity

examples of implementation guidance

1. comprehensive guidance

2. partial guidance

3. none

external and ecological validity

external: practice demonstrates ability be effective in different populations and contexts

ecological: practice is able to be conducted under real-world circumstances; conditions approximate real life in specific settings

why is external and ecological validity important

it can tell whether the program, practice, or policy can be applicable in real life settings

examples of external and ecological validity

• Two or More applied studies (different settings)

• two or more applied studies (same setting)

• real world informed

• somewhat real world informed

• not real world informed