Learning and Evaluation/Archive/Learning modules/2Impact Evaluation

From Meta, a Wikimedia project coordination wiki
Jump to navigation Jump to search

  Program Evaluation Basics Menu

Impact Evaluation

Stages Involved
Completion
& Feedback
Arrowtop.svg Identification
Arrowleft programeval.svg Arrowdiagonal programeval.svg Arrowright programeval.svg
Implementation Arrowbottom programeval.svg Design

Key question:

How much difference did it make?

  • Quantifies the contributions of a program toward a
{{{term}}}

{{{definition}}}

.
  • Reveals whether a program or a change in a program contributed to long-term outcomes (i.e., changes to the social, economic, civic, and/or environmental
{{{term}}}

{{{definition}}}

to which the program was targeted).

  • Requires a comparison of
{{{term}}}

{{{definition}}}

; either an examination of program participants over time or a more careful examination of your program participants against a separate control or

{{{term}}}

{{{definition}}}

.
  • Provides comparable
{{{term}}}

{{{definition}}}

about programs to inform decisions about continuing, expanding, or reducing funding based on cost of attaining

{{{term}}}

{{{definition}}}

. Impact evaluations tend to be the most complex in design. Not only does the evaluation of impact carefully examine how much a program contributes to one or many long-term effects, it often incorporates findings from other evaluation types (i.e.
{{{term}}}

{{{definition}}}

,
{{{term}}}

{{{definition}}}

, etc.) applied along the planning and
{{{term}}}

{{{definition}}}

path.
{{{term}}}

{{{definition}}}

is determined when one can:
  • compare the
{{{term}}}

{{{definition}}}

of a group before and after a program occurs and state that the program has changed the condition(s) of the group;
  • measure the value added by a program compared to either an existing program or alternative practices.

Many questions can be answered through impact evaluations, including: To what extent does a program increase the number of retained editors? What is the value of transforming participants into retained volunteer editors through a program? How much more or less impactful is a program compared to other programs that also aim to increase retained volunteer editors?