• Choose evaluation facilitator and team
• Identify output users
• Determine whether outputs were received by intended users
• Re-examine project mechanics
• Determine whether outputs were used
• Identify changes linked to outputs
• Determine whether changes promote sustainable livelihoods

Framework for evaluating project outcomes

The nature of evaluation

Project processes impacting an evaluation framework

A hypothetical evaluation

The evaluation of project outcomes differs significantly from the general evaluation of project implementation as judged by certain criteria. Outcomes can be thought of as change resulting from development projects which address the issue of sustainable livelihoods; this change can be both positive and negative. The primary purpose of our particular framework is not to design a project evaluation for cost-effectiveness or efficiency; methods for carrying out these activities are well established and often incorporated as an on-going exercise during the implementation of many projects. Instead, this framework attempts to move beyond these measures so that we can evaluate:

1. Are project outputs reaching the users?
2. Are the users "using" the outputs?
3. Is this use manifesting itself in change?
4. Is the direction of this change moving towards initial project objectives and goals -- that is the achievement or promotion of sustainable livelihoods.

This framework also takes into consideration the nature of evaluation and the complexities of project processes in order to guide us toward answering such questions in the field.

To aid in the understanding of the complex evaluation framework, a composite illustration within two different contexts is available to demonstrate the protocol in action. The contexts considered will be those of a policy environment and a poor rural community. Both the policy environment and the rural community are represented by a hypothetical situation and serve as an example of some of the methods which could be used to implement the evaluation protocol within the initiative. This example emphasizes the possibility of closely integrating the evaluation team with the project team during the production and transmission of outputs. A profile of the community or policy environment will be built up as each stage of the process is illustrated. Sample worksheets which assist in completing the actions utilize information from this case study for illustration.