Many types of evaluation exist, consequently evaluation methods need to be customised according to what is being evaluated and the purpose of the evaluation.1,2 It is important to understand the different types of evaluation that can be conducted over a program’s life-cycle and when they should be used. The main types of evaluation are process, impact, outcome and summative evaluation.1
Before you are able to measure the effectiveness of your project, you need to determine if the project is being run as intended and if it is reaching the intended audience.3 It is futile to try and determine how effective your program is if you are not certain of the objective, structure, programing and audience of the project. This is why process evaluation should be done prior to any other type of evaluation.3
Process evaluation
Process evaluation is used to “measure the activities of the program, program quality and who it is reaching”3 Process evaluation, as outlined by Hawe and colleagues3 will help answer questions about your program such as:
- Has the project reached the target group?
- Are all project activities reaching all parts of the target group?
- Are participants and other key stakeholders satisfied with all aspects of the project?
- Are all activities being implemented as intended? If not why?
- What if any changes have been made to intended activities?
- Are all materials, information and presentations suitable for the target audience?
Impact evaluation
Impact evaluation is used to measure the immediate effect of the program and is aligned with the programs objectives. Impact evaluation measures how well the programs objectives (and sub-objectives) have been achieved.1,3
Impact evaluation will help answer questions such as:
- How well has the project achieved its objectives (and sub-objectives)?
- How well have the desired short term changes been achieved?
For example, one of the objectives of the My-Peer project is to provide a safe space and learning environment for young people, without fear of judgment, misunderstanding, harassment or abuse. Impact evaluation will assess the attitudes of young people towards the learning environment and how they perceived it. It may also assess changes in participants’ self esteem, confidence and social connectedness.
Impact evaluation measures the program effectiveness immediate after the completion of the program and up to six months after the completion of the program.
Outcome evaluation
Outcome evaluation is concerned with the long term effects of the program and is generally used to measure the program goal. Consequently, outcome evaluation measures how well the program goal has been achieved.1,3
Outcome evaluation will help answer questions such as:
- Has the overall program goal been achieved?
- What, if any factors outside the program have contributed or hindered the desired change?
- What, if any unintended change has occurred as a result of the program?
In peer-based youth programs outcome evaluation may measure changes to: mental and physical wellbeing, education and employment and help-seeking behaviours.
Outcome evaluation measures changes at least six months after the implementation of the program (longer term). Although outcome evaluation measures the main goal of the program, it can also be used to assess program objectives over time. It should be noted that it is not always possible or appropriate to conduct outcome evaluation in peer-based programs.
Summative evaluation
At the completion of the program it may also be valuable to conduct summative evaluation. This considers the entire program cycle and assists in decisions such as:
- Do you continue the program?
- If so, do you continue it in its entirety?
- Is it possible to implement the program in other settings?
- How sustainable is the program?
- What elements could have helped or hindered the program?
- What recommendations have evolved out of the program?3,4
References
- Nutbeam & Bauman 2006
- Trochim 2006
- Hawe, P., Degeling, D., Hall, J. (1990) Evaluating Health Promotion: A Health Worker’s Guide, MacLennan & Petty, Sydney.
- South Australian Community Health Research Unit n.d.c
FAQs
The main types of evaluation are process, impact, outcome and summative evaluation. Before you are able to measure the effectiveness of your project, you need to determine if the project is being run as intended and if it is reaching the intended audience.
What are the 6 types of evaluation? ›
Evaluations are vital across organizations, aiding in assessing program effectiveness and impact. Understanding various evaluation types (e.g., formative, summative, process, outcome, impact, performance, and cost-benefit analysis) allows for tailored approaches.
What are the 3 types of evaluation in education? ›
Specifically there are three types of evaluation used in the classroom. These are summative evaluation, formative evaluation and diagnostic evaluation.
What are the 7 elements of evaluation? ›
Evaluation reporting should be clear, as free as possible of technical language and include the following elements: an executive summary; a profile of the activity evaluated; a description of the evaluation methods used; the main findings; lessons learned; conclusions and recommendations (which may be separate from the ...
What are the 4 C's of evaluation? ›
The 4Cs - Critical Thinking, Communication, Collaboration, and Creativity - support and integrate assessment strategies into teaching and learning systems. Click below for the 4Cs evaluation rubrics by grade level: Critical Thinking. Communication.
What are the 2 basic types of evaluation? ›
Evaluation strategies can be classified into two primary types depending on the information needed – Formative and Summative – and each can play important roles in our efforts to evaluate community engagement.
What are the three main evaluation approaches? ›
The three main types of evaluation methods are goal-based, process-based and outcomes-based. Goal-based evaluations measure if objectives have been achieved (We highly recommend S.M.A.R.T. Goals). Process-based evaluations analyze strengths and weaknesses.
What are the five approaches of evaluation? ›
The 5-Step approach
- Identify the problem. It is essential that you are clear from the start about the problem you are aiming to address. ...
- Review the evidence. ...
- Draw a logic model of how your service should work. ...
- Identify indictors and collect monitoring data. ...
- Evaluate logic model
The 4 major teacher evaluation models and what they can do
- The Value-Added Model (VAM) In basic terms, VAM measures how a certain teacher contributes to the progress of their students. ...
- Teacher observations. ...
- The Framework Model. ...
- The Marzano Focused Teacher Evaluation Model.
Purposes of Evaluation
There are two types of teacher evalu- ations: summative and formative. Summa- tive evaluation measures and rates teachers. It is used for determining promotion, tenure, merit raises, awards, and dismissal.
In general, evaluation processes go through four distinct phases: planning, implementation, completion, and reporting. While these mirror common program development steps, it is important to remember that your evaluation efforts may not always be linear, depending on where you are in your program or intervention.
What are the 8 principles of evaluation? ›
There are eight main key concepts, functions and fundamental principles of assessment in learning and development which you have to consider as an assessor. These are ethics, fairness, sufficiency, currency, authenticity, reliability, validity, and learning domains.
What are the five major components of program evaluation? ›
Logic Models have 5 major components: Resources or Inputs, Activities, Outputs, Short-term outcomes, and Long-term outcomes Creating a logic model helps articulate the problem, the resources and capacity that are currently being used to address the problem, and the measurable outcomes from the program.
What is an example of an evaluation method? ›
For example, say you are launching a new educational program and using participant surveys as one of your evaluation methods. Each survey could include an open-ended question for participants to share reflections on the value of the program and how it could be improved.
What are the 4 types of evaluation instrument? ›
Common formats for many evaluation instruments include checklists, numerical rating scales, questionnaires, interviews, and direct observation.
What is an example of process evaluation? ›
The process evaluation tells you how well plans are being put into action and helps routinely and systematically monitor areas important to making the program a success. Examples include: recruitment of participants. individuals' attendance or exposure.
 - Shopify Philippines)