ApproachesUtilization focused – Promotes intended use by intended users. Strong focus on participation of users throughout the evaluation process
Empowerment – Program participants are involved in the conduct of the evaluation. An outside Evaluator serves as a coach or facilitator in the evaluation process
Feminist - Addresses & examines opportunities to reverse gender inequities that lead to social injustice. Prioritizes women’s experience and voices, including women from discriminated and marginalized groups.
As part of developing the TOR, the manager needs to define the evaluation approach and methods. A G /HR responsive evaluation is characterized by not only its focus on GE/HR sensitive evaluation questions (what it examines) but also by how it is conducted – approach, process and methods that embrace GE and HR principles. Three such approaches are cited in the text box, and a summary of other approaches that promote inclusiveness and participation is provided.
The evaluation team will bring expertise on the application of different approaches and models for evaluation. The manager’s role is to define the general approach to be taken in the conduct of the evaluation. This will be influenced by:
- Evaluation purpose – recall the importance of defining users and uses of the evaluation at this early stage
- Reach – which stakeholders will the evaluation seek in the conduct / gathering of information
- Existing information & data – what information is already available on the programme (indicators, baseline, previous evaluations) that impacts what the evaluation needs to focus upon
The Guidance for Developing a ToR provides additional direction. The most important factor to consider in articulating a desired approach to the evaluation is, again, the intended uses and users of the evaluation. The evaluation team, through their proposal and after being recruited can provide additional expertise on approaches that support gender equality and human rights.
Similarly, the manager need not be an expert in evaluation methods, but the ToR needs to provide some direction on how the information and data collection process should unfold.
Selection of Methods
- Choose appropriate and relevant methods
- Choose methods that are participatory
- Ensure collection of disaggregated data
- Understand the constraints and challenges of informants
- Interrogate gender roles
- Be context and culturally sensitive
- Emphasize mixed methods
One of the defining features of an evaluation is that it is an assessment, as systematic as possible. Systematic refers to the evaluation methodology – the manner in which evaluation information and data are collected. Evaluation methodologies should consider how quantitative and qualitative data collection can be conducted to respect both GE and HR. This importantly includes avoiding biases in the selection of methods or in deciding on samples within methods, through the inclusion of the full range of stakeholder groups. Biases may involve gender, power (sources able to contribute freely because privacy and confidentiality issues are addressed), class or distance (favouring the more accessible). The methodology should incorporate a plan for how those who are marginalized or disadvantaged will be sought out and included in the data gathering process.
GE/HR responsive evaluation should use both qualitative and quantitative methods. Quantitative methods, such as surveys, use systematic scientific investigation and involve a process of measurement and statistical analysis. Qualitative methods, such as interviews and focus sessions, employ a set of research techniques in which data are obtained from a relatively small group of respondents and (usually) not analyzed with statistical techniques. Combining qualitative and quantitative methods, called a mixed methods approach, increases the reliability and validity of the evaluation findings, as well as helps to explore whether/why different stakeholders groups benefited differently.
Guidance on evaluation methods, including the selection of methods and a checklist is provided here.
Tip: Don’t be overly prescriptive in the ToR – evaluation proposals and inception reports can help refine and improve on approach and methods, if allowed an opportunity to do so.
