Methodological Briefs Overview: Data Collection and Analysis Methods in Impact Evaluation: Methodological Briefs - Impact Evaluation No. 10 AUTHOR(S) Greet Peersman Published: 2014 Methodological Briefs Impact evaluations need to go beyond assessing the size of the effects (i.e., the average impact) to identify for whom and in what ways a programme or policy has been successful. What constitutes ‘success’ and how the data will be analysed and synthesized to answer the specific key evaluation questions (KEQs) must be considered up front as data collection should be geared towards the mix of evidence needed to make appropriate judgements about the programme or policy. This brief provides an overview of the issues involved in choosing and using data collection and analysis methods for impact evaluations. + - Cite this publication | No. of pages: 21 | Thematic area: Ethical research, Knowledge management | Tags: data analysis, data collection, evaluation, research methodology × COPY BIBLIOGRAPHIC CITATION Greet Peersman 2014 Overview: Data Collection and Analysis Methods in Impact Evaluation: Methodological Briefs - Impact Evaluation No. 10. , pp. 21.
Methodological Briefs Developing and Selecting Measures of Child Well-Being: Methodological Briefs - Impact Evaluation No. 11 AUTHOR(S) Howard White; Shagun Sabarwal Published: 2014 Methodological Briefs Indicators provide a signal to decision makers by indicating whether, and to what extent, a variable of interest has changed. They can be used at all levels of the results framework from inputs to impacts, and should be linked to the programme’s theory of change. Most important at the lower levels of the causal chain are monitoring indicators such as inputs (e.g., immunization kits supplied), activities (e.g., immunization days held) and outputs (e.g., clinics built). For higher-level indicators of outcomes and impact, however, monitoring tells us what has happened but not why it happened. To understand this, impact evaluation must be used to increase our understanding of the factors behind achieving or not achieving the goal. + - Cite this publication | No. of pages: 20 | Thematic area: Ethical research, Knowledge management | Tags: indicators, monitoring, programme evaluation, research methods × COPY BIBLIOGRAPHIC CITATION Howard White; Shagun Sabarwal 2014 Developing and Selecting Measures of Child Well-Being: Methodological Briefs - Impact Evaluation No. 11. , pp. 20.
Methodological Briefs Interviewing: Methodological Briefs - Impact Evaluation No. 12 AUTHOR(S) Bronwen McDonald; Patricia Rogers Published: 2014 Methodological Briefs Interviews are easy to do badly and hard to do well - good planning, adequate time and appropriate skills are required. The type of interview should be carefully chosen to suit the situation rather than choosing a type of interview (such as focus groups) simply because it is commonly used. Interviews with children raise particular ethical issues that need to be carefully considered and fully addressed. This brief outlines key issues to consider in planning interviews for impact evaluation, taking into account the purpose of the evaluation, how interview data aim to complement other data for assessing impact, and the availability of resources. + - Cite this publication | No. of pages: 15 | Thematic area: Ethical research, Knowledge management | Tags: data collection, evaluation, research methods × COPY BIBLIOGRAPHIC CITATION Bronwen McDonald; Patricia Rogers 2014 Interviewing: Methodological Briefs - Impact Evaluation No. 12. , pp. 15.
Methodological Briefs Modelling: Methodological Briefs - Impact Evaluation No. 13 AUTHOR(S) Howard White; Shagun Sabarwal Published: 2014 Methodological Briefs Modelling is an approach to impact evaluation which uses mathematical models to describe social and economic relationships and to infer causality from an intervention to an outcome, and/or between an outcome and its determinants. Models with more than one equation are most valuable, as they allow for both direct and indirect effects and also two-way relationships to be captured. Models can be used to examine the impact of a programme or policy by introducing them as an exogenous change in some of the variables, parameters or equations. + - Cite this publication | No. of pages: 11 | Thematic area: Ethical research, Knowledge management | Tags: evaluation, mathematical models, models, research methods × COPY BIBLIOGRAPHIC CITATION Howard White; Shagun Sabarwal 2014 Modelling: Methodological Briefs - Impact Evaluation No. 13. , pp. 11.
Methodological Briefs Présentation de l'évaluation d’impact : Note méthodologique - Évaluation d'impact n° 1 Published: 2014 Methodological Briefs L’évaluation d’impact fournit des informations sur les effets induits par une intervention. Elle peut être réalisée dans le cadre d’un programme, d’une politique ou de travail en amont, par exemple le renforcement des capacités, le plaidoyer politique et l’appui à la mise en place d’un environnement favorable. Cela va au-delà d’une simple étude des buts et objectifs et examine également les impacts inattendus. + - Cite this publication | No. of pages: 22 | Thematic area: Ethical research, Knowledge management | Tags: evaluation techniques, programme evaluation, research methods × COPY BIBLIOGRAPHIC CITATION 2014 Présentation de l'évaluation d’impact : Note méthodologique - Évaluation d'impact n° 1. , pp. 22.
Methodological Briefs Présentation des stratégies d'attribution causale : Note méthodologique - Évaluation d'impact n° 6 AUTHOR(S) Patricia Rogers Published: 2014 Methodological Briefs L’un des éléments essentiels d’une évaluation d’impact est qu’il ne s’agit pas seulement de mesurer ou de décrire les changements survenus, mais également de comprendre le rôle joué par certaines interventions particulières (programmes ou politiques) dans ces changements. Ce processus est appelé attribution causale. Il existe trois grandes stratégies d’attribution causale dans les évaluations d’impact : 1) l’estimation du scénario contrefactuel ; 2) la vérification de la cohérence des données probantes pour les relations de cause à effet explicitement exposées dans la théorie du changement ; et 3) l’exclusion d’autres explications par le biais d’un processus logique fondé sur des données probantes. La stratégie d’attribution causale la mieux adaptée dépend du contexte d’évaluation et de ce qui est évalué. + - Cite this publication | No. of pages: 18 | Thematic area: Ethical research, Knowledge management | Tags: evaluation analysis, programme evaluation, research methods × COPY BIBLIOGRAPHIC CITATION Patricia Rogers 2014 Présentation des stratégies d'attribution causale : Note méthodologique - Évaluation d'impact n° 6. , pp. 18.
Methodological Briefs Présentation des méthodes de collecte et d'analyse de données dans l'évaluation d'impact : Note méthodologique - Évaluation d'impact n° 10 AUTHOR(S) Greet Peersman Published: 2014 Methodological Briefs Les évaluations d’impact ne doivent pas se cantonner à déterminer l’ampleur des effets (c’est-à-dire l’impact moyen), mais doivent également identifier qui a bénéficié de ces programmes ou politiques et comment. Il convient de préciser dès le début ce qui constitue une « réussite » et la façon dont les données seront analysées et synthétisées pour répondre aux questions clés d’évaluation. La collecte de données doit en effet permettre d’obtenir l’ensemble de données probantes nécessaires pour porter des jugements appropriés sur le programme ou la politique. + - Cite this publication | No. of pages: 24 | Thematic area: Ethical research, Knowledge management | Tags: evaluation analysis, programme evaluation, research methods × COPY BIBLIOGRAPHIC CITATION Greet Peersman 2014 Présentation des méthodes de collecte et d'analyse de données dans l'évaluation d'impact : Note méthodologique - Évaluation d'impact n° 10. , pp. 24.
Methodological Briefs Sinopsis de la Evaluación de Impacto: Síntesis metodológica - Sinopsis de la evaluación de impacto n° 1 AUTHOR(S) Patricia Rogers Published: 2014 Methodological Briefs La evaluación de impacto proporciona información sobre los impactos que produce una intervención. Puede realizarse una evaluación de impacto de un programa o una política o del trabajo preliminar, como la creación de capacidad, la promoción de políticas y el apoyo a la creación de un entorno propicio. Esto supone examinar no solo las metas y los objetivos, sino también los impactos imprevistos. + - Cite this publication | No. of pages: 21 | Thematic area: Ethical research, Knowledge management | Tags: programme evaluation, research methods × COPY BIBLIOGRAPHIC CITATION Patricia Rogers 2014 Sinopsis de la Evaluación de Impacto: Síntesis metodológica - Sinopsis de la evaluación de impacto n° 1. , pp. 21.
Methodological Briefs Sinopsis: Estrategias de Atribución Causal: Síntesis metodológica - Sinopsis de la evaluación de impacto n° 6 AUTHOR(S) Patricia Rogers Published: 2014 Methodological Briefs Uno de los aspectos esenciales de la evaluación de impacto es que no solo mide o describe los cambios que han ocurrido, sino que también procura entender la función de determinadas intervenciones (es decir, programas o políticas) en la generación de estos cambios. Este proceso se conoce como atribución causal. Existen tres estrategias generales de atribución causal en las evaluaciones de impacto: 1) estimar lo contrafáctico; 2) comprobar la coherencia de las pruebas empíricas respecto a las relaciones causales explicitadas en la teoría del cambio; y 3) descartar explicaciones alternativas mediante un proceso con base empírica lógico. La estrategia más adecuada para la atribución causal depende del contexto de evaluación, así como de lo que se está evaluando. + - Cite this publication | No. of pages: 17 | Thematic area: Ethical research, Knowledge management | Tags: evaluation, programme evaluation, research methods × COPY BIBLIOGRAPHIC CITATION Patricia Rogers 2014 Sinopsis: Estrategias de Atribución Causal: Síntesis metodológica - Sinopsis de la evaluación de impacto n° 6. , pp. 17.
Methodological Briefs Sinopsis: Métodos de recolección y análisis de datos en la evaluación de impacto: Síntesis metodológica - Sinopsis de la evaluación de impacto n° 10 AUTHOR(S) Greet Peersman Published: 2014 Methodological Briefs Las evaluaciones de impacto deben ir más allá de la simple evaluación de la magnitud de los efectos (el impacto medio) para determinar con quién ha tenido éxito un programa o política y de qué forma. Lo que constituye «éxito» y la forma de analizar y sintetizar los datos para responder a las preguntas clave de evaluación específicas debe examinarse por anticipado, puesto que la recolección de datos debe orientarse a la combinación de pruebas empíricas necesarias para tomar decisiones adecuadas sobre el programa o política. + - Cite this publication | No. of pages: 24 | Thematic area: Ethical research, Knowledge management | Tags: data collection, evaluation techniques, research methods × COPY BIBLIOGRAPHIC CITATION Greet Peersman 2014 Sinopsis: Métodos de recolección y análisis de datos en la evaluación de impacto: Síntesis metodológica - Sinopsis de la evaluación de impacto n° 10. , pp. 24.
Methodological Briefs Overview of Impact Evaluation: Methodological Briefs - Impact Evaluation No. 1 AUTHOR(S) Patricia Rogers Published: 2014 Methodological Briefs Impact evaluation provides information about the impacts produced by an intervention. It can be undertaken of a programme or a policy, or upstream work – such as capacity building, policy advocacy and support for an enabling environment. This goes beyond looking only at goals and objectives to also examine unintended impacts. This brief provides an overview of the different elements of impact evaluation and options for planning and managing its various stages. + - Cite this publication | No. of pages: 20 | Thematic area: Ethical research, Knowledge management | Tags: capacity building, evaluation, policy and planning × COPY BIBLIOGRAPHIC CITATION Patricia Rogers 2014 Overview of Impact Evaluation: Methodological Briefs - Impact Evaluation No. 1. , pp. 20.
Methodological Briefs Theory of Change: Methodological Briefs - Impact Evaluation No. 2 AUTHOR(S) Patricia Rogers Published: 2014 Methodological Briefs A theory of change explains how activities are understood to produce a series of results that contribute to achieving the final intended impacts. It can be developed for any level of intervention – an event, a project, a programme, a policy, a strategy or an organization. In an impact evaluation, a theory of change is useful for identifying the data that need to be collected and how they should be analysed. It can also provide a framework for reporting. + - Cite this publication | No. of pages: 16 | Thematic area: Ethical research, Knowledge management | Tags: data analysis, evaluation techniques, reports, research methods × COPY BIBLIOGRAPHIC CITATION Patricia Rogers 2014 Theory of Change: Methodological Briefs - Impact Evaluation No. 2. , pp. 16.
