Using Data Session 10 Analyzing and Using Data Document Version Date: 2013-09-18
Session Objectives By the end of this course, participants should be able to: Analyze and use performance data for decisionmaking.
Performance Management Managing the design, collection, storage, analysis and use of performance monitoring and evaluation. Monitoring data should inform decision making. Management decisions are also based on findings from evaluation, collaboration and learning.
Performance Management Using data in your work (for performance management): Day-to-day? Portfolio reviews (strategy-level)? Ongoing learning?
Data Analysis Monitoring and analysis of performance data is at the core of USAID s adaptive management process. USAID relies on the best available evidence and analysis to make management decisions, learn more systematically, and document program effectiveness
Ways to Analyze Data Comparing Actuals to Targets Disaggregation Trends Analysis Looking for Patterns Mapping
Analyzing Performance Data Comparing Actuals to Targets 1.1. 1 1.1. 2 1.1. 3 Baseline FY 2012 FY 2013 Indicator Date Actual Target Rationale Number of public policies introduced, adopted, repealed, changed or implemented consistent with citizen input Dimension of NGO Sustainability Index: Advocacy Dimension of NGO Sustainability Index: Legal Environment Number of laws and regulations adopted/amended to improve CSO enabling environment Number of laws and regulations adopted/amended to improve media environment % of citizens who trust in media 2012 0 Mechanisms for citizen input need development 2011 4.3 Trend analysis of last 5 years 2011 3.3 Expert judgment 2012 0 Political environment restrictive; no current bills underway 03/2013 4 Project will support adoption of 4 laws in process + 2 new ones 02/2010 30% Prior studies & experts indicate trust is low Target Actual Target Rationale Mechanisms for 1 1 citizen input improved 4.2 4.2 Project gains momentum 3.3 3.5 Project gains momentum 1 1 Improved advocacy practice by CSOs 6 6 Project supports 6 laws 35% 29% Journalists demonstrate improved skills & ethical practice Target Actual 5 4 4.0 4.2 3.0 3.5 3 3 6 3 45% 32%
Analyzing Performance Data Comparing Actuals to Targets Demand For Program Exceeds Expectations 350 Teachers Trained 300 250 Program expected to wined down 200 150 100 Target Actual Program Funds are depleted early due to very successful program Low target for program ramp-up 50 0 2006 2007 2008 2009 2010 2011 2012 Program implementation started later than projected in year
Analyzing Performance Data Trend Analysis
Analyzing Performance Data Disaggregation 5 4.5 4 Civil Society 1 to 5 Scale 3.5 3 2.5 Electoral Process Independent Media 2 1.5 Rule of Law Governance Anti-Corruption 1 Source: Freedom House, Nations in Transit 2010.
Analyzing Performance Data Disaggregation Expose differences between Groups Index components Disaggregate by: sex, age, income urban/ rural or other geographical location, socio-cultural or ethnic background, language, political/administrative units
Sex Disparities in Yemen Analyzing Performance Data: Disaggregation
Analyzing Performance Data: Disaggregation 100 Illiteracy in India by Sex and Rural/Urban 90 % of Population 80 70 60 50 40 30 20 10 Rural Female Urban Female Rural Male Urban Male 0 1983 1988 1994 2000 2005
Analyzing Performance Data Looking for Patterns Compare PM data with Other indicators for the same result Context indicators Other geographical areas International & national standards Data from other sources (other donors, partners, govt)
Project Site Percent of Total Deliveries at Registered Facilities ID Baseline Target Actual 1 47% 80% 82% 2 24% 45% 43% 3 12% 25% 13% 4 16% 30% 18% 5 21% 40% 39% Analyzing Performance Data: Mapping East Timor - Improving Infant and Child Health
Project Site Percent of Total Deliveries at Registered Facilities ID Baseline Target Actual 1 47% 80% 82% 2 24% 45% 43% 3 12% 25% 13% 4 16% 30% 18% 5 21% 40% 39% Analyzing Performance Data: Mapping East Timor - Improving Infant and Child Health
Project Site Percent of Total Deliveries at Registered Facilities ID Baseline Target Actual 1 47% 80% 82% 2 24% 45% 43% 3 12% 25% 13% 4 16% 30% 18% 5 21% 40% 39% Analyzing Performance Data Mapping East Timor - Improving Infant and Child Health
Analyzing Performance Data: Quantitative % of Underweight Children 60 Malnourishment vs GDP Growth (10 yr) Madhya Pradesh Bihar 50 40 30 Uttar Pradesh Assam Orissa Rajasthan Maharashtra Haryana Gujarat Tamil Nadu West Bengal Karnataka Andhra Pradesh 20 Punjab Kerala 10 0 0 1 2 3 4 5 6 GDP Growth (10 years)
Using Performance Data The purpose of data analysis is to facilitate the use of data in decision making. Portfolio Reviews are an excellent opportunity to put together the big picture.
Ways to Utilize Knowledge Gained from Data Analysis Re-examine causal logic of the CDCS Results Framework and Project LogFrames Respond to identified context changes Engage partners in analysis and discussions around performance trends and gaps in causal logic Enhance dialogue, collaboration and coordination with stakeholders around new knowledge and learning Share knowledge to influence others Inform implementation and facilitate adaptive management
Using Performance Data Mapping Performance to a results framework Improved Performance of Primary School Students More Consistent School Attendance Improved Quality of Classroom om Instruction Reduced Economic Disincentives to School ol Attendance Increased Community Involvement Increased Skills and Knowledge of Teachers Improved Curricula and Teaching Materials Increased Capacity of the Ministry of Education Activities Activities Activities Activities 21
Using Performance Data Exercise 60 minutes in small groups (30 to prepare, 30 to present) Your DO team is preparing for a Portfolio Review. Present (include visuals): Analysis: What does the data mean? Recommendations: What actions should be taken? Evaluation & Learning: What questions need further investigation?
So What s Next? Session 11: Performance Monitoring in Action