Building State Capability for Policy Implementation MICHAEL WOOLCOCK DEVELOPMENT RESEARCH GROUP, WORLD BANK DEC POLICY RESEARCH TALK WASHINGTON, DC JUNE 5, 2017 Free download available at: http://bsc.cid.harvard.edu/building-state-capability-evidence-analysis-action
Overview 1. Rationale Why state capability for policy implementation matters 2. Evidence 3. Analysis 4. Action The (unhappy) state of state capability Explaining the limits of past, current approaches Implications for operational research Applications to operational practice (PDIA) Within the World Bank, and beyond
1. Rationale Why building state capability matters: 1. The development challenges only get harder SDG 4: In Education, from enrollment to learning SDG 16: Peace, inclusion, justice for all, accountability Such laudable goals raise expectations on states but current capability is low, and population growth alone (esp. in Africa) will double in next 30 years 2. Any policy is only as good as its implementation SDG 17: Strengthen the means of implementation But technical and adaptive problems are really different IFIs were (primarily) designed to engage with the former Erecting schools, printing textbooks isn t classroom instruction Especially important in fragile states
2. Evidence Only the 13 historically developing countries (in green) are on a plausible path to strong capability by the end of the 21 st C Rapid negative Slow Rapid positive (g<-.05) Negative (-.05<g<0) Positive (0<g<05) (g>.05) Strong (SC>6.5) BHR, BHS, BRN CHL(0), SGP(0), KOR(0), QAT(0) ARE(0) Middle (4<SC<6.5) Weak (2.5<SC<4) 8 0 3 4 1 MDA, GUY, IRN, PHL, PER, EGY, CHN, MEX, LBN, KAZ(10820), GHA(4632), LKA, MNG, ZAF, MAR, VNM, BRA, IND, JAM, SUR, PAN, UKR(1216), ARM(1062), THA, NAM, TTO, ARG, CUB, TUN, JOR, OMN, MYS, RUS(231), BWA(102), CRI KWT, ISR IDN(68), COL(56), TUR(55), DZA(55), ALB(42), SAU(28), URY(10), HRV(1) 45 13 18 14 0 GIN, VEN, MDG, LBY, PNG, KEN, NIC, GTM, SYR, DOM, PRY, SEN, GMB, BLR MLI, CMR, MOZ, BFA, HND, ECU, BOL, PAK, MWI, GAB, AZE, SLV Very weak (SC<2.5) YEM, ZWE, CIV SOM, HTI, PRK, NGA, COG, TGO, MMR UGA(6001), AGO(2738), TZA(371), BGD(244), ETH(103), ZMB(96) 32 14 12 6 0 SDN(7270), SLE(333), ZAR(230), IRQ(92) NER(66), GNB(61), LBR(33) 17 3 7 4 3 102 30 40 28 4 Source: Authors calculations of state capability from Quality of Government, Failed State Index, and World Governance indicators Number in brackets is years to the level of the lowest OECD country ( Portugal )
Glacial progress on governance e.g., Guatemala s distance to Portugal
Education in India Successive cohorts doing worse Parents smuggling answers to students doing exams (Bihar, India)
Education in Indonesia Poor service, even for the wealthy
Low capability, even on routine tasks Testing the post office in 157 countries Percent of 10 misaddressed letters returned to USA within 90 days Lowest 25 countries Bottom half of countries by years of Lowest quartile Third quartile by income 0 9.2 21.2 30 Includes not just Somalia and Myanmar but Tanzania, Ghana, Nigeria, Egypt, Russia, Mongolia, Cambodia, Honduras, Fiji, etc. Second quartile by income 43 Top quartile by income 60 Colombia 90 Uruguay 90 Finland 90 Czech Republic 100 0 10 20 30 40 50 60 70 80 90 100 Source: Chong, et al (2014)
but especially in complex tasks (i.e., high discretion, transaction-intensive, contentious) Anthropology Sociology Popular Culture On implementing a national social protection program for women in rural India On implementing responses to the AIDS crisis in Malawi On implementing the welfare state under austerity in Britain
3. Analysis Three big questions, three short answers a) If implementation matters, how can it be getting worse while human welfare (in aggregate) keeps getting better? b) If most efforts to enhance state capability are struggling, how and why do such efforts continue to be supported? c) Similar arguments have been made before, and didn t really change practice. How might this time be different?
(a) How can implementation be declining if welfare is improving? Because so many places were starting from a very low base And if a country stops doing awful things (civil war, endemic corruption) and starts providing basic public goods (roads, immunization, stability), major gains ensue But the low hanging fruit has mostly been plucked and each success just raises expectations or lowers tolerance for evils which were endured with patience so long as they were inevitable the abuses which are removed seem to lay bare those which remain, and to render the sense of them more acute (Tocqueville; see also Huntington 1968 et al) Development challenges just keep getting harder (not easier)
(b) How do so many efforts at reform succeed yet fail? Isomorphic Mimicry : Success determined by appearances, inputs, adoption of best practices, not actual achievements Transitional Justice, Corruption, Education Premature Load Bearing : Ask too much too soon of too little Which inevitably leads to failure, thereby delegitimizes the idea of reform Square Pegs, Round Holes : Prevailing administrative systems largely designed for technical problems, logistical decisions i.e., for filling object gaps (Romer 1993): infrastructure, factories and macroeconomic management (interest rates, etc) not problems requiring tacit knowledge (mostly unobservable ) So, seeing like a state (Scott 1998) meets looking like a state (PWA, 2013)
(c) Earlier generations made similar claims. How might this time be different? [The options presented to us] often fits so ill with our own style or is so far removed from it that we can use it at best as a decoration and not as material to build with. there has been so little to choose from. Ki Hajar Dewantara, 1935 (Education reformer, Indonesia) Lindblom (1960s), Hirschman (1970s), Rondinelli (1980s), Scott (1990s) Strong diagnosis, weak proscription, no social movement
(c) Earlier generations made similar claims. How might this time be different? [The options presented to us] often fits so ill with our own style or is so far removed from it that we can use it at best as a decoration and not as material to build with. there has been so little to choose from. Ki Hajar Dewantara, 1935 (Education reformer, Indonesia) Lindblom (1960s), Hirschman (1970s), Rondinelli (1980s), Scott (1990s) Strong diagnosis, weak proscription, no social movement So, Building State Capability seeks to: Expand, improve, refine empirics and diagnostics (Part I) On this basis, offer a concrete, actionable alternative (Part II) Contribute to building a global social movement Book available online for free, to anyone (2500 in four months, 150 countries) Companion training program available online for free, to anyone Work with wide array of global partners Doing Development Differently
4. Action How can we do development differently? Building state capability by expanding local successes Different kinds of implementation problems require different kinds of solutions Thus need different kinds of evidence and strategies Organizations, like individuals, acquire capability through practice Cf. languages, musical instruments, sports You can t juggle without the struggle Document, explore, explain, share sub-national variation Wide variance in outcomes a ubiquitous feature of complex problems Integrate broad surveys with detailed case studies of how vexing implementation problems were solved Global Delivery Initiative (World Bank et al) Innovations for Successful Societies (Princeton)
Wide variation between countries In education, why is poor Vietnam better than rich Norway? East Asia & Pacific OCED Middle East North Africa Eastern Europe Central Asia Latin America & Caribbean High Income East Asia Source: OECD (2016)
Wide variation within countries e.g., Health clinic performance. Why? Algobein Alsawadiah Alhaymah Aldak Mothikerah Alodein Alfaraa Alsadah Mazhar Hobeish Alqoraishiah Yareem Almakhader Manakhah Alqafr Alaymah Alkhar Bani Dhabian Kosmah Alttafah Absenteeism by District, Yemen 0% 20% 40% 60% 80% 100% 8% 18% 18% 20% 20% 20% 23% 24% 25% 25% 25% 25% 27% 27% 29% 33% 33% 35% 38% 38% 40% 49% 50% 50% 50% 50% 52% 52% 67% 70% 73% 78% 80% 82% 83%
No singular solutions: the mechanisms for managing staff may be very different than those for providing equipment and amenities Correlation of Measures at Governorate and District Levels in Yemen GOVERNORATE Absenteeism # of Beds Electricity Heat Water Phone Absenteeism 1 # of Beds -0.2468 1 Electricity -0.1921-0.1604 1 Heat -0.0158 0.5782 0.6472 1 Water -0.3928-0.0641 0.9773 0.6361 1 Phone -0.0019 0.5529 0.6649 0.9995 0.6491 1 DISTRICT Absenteeism # of Beds Electricity Heat Water Phone Absenteeism 1 # of Beds 0.017 1 Electricity -0.0136 0.1645 1 Heat 0.0513 0.3887 0.8618 1 Water -0.0032 0.1163 0.9309 0.8829 1 Phone 0.0554 0.2939 0.8828 0.9427 0.9013 1 Source: Brixi, Lust and Woolcock (2015)
Implications for operational research Thus a key role for evidence in improving implementation quality entails (a) mapping variation in the outcomes a team proposes to navigate (b) explaining where, how, why and for whom identical policies yield such variation (c) sharing insights from local teams that have managed to navigate this tough terrain better than others All done as part of a more focused strategy that begins and ends with helping local professionals, elected leaders and citizens respond to problems that they themselves have jointly nominated and prioritized i.e., understanding not just the effects of causes but the causes of effects Need ecologies of evidence to do all this well See Vijayendra Rao s work with the Social Observatory (India) Historically and today, capability for implementation learned by doing See Yuan Yuan Ang (2016) How China Escaped the Poverty Trap (Cornell UP)
Applications to operational practice PDIA: Problem-Driven Iterative Adaption An approach to building capability of state organizations while producing results (or: Success gets you good institutions, not good institutions gets you success) Four principles of PDIA: 1. Local Solutions for Local Problems 2. Pushing Problem Driven Positive Deviance 3. Try, Learn, Iterate, Adapt 4. Scale Learning through Diffusion
How does PDIA differ? What drives action? Planning for action? Feedback loops? Scale? Big D (e.g. WB, agencies) Pre-determined solutions ( institutional monocropping, best practice ), more inputs Lots of advance planning (implementation of secondary importance) Monitoring (short, on financing, compliance, inputs) and Evaluation (long feedback loop on outputs, maybe outcomes) Top-down: the head learns, implementation is just muscle ( political will ) small d (e.g. NGOs) Niche, parallel solutions (via variety of antidotes e.g. participation community driven ) Boutique; starting very small with no plans for scale Casual; geared to advocacy, not systemic learning Small is beautiful Or, just not logistically possible PDIA
How does PDIA differ? Big D (e.g. WB, agencies) small d (e.g. NGOs) PDIA What drives action? Pre-determined solutions ( institutional monocropping, best practice ), more inputs Niche, parallel solutions (via variety of antidotes e.g. participation community driven ) Problem-Driven: looking to solve particular problems, locally nominated and prioritized Planning for action? Lots of advance planning (implementation of secondary importance) Boutique; starting very small with no plans for scale Assuring authorizing environment promoting positive deviation, purposive crawl of the design space Feedback loops? Monitoring (short, on financing, compliance, inputs) and Evaluation (long feedback loop on outputs, maybe outcomes) Casual; geared to advocacy, not systemic learning MeE: integration of rigorous experiential learning into tight feedback loops Scale? Top-down: the head learns, implementation is just muscle ( political will ) Small is beautiful Or, just not logistically possible Diffusion of feasible practice across organizations and communities of practitioners
PDIA within, beyond the World Bank 1. Major reports, donor programs World Development Reports Conflict & Security (2012), Behavioral Economics (2015), Governance & Law (2017), Education (2018) Trust, Voice and Incentives: Learning from Local Success Stories in MENA (2015) The Innovation Paradox (forthcoming) DFID, Australian Aid, et al 2. World Bank country programs Indonesia, Nigeria, Sierra Leone, Equatorial Guinea, Tajikistan, Cambodia... 3. Adaptive Fellows Program 4. Global Delivery Initiative http://www.worldbank.org/reference/gdi/ Case studies on implementation dynamics, problem solving, in projects 5. Forging a global community of practice See Doing Development Differently Manifesto (November 2014) http://buildingstatecapability.com/the-ddd-manifesto/ Boston (2014), Manila (2015), London (2016), Jakarta (2017) 6. Other organizations IRC, Mercy Corps, Results for Development, Feedback Labs, RTI, Abt, USAID, global health
Conclusion: A self-critique (or, enacting a propensity for self-subversion ) Water pistol in a gun fight? What if prevailing politics too nasty, overwhelming? Adequate administrative plumbing? Procurement, accounting, etc Securing robust authorizing environment? When political winds shift, staff turnover is high Discerning good failure from design failure, implementation failure When to hold, fold, walk away, run? PDIA-ing PDIA: a perpetual second word on implementation