Learning and Educational Attainment in Punjab, Pakistan: Thoughts for Debate and Discussion Growth Commission on Education Jishnu Das (CPR & World Bank) Tahir Andrabi (Pomona College) Asim Khwaja and Tristan Zajonc (Harvard U.) Tara Vishwanath (World Bank)
South Asian Education in the New Millennium Remarkable growth of private schools in South Asia during the last 10 years
A map of India
Implications This changes Evaluations of government policy towards schooling (worry about G.E. effects) Construction of research questions (what is the right intervention?) The policy framework for debate (a modified role of the government)
Yet We know very very little Organization of the village education market Village is never taken as sampling unit for facility surveys Parental choice and optimization Little data linking household decisions and school-level inputs The market for teachers Little information on supply elasticity
Data framing the presentation First year of 4-year longitudinal study in 112 villages Randomly selected from villages with a private school in 3 districts of Punjab All schools in these villages: 812 public and private schools 5000 teachers 12000 children followed and tested annually for 4 years 2000 households with 900 children linked to testscore information
Why Punjab? The heartland of private schooling Strong, pro-active lending program from The World Bank Survey baseline initiated with WB program Follows outcomes every year of the program Builds in randomized evaluations Information School-Management Councils
This Presentation Insights from the Learning and Educational Attainment Project in Punjab, Pakistan Basic descriptive facts about schools, teachers, households and learning in villages from 1 st year of survey Relevant highlights about Schools Teachers Households Learning Outcomes Set the stage for academic research and a discussion on the policy framework
A Bit About Pakistan Four main provinces: Punjab, North-West Frontier Province (NWFP), Balochistan and Sindh account for 97% of population Punjab is the largest (55% of population) Azad Jammu Kashmir (AJK), FATA, Islamabad and the Northern Areas are the other 4
A Bit About Pakistan Traditionally poor educational numbers But enrollment is looking up Net Enrollment rates increased from 51 to 61 percent between 2001 and 2005 Like other countries, discourse based on household surveys and school censuses Little information about learning No links between households and schools
The new educational landscape Rapid growth of private schools Questions much like in the US (vouchers/regulation/failing government schools), except for religious schooling which plays a much smaller role: 1% of all enrollment in 2001 (9% in the US)
Private Schools Huge growth in number of schools from 1995 3800 in 1983, 32,000 in 2001 and 47,000 in 2005 Reflected in large increases in enrollment Share of private schooling increased from 29.6% to 36.9% (Punjab), 19.9% to 25.2% (NWFP) and 30.6% to 33.5% (Sindh) Median private school was $1/month in 2001 and $1.5/month in 2005 Highest enrollment growth in rural areas and lowmiddle income households ( 1991-2001)
Private Schools the but Primarily a Punjab and NWFP phenomenon Not rural Sindh or Balochistan Primarily a richer village phenomenon Although this seems to be changing slowly Government schools are everywhere And the only option in most poorer villages
Distribution of Private Schools Persons per private school 20000 15000 10000 5000 0 Population per Private School Across Village Socio-economic Categories 17620 13169 10119 6033 3673 2486 629 712 832 Lowest SES Middle SES Highest SES Village Type 2001 (Private) 2005 (Private) 2005 (Public) Private schools are overwhelmingly located in high SES villages while there is equal access to government schools in all types of villages
LEAPS data adds the within village perspective to this overall picture and looks at all inputs into the education production function
Here is what a village looks like now 3 4 g 5 2 1 One Village in Attock 13 6 g 21 7 25 mins walk 11 8 GPS Longitude East (Decimal) 50.44 50.445 50.45 50.455 50.46 50.465 50.69 50.695 50.7 50.705 50.71 50.715 GPS Latitude North (Decimal) Govt. Boys School Govt. Girls School Private School
These location patterns are generic School Locations and Number of Nearby Schools -.5 0.5 1 % Private and School Wealth Index Only School 1 more school 2 more schools 3-5 more schools 6 or more schools % Private Schools School Wealth Index Private schools are overwhelmingly located in schooling clusters where students are richer
Tremendous Variation Across Schools Infrastructure and student-teacher ratios Figure 2.4: Private schools report lower student-teacher ratios and better basic facilities and there are some government schools where student-teacher ratios exceed 50 and basic facilities are completely absent kdensity 0.02.04.06 Student/Teacher Ratio in Schools By School Type kdensity basic_facilities 0.1.2.3.4 Basic Facilities By Type 0 100 200 300 400 500 x Government Schools Private Schools -2 0 2 4 6 8 x Government Schools Private Schools
Tremendous Variation Across Schools (2) Rs. per year per student 0.0005.001.0015 The Distribution of Teaching Costs 0 1000 2000 3000 4000 5000 x Government Schools Private Schools The median cost of educating a child in the government sector, at Rs.2000 per year, is twice that in the private sector, at Rs.1000
So what drives cost-differences? Salary in Rs. 0 2,000 4,000 6,000 Teacher Compensation 6178 5299 1619 1231 Unadjusted Adjusted Unadjusted Adjusted Private Public Private School Teachers are paid 20% of their government counterparts
Hiring and compensation Government Sector Hires more educated and better trained teachers Ensures equitable distribution across all villages Setting wages to ensure access in remote areas? Has no link to performance Pays a uniform wage (no discrimination)
Compensation and the labor market Public/Private Wage Premiums and Penalties -28.1-5.8 1 2.0 3.0 113.8 Public School Training Premium Public Female Penalty Public Local Penalty Private School Training Premium Private Female Penalty -20.5 Private Local Penatly -50.0 0.0 50.0 100.0 150.0 Percent Premium/Penalty The private sector exploits local market conditions: women and local teachers are paid (a lot) less
Private Sector Location Decisions Figure II. Probability of Private School w/ Exposure to Government Schools Probability.05.1.15.2 0 5 10 15 20 Exposure in Years Girls Primary School Exposure Boys Primary School Exposure Girls Secondary School Exposure Boys Secondary School Exposure As a consequence, private sector location decisions respond to the availability of an educated female workforce
How do households make decisions? Information Household Preferences
Information: Parents know how well their kids are doing Mother's Perception of Intelligence and Child's Test Score By Literacy of Mother Scaled Test Score -.6 -.4 -.2 0.2.4 Poor Average Above Average Poor Average Above Average Illiterate Literate English Urdu Math
Information: Parents know how good schools are Parental Assessment and Actual Performance of Schools in English Mothers By Literacy Fathers -.4 -.2 English 0 Scaled Test.2 Score.4 Cannot Read Can Read Cannot Read Can Read Poor Average Above average Poor Average Above average
Preferences: Distance matters Distance and Enrollment Percent of All Schools 0 5 10 15.4.5.6.7.8.9 % Enrolled 0.5 1 1.5 Distance to Closest School Frequency of Distance to School Boys Girls For girls, every 500m distance from school is associated with a 15%-point drop in enrollment
Preferences: Parents choose winners Education Expenditure by Intelligence and School Type Mean Education Expenditure 0 100 200 300 400 Private Public Very Poor Poor Average Above Average Highly Above Average
So: What do they learn Across all schools, children perform far below curricular standards by the end of Grade III Majority can do single-digit subtraction Recognize English alphabets and simple picture matching Read simple words in Urdu, but only 31 percent can write a sentence with the word school
Learning Outcomes: The Facts Subject Table 1.1: What do Children Know in Mathematics The Question Percentage who answered correctly Corresponding Grade for Curriculum Mathematics 4 + 6 89 K & I Mathematics 36 + 61 86 K & I Mathematics 8 3 65 K & I Mathematics 5 x 4 59 II Mathematics 238-129 32 II Mathematics Read and Write the time (Clock shows 3:40) 24 II Mathematics 384 6 19 III Mathematics 4 x 32 50 III Mathematics Fractions: ½ + 3/2 19 III Mathematics Read a diagram of a scale to answer which part is heavier 12 III Mathematics Fractions: 7/5 ¾ 1 IV Notes: Questions are from the Pakistan LEAPS exam. Columns 3, 4, and 5 report the percentage of children who answered the question correctly in all schools, government schools, and private schools. Children are performing significantly below curricular standards in Mathematics
Learning Outcomes: The Facts 150 Private Government School Gap 149 143 100 101 92 76 73 50 0 Math Urdu English Unadjusted Gap Adjusted Gap The main learning differences are across public and private schools
Learning Outcomes: The Facts Rich Poor Gap Father Literate Illiterate Gap 80 60 40 40 66 73 80 60 40 34 45 49 Private Government School Gap 20 0 7 15 12 20 0 9 11 7 150 100 101 92 149 143 20 Math Urdu English 20 Math Urdu English 50 76 73 Mother Literate Illiterate Gap Female Male Gap 0 Math Urdu English 80 80 Unadjusted Gap Adjusted Gap 60 40 20 0 20 57 47 35 4 5 7 Math Urdu English 60 40 20 0 20 27 26 17 18 4 12 Math Urdu English Unadjusted Gap Adjusted Gap Differences across public-private schools are 8 to 15 times the difference across socio-economic categories
Learning Outcomes: The Facts English Urdu Math 600 Class 3 Private 597 596 568 150 100 50 0 Private Government School Gap 149 143 101 92 76 73 Math Urdu English Unadjusted Gap Adjusted Gap Knowledge Score 550 500 Public 492 507 503 450 455 470 478 3 4 5 3 4 5 Class 3 4 5 And its going to take government school children 1.5-2.5 years to catch up to private school learning outcomes in Grade III
Learning Outcomes: The Facts The Cost of Schooling Cost in Rupees for Every Percent Correct 0 100 200 300 400 Public Private English Urdu Math The cost per percentage correct in a test is 2-3 times higher in public schools
and the worst private schools are much better than the worst govt. schools English Test Scores in Public and Private Schools English Test Scores for Children from Different Families High Performance High Average Score in Sample of 12000 children Performance Average Score in Sample of 12000 children Best Schools (95 th Percentile) Top Wealth Decile/ Literate Parents Low Public Schools Private Schools Worst Schools 5 th Percentile) Low Socio- Economic Status Literacy Bottom Wealth Decile/Illiterate Parents When government schools fail, they fail completely
A Proposal for Reform Government sector should complement private sector Three ways Provide information for competition (learning outcomes in every school) Reform government hiring and compensation of teachers Experiment with vouchers
Teacher and Child Test Scores Private and Public Schools Child English Test Scores.2.3.4.5 The difference in test-scores between children in private and public schools with secondary educated teachers The English Test score of a teacher with a bachelors.7.75.8.85.9.95 Teacher English Test Scores Private Teachers Public Teachers The difference in test-scores between children with a secondary educated teacher and a teacher with a bachelor s degree in the public school The English Test score of a teacher with secondary education The figure is based on a non-parametric plot of child English test scores against teacher s English test scores in the public and private sectors.
Government Teacher Reform Required? (2) This is the gap in child test-scores between children in public and private schools, both with teachers who have a secondary education This is the gap in child test-scores between children with teachers who have a secondaryeducation versus a bachelor s degree This is the average salary of a teacher in the public sector This is the average salary of a teacher in the private sector
Government Teacher Reform Required? Reforming hiring and compensation is politically difficult Teacher unions hard for the Terminator in the US; Pakistan is no different Use teacher posting and transfers to complement private sector location decisions Access for the poor Creating the teachers for tomorrow (secondary schooling is mostly government) Allow districts to set own salaries With recourse to a set of teachers from the province
Experimenting with vouchers Need Parents are informed Parents care about what governments care about The supply curve of private schools is sufficiently elastic #1 is probably not a problem, #2 and #3 are
And government schools? Given parental preferences (distance, higher investments in certain children) Given supply constraints in the private sector Given core failing government schools Need at least an interim strategy to improve government schools This is all about teachers, teachers, teachers Hints from US reforms? (NCLB)
Oh.and the WB project Private sector share expanded fastest in Punjab during the 4 years of the WB project compared to other provinces Despite all funding to government schools only Test-Scores stagnated For both public and private schools The private-public infrastructure gap widened Although a large part of the lending program is improving infrastructure