School Education Department Government of Sindh

Size: px
Start display at page:

Download "School Education Department Government of Sindh"

Transcription

1

2 School Education Department Government of Sindh Standardized Achievement Test (SAT) - IV s:language, Maths & Class V & VIII Technical & Statistical Analysis Report Conducted by: Sukkur Institute of Business Administration ( This material is based on work supported by Reform Support Unit-School Education Department, Government of Sindh under Sindh Education Reform Program-II funded by World Bank Pakistan II

3 Copyright 2016 Reform Support Unit-School Education DepartmentGovernment of Sindh, Pakistan All rights reserved. No part of the publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, electrostatic, magnetic tape,mechanical, photocopying, recording or otherwise without the permission in writing from the copyright holder. The copies of the Standardized Achievement Test (SAT) IV, : Language, Math and of class V & VIII, Technical & Statistical Analysis Report can be obtained from: Office of the Chief Program Manager Reform Support Unit 47-E/1, 48th street, Block 6, PECHS Nursery, Shahrah-e-Faisal Karachi, Pakistan Telephone: Department of Education Sukkur Institute of Business Administration Airport Road, Sukkur-65200, Sindh, Pakistan Telephone: dr.fidahussain@iba-suk.edu.pk The soft copies of the report can also be accessed on & III

4 Authors: Dr. Fida Hussain Chang (Ph. D - Education, Project Director SAT, Sukkur IBA) Ms. Unaeza Alvi (MS Education, Assistant Professor Sukkur IBA) Mr Hamid Ali Shaikh (MBA, Team Lead-Administration SAT, Sukkur IBA) Support Staff Ms.Rakhi Batra Software Engineer, SAT Project Sukkur IBA Mr. Syed Ali Hasnain Shah- Project Officer, SAT Project Sukkur IBA. Mr. Arslan Ali Channa - Project Officer, SAT Project Sukkur IBA. Mr. Raheel Ahmed Memon -Project officer, SAT Project Sukkur IBA. Mr. Muhammad Raees -Project Officer-IT Support, SAT Project Sukkur IBA. Mr. Bhagwan Das - Project Officer-IT Support, SAT Project Sukkur IBA. Mr. Sajid Ahmed - Project Officer-IT Support, SAT Project Sukkur IBA. IV

5 Acknowledgements This study would not have been possible without the help of many people fromthe districts and regions we studied. We appreciate and applaud the efforts of Minister for Education Sindh, Secretary Education Sindh, Chief Program Manager RSU, Deputy Program Manager RSU, Regional Director Education (All Regions), District Officer Education (All Districts), Taluka Education Officers (Male/Female-All Talukas), Supervisors, Head Teachers, Consultants and Coordinators of Local Support Unit (All districts) in the smooth execution of the project activities. We are also thankful to faculty members of the Department of Education-Sukkur IBA for their assistance in technical work. Furthermore we are indebted to the Director Sukkur IBA Office, the Registrar Office, Offic of Research, Innovation & Commercialization ORIC, IT Department, Procurement Office, Engineering Wing, Marketing Department, and all other units of Sukkur IBA for their profound support and cooperation. V

6 s List of Tables... IX List of Figures... X Acronyms and Abbreviations... XI Executive Summary... XII Graphical Overview of SAT IV... XVI SECTION ONE:... 1 TEST DEVELOPMENT AND ADMINISTRATION Overview of Standardized Testing Background of SAT Project SAT IV Test Development Procedures and Processes Test Specification Development and Structure Test Construction Item Development and Test Booklet Construction Pilot Testing and Analysis Pilot Test Administration Sample Item Analysis: Actual Test development and analysis Item selecton Actual test booklet construction Actual Test Administration Test Printing Dispatching of Test Booklets Selection and Training of Taluka/Town Coordinators and Test Invigilators Identifying Clusters of Centre Secondary Schools and Nearby Feeding Primary Schools Preparing Test Field Plans SAT IV ( ) Actual Test Information Dissemination Publication of Sample/Model Papers and Advertisements in Newspapers Regional Workshops Telephone Calls to Head Masters/Mistresses of Government Secondary and Primary Schools by SAT TCs Administration of SAT IV ( ) Actual Test Monitoring Mechanism of Actual Test Administration Monitoring by Reform Support Unit Preparing and Distributing Student Report Cards to the Parents Distribution of Student Report cards Regional Workshops for Dissemination of SAT Phase-IV ( ) Results SAT Project Website VI

7 6.1 Online Item Data Bank Review of Uploaded Items Challenges Faced During SAT IV ( ) SECTION TWO: DESCRIPTIVE ANALYSIS OF RESULTS INTRODUCTION OF RESULTS AND ANALYSIS Province Level Overall and Based Results Province Level Overall and Based Student Scores Class VIII Region Level Based Results Region Level Based Results of Class V Region Level Math Based Results Class V Region Level Based Results Class V Region Level Language Based Results Class VIII Region Level Math Based Results of Class VIII Region Level Based Results of Class VIII District Level Based Results Class V District Level Language Based Results Class V District Level Math Based Results Class V District Level Based Results Class V District Level Based Results Class VIII District Level Based Results of Language Class VIII District Level Based Results of Math Class VIII District Level Based Results of Class VIII Gender based analysis of results Location based analysis of results SEF Schools District Based Results SEF School Districts Based Results Language Class V SEF School Districts Based Results Math Class V SEF School Districts Based Results Class V SECTION THREE: COMPARATIVE RESULTS COMPARATIVE ANALYSIS OF RESULTS Province level language content strand based comparison between class V and class VIII scores Province level math content strand based comparison class V and class VIII Province level science content strand based comparison between class V and class VIII District-based Inter-subject Comparisons Performance (grade) based analysis of districts scores Districts performance level based proportions of students in language Districts performance level based proportions of students in math Districts performance level based proportions of students in science COMPARATIVE ANALYSIS OF SATI, SAT II, SAT III AND SAT IV RESULTS VII

8 17.1 Province level comparison between SAT III and SAT IV District based comparison between SAT I, SAT II, SAT III and IV language scores District based comparison between SAT I, SAT II, SAT III and SAT IV math scores District based comparison between SAT I, SAT II, SAT III and SAT IV science scores Recommendations Capacity Building of Teachers Enhancing Quality of In-service Teacher Education and Teacher Preparation Research References Appendix A (SAT Phase IV ( ) Actual Test Specification Appendix B (ToRs of Taluka/Town Coordinator) Appendix C (Taluka/Town Coordinator Undertaking) Appendix D (Manual for Taluka/Town Coordinators and Invigilators) Appendix E (Monitoring Report Pro-forma) Appendix F (Development, Printing and Dispatch Plan for SAT IV ( ) Student Report Cards) Appendix G (District Profiles of Class V & VIII) Appendix H (Gender Wise Based Results) Appendix I (Location Wise Based Results) Appendix J (School Type Wise Based Results) VIII

9 List of Tables Table 1:Region wise details of class V and VII I students, who appeared in SAT IV ( ) Actual Test Table 2:District-wise Number of Invigilators, Taluka Coordinators and Monitoring Officers... 9 Table 3:Gender-Wise & Medium-Wise Sampled Students Appearance of Classes VI & IX for SAT IV Pilot Test Table 4: Gender- wise Sampled Students Appearance in Pilot Test Table 5Pilot Test Student Sample based on District, Gender and Medium of Schools Table 6:The Reliability Statistics indicates that all the tests are highly reliable and would consistently give reliable results Table 7: Details of SAT IV booklets printed Table 8: Taluka/Town Coordinators Training in different regions of Sindh Table 9: Region based Number of test centers Table 10: Schedule of SAT Orientation Regional Workshops Table 11: Actual Test Administration Table 12: A Brief Summary of Region Wise Monitoring Coverage Table 13: District Level Meeting for orientation of Distribution of Student Report cards Table 14: Schedule of Regional Workshops for dissemination of SAT-IV Results Table 15: Province level content strand based analysis of students scores in class V Table 16: Regional level content strand based analysis of students scores in math of class VIII Table 17: Regional level content strand based analysis of students scores in science of class VIII Table 18: Districts level content strand based analysis of students scores in language of class V Table 19: District Level Math Based Results Class V Table 20: District level content strand based analysis of students scores in science of class V Table 21: District level content strand based analysis of students scores in language of class VIII Table 22: District level content strand based analysis of students scores in math of class VIII Table 23: District level content strand based analysis of students scores in science of class VIII Table 24: Provincial level gender based analysis of students scores in class V Table 25: Provincial level location based analysis of students scores in class V Table 26: Provincial level location based analysis of students scores in class VIII Table 27: SEF schools district wise content strand based analysis of students scores in language of class V Table 28: SEF schools district wise content strand based analysis of students scores in math of class V Table 29: SEF schools district wise content strand based analysis of students scores in science of class V Table 30: Provincial District-wise Results vis a vis Language of Class V and VIII Table 31: Provincial District wise results vis a vis Mathematics s of Class V & VIII Table 32: Provincial District-wise Results vis a vis Mathematics s of Class V & VIII Table 33: Provincial District-wise Results vis a vis s of Class V & VIII Table 34: District-wise Inter-subject Comparison of Students of Class VIII Table 35: District-based proportion of students at various language performance levels Class V Table 36: District-based proportion of students at various language performance levels Class VIII Table 37: District-based proportion of students at various math performance levels Class V Table 38: District-based proportion of students at various math performance levels of Class VIII Table 39: District-based proportion of students at various science performance levels class V Table 40: District-based proportion of students at various science performance levels Class VIII Table 41: Province level comparison between SAT III and SAT IV Table 42: District-based comparative analysis of SAT-I, SAT-II, SAT-III & SAT-IV Language results Table 43: District-based comparative analysis of SAT-I, SAT-II, SAT-III & SAT-IV results IX

10 List of Figures Figure 1. Monitoring Design & Reporting Figure 2District Level Wise Results Class V Figure 3Districts Class V Language Difference from Province s overall Language average Score Figure 4Districts Class V Math Difference from Province s overall Math average Score Figure 5Districts Class V Difference from Province s overall average Score Figure 6Scattered Representation of Districts Overall Scores Class VIII Figure 7Districts Class VIII Language Difference from Province s Overall Language Average Score Figure 8Districts Class VIII math Difference from Province s overall math average Score Figure 9Districts Class VIII Difference from Province s overall average Score X

11 Acronyms and Abbreviations ADOE: Assistant District Officer Education DC: District Coordinator DOE: District Officer Education GSTA: Government Secondary Teachers Association LSU: Local Support Unit PEC: Punjab Examination Commission PIRLS: Progress in International Reading Literacy Study PISA: Program for International Student Achievement PTALIF: Primary Teachers Association RSU: Reform Support Unit RDE: Regional Director Education SAT: Standardized Achievement Test SBA: Shaheed Benazir Abad SEF: Sindh Education Foundation SIBA: Sukkur Institute of Business Administration SPE: Supervisor Primary Education TEO: Taluka Education Officer TC: Taluka/Town Coordinator SRC: Student Report Card STAR: Standardized Testing and Reporting TIMSS: Trends in International Mathematics and Study XI

12 Executive Summary Standardized Achievement Test (SAT) Study was initiated by Reform Support Unit of Education and Literacy DepartmentGovernment of Sindh as a large scale population based study to assessachievement of the students at Govt schools in Language, Math, and at class V and VIII level. The SAT study started in 2012 and the consecutive fourth annual phase of SAT study (SAT IV) was completed in This report covers the technical processes of the test development, the administration of the test, and the statistical analysis of SAT IV results. The underlying aim of the SAT Project is to assess performance of the students learning in three subject areas Language, Math, and. The resultsof SAT are aimed to identify strengths and gaps in student achievement and to inform future educational reforms targeting improvement in education delivery at school, district and province level. On the basis of SAT results, various policies, research, curriculum, teacher development reforms are recommended to improve the quality of educational delivery, with purpose to improve the learning outcomes of students studying in the public sector schools ofsindh. This report has three main sections.section one covers thetechnical and administrativedetails of the SAT IV project. It includes detailed description about overall planning of the project, test development procedures and processes, test administration, test monitoring and test grading (or e-marking) of pilot test as well asactual test. Moreover, it also contains descriptions about results dissemination and reporting (Student Report Cards), development and review of item data bank, and project website. Section two presents various analysis of results, which include content strand-based analysis at province, region, and district levels as well as analysis of students achievement based on gender and location. Mostly descriptive statistics based analyses are provided such as averages, percentages, comparative differences, standard deviations, and so on. Averages(mean scores) are given as percentage scores as an alternative of actual score points to facilitate readers inunderstanding students performanceat various levels and comparisons clearly. Generally students overall language average scores at province level were found around 32% for class V and 37% for class VIII; whereas,the average score of Maths and was XII

13 around 24% for both classes. On a closer look at dispersion of school scores, many schools scores go beyond 60% score in Language and beyond 40% in Math and, which seems to be a strong area for further systematic exploration of students as well as schools achievement. Specific exploration should target understanding what makes many students and number of schools perform relatively higher and how knowledge about these students and schools can help improve low-performing schools. While students overall low scores in Math and suggest most of schools performed low; however, reasonably moderate variation in scores indicate some schools performed relatively higher than mean scores which could be a good area for further exploration. strand based analysis at district, region, and province level for classes V and VIII revealed Language scores highest, followed by Maths and scores which is a consistent pattern in performance across the province. Moreover, reading scores were found higher for both grades (around 50% for grade V and 58% score for grade VIII) in contrast to very low writing scores (around 15% for class V and around 25% for class VIII) suggesting that there is too much emphasis on teaching reading comprehension and a little focus on developing students writing skills. Severely low performance in writing seems to be a result of note-dictating strategy traditionally used by teachers working in Govt. school to teach writing. In the traditionalstrategy,students copy a written piece (by teacher or someone else) and reproduce it on their fair copy. Traditionalstrategy to teach writing does not develop students' ability to write a piece of description or information or a story on their own. Engaging students to write on their own instead of note-dictating needs to be taught to the teachers. Math scores were generally found low in all content strands. students score in Algebra and Geometry was found severely low across the province. Geometry, being one of the last units in the grade based curriculum and in the textbooks seems to be less covered by teachers; however, reasons of severe low performance in Algebra and Geometry needs to be studied systematically along with low performance in other content strands. One plausible reason seems that teachers content knowledge and pedagogical content knowledge as well as pedagogical skills may not be up to the required level to teach the subject effectively. scores were also low, with few variations, in all content strands and relatively low in physical science. Generally smaller standard deviations in comparison to mean scores were found, which suggests small variations in scores, but there were several high-performing students and schools, which also needs to be explored further. XIII

14 Analysis based on gender and location showed that girls were slightly ahead in Language (particularly reading), whereas girls and boysperformed almost same in Math and.there seems to be a reasonable difference between rural and urban groups in Language scores at class VIII level, as urban students scored 5 percent points higher. Similar performance of students different groups in most of the subject areas suggests that schooling conditions are almost uniform across the province and most probably same strata of population attend these schools. In order to improve scores, schooling conditions need to be improved and schools should be able to attract students from all strata of the population. Comparative analysis included comparison between class V and class VIII, inter-subject comparison, performance level comparisons, and comparison between results of different SAT phases. Class V and class VIII comparison in Language, Maths&, revealed that class VIII students scoredon average higher in language;slightlyhigher in reading comprehension and significantly higher in writing. While class VIIIwas found performing almost same in overall math scores, class Vscored higher in number and operations; whereas class VIII performed slightly higher in geometry and algebra. In science, class VIII students performed slightly higher in life science; whereas, class V students performed slightly higher in physical. Inter-subject comparison revealed districts following a pattern: highest score in language, followed by math, and sciencescores. Most of the districts performance also was found moderately narrow as most of the districts scores varied maximum 8 percent points higher or lower from their highest ranked score in a subject. Moreover, districtsstudents scores were pooled in four performance level proportional groups: low, mediocre, high, and exceptional. Students across districts mostly performed at low and mediocre levels, but a reasonable number of students performed at high level in Language; whereas noneof themperformed at exceptional level. For Math and, relatively higher percent was found performing at low and mediocre levels. A small number of students were foundperforming athigherlevel in Math but a relatively tiny numbergot to high level in. Nonetheless, students and schools performing at high level need attention in further exploration as studying them may lead to breakthroughs in understanding and to work on school improvement and enhancing students achievement. XIV

15 Comparative analysis of SAT III and SAT IV scores showed slightly higher scores in SAT IV but the differences are not significant statistically; therefore, comparison of results needs to be used and explained carefully. There was considerable variation among districts scores, as many of them scored higher in SAT IV but some of them scored less in SAT IV, and in some cases, a district scored higher in one subject area whereas lower in other subject area. Graphical representations as followed provide an overall picture of class V and class VIII students performance across the province in three subject areas. XV

16 Graphical Overview of SAT IV Graphical overview (stretched on eight pages) provides a concise and overall information about SAT IV student appearance and overall as well as content strand based results at province, region, and district level. Graphical overview is purposed to facilitate readers to get overall idea of appearance and results; whereas, main body of the report provides detailed and extensive analyses for a deeper understanding. Student Appearance Class V REGION WISE APPEARANCE OF STUDENTS IN CLASS V TOTAL 179,563 SBA, 28,555, 16% SEF, 1,432, 1% Sukkur, 28,078, 16% Karachi, 22,852, 13% Larkana, 38,609, 21% Hyderabad, 41,765, 23% Mirpur Khas, 18,272, 10% XVI

17 Reading Writing No & oper Measurement Algebra Geometry Info Handling life Physical Earth & Space Student Appearance Class VIII REGION WISE APPEARANCE OF STUDENTS PERCENT AVERAGE IN CLASS VIII TOTAL 111,177 SBA, 18,572, 17% Sukkur, 12,854, 12% Larkana, 20,461, 18% Karachi, 23,933, 22% Mirpur Khas, 10,541, 9% Hyderabad, 24,816, 22% Overall and Based Results Class V (% average) P R O V I N C I A L L E V E L C O N T E N T S T R A N D B A S E D A N D S U B J E C T W I S E A N A L Y S I S O F S T U D E N T S P E R C E N T A V E R A G E S C O R E S O F C L A S S V wise Based Language Math Overall XVII

18 FEMALE MALE Reading Writing No & oper Algebra Geometry Info Handling life Physical Earth & Space Overall and Based Results Class VIII(% average) P R O V I N C I A L L E V E L C O N T E N T S T R A N D B A S E D A N D S U B J E C T W I S E A N A L Y S I S O F S T U D E N T S P E R C E N T A V E R A G E OF C L A S S V I I I wise Based Language Math Overall Gender Based Results Class V (% average) PROVINCIAL LEVEL GENDER BASED ANALYSIS OF STUDENTS PERCENT AVERAGE SCORES OF CLASS V OVERALL SCIENCE MATH LANGUAGE OVERALL SCIENCE MATH LANGUAGE XVIII

19 FEMALE MALE Gender Based Results Class VIII (% average) PROVINCIAL LEVEL GENDER BASED ANALYSIS OF STUDENTS PERCENT AVERAGE SCORES OF CLASS VIII OVERALL SCIENCE MATH LANGUAGE OVERALL SCIENCE MATH LANGUAGE Location Based Results Class V (% average) PROVINCIAL LEVEL LOCATION BASED ANALYSIS OF STUDENTS PERCENT AVERAGE SCORES OF CLASS V Language Math Overall Language Math Overall Rural Urban XIX

20 Location Based Results Class VIII (% average) PROVINCIAL LEVEL LOCATION BASED ANALYSIS OF STUDENTS PERCENT AVERAGE SCORES OF CLASS VIII Language Math Overall Language Math Overall Rural Urban XX

21 XXI

22 XXII

23 District Based Results XXIII

24 District Based Results XXIV

25 SECTION ONE: TEST DEVELOPMENT AND ADMINISTRATION

26 1.0 Overview of Standardized Testing The standardized achievement tests are designed and administered for a large student population under standard conditions and with standardized procedures. Students respond to identical questions under similar standard procedural conditions. Standardizedtesting iswidespread throughout the globe. Globally, TIMSS (Trends in International Mathematics and Study) has been measuring trends in achievement of Math and at the fourth and eighth grades for past 20 years. It has been conducted on a regular 4-year cycle since 1995, making TIMSS 2015 the sixth assessment of Mathematics and achievement trends. TIMSS conducts comprehensive state-of the-art assessments of students achievement supported with extensive data about country, school, and classroom learning environments. More than 60 countries took part in TIMSS PIRLS (Progress in International Reading Literacy Study) was inaugurated in 2001 as a followup to International Association for the Evaluation of Educational Achievement(IEA) 1991 Reading Literacy Study. For the past 15 years, PIRLS has measured trends in reading comprehension at the fourth grade level. First assessed in 2001, PIRLS has been on a regular 5- year cycle since then. Most recently, PIRLS was expanded in 2011 to include pre-pirls, which is a less difficult version of PIRLS. Over 60 countries and sub-national, benchmarking entities participated in PIRLS 2016, including many that have participated in previous assessment cycles since In general, participating countries use TIMSS and PIRLS in various ways to explore educational issues, including: monitoring system-level achievement trends in a global context, establishing achievement goals and standards for educational improvement, stimulating curriculum reform, improving teaching and learning through research and analysis of the data, conducting related studies (e.g. monitoring equity or assessing students in additional grades), and training researchers and teachers in assessment and evaluation (TIMSS & PIRLS, 2015). Likewise, the Organization for Economic Cooperation and Development launched Program for International Student Achievement (PISA) in 1997 to evaluate education systems worldwide, by testing the skills and knowledge of 15-year-old students. To date, students representing more 2

27 than 70 countries and economies have participated in the assessment (OECD: Program for International Student Assessment). In California, for example, Standardized Testing and Reporting (STAR) was established by Department of Education, whose sole task is to help schools improve academic excellence of their students (California Department of Education, 2012). In the context of Pakistan; the government of Punjab has established an autonomous body named Punjab Examination Commission (PEC) to assess students learning achievement at Class V and VIII levels in the province of Punjab. The data collected from all districts of the province provide feedback to the system, policy decision-making, educational managers and teachers for improving student learning (Secondary Analysis of Examination Results, 2010). 2.0 Background of SAT Project In 2012 Reform Support Unit-Education and Literacy Department, Government of Sindh announced SAT project for Sindh Province to evaluate performance of students studying in public sector schools in Class V and VIII. As Sukkur IBA applied to acquire this project, a competitive bidding process was carried out by RSU after which the project was won by Sukkur IBA. The focus of the project is to serve following main purposes: 1. Knowing students achievement 2. Linking educational reforms to output/outcome rather than input 3. Informing parents, educational administration, civil society and government about the status of education in the province The first, second, and third phases of the project, entitled as SAT I, SAT II, and SAT III were successfully completed by Sukkur IBA in , , and respectively. The results of SAT I ( ), SAT II ( ), and SAT III ( ) were uploaded on the project dedicated website, and were shared to the parents by sending individual Student Report Card to them, through school head masters/mistresses. The fourth phase of the project, entitled as SAT IV ( ) started in December 2015, after formal signing of the contract between RSU and Sukkur IBA on December 28,

28 In the fourth phase of SAT project, Sukkur IBA conducted the Pilot Test in January 2016 from the students of class VI and IX, as students in these grades had completed class V and class VIII curriculum. Whereas Actual test was conducted by the end of academic year ( ) so the participants were students of class V and VIII in the subjects of Language, Math and. Table 1 provides details of students appearance in SAT IV. Table 1 Region wise details of class V and VII I students, who appeared in SAT IV ( ) Actual Test. Region Expected Number of Students Class V Class VIII Total Appeared Number of Students Class V Class VIII Total Percentage of Students Appeared Class Class V Total VIII Sukkur 41,135 31,049 72, ,854 40, % 41.40% 56.56% Larkana 57,922 38,149 96, ,460 58, % 53.63% 61.13% Mirpur Khas Hydera bad 26,343 17,544 43, ,541 28, % 60.08% 65.64% 60,880 43, , ,816 66, % 57.01% 63.66% Karachi 27,928 36,186 64, ,005 46, % 66.34% 73.17% SBA 38,958 31,249 70, ,543 47, % 59.34% 67.12% SEF 5, , , % 27.21% Grand Total 258, , , , , % 56.27% 63.62% The assessment results provide a base to identify and understand the gaps in the student achievement and lead to diagnose the real gaps and problems of public sector education standards in Sindh. The assessment results can help address the problems and issues affecting the quality education delivery process, by suggesting appropriate research-based scientifically driven reform initiatives. The results of SAT are directly shared with the students, parents, teachers, head teachers/ principals and other educational stakeholders to create a grassroots level and mass awareness about students achievement. The results are also uploaded on project s dedicated website i.e. for the wider audience. 4

29 3.0 SAT IV Test Development Procedures and Processes Standardized achievement tests are designed and administered for a large student population under standard conditions and with standardized procedures. Students respond to identical questions under similar standard procedural conditions. The development of large scale assessments requires the adoption of a quality and standardized methodology, hence following quality procedures and processes were adopted and implemented in the development of the SAT IV actual test. 3.1 Test Specification Development and Structure The development of test specification involved the review of various national and international frameworks, review of the content strands, standards, benchmarks and students learning outcomes in the latest National Curriculum In this phase the textbooks currently in use at grade levels V and VIII in the public schools of Sindh were also reviewed to identify contents, topics and the learning outcomes translated into text. Next, it involves the categorization of the students learning outcomes in three cognitive levels - knowledge, understanding, and application - and the development of the table of specification for all the tests. (Refer to Appendix A). This phase also included the review of the specification and its validation by content and assessment experts. 3.2 Test Construction The development of Pilot Test was based on a developed framework for the SAT IV based on content strands, the three cognitive levels, and item types. strands and specific topics were identified by the integration of content suggested in National Curriculum Guidelines 2006, Revised Curriculum 2011 and class-specific textbooks, published by Sindh Textbook Board and implemented in the Public schools. The integrated use of national curriculum with textbook helps in covering implemented curriculum as teachers use content in textbooks that are based on National Curriculum version 2006/Revised Curriculum. The mathematics tests comprised thefive content strands at knowledge, conceptual understanding and problem solving level and the science test included the content strands at knowledge, conceptual understanding and application levels. The language tests included reading comprehension and narrative/descriptive writing, also assessed at three levels:knowledge/reading 5

30 for information, understanding/reading for forming general understanding, and application/reading for specific purposes and task completion Item Development and Test Booklet Construction The technical team lead, along with a team of subject experts and assessment experts was engaged in the construction and review of pilot test contents and items based on selective and important content areas in accordance with the weightages of the areas in the table of specification to ensure test validity. Then the constructed items were undertaken through a rigorous process of review based on the quality criteria for item review development (Refer to Appendix II). At this stage technical team also engaged experienced item developers and subject specialists, experts in developing items based on test specifications. Item developers and writers, who taught the subject at class levels specified in SAT IV (classes V and VIII), were engaged in developing items under the supervision of each subject specialist, expert and technical team lead. Items were developed at knowledge, understanding, and application level as per the weightages assigned in the specifications. For each topic/concept, four versions of items were developed in English, thus number of items developed were four times higher than required in actual test, as per the ToRs of SAT Project. Refined English versions of items were translated in Sindhi and Urdu. Items were not taken directly from textbooks; however, most of the items were structurally and conceptually parallel to content in curriculum and textbooks at the class levels. Language test is comprised of two sections including 50% reading comprehension and 50% writing competencies. Reading section is purposed to assess students skills in understanding, interpreting, and performing specific tasks in literary text and informative text. For each reading section of language test, 20 Multiple Choice Questions (MCQs) on 2 reading texts were developed. The writing section targeted assessing two main competencies, emphasized in the national curriculum, 1- Narrative Writing (telling story), and 2 Writing for Performing Specific Tasks/ Informative Writing (informing the reader). A separate Extended Response Question (ERQ) was constructed to assess students each writing competency level. The number of items for both classes remained same; however, content and skill level was kept class-specific. Altogether, 80 MCQs and 8 ERQs were constructed for writing section for each Class (V or VIII), resulting in 160 MCQs, and 16 ERQs in a language subject test for both classes. Three 6

31 language test booklet versions (English, Urdu, and Sindhi) consisted of same number of items to keep the language test standardized. Hence, total of 480 MCQs, and 48 ERQs were developed for three versions of language pilot test. Refer to Appendix A for specifications of each language in pilot test for classes V and VIII. Mathematics pilot test covered content strands (Number and Operations, Algebra, Measurement, Geometry, Information Handling) and mathematical ability/skill levels conceptual understanding, procedural knowledge, and problem solving. Each class level and language version test consisted of 24 MCQs and 4 CRQs, resulting in 96 MCQs, and 16 CRQs constructed at each class level. The number of items for each class level remained same; however, a small deviation was made in covering content strands for each class level. All Mathematics pilot test items were developed in English and translated into Urdu and Sindhi to develop Sindhi and Urdu versions of the test. Altogether, 576 MCQs and 96 CRQs were constructed for all Mathematics pilot test booklet versions. See Appendix A for detailed specifications. pilot test specifications were based on content strands, science learning skills, and question types. Life s covered 35%, Physical s covered 55%, and Earth and Space s covered 10% of total items. Within each content strand, knowledge accounted for 40%, conceptual understanding accounted for 40%, and application accounted for 20%. 24 MCQs and 4 CRQs, accounting for 60%, and 40% of weight respectively, were included in each test version, resulting in 96, and 16 CRQs for each medium of science pilot test. Since specifications were same for both classes, number of items for each class level test remained same. All pilot test items were developed in English and translated in Urdu and Sindhi to develop Sindhi and Urdu versions of the test. Altogether, 576 MCQs, and 96 CRQs were constructed for all pilot test versions. See Appendix A for detailed specifications. Once the testbooklets are constructed, these weresentto the RSU review committeeinordertogetanexpert review and feedback onalltest booklets.consequently, theexperts reviewed the Pilot Test booklets andthe team of assessment experts, who have actually constructed the test, incorporated their feedback. The final Pilot Test booklets were then sent to TCS Private Limited for the printing in the second week of January, 2016, in a password protected folder. 7

32 3.2.2 Pilot Testing and Analysis The main purpose ofthispilot Testing wasto establish pool of strong test items which are used to construct a strong actual test to execute at a large scalein the Public Schools of Sindh. Pilot Test contained four times moreitems than the actual test. The statistical analysis of the results of Pilot Test provided information regarding reliability, difficulty level and distractor analysis oftest items. This process resulted in the loss ofmany Pilot Test items, based on their Facility Value, Discrimination Index and frequency distribution of distracter. Finally, the statistical analysis leads to construction of two standardized large-scale actual test Pilot Test Administration The pilot test administration involved various processes including the identification of a representative sample, the sharing of the pilot test administration sampling criteria along with list of schools for pilot test with Reform Support Unit for review and feedback. The management of the Pilot Schools was informed by Sukkur IBA through phone calls to confirm the medium of instruction and the strength of students in Classes VI and IX. And it was also assured that the Local Support Unit had informed all the concerned Head Teachers about the SAT Pilot Test. The Reform Support Unit also issued letter of information regarding SAT Pilot Test to all Regional Directors of Education. The same letter was handed over to Head Teachers as Sukkur IBA teams arrived at test center. With joint efforts of Sukkur IBA and RSU, overall attendance ratio in Pilot test remained 97% To make this activity successful, SAT team hired 80 Invigilators, 13 Taluka Coordinators and 13 Monitoring officers. The invigilators and Monitoring Officers were then engaged in a rigorous and interactive one day training to make them familiar to the essentials of the administration of the test; standardized direction about the test, the type of the booklets, versions of the test booklets, codes of test booklets. unpacking, packing and dispatching of the test booklets after the tests are done. In this regard, a manual was prepared as a guideline for the invigilators. It contained important instructions about the test. Team Lead-Administration and Project Officers of SAT project conducted the training workshops in each of the selected sample districts of Pilot Test. The monitoring officers were also deputed at every test center, in order to ensure the quality and smooth running of the test 8

33 administration process. The details ofdistrict-wise number of the invigilators and monitoring officers are given in the table 2. Table 2:District-wise Number of Invigilators, Taluka Coordinators and Monitoring Officers Sr No District No of Invigilator Taluka Coordinators No of Monitoring Officers 1. Karachi Hyderabad Sukkur Shaheed Benazirabad Tharparkar Kashmore Total TheprintingofSAT-IVPilottest booklets was carried out by TCS under the 24 hours surveillance of the monitoring officers ofsatprojectteam.tcscompletedtheprintingandthensentthetestbookletstotheidentified sixdistrictsofsindh.the authorized persons, designated by SAT office, collected these test booklets, one day before the test administration day in the respective districts, from TCS offices. In consultation with RSU, SukkurIBA conducted the administration of the PilotTestofSAT-IV( ) in classesviandix,asstudents had completedthecoursesof theseclassesinthe academicsessionof ,whilethecurrentstudentsofclassesv andviiihad only completed around 50% to 60% of the course.consequently, on the recommendations of RSU thepilottestwasconstructedfrom thenationalcurriculum 2006 ofclassvandviiiand administered on students of classes VI and IX. 9

34 The gender-wise distribution indicates that the total number of 805 girls and total number of 1140 boys appeared in the pilot test. Table 3:Gender-Wise & Medium-Wise Sampled Students Appearance of Classes VI & IX for SAT IV Pilot Test. S.No District Gender Wise no. of Schools as per Pilot Test Plan Gender Wise Appearance of Class VI and IX Medium Wise Pilot Test Appearance of Class VI and IX B G T B G T S U E T 1 Karachi Hyderabad Sukkur Tharparkar Shaheed Benazirabad 6 Kashmore Total Percentage Appearance 97% *B for Boys *G for Girls *T for Total *S for Sindhi *U for Urdu *E for English Table 4: Gender- wise Sampled Students Appearance in Pilot Test Language/Math/ Number of Boys Responded Number of Girls Responded Total Booklet Version A Booklet Version B Booklet Version C Booklet Version D Total Booklets At the completion of pilot testing the test booklets in sealed boxes were sent back to Sukkur IBA for e-marking, data entry and analysis. 10

35 3.2.4 Sample Keeping in view the guidelines mentioned in the ToRs of SAT IV project, thesat office Sukkur IBA selected a representative sample schools based on following strata: Urban and Rural areas Male and Female students Mediums of schools suchas Sindhi, Urdu and English Table 5 Pilot Test Student Sample based on District, Gender and Medium of Schools S.N o District Gender Wise no. of Schools as per Pilot Test Plan Gender Wise Enrollment of Class VI and IX Medium Wise Pilot Test Enrollment of Class VI and IX *B *G *T B G T *S *U *E T 1 Karachi Hyderabad Sukkur Tharparkar Shaheed Benazirabad 6 Kashmore Total *B for Boys----- *G for Girls *T for Total *S for Sindhi------*U for Urdu *E for English In this way, a representative sample totaling 2,000 students were selected from40 schools (constituting approximately 50 students per school, 30 students of class VI and 20 students of Class IX) of six districts, three fromurban Sindh (Karachi, Hyderabad, and Sukkur)and three from Rural Sindh (Kashmore, Shaheed Benazirabad & Tharparkar). The details ofthe selected sample are given in Table Item Analysis: Pilot Test SAT IV ( ) was constructed in three mediums (English, Sindhi, and Urdu) for each class level, totaling 24 test booklets(a,b,c,d) versions with parallel form of tests for classes V and VIII. Along with these marking keys and analytical marking rubrics were developed in alignment with the content, skills and cognitive levels consistent with National Curriculum 2006, Revised Curriculum 2011 and in integration with the textbooks. 11

36 A qualitative review of item was undertaken to match items with the students learning outcomes, content strands and cognitive levels. This stage also included pretesting of items with small group of children in public school and modification of the text, language and structure of items to the level and context. Qualitative item analysis also included language editing, language simplification, word count in the text, stems and options to match the class level. Items were reviewed to avoid double negatives, resultantly non-distractors and negatives were removed/replaced, long stems and non-parallel or long options were modified. Special care was taken toinclude only contextually and culturally unbiased items in the test. The pictures included in the tests were reviewed for clarity and visibility. A quantitative review of items included Facility Value (FV), also known as Difficulty Index, Discrimination Index (DI) and Reliability Measures. Also Frequency Distribution on the distractors and keys was undertaken to analyze and address miss-keying and non-distractors. Similar to previous years, the response rate on MCQs for Mathematics, s and Languages (English, Urdu and Sindhi) was appropriate to carry out item analysis; however, response rate on CRQs was significantly low in s and Mathematics but appropriate in languages. Similar to previous SAT phases, SAT IV, revealed significantly low performance of students in both subjects, which indicates that low response rate on questions with increasing level of complexity of knowledge and skills (such as CRQs) was expected. Hence, item analysis was done for MCQs only. Since the test booklets contained parallel forms of tests and items were selected for actual test on the basis of subject and medium hence item analysis was undertaken on similar basis. However, based on comparative analysis, best performing items from in any medium and particularly Sindhi medium (with highest number of students, 1155) formed the basis for the selection of items for the actual test. Overall items analysis shows that a significant proportion of MCQs piloted in all subjects falls within the desirable range (.2 to.8) of Facility Value and Discrimination Index. Overall, 53% to 98% MCQs in all subjects scored between.2 and.8 on both analysis indicators. The proportion of items within appropriate values was enough to construct the SAT IV actual test. Table 6 provides an overview of MCQ items performance in SAT IV Pilot test. Overall, item analysis of SAT IV pilot test items show a significant number of statistically strong items, that could be included in the actual test. 12

37 Table 6:The Reliability Statistics indicates that all the tests are highly reliable and would consistently give reliable results. Class 5 English Sindhi Urdu Math A B C D Class 8 English Sindhi Urdu Math A B C D

38 4.0 Actual Test development and analysis The finalization of the actual test was based on the item analysis data, including item difficulty, discrimination index and frequency distribution of options A to D and test reliability statistics. 4.1 Item selecton The items with desirable item values and discrimination indices were selected for inclusion and the issue of mis-keying (more number of test takers selecting) a distracter, ambiguity (equal number of test takers selecting a distractor and key) and non-distractor (no test taker selecting a distracter) based on frequency distribution data was addressed by reviewing the options. 4.2 Actual test booklet construction The Actual Test SAT IV ( ) were constructed in three mediums (English, Sindhi, and Urdu) for each class level, totaling 12 test booklets (A&B versions for each medium) with parallel form of tests for classes V and VIII through a quality and standardized test development process. Along with these marking keys and analytical marking rubrics have been developed in alignment with the content, skills, and cognitive levels consistent with National Curriculum 2006, revised Curriculum 2011 and in integration with the textbooks. 4.3 Actual Test Administration Test Printing Sukkur IBA, being a public sector institute, adapted the Sindh Public Procurement Regulatory Authority (SPPRA) rules and regulation in procuring the services for printing and dispatch of test booklets. Sukkur IBA published tender for printing and dispatch of test booklets in leading Newspapers of Pakistan i-e: Daily Dawn, Daily Jung, Daily Kawish, Daily Sobh, Daily Awami Awaz on January 08, The bids were invited on single stage two envelope bases. After competitive bidding, TCS Pvt Limited won the printing and dispatch of test booklets project. The booklet-wise printing details are provided in Table 7. 14

39 Table 7: Details of SAT IV booklets printed S# Class Medium Booklet Booklet ID No of A4 Pages 1 5 English A English B Urdu A Urdu B Sindhi A Sindhi B English A English B Urdu A Urdu B Sindhi A Sindhi B Dispatching of Test Booklets The tender for dispatch of test booklets was published together with the tender for printing on January 08, 2016 as mentioned earlier in Section 3.1 (Printing of Test Booklets). After a competitive bidding process TCS Private limited won dispatch project for SAT test booklets. The dispatch and distribution mechanism of test booklets were in following order, Sharing final test field plans to TCS by SAT office Sukkur IBA Finalizing the dispatch plan by TCS Packaging of Centre boxes, by keeping Centre school test papers box/es and feeding primary schools boxes. Dispatching the Centre boxes to each taluka/town TCS office in entire Sindh province on daily basis. 15

40 Handing over the center boxes to identified SAT Taluka/Town Coordinators (TCs) (after verifying their names and CNIC numbers) by TCS taluka/town offices. Distribution of test booklets to identified test centers as per test field plan by SAT TCs before 10 am (test start time). Collecting the filled test booklets boxes, unfilled test booklets and attendance sheets from centers by TCs. Dispatching the collected filled test booklets boxes, unfilled test booklets and attendance sheets to SAT office Sukkur IBA by TCs on daily basis. 4.4 Selection and Training of Taluka/Town Coordinators and Test Invigilators SAT office Sukkur IBA selected local qualified individuals for the positions of Taluka/Town Coordinators (TCs) from every taluka/town of entire Sindh province. The preference was given to those Taluka Coordinators who have worked with SAT Office in previous phases. Later on, these TCs, in coordination with SAT Project Officers, selected a team of local UC and taluka/town based invigilators in their respective talukas/towns on a ratio of one invigilator for 25 students. After completing the selection process, SAT office Sukkur IBA organized day-long training workshops for TCs and Test Invigilators. The focus of TCs training workshops, which were conducted by Team Lead-Administration was on following important elements, Introduction and purpose of SAT project Test administration mechanisms ToRs of TCs during test administration (Please see Appendix B) Undertaking by TCs (Please see Appendix C) After TCs training workshops, which were conducted at Sukkur, Hyderabad, and Karachi, SAT Team Lead-Administration & project officers offered training workshops to selected invigilators by visiting every district of Sindh province. The training workshops were organized along with the respective TC of the taluka/town. SAT office prepared a comprehensive manual for taluka coordinators and test invigilators, which were also shared with them during the training program (Please see Appendix D) 16

41 Table 8: Taluka/Town Coordinators Training in different regions of Sindh S No District TCs SAT IV Invigilators 1 Sukkur Khairpur Ghotki Naushero Feroze Larkana Qambar Shahdadkot Shikarpur Jacobabad Kashmore Mirpur Khas Sanghar Umerkot Tharparkar Thatta Sujawal Hyderabad Badin Tando Muhammad Khan Matiari TandoAllahyar Shaheed Benazir Abad Jamshoro Dadu Karachi Total 119 2,320 17

42 4.5 Identifying Clusters of Centre Secondary Schools and Nearby Feeding Primary Schools The SAT Project Officers were engaged to identify and prepare the clusters of Centres secondary schools and nearby feeding primary schools in every taluka/town of entire Sindh province. In order to facilitate the students of primary schools, SAT Office developed a clear strategy to link feedingprimary schools with a secondary school within radius of about 1.5 kilometers. In each taluka/town, the workshops were conducted for two days in which Taluka Education Officer (M/F) along with respective School Supervisors identified and developed linkages of primary schools to specific secondary school to appear in SAT IV. As per policy, all secondary/higher secondary/middle & Elementary schools were taken as test center by default. However, some primary schools were also made test centers in those Union councils where there was no secondary school available. The signature and official stamp of Supervisors and TEO (M/F) were also taken on hard sheets for office record. After this, SAT Taluka Coordinator visited each & every center highlighted by TEO (M/F) physically in order to validate the data. This activity was performed so that Sukkur IBA can ensure that highlighted test centers are functional and SAT can be conducted easily keeping in view the infrastructure of schools. The list of test center identified through workshops and physical survey are as under: 4.6 Preparing Test Field Plans SAT office Sukkur IBA organized workshops in every region of Sindh province in order to prepare the final test field plans. TCs, SAT Project Officers and Team Lead Administration carried out this activity. The test field plans were prepared by keeping in mind the criteria that the test should be completed in every taluka/town in maximum ten (10) days. Consequently, on an average 4 to 5 test centers were included in the test field plan on every test day. These test centers were finalized with the close coordination of respective local TC, keeping in mind two important criteria of their distance from one to each other and being on same route. As soon as the final field plans were prepared, they were sent to TCS as it could prepare the printing & dispatch plan accordingly. The details of region-wise selected test centers during SAT IV ( ) Actual Test are given in Table 9. 18

43 Table 9: Region based Number of test centers S. No Region Number of Test Centers 1 Sukkur Larkana Hyderabad 1,562 4 Mirpur Khas Shaheed Benazirabad Karachi 1,021 Total 5, SAT IV ( ) Actual Test Information Dissemination SAT office Sukkur IBA devised strong communication mechanism to inform parents, teachers, head teachers, supervisors, Taluka Education Officers, District Education officers, Regional Directors and Coordinators/Consultants of Local Support Unit so that the test schedules may be communicated at all levels in order to increase appearance ratio. Three modes of communication were adapted by Sukkur IBA which are described as follows Publication of Sample/Model Papers and Advertisements in Newspapers Sukkur IBA published advertisements about the administration of SAT Actual Test in leading local and national newspapers including, Daily Dawn, Daily Jang, Daily Awami Awaz, Daily Ibrat, Daily Kawish and Daily Sobh on January 18, 2016 in English, Urdu & Sindhi content. The information in these Advertisement contained sample papers of Language, Math & along with necessary information pertaining to parents and teachers regarding SAT Regional Workshops Regional workshops for educational managers were also organized in all six regions of Sindh in which Regional Directors (Primary/Secondary), District Education officers (Primary/Secondary), Taluka Education officers (M/F), and School Supervisors on respective region participated. Apart from Education department hierarchy, Coordinators and Consultants of local Support Unit also took part in the workshop. The workshop contained full orientation program about SAT project, subjects included, type of questions with examples, mechanism to execute the test, 19

44 recommendation from Sukkur IBA and cooperation required from Education Managers to implement the SAT successfully. The detailed field plans of region, district and taluka were also handed over to Regional Directors, DEOs, TEOs and coordinators/consultants of local Support Unit so that these stakeholders could pre-inform the head masters/mistresses of secondary, elementary and primary schools about the actual days and dates of test administration. The schedule of Regional workshops conducted is as under: Table 10 Schedule of SAT Orientation Regional Workshops S# Date Region Venue 1 3-Feb-16 Sukkur & Larkana Main Campus, Sukkur IBA 2 11-Feb-16 Hyderabad Auditorium, Sindh Museum, Hyderabad 3 12-Feb-16 Mirpurkhas GGHS Bhan Singabad, Mirpurkhas 4 22-Feb-16 Shaheed Benazirabad Gymkhana Restaurant, Nawabshah 5 24-Feb-16 Karachi Auditorium, Scout Head Quarter, Karachi Telephone Calls to Head Masters/Mistresses of Government Secondary and Primary Schools by SAT TCs Phone calls were made to all head teachers of primary & secondary schools by SAT Taluka/Town Coordinators one week before inception of test. The incumbent told the Head Teachers about specific date, day, and test center where students of class V and VIII were required to appear in SAT test. 4.8Administration of SAT IV ( ) Actual Test SAT office Sukkur IBA started administration of the Actual Test after completing above mentioned tasks. Following process was followed by SAT office Sukkur IBA for the administration of Actual Test. The TCs collected test booklets from their respective TCS offices in the evening or morning of the test day; they kept the test booklets in a safe and secured place. Then, the TCs dispatched the test booklets to test centers on the day of test before test starting time. After handing over the test booklets to head invigilator on one Centre, TC moved to next center and so on. Thus, after completing the distribution, TC used to pay monitoring visits to test 20

45 centers. As soon as test completed, the TC again visited every center and collected filled test booklets, unfilled test booklets and attendance sheets from the centers and dispatched them to the SAT office Sukkur IBA on the same day through TCS courier services. The SAT office Sukkur IBA provided transport allowance to every TC to hire a taxi car/van/jeep to perform all above mentioned activities. The test was conducted region-wise in following order: Table 11Actual Test Administration S# Regions Schedule of SAT 1 Sukkur & Larakana February 08, 2016 to February 18, Hyderabad & Mirpurkhas February 19, 2016 to March 1, Karachi & Shaheed Benazirabad March 2, 2016 to March 12, 2016 In this way, The SAT office Sukkur IBA completed the test in entire Sindh province in 30 working days from February 08, 2016 to March 12, Monitoring Mechanism of Actual Test Administration SAT office prepared an effective monitoring mechanism to ensure the quality and transparency of the actual test. Doing so, a monitoring team, based on SAT Project Director, Team Lead- Administration, Team Lead-Technical Analysis & Assessment, project officers, faculty members and Alumni of Sukkur IBA and selected competent Taluka Coordinators (of those talukas where test was already administered) was formulated. SAT office offered training to the monitoring team members, before sending them to the field. SAT office prepared a Monitoring Report Proforma and shared to all monitoring officers, during the training program(attached in Appendix E). 21

46 Figure 1. Monitoring Design & Reporting Project Director Team Lead- Adminstration & Coordination Team Lead- Assessment & Analysis Alumni, Staff, Faculty of Sukkur IBA District Focal Person (Senior Project Officer) Monitoring Officer Taluka Coordinator Taluka Coordinator Taluka Coordinator Moreover, an independent team of monitoring officers comprising of faculty members, staff members and Alumni of Sukkur IBA was formulated for administering the actual test administration in each district. The team reported directly to Team Lead-Administration & Project Director and worked independently and reported all issues to concerned authorities. Apart from it, SAT Senior Project Officers were assigned one specific district to keep in touch with Local Support Unit, District Education officers (Primary & Secondary), Taluka Education Officers (TEOs), Supervisors and other stake holders of Education Department to ensure the adequate enrollment on test days and also were responsible to tackle all test related issues in the district. Along with that Senior Project officer also paid monitoring visits to test centers in order to ensure the quality. As per ToRs of job, SAT Taluka Coordinators spent 20% of their time to pay monitoring visits to test centers in order to verify that tests were being executed as per the plan. 22

47 Monitoring Officer Taluka Coordinator Project Director Team Lead- Assessment & Analysis District Focal Person Test Centers Team Lead- Administration In order to ensure the quality of test administration, the monitoring officers were required to make a proper check of the following aspects at thetest centers they visited: Invigilators team arrived on time Test started on the specified time Students were given proper instructions by the invigilators before the start of the test Students were sitting in a proper sequence Students properly filled up the face sheets Students were provided Pencil, Eraser and sharpener Attendance sheets were signed by the Head Teachers and respective invigilators Invigilators were performing their duties as per the instructions Environment at the test center was smooth, without having any physical distraction or having involvement of school administration Using the above mentioned monitoring proforma, Monitoring officers collected field issues and other relevant information during their monitoring visits. Following this, SAT Project Officers collected the identified field issues from the Monitoring Officers on daily basis, consolidated them and shared the issues to their respective Taluka Coordinators. The purpose was that the issues should be minimized on the next day of the test. Moreover the consolidated field 23

48 monitoring issues were also sent to the office of Project Director & Team Lead-Administration on daily basis, along-with the suggested solution of the identified issues. Some of the key field issues reported by the monitoring officers are as under, Non-cooperation of government head teachers and teachers at some center schools Less number of students turnout on the test day. Students from unlisted schools (in RSU provided data file) turned out to take test Lack of information about the test schedule to head masters/mistresses by their respective DEO and ADOE/TEO (M &F) offices Teachers misbehaved Sukkur IBA team in Kashmore and Shaheed Benazirabad and instigated the team to allow them inside the test blocks for supporting the students. SAT office reported these issues on daily basis to RSU and got its support to address these issues effectively. The test at all those centers was cancelled and re-arranged if misappropriation were reported on a center Monitoring by Reform Support Unit Reform Support Unit also worked hand-in-hand with Sukkur IBA in order to monitor the actual test administration in the entire Sindh. Chief Program Manager RSU, Deputy Program Manager RSU, representatives of Local Support Unit, District Education Officers (Primary & Secondary) and Taluka Education officers and Supervisors monitored the test administration in entire Sindh. 24

49 Local Support Unit District Education Officer Deputy Program Manager RSU Center Incharge Chief Program Manager RSU Test Centers Taluka Education Officer Table 12 A Brief Summary of Region Wise Monitoring Coverage Region Summary of Monitoring Coverage No. of Districts No. of Talukas No. of Monitoring officers Taluka wise coverage in terms of Percentage Taluka Coordinator Monitoring ** Total Monitoring Coverage Sukkur % 20% 110% Larkana % 20% 77% Mirpurkhas % 20% 77% Hyderababd % 20% 78% Shaheed Benazirabad % 20% 80% Karachi % 20% 92% Total % 20% 86% **As per Job ToRs of Taluka Coordinator, he/she spends 20% of total time in monitoring the test administration in concerned taluka, while 80% of his/her time is spent in administration process. The above table shows an average of 86% of the monitoring coverage during SAT Phase-IV Test Administration. In other words, the monitoring officers have accessed 86% of the 25

50 test centers across Sindh which indeed shows the efficiency and effectiveness of the monitoring strategy by Sukkur IBA. 5.0 Preparing and Distributing Student Report Cards to the Parents Student Report cards are generated from main data base file in which scores and biographic data of all students who appeared in test is stored. The student report card contains following information Student details with Father's Name Class with Medium School Name & SEMIS UC, Taluka & District Information -strand based score in language, Math & Overall student subject averages overall school subject averages Grading scale SAT related information 5.1 Distribution of Student Report cards In order to effectively execute this activity, district level meeting was arranged by Sukkur IBA and RSU in which all education officers of district including DEO (Primary & Secondary) & Taluka Education Officers (Primary & Secondary) M/F participated. The Orientation regarding distribution mechanism of report cards was given Sukkur IBA district Focal person in details. The region wise schedule of such meetings is as under: Table 13: District Level Meeting for orientation of Distribution of Student Report cards S# Date Region Districts 1 August 30, 2016 Sukkur Sukkur, Khairpur Mirs, Ghotki 2 September 07, 2016 Larkana Larkana, Jacobabad, Shikarpur, Kashmore, Qamber 3 September 20, 2016 Shaheed Benazirabad SBA, Naushero Feroze, Sangharv 4 October 04, 2016 Mirpurkhas Mirpurkhas, Umerkot, Tharparkar 5 October 06, 2016 Karachi East, West, South, Central, Korangi, Malir 6 October 17, 2016 Hyderabad Hyderabad, Matiari, Tando Muhammad Khan, Tando Allahyar, Dadu, Badin, jamshoro, Thatta, Sujawal, 26

51 The report cards of girls Primary, Middle and Elementary schools are sent to Taluka Education Officer Primary Female while report cards of Boys Primary, Middle and Elementary Schools are sent directly to office of Taluka Education Officer Primary Male. While report cards of Secondary & Higher secondary schools are sent directly to office of District Education Officer Secondary. This exercise is adapted because inaccessibility of schools address by any postal service in Pakistan. The report cards are dispatched to above mentioned Education Officers with a list of schools and a covering letter which suggest to invite Head Teachers (As mentioned in list of schools) to concerned office and discuss school results and hand over report cards of all students who appeared in test. Report cards of each school are packed in envelopes. Along with report cards of students, Sukkur IBA has also issued School Performance Report for Head Teachers, so that they can bring reforms at school level by keeping in view SAT results. The letter to Head Teacher suggests celebrating parents day at school or organizing parent-teacher meeting at school in which the teacher will discuss SAT results of students with parents and suggest areas of improvement. The Head teachers will take receiving of report card from Parent on given sheet which is included in each envelope of school. The Head teacher will submit the same receiving with official stamp of school to concerned Taluka Education officer with in 10 working days as a proof that Head teacher has distributed all report cards among parents. 5.2Regional Workshops for Dissemination of SAT Phase-IV ( ) Results In order to disseminate and share the results with education leaderships, Sukkur IBA organized regional workshop in all six regions of Sindh in which whole mechanism of SAT along with final results of Region, District and Taluka are discussed in detail. The results are summarized in performance wise and in contend-strand forms. Moreover, the recommendation and areas of improvement at taluka level are also discussed. The regional workshops are conducted in the month of October& November Below is schedule of regional workshops conducted in order to share the results of SAT-IV with education managers of Sindh province. 27

52 Table 14: Schedule of Regional Workshops for dissemination of SAT-IV Results S# Region Date Venue 01 Sukkur October 04, 2016 Sukkur IBA, Main Campus 02 Larkana October 05, 2016 Sir Shahnawaz Bhutto Library, Larkana 03 Shaheed Benazirabad October 18, 2016 Royal Taj Hotel, Nawabshah 04 Mirpurkhas October 19, 2016 Sufyana Hotel, Mirpurkhas 05 Karachi October 31, 2016 Reform Support Unit Office 06 Hyderabad November 01, 2016 Royal Taj Hotel, Hyderabad 6.0 SAT Project Website A separate domain for SAT project has been purchased with domain address Website has following features; Online data bank from class V to class VIII in the subjects of Language, Math and SAT Project brief Students can attempt online test (MCQs) and measure their efficiency The data of each subject is available class wise, and medium wise Teachers can make their own user name and password to use the data as per their requirement. After log in, teachers can prepare question papers of Languages, Math and for classes V to VIII Newsletters, events, updates and announcements about SAT are available Final Reports of SAT-I ( ), SAT II ( ) & SAT III ( ) are uploaded User counter enabled which helps RSU and Sukkur IBA to measure the reach and frequency of target users School profiles have been activated 28

53 School wise, taluka wise, District wise, region wise, and subject wise results of SAT-I ( ), SAT II ( ), SAT III ( ) & SAT IV ( ) have been uploaded on website. Moreover, comparative analysis of results i-e: comparison of schools within same UC, comparison of taluka with in same district, and comparison of districts within same regions is also available on the website Sample papers of SAT tests are also available in Sindhi, Urdu and English mediums, which help the teachers, head masters/head mistresses and educational stakeholders to prepare/guide students for SAT tests Facebook page of SAT has been linked to SAT website Quick links of RSU, NTS, Govt of Sindh and Sukkur IBA are also activated Logo of Government of Sindh is included SAT team profiles have been updated Contact us option is available on website 6.1 Online Item Data Bank Sukkur IBA has developed a test data bank from class V to class VIII in the subjects of Languages (Sindhi, Urdu and English), Math and. The items in these three subjects are developed in three mediums including, Sindhi, Urdu and English. For each subject in each class, 1000 test items consisting of MCQs and CRQs are developed. Following the ToRs, SAT office has added 1500 more items of Languages, Math & subjects to already developed item data bank, during SAT project phase IV ( ). Doing so, Item Development Workshops were arranged at Sukkur IBA under the leadership of assessment experts to develop the items. The subject specialists of IBA Community Colleges and Sukkur IBA Alumni under the supervision of assessment experts of Sukkur IBA Department of Education developed these items. After development of the items, these were reviewed by the assessment experts of Sukkur IBA and after review, these items are uploaded on SAT website, Review of Uploaded Items SAT office Sukkur IBA has conducted an online review of all items of Languages, Math and from classes V to VIII, which are uploaded during the first and second phase of the SAT project. 29

54 7.0 Challenges Faced During SAT IV ( ) During the implementation of SAT Project Phase IV ( ), Sukkur IBA faced following challenges, The educational stakeholders including RDEs, DOEs, ADOEs/TEOs (M&F) & Supervisors did not inform the head masters/mistresses of center schools as well as feeding primary schools about SAT IV ( ) test schedule in some cases, despite the fact, that SAT office Sukkur IBA provided them the test schedules of SAT IV ( ) Actual Test about 10 days before the test administration in Orientation Regional Workshops.Resultantly, student turn out ratio on test day remained low. Teachers misbehaved Sukkur IBA team in Kashmore and Shaheed Benazirabad and instigated the team to allow them inside the test blocks for supporting the students. Non-cooperation of Karachi Metropolitan Corporation schools (KMC) in Karachi on test day. Majority of school teachers did not allow Sukkur IBA team to conduct SAT exam, reasoned that they had not been informed by line authorities. Sukkur IBA later on discussed the matter with Reform Support Unit and then after 5th day of test, KMC schools were tested which rose administration cost for Sukkur IBA heavily. Change of medium issue was observed very frequently in whole Sindh. Data File of RSU suggested one medium, but on the ground, Sukkur IBA team found another or mix mediums. This created lots of trouble in test administration; however, required medium wise test booklets were arranged and all students having different medium of instructions were tested on the same day or another day. In some test centers, teachers tried to enter test blocks to help students cheat and guide them in taking the test. They also forced the invigilators to get out of test block, and made students write responses. Such cases were reported to Sukkur IBA and their test booklets were discarded and not included in the main results. 30

55 SECTION TWO: DESCRIPTIVE ANALYSIS OF RESULTS 31

56 8.0 INTRODUCTION OF RESULTS AND ANALYSIS Analysis are based on descriptive results of SAT IV Test. SAT IV Test aimed to assess and understand multiple dimensions of students achievement at class V and class VIII level. The test focused on assessing class V and class VIII students achievement in the subjects of Language, Math, and as these are considered three main areas of learning. Each subject test comprised of a number of content strands or main areas of learning, which were same for both the classes. strands of Language were Reading Comprehension and Writing. Math test comprised of five content strands such as Numbers and Operation, Algebra, Measurement, Geometry, and Information Handling. test was based on content strands of Life, Physical, and Earth and Space. This section presents various types of descriptive analysis of student results such as provincebased, region-based, and district-based statistics. In order to understand overall performance in terms of student background markers, further analysis consist of gender based (female and male), location based (rural and urban), and school type based (boys schools and girls schools) comparison of student achievement. Apart from analysis of overall achievement in each subject area, several analyses present content strand based achievement of students to highlight strengths and shortcomings in specific main learning areas within each subject. In various analyses, differences in relation to overall scores at each level are also provided to indicate positive or negative difference from overall scores at province, region, and district level. The section comprises of six categories of results and analysis. It comprises of general results of SAT IV which indicate overall percent averages for each subject as well as content strand based percent averages of students performance in each subject at province, region, and district levels. Next three categories provide analysis of overall province level performance of students in the three subjects, based on gender of students, location of schools, and school type. Last part of the section provides district based analysis of students performance for Sindh Education Foundation (SEF) managed schools. 8.1 Province Level Overall and Based Results Overall results at province level show highest achievement in Language followed by student scores in Math and at class V level. Table 15 shows overall as well as content 32

57 strand based province level scores. While overall averages in all subject areas are significantly low, content strand based analysis of averages shows that student scores are relatively higher in Reading Comprehension; which could be a reflection of traditional priority assigned to reading lessons (based on textbooks) across the schools. Compared to 50% overall score of Reading Comprehension, writing overall average score is drastically low; less than half of province s overall language score. Math content strand based scores, similar to previous trends, are relatively higher in Measurement and Information Handling, whereas lower in Geometry and Algebra; however, overall Math scores are severely low. overall scores are also significantly low with lowest scores in Physical s. Table 15: Province level content strand based analysis of students scores in class V & Overall Standard Deviation (Overall Average) Language Math Reading * Writing Number & Operation Measurement Algebra Geometry Information Handling * Life Physical Earth & Space Overall Students Score * Notes: 1. * represents the content strand wise highest score attained in class v across province 2. represents the content strand wise lowest score attained in class v across province 33

58 8.2 Province Level Overall and Based Student Scores Class VIII Grade VIII students overall average scores at province level were found higher in Languagewhereasthe scores in Math and were found significantly low. Table 16 provides details of overall as well as content strand based scores in the three subject areas. The pattern of overall scores is similar to Class V - highest in Language followed by and Math scores. strand based students achievement at class VIII was found significantly higher in reading comprehension and moderately higher in Information Handling; whereas, geometry and algebra were found significantly low at province level. Analysis shows writing scores lower to half of the reading scores, which seems a strong indication of low emphasis on teaching and learning of writing. Student scores in all three content strands of are low and similar between 22% and 25% - indicating almost low variance among main learning areas of science. Table 16: Province level content strand based analysis of students scores in class VIII & Overall Standard Deviation(Overall Average) Language Reading Writing * Number & Operation Math Algebra Geometry Information Handling * Life Physical * Earth & Space Overall Students Score Notes: 1. * represents the content strand wise highest score attained in class v across province 2. represents the content strand wise lowest score attained in 34

59 8.3 Region Level Based Results While all regions performed moderately high in reading comprehension, students overall performance across the six regions of the province was found low in all subject areas. Performance in Math and was found severely low Region Level Based Results of Class V Analysis of content strand based results of class V revealed that Karachi led in both reading and writing score whereas Shaheed Benazirabad, Mirpur Khas, and Hyderabad regions performed on mediocre levelon reading, and Larkana and Sukkur regions performed low on the two language skills. Writing scores were found slightly higher for Karachi region; however, for all other regions writing scores were severely low. Low writing scores across the regions indicate that there is low emphasis on developing genuine writing skills in the schools across the province as traditionally it has been observed that students are usually provided a written piece to copy on their notebooks rather than engaging them in producing their own piece of writing. In contrast, reading scores across regions are higher, which means that there is relatively high emphasis on reading lessons as it has been observed that most of the teachers regularly start with reading lessons based on language textbooks. Writing skill also seems to be negligibly covered in language textbooks while textbook is the only resource of teaching and learning in most of the schools. Table 17:Regional level content strand based analysis of students scores in language of class V S No Region Reading Average Writing Average Overall Average Difference From Overall Standard Deviation (Overall Average) 1 Karachi 57.95* 23.58* 40.76* Shaheed Benazirabad Hyderabad Mirpurkhas Larkana Sukkur Notes: 1. * represents the content strand wise highest score attained in class V across regions 2. represents the content strand wise lowest score attained in class V across regions 35

60 8.3.2Region Level Math Based Results Class V strand based analysis of class V Math scores revealed that Mirpur Khas led the regions with a significant difference from province s overall score. Nonetheless, overall averages range between 21.9% and 27.6%, which shows significantly low scores across the regions. strand based analysis also shows similar patterns of student achievement among the regions such as relatively higher scores in information handling and measurement and very low scores in geometry and algebra. Small differences, mostly around 6 percent points between lowest performing region and highest performing region indicate a low variation among regions suggesting similar public sector schooling conditions across the regions. Table 18: Regional level content strand based analysis of students scores in math of class V S. No Region Number & Operation Measurement Algebra Geometry Information Handling Overall Overall 1 Karachi * Shaheed Benazirabad Hyderabad Mirpurkhas 31.09* 37.15* 20.83* * Larkana * Sukkur Standard Deviation (Overall Average) Notes: 1. * represents the content strand wise highest score attained in class V across regions 2. represents the content strand wise lowest score attained in class V across regions 8.3.3Region Level Based Results Class V Although Karachi region scored highest as compared to overall result as well as in content strand based averages of life science and physical science, overall science achievement was found low in all regions. All of the regions performed relatively higher in Life and Earth and Space compared to Physical. There seems to be a small variation among the regions as difference between lowest performing and highest performing regions is 36

61 around 6 percent points. Small variation across the regions suggests consistency of schooling conditions and resulting student achievement in grade V science. Table 19: Regional level content strand based analysis of students scores in science of class V S. No Region Life Average Physical Average Earth & Space Average Overall Average Difference From Overall Average Standard Deviation (Overall Average) 1 Karachi 35.24* 18.97* * Shaheed Benazirabad Hyderabad Mirpurkhas Larkana * Sukkur Notes: 1. * represents the content strand wise highest score attained in class V across regions 2. represents the content strand wise lowest score attained in class V across regions 8.3.4Region Level Language Based Results Class VIII Analysis of class VIII language scores revealed that Karachi region led overall language average scores, while Sukkur and Mirpur Khas regions fell to the bottom. Hyderabad region scored highest in reading, Shaheed Benazirabad and Karachi scored slightly lower; whereas, Sukkur and Mirpur Khas scored significantly low. Consistent with class V language content strand based scores, all regions scored higher in reading compared to writing (almost double of writing scores), which is an strong indication of less focus on developing students writing skills. There seems to be a moderate variation within regions, as indicated by standard deviations, and among the regions, which suggests some schools might have performed higher than overall averages as well as content strand based regional averages. Analysis and further understanding of such schools (or other units) may lead to finding out solutions to address issue of consistent low achievement of students in the province as reflected by students scores of all four phases of SAT project. 37

62 Table 20: Region level content strand based analysis of students scores in language of class VIII S.No Region Reading Average Writing Average Overall Average Difference From Overall Average Standard Deviation Hyderabad 55.55* Karachi * 44.77* Larkana Mirpurkhas Shaheed Benazirabad Sukkur Notes: 1. * represents the content strand wise highest score attained in class VIII across regions 2. represents the content strand wise lowest score attained in class VIII across regions 8.3.5Region Level Math Based Results of Class VIII Similar to class V math regional scores, at grade VIII level, the six regions scored higher in Information Handling followed by Numbers and Operation; whereas, comparatively lower in Algebra and Geometry. This pattern holds across the regions and content strand scores. Larkana region stood top in three content strands as well as in overall scores; whereas, Hyderabad scored lowest. However, based on overall average scores, the difference between highest and lowest scoring regions is only 5 percent points, which suggests slight variation between regions. Consistency and similarity of regional scores in all content strands of class VIII math suggests similarity of instructional conditions in Govt. schools across the province. Moreover, standard deviations of regions ranged from 9 to 19, which means that there is different level of variation of scores within each region. 38

63 Table 16: Regional level content strand based analysis of students scores in math of class VIII S. N o Region Number &Operati on Average Algebra Average Geometry Average Information Handling Average Overall Average Difference From Overall Average Standard Deviation Hyderabad Karachi Larkana 28.36* 21.38* * 25.78* Mirpurkhas Shaheed Benazirabad Sukkur * Notes: 1. * represents the content strand wise highest score attained in class VIII across regions 2. represents the content strand wise lowest score attained in class VIII across regions 8.3.6Region Level Based Results of Class VIII All of the regions scored below 30% average score in all content strands of class VIII science, which is a significantly low score.further,region based class VIII content strand wise science scores do not show a significant variation between regions as most of the content strand based scores fell in twenties. Nonetheless, Larkana scored higher in Life science and Physical ; whereas, Karachi region scored highest in Physical. Difference between highest and lowest performing district was only 5 percent points on overall averages scores, which suggests similar schooling conditions across the province. Standard deviations also fell between 9 and 14 suggesting a different but moderate variation of scores within each region. 39

64 Table 17 Regional level content strand based analysis of students scores in science of class VIII S No Region Life Average Physical Average Earth & Space Average Overall Average Difference From Overall Average Standard Deviation 1 Hyderabad Karachi * Larkana 28.06* * 26.71* Mirpurkhas Shaheed Benazirabad Sukkur Notes: 1. * represents the content strand wise highest score attained in class VIII across regions 2. represents the content strand wise lowest score attained in class VIII across regions 9.0District Level Based Results Class V Figure 2 represents patterns in districts overall scores in Language, Maths, and science for class V. Comparatively; language scores of all districts are quite significantly higher than math and science scores. With an exception, most of the districts appear to be performing between 25% and 40% language average scores. With few variations, districts math and science scores fell between 20% and 30% average scores. More detailed district based comparisons and district level content based achievements are discussed in later parts. Moreover, detailed profile for each district based on its performance in different content strands and taluka-based is provided in Appendix J. 40

65 Figure 2District Level Wise Results Class V Overall Language Overall Math Overall 9.1 District Level Language Based Results Class V Analysis of language content strands (main areas of learning) at class V level shows that reading average scores of all districts were significantly higher than their writing scores. Table 23 gives details of district based scores. All six districts of Karachi scored higher in the language overall as well as content strand based scores, indicating a consistent performance in the region. While reading scores are encouraging as 18 out of 29 districts scored in fifties, writing scores are significantly low for all districts as districts scores range between 11% and 24% average writing scores. Narrow difference between lowest and highest performing districts in writing suggest similar instructional conditions in the schools across the province. Difference of 22 percent points between highest scoring and lowest scoring districts in reading suggests a significant variation among the districts. Standard deviations of districts mostly fall between 15 and 20 which means that there is moderate variation of scores within as well as between districts, and some schools may have performed significantly higher in each district. 41

66 Table 18 Districts level content strand based analysis of students scores in language of class V Difference From Writing Reading Overall S.N Standard District Average Average Average o Overall Deviation Average 1 Korangi Karachi Central Karachi West Karachi East Karachi South Karachi Malir Karachi Jamshoro Sujawal Shaheed Benazirabad Naushero Feroz Badin Mitiari Sanghar Tando Allah Yar Dadu Tando Mohd Khan Thatta Umerkot Kambar-Shahdadkot Kashmore Tharparkar SUKKUR Mirpur Khas Ghotki Hyderabad Khairpur Mirs Jacobabad Larkana Shikarpur Notes: 1. Districts are ranked from 1 to 24 (highest to lowest) based on overall average score. 2. *represents the content strand wise highest score attained in Language of class V across districts 3. represents the content strand wise lowest score attained in Language of class V across districts In column 6 of Table 23, positive difference means district performance above provincial average score, whereas negative difference means district performance below provincial average 42

67 Korangi Karachi West Karachi Central Karachi East Karachi South Karachi Malir Karachi Jamshoro Sujawal Shaheed Benazirabad Naushero Feroz Badin Mitiari Sanghar Tando Allah Yar Dadu Tando Mohd Khan Thatta Umerkot Kambar-Shahdadkot Kashmore Tharparkar SUKKUR Mirpur Khas Ghotki Hyderabad Khairpur Mirs Jacobabad Larkana Shikarpur score. Figure 3 illustrates more clearly the districts differences from the province s mean score. More districts have positive difference from provincial mean scores; however, only 8 districts scored 4 or more percent points higher than mean score. Figure 3Districts Class V Language Difference from Province s overall Language average Score District Level Math Based Results Class V strand based analysis of districts class V math scores show that most of the districts scored higher in Measurement and Information Handling compared to Algebra and Geometry; whereas, Number and Operations scores fell in the middle. Geometry was scored lowest among the content strands across the districts, which is a strong indication of less emphasis on teaching and learning of Geometry. Although districts scored relatively higher on Information Handling and Measurement, overall scores fell between 18% and 30%, which indicates significantly low achievement of all districts in class V math. Small differences between lowest performing and highest performing districts on all content strands, suggests that there was a little variation among the district scores. Moreover, standard deviation of districts ranged between 10 and 20, which suggests moderate variation of performance within districts that may be studied further to gain more insights into learning and achievement of students. 43

68 Table 19 District Level Math Based Results Class V S.No District Number & Operations Measurement Algebra Geometry Information Handling Overall Overall 1 Tharparkar Jacobabad Naushero Feroz Umerkot Malir Karachi Sujawal West Karachi Badin Shaheed Benazirabad Ghotki Mirpur Khas Korangi Karachi South Karachi Mitiari Dadu Central Karachi Jamshoro East Karachi Sanghar Shikarpur Thatta Khairpur Mirs Tando Allah Yar Kashmore Kambar-Shahdadkot Tando Mohd Khan Larkana SUKKUR Hyderabad Notes: 1. Districts are ranked from 1 to 24 (highest to lowest) based on overall average score. 2. *represents the content strand wise highest score attained in Math of class V across districts 3. represents the content strand wise lowest score attained in Math of class V across districts Standard Deviation(Overall Average) 44

69 Tharparkar Jacobabad Naushero Feroz Umerkot Malir Karachi Sujawal West Karachi Badin Shaheed Benazirabad Ghotki Mirpur Khas Korangi Karachi South Karachi Mitiari Dadu Central Karachi Jamshoro East Karachi Sanghar Shikarpur Thatta Khairpur Mirs Tando Allah Yar Kashmore Kambar-Shahdadkot Tando Mohd Khan Larkana SUKKUR Hyderabad Looking at another indicator of distribution of districts scores, which shows a pattern in difference from province s average score, four districts appear performing significantly above and four districts below the province s average; whereas, rest of the districts fall somewhere in the middle. This pattern indicates somewhat symmetry in distribution or districts class V math scores. See Figure 4 for clear illustration of districts differences from the provinces mean score. Figure 4Districts Class V Math Difference from Province s overall Math average Score District Level Based Results Class V Consistent with result patterns in previous phases of SAT, districts scored higher in Earth and Space, and Life ; whereas, significantly low in Physical. Korangi Karachi toped in Life ; whereas Jacobabad toped in Physical (with very narrow difference from Tharparkar) and Earth and Space. Since Physical constitutes major part of curriculum (about 65%), overall district scores reflect its impact as average scores ranged from 19% to 27%, indicating a low achievement across the districts. Moreover, small differences between lowest performing and highest performing districts and small district based standard deviations suggest moderate variation among and between districts scores. 45

70 Table 20 District level content strand based analysis of students scores in science of class V S. No District Life Average Physical Average Earth & Space Average Overall Average Difference From Overall Average Standard Deviation (Overall Average) 1 Jacobabad Tharparkar Korangi Karachi West Karachi Sujawal Malir Karachi South Karachi East Karachi Central Karachi Umerkot Jamshoro Naushero Feroz Tando Allah Yar Mirpur Khas Badin Ghotki Tando Mohd Khan Mitiari Shikarpur Thatta Shaheed Benazirabad Sanghar Dadu Kambar-Shahdadkot Kashmore Hyderabad SUKKUR Larkana Khairpur Mirs Notes: 1. Districts are ranked from 1 to 24 (highest to lowest) based on overall average score. 2. *represents the content strand wise highest score attained in of class v across districts 3. represents the content strand wise lowest score attained in of class v across districts 46

71 Jacobabad Tharparkar Korangi Karachi West Karachi Sujawal Malir Karachi South Karachi Central Karachi East Karachi Umerkot Jamshoro Naushero Feroz Tando Allah Yar Mirpur Khas Badin Ghotki Tando Mohd Khan Mitiari Shikarpur Thatta Shaheed Benazirabad Sanghar Dadu Kambar-Shahdadkot Kashmore Hyderabad SUKKUR Larkana Khairpur Mirs Looking at difference from overall province s average (Column 6 in Table 25), six districts perform significantly higher; whereas, two districts performed significantly lower than province s overall science average score, and rest are concentrated around the provincial mean. See Figure 5 for clear illustration of districts differences from the provinces mean score. Figure 5Districts Class V Difference from Province s overall average Score District Level Based Results Class VIII Figure 6 depicts patterns in district based overall scores in language, math, and science for class VIII. Relatively, language scores for all districts are significantly higher than math and science scores. With a few exceptions, most of the districts appear to be performing between 25% and 50% language average scores suggesting a significant variation between districts. Districts math and science average scores appear to be concentrated between 20% and 30%, except a few districts performing above 20% or 30%. Detailed district based comparisons and content based achievements are discussed separately in thefollowing parts. 47

72 Figure 6Scattered Representation of Districts Overall Scores Class VIII Overall Language Overall Math Overall District Level Based Results of Language Class VIII strand based analysis of districts class VIII scores revealed a pattern of achievement similar to class V higher scores in reading across the districts; mostly twice the writing scores. District Jamshoro was found leading in reading scores; whereas, Korangi Karachi scored highest in writing. Twenty out of 29 districts scored above 50% in reading which is encouraging; however, only six districts scored above 30% in writing and all scores of rest of the districts fell between 17% and 30% which suggests severely low achievement in writing across the districts. The difference of 30 percent points between lowest performing district and highest performing district suggests significant variation among the districts; whereas standard deviations of most of the districts falling between 15% and 20% suggest a moderate variation within districts scores. These variations need to be studied carefully in studies based on SAT data as they may lead to understanding of how some schools and students perform higher or lower within similar overall schooling conditions. 48

73 Table 21 District level content strand based analysis of students scores in language of class VIII S.No District Difference From Reading Writing Overall Standard Average Average Average Overall Deviation Average 1 Korangi Karachi West Karachi Central Karachi Jamshoro South Karachi East Karachi Shaheed Benazirabad Malir Karachi Tando Allah Yar Sujawal Badin Umerkot Mitiari Sanghar Kambar-Shahdadkot Dadu Naushero Feroz Thatta Tharparkar SUKKUR Hyderabad Kashmore Tando Mohd Khan Larkana Jacobabad Shikarpur Ghotki Khairpur Mirs Mirpur Khas Notes: 1. Districts are ranked from 1 to 24 (highest to lowest) based on overall average score. 2. *represents the content strand wise highest score attained in Language of class VIII across districts 3. represents the content strand wise lowest score attained in Language of class VIII across districts 49

74 Korangi Karachi West Karachi Central Karachi Jamshoro South Karachi East Karachi Shaheed Benazirabad Malir Karachi Tando Allah Yar Sujawal Badin Umerkot Mitiari Sanghar Kambar-Shahdadkot Dadu Naushero Feroz Thatta Tharparkar SUKKUR Hyderabad Kashmore Tando Mohd Khan Larkana Jacobabad Shikarpur Ghotki Khairpur Mirs Mirpur Khas Since districts differences with province s average score tend to be more positive compared to number of negative differences, it may mean slightly positively skewed distribution of districts language scores. See Figure 7 for clear illustration of districts differences from the provinces mean score. However, six districts differencesdeviate positively 5 or more percent points from provincial average score suggesting some districts have performedmoderately higher than other districts. Figure 7Districts Class VIII Language Difference from Province s Overall Language Average Score District Level Based Results of Math Class VIII Overall math scores of districts were found severely low as most of the districts performed below 30% average score; which suggests prevalence of similar issues that hinder student achievement across the districts. Shikarpur, Jacobabad, and Tharparkar came out as top performers in almost all content strands of Math class VIII. All districts relatively performed higher in Information Handling and Numbers and Operations; whereas, districts scores were found significantly low in Algebra and Geometry as most of the scores in the tow content strands fell below 20% average score. The difference of 14 percent points in overall average between lowest performing and highest performing districts suggests a moderate variation among districts; however, content strand based differences vary at different scales. 50

75 Table 22 District level content strand based analysis of students scores in math of class VIII S.No District Number & Operations Algebra Geometry Information Handling Overall Overall 1 Shikarpur Jacobabad Tharparkar Larkana Naushero Feroz Tando Mohd Khan Sujawal Malir Karachi Ghotki Khairpur Mirs Umerkot Shaheed Benazirabad Mitiari Badin Central Karachi South Karachi Korangi Karachi East Karachi Tando Allah Yar West Karachi Kashmore Thatta Sanghar Dadu Kambar-Shahdadkot Hyderabad SUKKUR Jamshoro Mirpur Khas Notes: 1. Districts are ranked from 1 to 24 (highest to lowest) based on overall average score. 2. *represents the content strand wise highest score attained in Language of class v across districts 3. represents the content strand wise lowest score attained in Language of class v across districts Standard Deviation 51

76 Shikarpur Jacobabad Tharparkar Larkana Naushero Feroz Tando Mohd Khan Sujawal Malir Karachi Ghotki Khairpur Mirs Umerkot Shaheed Benazirabad Mitiari Badin Central Karachi Korangi Karachi South Karachi East Karachi Tando Allah Yar West Karachi Kashmore Thatta Sanghar Dadu Kambar-Shahdadkot Hyderabad SUKKUR Jamshoro Mirpur Khas Pattern of districts differences from province s overall math average show a few districts (Shikarpur, Jacobabad, and Tharparkar) significantly positive difference from province s mean score. See Figure 8 for pattern of districts differences from the province s mean score. Because of a few districts quite higher positive differences, majority of districts have a negative difference from provincial mean score. Figure 8Districts Class VIII math Difference from Province s overall math average Score District Level Based Results of Class VIII With narrow differences from Jacobabad and Sujawal, Shikarpur scored highest in Life and Earth and Space ; whereas, Korangi Karachi scored highest in Physical. Nonetheless, most of the districts overall scores as well as content strand based scores were found significantly low. Table 27 shows details of district based scores. Looking at variation indicators of districts, there are small differences between highest performing and lowest performing districts on content strand based average scores as well as overall average scores, which suggests moderate variation among districts performance. Standard deviations of districts also range between 9 and 20 suggesting moderate to significant variation within a district s scores. 52

77 Table 23 District level content strand based analysis of students scores in science of class VIII S.No District Life Average Physical Average Earth & Space Average Overall Average Difference From Overall Average Shikarpur Jacobabad Standard Deviation Sujawal Tharparkar Korangi Karachi Larkana West Karachi Central Karachi Tando Allah Yar South Karachi Umerkot Naushero Feroz Malir Karachi Tando Mohd Khan East Karachi Badin Mitiari Shaheed Benazirabad Ghotki Kambar-Shahdadkot Jamshoro Dadu Sanghar SUKKUR Thatta Hyderabad Kashmore Mirpur Khas Khairpur Mirs Notes: 1. Districts are ranked from 1 to 24 (highest to lowest) based on overall average score. 2. *represents the content strand wise highest score attained in of class VIII across districts 3. represents the content strand wise lowest score attained in of class VIIIacross districts 53

78 Shikarpur Jacobabad Sujawal Tharparkar Korangi Karachi Larkana Tando Allah Yar West Karachi Central Karachi Umerkot South Karachi Naushero Feroz Badin Malir Karachi Tando Mohd Khan East Karachi Mitiari Jamshoro Kambar-Shahdadkot Dadu Shaheed Benazirabad Ghotki Sanghar SUKKUR Thatta Kashmore Hyderabad Mirpur Khas Khairpur Mirs Districts difference from province s overall science average show that four districts differences significantly positive and about same number of districts differences significantly negative from provincial mean score.rest of the differences is close to the province s average score, which indicatesthat majority of districts scores are concentrated around the mean of districts scores. See Figure 9 for pattern of districts differences from the provinces mean score. Figure 9Districts Class VIII Difference from Province s overall average Score Gender based analysis of results Province level gender based analysis of overall results for class V and class VIII indicate girls significantlyahead of boys in language with 4.6 percent points difference in class V and 8 percent points difference in class VIII. Statistical significance of the variance in two groups (mean scores) in language achievement is not tested; therefore, it should be kept in view while interpreting the results. See Table 29 and Table 30 for details. Although province level average scores for science appear to be very slightly different for girls and boys, it may not be considered a difference in performance as scores are extremely close. The overall scores of boys and girls in SAT IV test show that girls performed slightly higher than boys, as evident from girls positive difference from province s overall average in both classes. Girls high performance in overall 54

79 scores could be an effect of girls higher mean scores in language. Standard deviation value for girls and boys are also very close which indicates a similar overall variation for both groups. Table 24 Provincial level gender based analysis of students scores in class V S. No Gender Language Average Math Average Average Overall Average Difference from Province Overall Average Standard Deviation 1 Female 35.22* 23.54* * Male * Note: 1. *represents the subject wise highest score attained in class V across gender Table 30Provincial level gender based analysis of students scores in class VIII S. No Gender Language Average Math Average Average Overall Average Difference from Province Overall Average 1 Female 42.35* 21.86* 25.91* 30.04* Male Standard Deviation Note: 1. *represents the subject wise highest score attained in class VIII across gender 12.0 Location based analysis of results Analysis of results based on rural and urban locations shows no significant difference between performances of students in these two localities at class V level as difference between location based content strand based averages is not significant. Table 31 and Table 32 provide details of location based analysis of results. There seems to be a significant difference between rural and urban students at class VIII level language achievement, as urban students group scored 5 percent points, on average, higher than rural students group. 55

80 Almost same results for both locations indicate that in general conditions of schooling and student background may be closely similar for two population groups in the schools targeted in SAT IV assessment. Table 25 Provincial level location based analysis of students scores in class V S. No Location Language Average Math Average Average Overall Average Difference from Province Overall Average Standard Deviation 1 Rural Urban * * * Note: 1. *represents the subject wise highest score attained in class V across location Table 26 Provincial level location based analysis of students scores in class VIII S. No Location Language Average Math Average Average Overall Average Difference from Province Overall Average Standard Deviation 1 Rural * Urban * * Note: 1. *represents the subject wise highest score attained in class VIII across location 56

81 13.0 SEF Schools District Based Results Grade V students of Sindh Education Foundation (SEF) schools of nine districts appeared in SAT IV test. SEF school districts show pattern of achievement similar to main district as SEF school districts scored higher in language and significantly low in math and science SEF School Districts Based Results Language Class V SEF schools of district Thatta performed significantly higher on reading comprehension, writing, and overall language scores compared to SEF schools in other nine districts. Table 33 provides content strand based analysis of SEF schools in nine districts. Following general performance trends in districts of the province, SEF schools across the districts performed higher in reading comprehension and significantly lower in writing skills. Table 27 SEF schools district wise content strand based analysis of students scores in language of class V S No District Writing Average Reading Average Overall Language Difference with Main District Difference with Province Average 1 Badin Dadu Jacobabad Kambar-Shahdadkot Khairpur Mirs Larkana Mirpur Khas Sanghar Shaheed Benazirabad Tharparkar Thatta 18.45* 56.11* 37.28* Umerkot Notes: 1. *represents the subject content wise highest score attained in class V across SEF school 2. represents the subject content wise lowest score attained in class V across SEF schools 57

82 Severity of SEF schools low performance in writing is visible by the fact that four districts scored below 5% average score and five scored between 12% and 15% average score. Looking at overall performance in language, SEF schools appeared performing slightly lower than other school types targeted in SAT IV assessment as seven out of nine SEF schools districts have negative difference with respective district s overall average score and province s average score SEF School Districts Based Results Math Class V SEF district Jacobabad took the lead in number & operations, measurement and information handling; whereas Shaheed Benazirabadscored higher in geometry. Larkana and Shaheed Benazirabad performed lowest in math among SEF districts. See Table 34 for details. Table 28 SEF schools district wise content strand based analysis of students scores in math of class V S No District Number &Operation Measurement Average Alegbra Geometry Average Information Handling Overall Math Average Difference with Main District Difference with Province Average 1 Badin Dadu Jacobabad 59.52* 50.00* 50.00* 42.86* * 56.25* Kambar-Shahdadkot Khairpur Mirs Larkana Mirpur Khas * Sanghar Shaheed Benazirabad Tharparkar Thatta Umerkot Notes: 1. *represents the subject content wise highest score attained in Math of class V across SEF school 2. represents the subject content wise lowest score attained in Math of class V across SEF school 58

83 Similar to trends for main districts, SEF districts performed higher in measurement and information handling; however, scores for a couple of SEF districts are significantly higher than main districts. Only three SEF districts performed higher than their comparable main districts overall averages and same number of SEF districts performed higher than province s overall average score suggesting slightly lower overall performance of SEF districts in math class V SEF School Districts Based Results Class V Similar to performance trend in all districts, SEF school districts also performed relatively higher in Earth and Space, followed by life science and lowest in physical science. Sanghar topped in life science followed by Tharparkar in earth & space, and Shaheed Benazirabad in physical science; whereas Dadu scored lowest in almost all content strands. SEF districts modestly varied in overall scores as indicated by difference of about eleven percent points between relatively high-performing and low-performing SEF districts. Overall, SEF school districts appeared to be performing slightly lower than main districts as indicated by negative difference of seven out of nine SEF districts scores with relevant main districts. Approximately same is indicated by analysis of SEF districts difference with province s overall averages. See Table 35 for details. 59

84 Table 29 SEF schools district wise content strand based analysis of students scores in science of class V S No District Life s Physical Average Earth & Space Overall Average Difference with District 1 Badin Dadu Jacobabad 46.43* 34.09* 75.00* 42.50* Kambar-Shahdadkot Khairpur Mirs Larkana Mirpur Khas Sanghar Shaheed Benazirabad Tharparkar Thatta Umerkot Difference with Province Notes: 1.*represents the subject content wise highest score attained in of class V across SEF school 2. represents the subject content wise lowest score attained in of class V across SEF school 60

85 SECTION THREE: COMPARATIVE RESULTS 61

86 14.0COMPARATIVE ANALYSIS OF RESULTS This section presents different comparative analysis. Province level analysis based on comparison between class V and class VIII is provided based on performance in different content strands and separate for each subject. Since assessment framework for both grades was same in the three subjects, comparative analysis of content strand based scores (and overall scores) illustrates an overall comparative performance of the two classes. Further comparative analysis comprises of district-based inter-subject comparison of student scores, district-based comparison of four performance levels ranging from low to exceptional levels, and comparative analysis of SAT I, SAT II, SAT III and SAT IV results. The comparative analysis identify several areas for further investigation, research and research based reform initiatives Province level language content strand based comparison between class V and class VIII scores strand based comparison between class V and class VIII performance (in terms of scores) provides each district s scores in both grades as well as positive or negative differences based on how higher or lower class VIII performed in comparison to class V. Hence, positive difference means class VIII s higher score in percent points; whereas, negative difference means class VIII s lower score in comparison to corresponding class V scores. As provided in Table 36, content strand based comparative analysis of language indicates that class VIII performed slightly higher in reading comprehension with positive difference in 16 districts (out of 29) and significantly higher in writing with positive difference in 28 districts (out of 29) districts. Class VIII s positive differences in reading comprehension ranged from 0.21 to percent points with 12 districts differences, ranging from 2.0 to percent points and three districts performing significantly low with differences ranging from 0.21 to Districts differences in writing scores ranged from 1.49 to percent points suggesting all districts performance was significantly higher in class VIII writing except one district where the difference is in negative. The reason for higher performance in writing by class VIII is possibly because of relative higher emphasis on writing in class VIII curriculum, instructions and paper pencil/written examinations. 62

87 Table 30 Provincial District-wise Results vis a vis Language of Class V and VIII Reading Comprehension Writing Comprehension S.No. District V VIII Class VIII s Difference to V V VIII Class VIII s Difference to V 1 Badin Central Karachi Dadu East Karachi Ghotki Hyderabad Jacobabad Jamshoro Kambar-Shahdadkot Kashmore Khairpur Mirs Korangi Karachi Larkana Malir Karachi Mirpur Khas Mitiari Naushero Feroz Sanghar Shaheed Benazirabad Shikarpur South Karachi Sujawal SUKKUR Tando Allah Yar Tando Mohd Khan Tharparkar Thatta Umerkot West Karachi Although differences in districts performance in writing are significantly higher for class VIII, overall performance in writing is significantly low for all districts in both classes. This may mean that, across the classes, there is higher emphasis on reading in grade level curricula, teaching, 63

88 and assessments that need to be further studied systematically. Another important aspect revealed in the comparative analysis is the significantly high-performing districts in class V writing have also scored quite higher in class VIII writing that also requires further systematic investigation Province level math content strand based comparison class V and class VIII The Table 37 presents comparison of math scores in number and operations and algebra as well as percent point differences between class V and class VIII district scores. Overall districts appeared to be performing low in number and operations in class VIII with only 3 positive differences compared to corresponding scores in class V. Positive differences ranged from 3.48 to 9.20 percent points whereas most of the negative differences ranged from to 8.48 percent points indicating most of the districts performing higher or lower with narrow margin except four districts in which the negative differences ranged from -5 to -8. While districts overall appeared to be performing extremely low in number and operations in class VIII, the overall scores of all districts for both grades ranged from 20% -35% with variation of few points higher or lower. Differences between districts positive scores in class VIII and class V algebra are 0.53to13.38 percent points, which means class VIII performed significantly higher. While interpreting these differences, curriculum of grades must be taken into account. Class V curriculum have very limited contents in algebra, that have been introduced very recently compared to class VIII that has many concepts. So very recent introduction of algebra at class V could be a reason for lower performance in class V. 64

89 Table 31 Provincial District wise results vis a vis Mathematics s of Class V & VIII S No. District Number & Operations Class VIII s Difference to V Algebra Class VIII s Difference to V V VIII V VIII 1 Badin Central Karachi Dadu East Karachi Ghotki Hyderabad Jacobabad Jamshoro Kambar-Shahdadkot Kashmore Khairpur Mirs Korangi Karachi Larkana Malir Karachi Mirpur Khas Mitiari Naushero Feroz Sanghar Shaheed Benazirabad Shikarpur South Karachi Sujawal SUKKUR Tando Allah Yar Tando Mohd Khan Tharparkar Thatta Umerkot West Karachi

90 Table 32 Provincial District-wise Results vis a vis Mathematics s of Class V & VIII S No. District Geometry Class VIII s Information Handing Difference to V V VIII V VIII Class VIII s Difference to V 1 Badin Central Karachi Dadu East Karachi Ghotki Hyderabad Jacobabad Jamshoro Kambar-Shahdadkot Kashmore Khairpur Mirs Korangi Karachi Larkana Malir Karachi Mirpur Khas Mitiari Naushero Feroz Sanghar Shaheed Benazirabad Shikarpur South Karachi Sujawal SUKKUR Tando Allah Yar Tando Mohd Khan Tharparkar Thatta Umerkot West Karachi The content strand based differences in geometry in class V compared to class VIII indicates significantly better performance at class VIII with positive percent point in 28 districts out of 29 66

91 districts. The positive differences ranged from 0.87 to percent point. The positive difference could be due to relatively better performance of all districts in geometry in class VIII in comparison with class V. Another reason could be sequence of grade level math curriculum (and math textbooks) in which geometry is usually one of the last couple of units, which increases the probability of no coverage for geometry in teaching of math in a given academic year. Nonetheless, reasons for differences need to be studied systematically. Contrary to algebra and geometry, the table above shows that class VIII performed extremely low in information handling with negative differences ranging from to percent pointsin 17 districts out of 29 districts. It seems, differences were high partially because performance for this content strand in class VIII was quite low possibly an effect of placing information handling as the last unit in class VIII curriculum that increases the chance of noncoverage of this unit in the teaching of math. The low scores and differences may also be due to gaps in teachers capacity, teachers content knowledge, and teachers teaching methodology, the representation of the content in the textbooks and the shortage of mathematics teachers in the system. Nonetheless, these all assumptions offered to explain differences need to be studied systematically in order to inform future reforms in math Province level science content strand based comparison between class V and class VIII Comparative analysis between two grades revealed that class VIII students performed slightly higher in physical science and moderately lower in life science, whereas class V students performed significantly higher in earth & space science. See Table 38 for details. There are 29 positive differences in physical science that means 29 districts performed comparatively higher in class VIII. The positive differences are significantly high as they ranged from 4.84 to 11.6 percent points. These are comparisons based on overall mean scores of classes, thus curriculum differences and the recent changes in curriculum should be considered while interpreting these differences. In life sciences 2 out of 29 differences are positive. As 27 differences in life science are negative and these ranged from 0.74 to with 20 districts differences higher than 5 percent points, it may suggest that class V students performed significantly higher in life science. 67

92 Table 33 Provincial District-wise Results vis a vis s of Class V & VIII S No. District Physical Difference from Class VIII to V Life Difference from Class VIII to V Earth & Space V VIII V VIII V VIII Difference from Class VIII to V 1 Badin Central Karachi Dadu East Karachi Ghotki Hyderabad Jacobabad Jamshoro Kambar-Shahdadkot Kashmore Khairpur Mirs Korangi Karachi Larkana Malir Karachi Mirpur Khas Mitiari Naushero Feroz Sanghar Shaheed Benazirabad Shikarpur South Karachi Sujawal SUKKUR Tando Allah Yar Tando Mohd Khan Tharparkar Thatta Umerkot West Karachi

93 Another important aspect is that some low-performing districts in class VIII life science such as East Karachi, Central Karachi, Korangi Karachi, Malir Karachi, South Karachi, West Karachi and Jamshoro performed reasonably higher in class VIII Physical sciences test. District based comparison for earth & space science shows that all districts performed significantly higher in class V as all of the differences are negative ranging from to with 5 districts differences less than 10 percent points. Nature of curriculum and learning material could affect the scores, as earth & space portion is quite small in curriculum for both classes and relatively even smaller for class V, the differences should be interpreted cautiously. Although it is hard to establish reasons behind the differences, as it was not mandate of this study, comparison of scores for two classes showed clearly that all districts scored higher in class V which suggests further investigation of reasons behind this pattern of difference District-based Inter-subject Comparisons Districts were ranked based on their overall score in each subject. Super script number on each score indicates a district s ranking in the subject area, as shown in Table 40. Some overall patterns are visible in district based inter-subject comparison of performance. Most of the districts emerged following this order in their subject based average scores: highest score in language, followed by score in math, and lowest score in science. This pattern indicates consistency of performance and scoring in different subject based tests. However, some variation in math and science score was also observed. In some districts the science scores are observed to be higher than math score. Also there seems to be a pattern in the ranks obtained in Language and s as ranks in most districts vary from 1st to 5th in the two subjects. For example, Korangi Karachi ranked 1 st in language is ranked 3 rd in s, similarly Sukkur ranked 22 nd in Language and 27 th in s. In some districts math and science scores are quite close; however, language scores deviate significantly. For example Tharparkar that scored 1 st in Math and 2 nd in s but deviates in languages as it is ranked 21 st in Languages. Based on the overall averages most of the districts in Karachi are ranked amongst the top 5 districts in class V. 69

94 Table 40District Wise inter subject Comparison of Students of Class V S. No District Language Math Average Average Overall 1 West Karachi Malir Karachi Korangi Karachi Central Karachi South Karachi Sujawal East Karachi Tharparkar Naushero Feroz Jacobabad Umerkot Jamshoro Badin Shaheed Benazirabad Mitiari Tando Allah Yar Sanghar Dadu Mirpur Khas Thatta Ghotki Tando Mohd Khan Kambar-Shahdadkot Kashmore Shikarpur Khairpur Mirs SUKKUR Hyderabad Larkana Note: Districts are ranked from 1 to 29 (Highest to Lowest) based on overall average score. Language still remains to be the subject where most districts did their best, while performing the lowest in Math. This trend is however not consistent in Shikarpur and Jacobabad. In Shikarpur it can be especially noted that though the district performed well in Math and, it has performed severely low in Language. Jacobabad on the other hand has had a very little difference in averages of all three subjects, though it ranks highly in Math and s and poorly in Language. It can also be noted overall that districts which rank high in Math and science usually 70

95 deviate in their Language ranking; this seems to be true for Larkana, Shikarpur and Tharparkar along with a few others. Table 34 District-wise Inter-subject Comparison of Students of Class VIII S. No District Language Math Average Average Overall Average 1 Korangi Karachi Tharparkar Central Karachi West Karachi Sujawal Shikarpur South Karachi Naushero Feroz Malir Karachi Jacobabad East Karachi Shaheed Benazirabad Tando Allah Yar Umerkot Badin Jamshoro Mitiari Larkana Tando Mohd Khan Sanghar Kambar-Shahdadkot Dadu Thatta SUKKUR Kashmore Hyderabad Ghotki Khairpur Mirs Mirpur Khas Note: Districts are ranked from 1 to 29 (Highest to Lowest) based on overall average score. 71

96 16.0 Performance (grade) based analysis of districts scores Districts scores were analyzed on proportion of their students separated in four levels of performance (grade) classifications comprising: low performance (students with 0% to 33% of scores), mediocre performance (students with 34% to 60% scores), high performance (students with 61% to 80% scores), and exceptional performance (students with above 80% scores). Hereafter, four performance levels will be mentioned as low, mediocre, high, and exceptional. The Tables below provide details of districts performance at different performance levels Districts performance level based proportions of students in language Districts class V language performance level based analysis revealed that overwhelming proportion of students (approximately 90%) scored at low performance level and mediocre performance level combined; however, all of districts students, with varying proportions, scored at high level and relatively small proportion at exceptional level. Central Karachi seems to have the highest density of high performance students followed by South Karachi and East Karachi. Though these three districts hold the highest percentage of high performers, it is Korangi Karachi which holds the highest percentage of exceptional performances. It is also interesting to know how, along with the most exceptional performances, Korangi also holds the highest percentage for mediocre performances along with East Karachi. On the lower end, Badin, Shikarpur and Larkana seem to have the highest percentage of low performances as all of them had over 80% of students in this category. Many districts had a relatively high number of mediocre performances ranging from 30% to 60% of students while Korangi Karachi appeared to be the most mediocre. Low Performances still took up the majority of the students with a peak value of 84% of students, while most districts range around 50 60% in the low performance percentage. Korangi Karachi tops the high performance percentage chart with 8.25% of students, but many other districts also had 2% to 4 % of students with high performances. Nonetheless, scarcity of exceptional performances is quite visibleas many districts completely lackedthis category. 72

97 Table 35 District-based proportion of students at various language performance levels Class V S No District Low Performance (0%-33.99% score) Language of Class V(Proportions of Students) Mediocre Performance (34%-59.99% score) High Performance (60%-79.99% score) Exceptional Performance (80%-100% score) 1 Badin 84.88% 14.21% 0.91% 0.00% 2 Central Karachi 33.33% 58.17% 8.50% 0.00% 3 Dadu 55.15% 42.51% 2.33% 0.00% 4 East Karachi 29.73% 64.86% 5.41% 0.00% 5 Ghotki 69.90% 29.26% 0.83% 0.00% 6 Hyderabad 70.67% 28.72% 0.61% 0.00% 7 Jacobabad 80.74% 19.26% 0.00% 0.00% 8 Jamshoro 45.39% 52.43% 1.94% 0.24% 9 Kamber Shahdadkot 55.70% 41.83% 2.15% 0.32% 10 Kashmore 58.37% 38.18% 3.45% 0.00% 11 Khairpur Mirs 68.76% 30.35% 0.84% 0.04% 12 Korangi Karachi 29.08% 65.58% 4.45% 0.89% 13 Larkana 80.71% 18.86% 0.43% 0.00% 14 Malir Karachi 38.39% 53.57% 7.74% 0.30% 15 Mirpur Khas 66.72% 31.18% 1.79% 0.31% 16 Matiyari 52.92% 44.57% 2.34% 0.17% 17 Noushero Feroz 53.08% 44.39% 2.29% 0.24% 18 Sanghar 52.07% 44.37% 3.44% 0.13% 19 SBA 46.95% 48.52% 4.54% 0.00% 20 Shikarpur 80.13% 19.37% 0.50% 0.00% 21 South Karachi 41.67% 52.08% 6.25% 0.00% 22 Sajawal 44.08% 51.22% 4.70% 0.00% 23 SUKKUR 69.10% 28.59% 2.19% 0.12% 24 Tando Allayar 57.23% 40.33% 2.24% 0.20% Tando Mohammad 58.66% 39.37% 1.77% 0.20% 25 Khan 26 Tharparkar 67.19% 31.13% 1.68% 0.00% 27 Thata 53.06% 42.73% 3.85% 0.35% 28 Umerkot 56.92% 41.55% 1.53% 0.00% 29 West Karachi 35.64% 59.41% 4.95% 0.00% 73

98 Table 36 District-based proportion of students at various language performance levels Class VIII Language of Class VIII (Proportions of Students) S. No District Low Performance (0%-33.99% score) Mediocre Performance (34%-59.99% score) High Performance (60%-79.99% score) Exceptional Performance (80%-100% score) 1 Badin 35.41% 61.09% 3.50% 0.00% 2 Central Karachi 25.24% 68.57% 5.71% 0.48% 3 Dadu 37.07% 57.53% 5.02% 0.39% 4 East Karachi 27.10% 70.09% 2.80% 0.00% 5 Ghotki 72.63% 25.70% 1.68% 0.00% 6 Hyderabad 43.06% 55.09% 1.85% 0.00% 7 Jacobabad 81.92% 18.08% 0.00% 0.00% 8 Jamshoro 23.40% 69.15% 6.38% 1.06% 9 Kamber Shahdadkot 31.90% 63.80% 3.68% 0.61% 10 Kashmore 67.42% 29.55% 3.03% 0.00% 11 Khairpur Mirs 75.21% 22.69% 2.10% 0.00% 12 Korangi Karachi 23.20% 67.01% 8.25% 1.55% 13 Larkana 71.43% 27.62% 0.95% 0.00% 14 Malir Karachi 36.00% 56.00% 8.00% 0.00% 15 Mirpur Khas 79.12% 17.67% 3.21% 0.00% 16 Matiyari 38.89% 59.26% 1.85% 0.00% 17 Noushero Feroz 39.50% 55.74% 3.92% 0.84% 18 Sanghar 44.48% 50.84% 4.68% 0.00% 19 SBA 34.45% 57.53% 7.36% 0.67% 20 Shikarpur 83.33% 16.67% 0.00% 0.00% 21 South Karachi 34.19% 64.52% 1.29% 0.00% 22 Sajawal 39.51% 53.09% 7.41% 0.00% 23 SUKKUR 49.37% 41.77% 7.59% 1.27% 24 Tando Allayar 38.21% 57.72% 4.07% 0.00% 25 Tando Mohammad Khan 48.60% 47.66% 3.74% 0.00% 26 Tharparkar 46.06% 48.79% 5.15% 0.00% 27 Thata 46.67% 50.00% 3.33% 0.00% 28 Umerkot 34.38% 62.50% 3.13% 0.00% 29 West Karachi 25.56% 66.67% 7.78% 0.00% 74

99 16.2 Districts performance level based proportions of students in math Table 44 shows an enormously high percentage of districts lie within low performance. Table 37 District-based proportion of students at various math performance levels Class V S No. District Low Performance (0%-33.99% score) Math of Class V (Proportions of Students) Mediocre Performance (34%-59.99% score) High Performance (60% % score) Exceptional Performance (80%-100% score) 1 Badin 76.57% 20.86% 2.47% 0.11% 2 Central Karachi 90.20% 9.48% 0.33% 0.00% 3 Dadu 83.17% 15.62% 1.21% 0.00% 4 East Karachi 95.95% 4.05% 0.00% 0.00% 5 Ghotki 77.03% 22.82% 0.15% 0.00% 6 Hyderabad 97.87% 1.98% 0.15% 0.00% 7 Jacobabad 82.95% 16.84% 0.21% 0.00% 8 Jamshoro 88.83% 10.92% 0.24% 0.00% 9 Kamber Shahdadkot 89.46% 10.00% 0.54% 0.00% 10 Kashmore 86.33% 12.81% 0.86% 0.00% 11 Khairpur Mirs 79.88% 17.50% 2.61% 0.00% 12 Korangi Karachi 90.80% 8.31% 0.89% 0.00% 13 Larkana 95.61% 4.29% 0.11% 0.00% 14 Malir Karachi 75.89% 23.51% 0.60% 0.00% 15 Mirpur Khas 77.16% 20.03% 2.57% 0.23% 16 Matiyari 83.31% 14.86% 1.84% 0.00% 17 Noushero Feroz 72.07% 25.75% 2.17% 0.00% 18 Sanghar 84.28% 14.83% 0.89% 0.00% 19 SBA 78.07% 19.84% 1.98% 0.12% 20 Shikarpur 90.94% 8.55% 0.50% 0.00% 21 South Karachi 86.67% 12.92% 0.42% 0.00% 22 Sajawal 74.72% 23.18% 2.11% 0.00% 23 SUKKUR 89.90% 9.00% 1.09% 0.00% 24 Tando Allayar 90.22% 9.16% 0.61% 0.00% 25 Tando Mohammad Khan 92.13% 7.48% 0.39% 0.00% 26 Tharparkar 68.65% 29.13% 2.06% 0.16% 27 Thata 83.19% 15.94% 0.88% 0.00% 28 Umerkot 70.88% 25.36% 3.36% 0.41% 29 West Karachi 88.12% 11.39% 0.50% 0.00% 75

100 Districts class V math low performance ranges from 72% to almost 98% students performing at this level with Hyderabad demonstrating a severe lowperformance of 97.87% of its students. Mediocre performances of districts range from 1.98% to 29.13%of students performing at this level. Table 38 District-based proportion of students at various math performance levels of Class VIII S. No District Low Performance (0%-33.99% score) Math of Class VIII (Proportions of Students) Mediocre Performance (34%-59.99% score) High Performance (60% % score) Exceptional Performance (80%-100% score) 1 Badin 91.05% 8.56% 0.39% 0.00% 2 Central Karachi 97.62% 2.38% 0.00% 0.00% 3 Dadu 95.75% 4.25% 0.00% 0.00% 4 East Karachi 98.13% 2.80% 0.00% 0.00% 5 Ghotki 77.09% 22.91% 0.00% 0.00% 6 Hyderabad 98.61% 1.39% 0.00% 0.00% 7 Jacobabad 83.62% 16.38% 0.00% 0.00% 8 Jamshoro 96.81% 2.13% 1.06% 0.00% 9 Kamber Shahdadkot 94.48% 4.91% 0.61% 0.00% 10 Kashmore 96.21% 3.79% 0.00% 0.00% 11 Khairpur Mirs 81.93% 15.55% 2.52% 0.00% 12 Korangi Karachi 97.42% 2.06% 0.52% 0.00% 13 Larkana 89.52% 10.00% 0.48% 0.00% 14 Malir Karachi 87.33% 11.33% 1.33% 0.00% 15 Mirpur Khas 94.38% 5.22% 0.40% 0.00% 16 Matiyari 82.41% 17.59% 0.00% 0.00% 17 Noushero Feroz 82.63% 14.57% 2.80% 0.00% 18 Sanghar 94.65% 5.35% 0.00% 0.00% 19 SBA 91.97% 7.69% 0.33% 0.00% 20 Shikarpur 84.00% 16.00% 0.00% 0.00% 21 South Karachi 96.77% 3.23% 0.00% 0.00% 22 Sajawal 91.36% 8.64% 0.00% 0.00% 23 SUKKUR 97.47% 2.53% 0.00% 0.00% 24 Tando Allayar 93.50% 6.50% 0.00% 0.00% 25 Tando Mohammad Khan 90.65% 9.35% 0.00% 0.00% 26 Tharparkar 78.79% 17.58% 3.64% 0.00% 27 Thata 94.17% 5.00% 0.83% 0.00% 28 Umerkot 91.88% 7.50% 0.63% 0.00% 29 West Karachi 95.56% 4.44% 0.00% 0.00% 76

101 The average score of districts at mediocre levelremain between 8% and 12% score range. High performances of districts are extremely rare with a peak value at only 3.36% of students in this category in Umerkot district. Exceptional performances fail to even reach the 1% mark with most districts lacking the percentage entirely, while Umerkot tops the list with 0.4% of its students in this category. See Table 45 for details. In class VIII math, most districts recorded a very high number of low performances generally higher than 90% of their students at this performance levelwith a few exceptions such as Ghotki and Tharparkar. Mediocre performances vary to great degrees ranging from a lowest value of 1.39% and highest at 22.91% for Ghotki, while most values remained below 10%. There are only 5 districts with over 1% of their students in high performances with Tharparkar at the top with 3.64% students whereas most districts lack high performances completely. No district tabulated any exceptional performances in class VIII math Districts performance level based proportions of students in science For science grade V, low performances level is very high in all districts as districts proportion of students at this level ranged from 75% to 97% of students. See Table 45 for details. Mediocre performances of districts is generally over 10% of students at this level with a few districts performing lower such as Larkana at 2.68% and Shikarpur at 6.54%. Sujawal proves to be the most mediocre of the bunch as 23.99% of its students performed at this level. No exceptional performances were recorded and high performances were recorded below 1% of students for all districts. In grade VIII science, low performance levelwas recorded high as around 80% of students performed at this level for most of the districts,while Hyderabad being highest with 98.15% of its students performing at low performance level. See Table 46 for details. Mediocre performances proportion of students ranged from 2.53% for Sukkur district to 25.7% for Ghotki district showing quite high deviation among districts. Only seven districts recorded any high performance percentage of students with just five districts crossing the mark of 1% of their students at this level as Khairpur Mir sdistrict topped with 1.26% of its students. No districts recorded any proportion of their students at exceptional performance level. 77

102 Table 39 District-based proportion of students at various science performance levels class V No District Low Performance (0%-33.99% score) of Class V (Proportions of Students) Mediocre Performance (34% % score) High Performance (60% % score) Exceptional Performance (80%-100% score) 1 Badin 84.88% 14.21% 0.91% 0.00% 2 Central Karachi 87.58% 12.09% 0.33% 0.00% 3 Dadu 90.02% 9.90% 0.08% 0.00% 4 East Karachi 90.54% 9.46% 0.00% 0.00% 5 Ghotki 82.94% 16.91% 0.15% 0.00% 6 Hyderabad 96.66% 3.34% 0.00% 0.00% 7 Jacobabad 87.47% 12.53% 0.00% 0.00% 8 Jamshoro 86.65% 13.11% 0.24% 0.00% 9 Kamber Shahdadkot 91.29% 8.71% 0.00% 0.00% 10 Kashmore 91.75% 8.25% 0.00% 0.00% 11 Khairpur Mirs 89.59% 9.57% 0.84% 0.00% 12 Korangi Karachi 85.76% 13.95% 0.30% 0.00% 13 Larkana 97.32% 2.68% 0.00% 0.00% 14 Malir Karachi 75.00% 24.11% 0.89% 0.00% 15 Mirpur Khas 80.05% 18.94% 0.86% 0.16% 16 Matiyari 86.48% 13.36% 0.17% 0.00% 17 Noushero Feroz 87.15% 12.48% 0.36% 0.00% 18 Sanghar 88.92% 10.76% 0.32% 0.00% 19 SBA 85.81% 14.08% 0.12% 0.00% 20 Shikarpur 93.46% 6.54% 0.00% 0.00% 21 South Karachi 85.83% 14.17% 0.00% 0.00% 22 Sajawal 75.53% 23.99% 0.49% 0.00% 23 SUKKUR 91.24% 8.64% 0.12% 0.00% 24 Tando Allayar 92.46% 7.54% 0.00% 0.00% 25 Tando Mohammad Khan 90.16% 9.84% 0.00% 0.00% 26 Tharparkar 77.04% 22.63% 0.32% 0.00% 27 Thata 85.81% 13.84% 0.35% 0.00% 28 Umerkot 83.81% 15.48% 0.71% 0.00% 29 West Karachi 88.12% 11.88% 0.00% 0.00% 78

103 Table 40 District-based proportion of students at various science performance levels Class VIII S No District Low Performance (0%-33.99% score) of Class VIII (Proportions of Students) Mediocre Performance (34%-59.99% score) High Performance (60% % score) Exceptional Performance (80%-100% score) 1 Badin 82.88% 17.12% 0.00% 0.00% 2 Central Karachi 91.90% 8.10% 0.00% 0.00% 3 Dadu 88.80% 11.20% 0.00% 0.00% 4 East Karachi 97.20% 2.80% 0.00% 0.00% 5 Ghotki 74.30% 25.70% 0.00% 0.00% 6 Hyderabad 98.15% 1.85% 0.00% 0.00% 7 Jacobabad 85.31% 14.69% 0.00% 0.00% 8 Jamshoro 90.43% 9.57% 0.00% 0.00% 9 Kamber Shahdadkot 85.89% 13.50% 0.61% 0.00% 10 Kashmore 93.18% 6.82% 0.00% 0.00% 11 Khairpur Mirs 88.03% 10.71% 1.26% 0.00% 12 Korangi Karachi 90.21% 9.79% 0.00% 0.00% 13 Larkana 89.05% 10.95% 0.00% 0.00% 14 Malir Karachi 86.67% 13.33% 0.00% 0.00% 15 Mirpur Khas 87.95% 10.84% 1.20% 0.00% 16 Matiyari 80.56% 18.52% 0.93% 0.00% 17 Noushero Feroz 86.55% 12.32% 1.12% 0.00% 18 Sanghar 91.64% 8.36% 0.00% 0.00% 19 SBA 89.30% 10.70% 0.00% 0.00% 20 Shikarpur 92.00% 8.00% 0.00% 0.00% 21 South Karachi 94.19% 5.81% 0.00% 0.00% 22 Sajawal 77.78% 20.99% 1.23% 0.00% 23 SUKKUR 97.47% 2.53% 0.00% 0.00% 24 Tando Allayar 83.74% 16.26% 0.00% 0.00% 25 Tando Mohammad Khan 88.79% 11.21% 0.00% 0.00% 26 Tharparkar 80.30% 18.48% 1.21% 0.00% 27 Thata 94.17% 5.83% 0.00% 0.00% 28 Umerkot 88.13% 11.88% 0.00% 0.00% 29 West Karachi 90.00% 10.00% 0.00% 0.00% 79

104 17.0 COMPARATIVE ANALYSIS OF SATI, SAT II, SAT III AND SAT IV RESULTS Comparison is provided between SAT I, SAT II, SAT III, and SAT IV results for class V and between SAT II, SAT III, and SAT IV results for class VIII as class VIII students were not assessed in SAT I. Differences are calculated on the basis how high or low (in terms of percent points) SAT IV scores were compared to SAT III scores. Hence, a positive difference means SAT IV score higher and a negative difference means SAT IV score lower Province level comparison between SAT III and SAT IV Comparative analysis of overall scores at province level indicates that SAT IV results of language are slightly lower and the results are higher in sciences and math for both classes; however, language score is slightly lower in class V and moderately lower in class VIII. In math, the scores are moderately high at both grades V and VIII and in science scores are considerably higher in both classes V and class VIII. It is hard to explain the differences because two populations of students assessed in SAT III and SAT IV are different and we have very limited information about background of students. Difference could be also because of standard errors in test scores of the two population groups. Overall these differences may not be considered significant in case of languages, mathematics, and science because scores are not significantly higher given the number of students in thousands who appeared in SAT III and SAT IV. Nonetheless, this requires further systematic investigation in the context of Sindh, Pakistan. Moreover, there are several significant differences (greater or less than 5) in district based analysis, which need further systematic investigation. 80

105 Table 41 Province level comparison between SAT III and SAT IV SAT- I SAT- II Class V Class VIII 1 SAT- III SAT- IV SAT-IV s difference to SAT III SAT- II SAT- III SAT- IV SAT-IV s difference to SAT III Language Average Math Average Average Overall Average [1]: As per Tors of SAT Phase I (2012), the test was conducted from students of grade V only, Therefore Comparative Analysis of grade VIII from SAT phase I (2012) is not Applicable 17.2 District based comparison between SAT I, SAT II, SAT III and IV language scores Table 49 below presents comparative analysis of SAT III and SAT IV language scores. The language results at class V are mixed as relatively more districts,14 out of 24, scored slightly lower in SAT IV language scores; however, most of the differences are not very far. The ten districts positive differences are ranging from 0.15 to 5.39 percent points, whereas 14 districts differences are negative ranging from 0.30 to 7.71percent points. Districts which gained significantly high (from 3% to 5.39%) include Hyderabad, Naushero Feroze, Sanghar and Karachi with 5.39% difference in scores. Most of the districts differences (18 out of 24) are negative in class VIII language indicating that districts performed relatively lower in SAT IV as negative differences ranged from to percent points. Except Hyderabad and Karachi all positive differences among the districts were below 2 percent points in class VIII Languages. As explained earlier, in order to explain what led to these differences, a systematic study or studies need to be done. 81

106 Table 42 District-based comparative analysis of SAT-I, SAT-II, SAT-III & SAT-IV Language results Class V Language Class VIII Language S No District SAT- I SAT- II SAT- III SAT- IV SAT-IV s difference to SAT III SAT- II SAT- III SAT- IV SAT-IV s difference to SAT III 1 Badin Dadu Ghotki Hyderabad Jacobabad Jamshoro Kambar- Shahdadkot Karachi Kashmore Khairpur Mirs Larkana Mirpur Khas Mitiari Naushero Feroz Sanghar Shaheed Benazirabad Shikarpur Sujawal 3 NA 2 NA NA Sukkur Tando Allah Yar Tando Mohd Khan Tharparkar Thatta Umerkot Note: 1. All districts of Karachi are combined, since it is considered as one administrative unit 2. NA means Not Available 3. In SAT Phase-I & Phase-II, Sujawal was part of Thatta district. In SAT Phase-III, Sujawal was made a separate district having Mirpur Bithoro, Jati, Kharo Chann, Sujawal & Shah Bunder Talukas. Therefore, the results of language,, and Math in SAT Phase-I and Phase-II in class V & VIII are not given

107 17.3 District based comparison between SAT I, SAT II, SAT III and SAT IV math scores District-based math comparative analysis between SAT phases shows that all districts gained slightly in SAT IV class V math scores. The positive differences in the twenty four districts ranged from 0.26 to percent points and most of these differences were above 3 percentpoints.this indicates significantly higher results in SAT IV class V math. It is hard to explain if these differences are significant enough and the reason for the differences since the population is different and background variables are not available for two population groups. The comparative analysis indicates that most districts (22 out 24 districts) showed an increase in SAT IV class VIII math scores as positive differences ranged from 0.47 to percent points. Shikarpur gained most with percent points increase in SAT IV among the twenty two districts, with significant gains in scores ranging from 3.44 to percent points. While Tharparkar made significant gains in SAT IV class V scores, interestingly it scored extremely low with 0.47 percent points in SAT IV class V scores. 83

108 Table 50District-based comparative analysis of SAT-I, SAT-II, SAT-III & SAT-IV Math results Class V Math Class VIII Math S No District SAT- I SAT- II SAT- III SAT- IV SAT-IV s difference to SAT III SAT- II SAT- III SAT- IV SAT-IV s difference to SAT III 1 Badin Dadu Ghotki Hyderabad Jacobabad Jamshoro Kambar- Shahdadkot Karachi Kashmore Khairpur Mirs Larkana Mirpur Khas Mitiari Naushero Feroz Sanghar Shaheed Benazirabad Shikarpur Sujawal 3 NA 2 NA NA Sukkur Tando Allah Yar Tando Mohd Khan Tharparkar Thatta Umerkot Note: 1. All districts of Karachi are combined, since it is considered as one administrative unit 2. NA means Not Available 3. In SAT Phase-I & Phase-II, Sujawal was part of Thatta district. In SAT Phase-III, Sujawal was made a separate district having Mirpur Bithoro, Jati, Kharo Chann, Sujawal & Shah Bunder Talukas. Therefore, the results of language,, and Math in SAT Phase-I and Phase-II in class V & VIII are not given

109 17.4 District based comparison between SAT I, SAT II, SAT III and SAT IV science scores Comparison of district based class V science results shows all twenty four districts performed significantly higher and their positive differences ranged from 3.72 to Interestingly the districts that scored higher in SAT I, II and III also scored higher in class V in SAT IV, while Jacobabad jumped up by scoring the highest with point percent in SAT IV. See Table 51 for details. Class VIII science results comparison between SAT III and SAT IV shows that all the districts have performed higher in SAT IV with differences ranging from 0.64 to Among these,mirpurkhas district scored lowest in SAT IV grade V with a score of Also most of the districts showed significant gains in SAT IV as compared with SAT I, II and III. As stated earlier it is extremely difficult to explain the reason for the differences in scores due to population group differences and unavailability of background information on students, teachers, schools, and leadership related factors. This may be due to the nature of test, some standard error, the time when SAT IV was conducted and many other factors that require a systematic investigation. 85

110 Table 43 District-based comparative analysis of SAT-I, SAT-II, SAT-III & SAT-IV results Class V Class VIII S No District SAT- I SAT- II SAT- III SAT- IV SAT-IV s difference to SAT III SAT- II SAT- III SAT- IV SAT-IV s difference to SAT III 1 Badin Dadu Ghotki Hyderabad Jacobabad Jamshoro Kambar- Shahdadkot Karachi Kashmore Khairpur Mirs Larkana Mirpur Khas Mitiari Naushero Feroz Sanghar Shaheed Benazirabad Shikarpur Sujawal 3 NA 2 NA NA Sukkur Tando Allah Yar Tando Mohd Khan Tharparkar Thatta Umerkot Note: 1. All districts of Karachi are combined, since it is considered as one administrative unit 2. NA means Not Available 3. In SAT Phase-I & Phase-II, Sujawal was part of Thatta district. In SAT Phase-III, Sujawal was made a separate district having Mirpur Bithoro, Jati, Kharo Chann, Sujawal & Shah Bunder Talukas. Therefore, the results of language,, and Math in SAT Phase-I and Phase-II in class V & VIII are not given

111 The gains and losses or no gains and no losses in scores in SAT IV, as explained in the analysis so far, can be based on a range of factors which are hard to explain just based on analysis of results and comparisons. Hypotheses can be offered based on general observations and informed assumptions; however, degree of confidence may not be as strong as it could be established based on findings of systematic research. Research work based on SAT results should be encouraged and sponsored to answer questions like who are (and to what extent) responsible for students achievement scores, and what makes students and schools perform higher or lower Recommendations Based on descriptive analysis of students test scores, recommendations are framed for improvement in key educational areas at primary and middle schooling levels in Sindh. SAT IV results are helpful in putting forward recommendations for capacity building of existing teachers, enhancing quality of teacher preparation programs, and improvement in schooling conditions, quality improvement of curriculum and teaching resource materials, and further research to understand trends in results to inform future policy and program reforms. However, it is important to note that recommendations are limited to only knowledge based on descriptive analysis of results in relation to general observations about schooling practices in Sindh. Several correlation based analysis and further research should be conducted in the specific key areas discussed here to understand the issues systematically and to generate more empirical evidence to inform the future reforms in K-8 education in the province Capacity Building of Teachers Traditionally,periodical in-service trainings for teachers are used as an strategy to enhance teachers capacity; however, it is a growing strong understanding among community of teacher educators that use of variety of strategies on an on-going basis is more effective to keep teachers knowledge and skills up to mark. Therefore, as a general recommendation, many other strategies along with in-service training should be applied, such as provision of updated teacher learning reading resource materials, provision of alternative textbooks and pedagogical content knowledge based books, establishing structures to develop peer-coaching and mentoring relationships among teachers, exposure visits to other school systems in other provinces and parts of country, provision and use of online web-based resources, encouraging teachers to do 87

112 small level studies and publish in teacher district-based newsletters and so on. Some specific recommendations include: a) Creating Continuous Professional Interaction among Teachers of Different Schools, UCs, Talukas, and Districts Performing at Various Levels:Data dispersion and distribution of school mean scores show that there were many schools which performed high and even few of them at exceptional level. List of relatively better performing schools specifically high performing schools in each district should be generated. Teachers from lower performing schools should be engaged in interaction with teachers in high performing schools. District-based or taluka-based sessions should be arranged where teachers from high-performing schools can share their practices of teaching and learning in their schools with other teachers. These interactions should be done on regular basis to provide opportunities to the teachers to think and reflect upon their teaching practices and learn from their peers. b) Creating Balance of Focus between "Reading" and "Writing" Skills and Training Teachers to Develop Students Genuine Writing Skills Instead of Teaching Writing as Notedictating: based analysis of results shows that overall students performed higher in reading comprehension and severely lower in writing. This is clear indication that there is overemphasis on reading and no or little emphasis on writing. There is need to create a balance in curriculum, textbooks, and teaching and learning of the two skills. Apart from this, it is generally observed that teachers use note-dictating method to teach writing.more specifically, teachers dictate students to copy a written paragraph, essay, letter, or story in their fair copy and reproduce it in a teacher-made test or exam. In this method, students are not engaged in actual writing in which they think ideas, create outline,develop structure and organize their sentences and parts on their own. Note-dictating is traditional long-holding practice of teachers in Pakistani school systems.to change teachers this practice, rigorous trainings should be arranged for all teachers teaching language on how to engage students in developing their writing skills by using progressive student-centered methods. 88

113 c) Changing Math Instructions to Focus on Developing Children's "Conceptual Understanding" and "Problem Solving" Skills Instead of Just Remembering the Rules and Procedures: Students overall performance is very low in Maths. It has been observed frequently that teachers lack in deeper content knowledge as well as appropriate pedagogical content knowledge in Maths to teach this subject effectively. Most of the time, focus in teaching of math is engaging students to remember rules and procedures whereas conceptual understanding and problem solving is neither taught nor learnt by teachers themselves. Teachers teaching math at class V and class VIII should be provided specific trainings on conceptual understanding of math content and problem solving skills and how to develop both of these math abilities in their students. Moreover, trainings should be given on pedagogies of teaching math as fun and in interesting ways. It is a common observation that students dislike teachers traditional methods of lecturing and note-dictating and teachers focus on remembering by practicing procedures. Teachers should be provided trainings on effective ways of teaching math and should be provided reading materials on effective pedagogies of math at primary and middle school level. d) Sharing Effective Resources on Teaching and Learning of Geometry with Schools and Training Teachers to Enhance Their Ability to teach this Least-focused Effectively: Moreover, it seems that Geometry is the most neglected area in teaching and learning of math as students scores turned out to be severely low in both grades. Specific trainings should be conducted on content knowledge and pedagogical content knowledge for teaching geometry. Also several kinds of reading resources should be shared with teachers. UCbased and/or taluka-based interaction (workshops, reflective meetings, demonstration of effective lessons followed by critical and reflective discussions) among math teachers focused on teaching and learning geometry also will help in enhancing teachers capacity to teach geometry effectively. 89

114 e) Developing Teachers Conceptual Knowledge and Inquiry Skills by Engaging them in Effective Training and by Sharing Effective Reading as well as Teaching andlearning Materials: Students performance was found lowest in science and almost in all content strands; specifically quite low in physical science. It isgenerally observed thatmost of the teachers engage students in rote learning of science materials instead of developing their conceptual understanding and inquiry and problem solving skills. Teachers should be shared effective reading materials on teaching and learning science focusing on conceptual understanding and inquiry skills and attitude. There are many effective resources available online; teachers should be engaged in learning from and utilizing those resources. f) Training Teachers to Develop Teacher-Made and Standardized Tests and to Analyze Test-based Data to Enhance Students' Learning as well as to Improve Teachers' Own Teaching: Apart from developing teachers professional capacityin teaching subject areas, teachers test development skills should be enhanced through engaging them in sessions focused on development of teacher-made tests as well as standardized tests. Further, teachers ability to analyze student scores and to use the scores for improving students learning and improving their own teaching should be enhanced. Training sessions, peer coaching and mentoring could be effective strategies to develop teachers capacity in testing and assessment areas Enhancing Quality of In-service Teacher Education and Teacher Preparation Traditionally in-service teacher education and teacher preparation programs have been theoretical in nature and alienated from ground realities of the schools. Moreover, materials and resources have been outdated because of lack of local initiatives to enhance teacher education in the province. However, recent initiatives of four-year B. Ed Honors program for elementary and secondary teachers are good initiatives to prepare effective teachers. These programs should be strengthened bymaking appropriate provincial educational policies, provision of funding for program participants, and aligning teacher recruitment policies to support quality teacher preparation. Generally, higher secondary graduates, especially high performing students, prepare for getting admissions either in medical colleges or engineering schools. B. Ed. 4-year Program 90

115 is an effective initiative to attract high-performing students towards teaching profession. However, policies should be made to make schools a conducive work place and reputable grades and compensations should be given to the graduates with B. Ed. 4-year qualifications Research Research is hallmark of progressive societiesas empirical evidence is used to inform policies and programs. Unfortunately, research culture has not taken strong roots in Pakistan especiallybecause of lack of support in public policies and shortage of funding for research in public institutions. Different phases of SAT project have created wealth of data which could be utilized to conduct different studies. Moreover, many patterns in results and students achievement at district, region, and province level invite research to answer questions arising from analysis of trends and patterns. Some of the areas for research are identified as follows: Researching What Makes Some Schools Perform Higher than Other Schools: Schools performing at high level and exceptional level of performance as explained in the section three and in data dispersion and distribution graphs invite for research to understand what makes these schools perform to the level significantly higher than overwhelming number of schools which perform low. Findings will help in figuring out strategies and mechanisms which can help to improve low-performing schools. Studying Very High Performing and Very Low Performing Students: Significantly high-performing and low-performing students also need to be studied to understand what helps high-performing students and what hinders learning of low-performing students. Developing Case Studies of Highly Effective Teachers to InformTeacher Education, Teachers' Professional Development, and Teacher Recruitment: Case studies of teachers whose students perform very high or significantly higher than other students will help in understanding what characteristics should be desired in an effective teacher. Based on findings, in-service teacher education programs and preparation program will be able to define features of 91

116 their program to prepareeffective teachers. Appropriate teacher recruitment criteria also can be developed to identify and to appoint teacher candidates having desired characteristics. Studying How Weights are given to Reading, Writing, Math, and s in taught Curriculum to inform and to develop a Balance in Teaching of Different s. Studies should be done on understanding of weightage given to different subjects in implemented or enacted curriculum by teachers. Assumption is that some subject content strands, such as reading, are given too much weight on the cost of important subjects such as math and science and writing skills. Findings may help in creating an appropriate balance in teaching of different subjects and skills. Public-initiated Programs and Allocating Public Funding for Further Research and Utilization of SAT Data/Findings: Generally funding is allocated by competent organizations and authorities to utilize data generated by projects like SAT. Along with funding allocations, consultants should be hired to identify specific areas for research utilizing SAT data. Competent organizations/individual researchers should be supported with appropriate funding to further explore SAT data as well as design and conduct studies based on SAT results.findings of such studies may inform well in answering many long-standing questions about improving quality of education in the province. 92

117 19.0 References CaliforniaDepartmentofEducation.(2012).StandardizedTestingandReporting.Retrieved April 02,2015,fromhttp://star.cde.ca.gov/ Hair, J. F. Black, WC, Babin, BJ, & Anderson, RE (2010).Multivariate data analysis, 7. OECD:ProgrammeforInternationalStudentAssessment.RetrievedApril 02,2015,from Report.(2010).SecondaryAnalysisofExaminationResults2010:Performanceof5 th and8 th GradestudentsinPunjab,Pakistan.Lahore:PunjabExaminationCommission. TIMSS & PIRLS International Study Center, Boston College. Retrieved on April 02, 2015 from McAlpine, M. (2002). A Summary of Methods of Item Analysis. Published by Computer Assisted Assessment (CAA) Center, UK. Anderson, P. and Morgan, G. (2008). Developing Tests and Questionnaires for a National Assessment of Educational Achievement. The World Bank: Washington DC

118 Appendix A (SAT Phase IV ( ) Actual Test Specification Actual Test Specification For Language Grade V&VIII (SAT IV) Learning Level/Ability Reading for Literary Experience Reading for Information % Competencies MCQs % Competencies MCQ Knowledge 17.5 Understanding 22.5 Application (Beyond understanding) 10 Competency 1 (Reading and Thinking skills) of National Curriculum 2006 Standard 1 & Standard 2 [4 items of 1 marks each] [5 items of 1 mark each] [1 item of 2 marks each] Competency 1 (Reading and Thinking skills) of National Curriculum 2006 Standard 1 & Standard 2 [4 items of 1 mark each] [5 items of 1 mark each] [1 item of 2 marks each] Total Marks Total Items Actual Test Specification For Language Writing Grade V&VIII (SAT IV) Learning Level Writing % Competencies ERQ Narrative/Creative Writing 50 I ERQ of 10 marks Descriptive Writing / Writing for Specific Purpose Competency2 (Writing skills) of 50 National Curriculum 2006 Standard 1 1 ERQ of 10 marks 2 ERQs Total Marks 20 marks 94

119 Actual Test Specification and Distribution of Items For Test Grade V&VIII (SAT IV) Area Weightage Knowledge 40% Understanding 40% Application (Beyond Understanding) 20% Life s Biology 35% 15% 10% 10% Physical Physics 35% 10% 15% 10% Chemistry 20% 7.50% 12.50% Earth and Space Earth and Space 10% 7.50% 2.50% Distribution of Questions in the Actual Test Paper MCQs (Knowledge Based) MCQs (Understanding Based) CRQs (Understanding Based) CRQs (Application Based) Total Number of Questions Marks Biology Physical Earth and Space

120 Actual Test Specification and Distribution of Items for Mathematics Grade V (SAT IV) Mathematics Standards No. of SLOs % Weightag e Mark Weightage MCQ CRQs Numbers and Operations % % 12 2 K % U % A % Algebra % % 2 K % U % A % 1.82 Measurements and Geometry % % 8 2 K % U % A % Information Handling % % 2 K % U % A % 0.45 Total % 40 96

121 Appendix B (ToRs of Taluka/Town Coordinator) He / She will be responsible to, Conduct survey workshops with ADOE/TEO (M/F) & Supervisors Primary Education for preparing Centre schools and feeding primary schools linkages in each UC of respective taluka/town Collect any other relevant information Select a team of invigilators as prescribed by SAT Office Prepare test administration field plan in coordination with SAT team Collect stationery for TC office use, students stationery and attendance sheets from respective TCS office Collect test booklets from respective TCS office on the evening/morning of each test day Distribute stationery, test booklets and student s attendance sheets at every test Centre before 10 am Start the test at all test Centers of the taluka/town simultaneously at 10 am on every test day Collect Head Teacher s Background Questionnaire, Teacher s Background Questionnaire (TBQ) and Parent s Socio Economic Status and Background Questionnaires from respective TCS office after the administration of SAT III ( ) Actual Test Get-filled the above mentioned research tools from sample schools, as advised by SAT office Monitor the test administration process at test Centres Collect filled and unfilled test booklets and student s attendance sheets from Centre schools, as soon as test completes Dispatch the filled and unfilled test booklets and student s attendance sheets to SAT office Sukkur IBA through TCS (Dispatch address for SAT Office Sukkur IBA is mentioned in TC presentation {provided in the personal folders on Training Day}. Do not make any payment for dispatching at TCS office, just instruct TCS representative at the respective TCS office to dispatch the material through SAT office Sukkur IBA account). Perform all other tasks as mentioned in TC presentation (hard copy is provided in the personal folders on Training Day) Perform any other task assigned by SAT Office 97

122 Appendix C (Taluka/Town Coordinator Undertaking) Undertaking It is stated that I, Taluka/Town Coordinator at Taluka/Town of District in SAT Project Sukkur IBA take legal obligation for underlying terms and conditions, 1. I will not select any Government school teacher or any other person who has any association with Education & Literacy Department Government of Sindh or any other department of Government of Sindh as Invigilator in SAT IV ( ) Actual Test administration under SAT Project Sukkur IBA in my Taluka/Town. 2. I shall prefer to hire the Invigilators with minimum qualification of graduation and SAT or field work experience previously. In case of shortage of the people with required qualification and experience, I may hire with some relaxation in the criteria. 3. I will collect test booklets one day before the test and will secure these booklets at most safest place and ensure the complete confidentiality, secrecy and sensitivity of the test booklets. 4. I will ensure that the sealed test booklets boxes will be opened at test centres before the presence of Head Teacher/In charge teacher and head invigilator will take signature from the Head Teacher/In charge teacher to ensure that test centre booklet boxes are opened before him/her. Furthermore, the seal of test booklet boxes of each class/block will be opened in the block before the students. 5. I will rent a car/van on every test day for the following tasks, a. receiving of test booklets from TCS office b. dispatching of test booklets to every test centre before starting the test c. collecting filled, unfilled test booklets and student s attendance sheets from test centres d. dispatching the filled test booklets, unfilled booklets and attendance sheets to SAT office Sukkur IBA through TCS. (Filled and unfilled test booklets are to be packed in separate boxes and must be clearly written above the box "Filled Booklets" or "Unfilled Booklets". Sending filled booklets mixed with unfilled booklets will result in deduction of the payment from Taluka 98

123 Coordinator's salary as it incurs the cost to deploy extra labor force to search out the filled booklets from unfilled boxes.) e. for any other relevant task 6. I ensure that I will perform all duties as prescribed in the Office Order reliably and transparently 7. I will be present in the field during SAT-IV actual test ( ) administration and will be available for SAT work full time. I agree that SAT Office Sukkur IBA reserves the right to deduct my payment for the days I am not present for the work of SAT Office Sukkur IBA for any reason. (i.e. number of days missing multiply by per day payment shall be deducted. Per day payment shall be determined by dividing Rs.XXX by number of days of actual test in the taluka/town) 8. I shall not hire any of my immediate family members as Invigilator. I agree that SAT Office Sukkur IBA reserves the right to cancel all the payments of those invigilators who are from my immediate family. (I.e. Brother, sister, parent, daughter/son, spouse) Full Name of Taluka/Town Coordinator Signature CNIC Witness 1 Witness 2 Name Name CNIC CNIC Signature Signature 99

124 Appendix D(Manual for Taluka/Town Coordinators and Invigilators) Standardized Achievement test is any test, which is given to large student population under standard conditions and with standardized procedures. Students respond to identical or quite similar questions with similar test conditions, directions and time. Standardized testing is very popular throughout the globe. In California, Standardized Testing And Reporting (STAR) has been established by Department of Education whose sole task is to help schools improve academic excellence of their students, Standardized tests are also taken in many countries together. Program for International Student Achievement (PISA) Launched in 1997 by the Organization for Economic Cooperation and Development, is an international study which aims to evaluate education systems worldwide, by testing the skills and knowledge of 15-year-old students. To-date, students representing more than 70 countries and economies have participated in the assessment, In 2012, Reform Support Unit-Education and Literacy Department, Government of Sindh announced SAT project for the Province of Sindh to evaluate performance of students, studying in public sector schools in grade V and VIII in the subjects of Languages, Math and. Sukkur IBA applied to get this project and after a competitive bidding process the project was won by Sukkur IBA. The aim of the project is to serve following main purposes: 1. Knowing students achievement 2. Linking educational reforms to output/outcome rather than input 3. The results are also aimed to review the curriculum of teacher training colleges and teacher recruitment policies. 4. Informing parents, education administration, civil society and government about the status of education in the province Sukkur IBA has successfully completed the first and second phases of the project in 2012 and respectively. The implementation of third phase of the project is started after the formal signing of the contract extension between RSU and Sukkur IBA on September 26,

125 Orientation to Taluka/Town Coordinator s about SAT Project Phase IV ( ) SAT-IV ( ) Deliverables Pilot Test Construction of Pilot Test Administration of Pilot Test Statistical Analysis of Pilot Test Results Actual Test Construction of Actual Test on the basis of statistical analysis of Pilot Test Administration of Actual Test E-Assessment of Actual Test Result announcement of Actual Test Karachi) Development of 1500 Application Level Items of Languages, Math and (Class IV-VIII) Student's Report Cards (SRCs) Printing & Distribution SAT website maintenance, Pilot Test Pilot Test was conducted from six districts of Sindh, including Karachi, Hyderabad, MirpurKhas, NausheroFeroze, Jacobabad & Sukkur Test was administered in 40 schools from Dec 17, 2014 to December 19, 2014 A total number of 1866 students appeared in the Pilot Test out of 2000 sampled students The students appearance ratio on test day remained 93% SAT IV ( ) Actual Test Administration Test will be taken from class V and VIII students, studying in all Government schools of Sindh Class V students of Sindh Education Foundation (SEF) schools will also appear in the test from 10 districts of Sindh including, Badin, Dadu, Khairpur, Larkana, QambarShahdadkot, Sanghar, ShaheedBenazirabad, Tharparkar, Thatta and Umerkot 101

126 Students of class V will travel to Centresecondary schools and appear in the test Secondary schools will be treated as test centers and some of the Primary schools will also serve as test centers in those UCs, where there is no secondary school or secondary school is located on a distance of more than 1.5 or 2 Kilometers The test will be taken from the subjects of Languages (Sindhi/Urdu/English), Math and Two versions (A and B) of SAT IV ( ) booklets are prepared to conduct the test These booklets contain, Multiple Choice Questions (MCQs), Fill in the Blanks (FIBs) and Constructed Response Questions(CRQs) of all three subjects (Language, Math and ) Student s have to fill one circle option out of four in response to each MCQ Student s will write the missing word in the blank space of each FIB Student s will write/construct their response in the given space against each CRQ These test booklets have dedicated codes such as, (for class V) 0511: class five, English medium, Booklet A 0512: class five, English medium Booklet B 0521: class five, Urdu medium, Booklet A 0522: class five, Urdu medium, Booklet B 0531: class five, Sindhi medium, Booklet A 0532: class five, Sindhi medium, Booklet B These test booklets have dedicated codes such as, (for class VIII) 0811: class eight, English medium, Booklet A 0812: class eight, English medium, Booklet B 0821: class eight, Urdu medium, Booklet A 0822: class eight, Urdu medium, Booklet B 0831: class eight, Sindhi medium, Booklet A 0832: class eight, Sindhi medium, Booklet B 102

127 Taluka/Town Coordinator Responsibilities/ToRs Preparation of Centre-Feeding Schools Linkages in coordination with SAT project officers Coordinate with SAT Project Officers, ADOEs/TEOs (M/F) Prepare field plans in coordination with SAT Project Officer Identify UC-wise and taluka/town-wise team of invigilators (Ideally fresh graduates and not anyone from Education & Literacy Department: Government of Sindh or from any other government department) Select UC-wise and taluka/town-wise team of invigilators in coordination with SAT Project Officer Provide training to invigilators in coordination with SAT Project Officer Collect Student s Attendance Sheets from the given address to SAT office (local TCS office or personal) one day before the start of the test Collect test booklets from the given address to SAT office (local TCS office or personal) one day before each test day between 3-7 pm Every test day distribute the test booklets and Student s Attendance Sheets at every test Centre before 10 am Start the test at every Centre at 10 am daily Use separate Attendance Sheet for every school (Secondary and Primary) Every test day collect the filled and unfilled test booklets, Tail Sheet and Student s Attendance Sheet from Centre schools, as soon as test completes. TCS will provide one Tail Sheet in every box of test booklets Tail sheet must be filled by invigilator during test Student Attendance sheet must also be filled by invigilator and must be signed by Center Head teacher/fa/incharge Teacher Instruct your each and every Invigilator to write FILLED COPIES over the boxes of filled test booklets and write UNFILLED COPIES over the boxes of unfilled test booklets with Green or Red marker pen. 103

128 Every test day, dispatch the filled test booklets (with filled Tail Sheet and Student s Attendance Sheet) and unfilled test booklets to SAT office Sukkur IBA through TCS on following address. Mr. Hamid Ali Sheikh Team Lead Administration SAT Department of Training & Development: Sukkur IBA, Airport Road, Sukkur hamid@iba-suk.edu.pk Off No Ext 218 Cell No Do not make any payment for dispatching at TCS office Monitor the test administration process Travel to the homes of identified student s parents and get filled the Parents Socio Economic Status and Background Information Questionnaire by asking questions of this form from the parents (TENTATIVE) Get filled the TBQs and Parents Socio Economic Status and Background Information Questionnaire, as per the guidelines of SAT office and return the same back to Sukkur IBA on following Address, Mr Farhan Mehboob Senior Project Officer SAT SAT Office, Department of Training & Development: Sukkur IBA, Airport Road, Sukkur Off No Ext 218 Cell # Coordinate with Regional Directors Education (RDEs), District Education Officers (DEOs) and Assistant District Officers Education (ADOEs) or Taluka Education Officers (TEOs) Male & Female and other relevant Government Education Department stakeholders of Talukas/Towns and Districts Coordinate and facilitate District-based Local Support Unit (LSU) Staff of RSU Submit Student Appearance Report on daily basis to SAT Responsible Project Officer of respective taluka/town through or Mobile Phone till 4PM 104

129 Coordinate and facilitate Sukkur IBA, Local Support Unit (LSU) of Reform Support Unit (RSU), District level educational officers, Provincial Educational Assessment Centre (PEACE) Staff and RSU Monitoring Teams during their monitoring visits to test Centres Ensure the quality of test administration Put your Taluka/Town Coordinator Card at the time of entering in school premises Coordinate with head teacher, teachers and other staff members of the school in a humble and professional way As per the policy of Sukkur IBA there is zero tolerance for cheating during the test or using any other unfair means If any case of cheating, or any other use of unfair means will be founded at any test Centre of your respective taluka/town, then the test of that day will be cancelled and re-test will be arranged at that certain test Centre. You and your invigilator/s will also be penalized as per the policy of Sukkur IBA. Your taluka s/town s invigilators payment is linked to professionally acting upon the all given instructions in SAT III ( ) Actual Test Invigilator Manual and specifically appropriate completion of the following, o Face Sheet o Tail Sheet o Attendance Sheet (with Stamp and Signature of Center Head teacher/f.a/in-charge Teacher) Ensure to take each and everything from test Centre, which you or your invigilator/s have brought there and nothing should be left behind at any test Centre Take 200 extra test booklets (100 of Class V and 100 of Class VIII) with yourself on every test day on daily basis Provide required copies of test booklets from these extra test booklets at all those test Centre where-ever required It is mandatory that test should be completed within 10 working days in your respective taluka/town. So, prepare the test field plans accordingly. 105

130 Invigilators Manual Instruction for SAT Phase IV ( ) Actual Test Administration 106

131 107

132 Introduction Standardized Achievement test is any test, which is given to large student population under standard conditions and with standardized procedures. Students respond to identical or quite similar questions with similar test conditions, directions and time. Standardized testing is very popular throughout the globe. In California, Standardized Testing And Reporting (STAR) has been established by Department of Education whose sole task is to help schools improve academic excellence of their students, Standardized tests are also taken in many countries together. Program For International Student Achievement (PISA) Launched in 1997 by the Organization for Economic Cooperation and Development, is an international study which aims to evaluate education systems worldwide, by testing the skills and knowledge of 15-year-old students. To-date, students representing more than 70 countries and economies have participated in the assessment, In 2012, Reform Support Unit-Education and Literacy Department, Government of Sindh announced SAT project for the Province of Sindh to evaluate performance of students, studying in public sector schools in grade VandVIII in the subjects of Languages, Math and. Sukkur IBA applied for this project and after a competitive bidding process the project was won by Sukkur IBA. The aims of the project are: a. To link our mostly input driven reform agenda to output/outcomes. b. To use the process and results of SAT to change teachers practices, for instance helping them to graduate from rote learning to active learning method that help to inculcate problem solving, critical thinking, communication, inquiry, and analytical skills in pupils. The results of the tests may also be used to review the curriculum/syllabus/textbooks of schools/teacher training colleges and teacher recruitment policies of various cadres and group of services. c. To inform parents, education administration, civil society and government of the outcomes/gaps in the systems and to gradually shift to result based accountability system. 108

133 d. To inform policy makers, development partners, planners and implementers of the current needs/gaps and to gradually move to evidence based policy making, planning and implementation. e. To acknowledge achievers and help and support under achievers through planned inputs. f. To identify good districts and background/ practices in order to learn and multiple the good practices to other districts. Sukkur IBA has successfully completed the three phases of SAT and now the 4 th phase has been awarded to Sukkur, IBA in December Invigilator s Instruction for SAT Phase IV ( ) Actual Test Administration On Test day Pre-arrangements on test day Carefully read the invigilator s manual one night before the test administration as it will refresh the tasks you need to perform on test day. Put on clean and nice clothes, and keep proper dressing attire. Take invigilator file along with details of test Centre and its address. All invigilators must reach test center as instructed by Taluka Coordinator before 9.00 am Sukkur IBA. Before entering the school premises, put on your invigilator card given to you by Arrival at the School Meet with Head Teacher or In-charge Head Teacher/First Assistant (FA) of the school and introduce him/her about SAT exam and its objectives. Share with him/her the purpose of your visit and give him the RSU/Secretary Education & Literacy Department: Government of Sindh letter, and request him/her that No 109

134 any Teacher except the Head teacher is allowed in the block, Sukkur IBA is properly trained and will conduct the test themselves. Ask for the attendance register of class V and class VIII from the head teacher. Check by comparing with the Actual Test enrollment of class V and VIII mentioned in your field plans. The test booklets of class V and VIII have been given to you as per the Actual Test enrollment provided to you by SAT office So, if the number of students of class V and VIII is as per the Actual Test enrollment or less than the mentioned enrollment, then you will take the test from all students. But, if the number of students in class V and VIII or anyone of these classes is more than the mentioned Actual Test enrollment in the field plan, then you will provide them extra test booklets (which have been given to you by TC) Manage class-wise separate test blocks for V&VIII classes Before Starting the Test Write following information on the black/white board of the test block Name of the School School s SEMIS ID Taluka District Medium No of students appearing in the test (class-wise) Test Start time Start time of Practice Test and End time. Start time of Sindhi Section and End time. Start time of Math Section and End time. Start time of Section and End time. 110

135 Motivate the students, by telling them that if they perform at their best, it will raise rank of Sindh in Pakistan and the World. The name of schools will be highlighted in Newspapers and Media. Also, students and their teachers may be given an award by Govt of Sindh. Distribute the stationery packets (pencil, sharpener, eraser) Make sure that every student has a pencil, sharpener and eraser. Open the sealed boxes, containing test booklets. Information about the school name, district, taluka and UC name, SEMIS ID #, class, medium, no of test booklets in boxes is written on the LABEL pasted on each box. The booklets are packed in sealed Poly bags and kept in boxes (class-wise and version-wise (A-B) as per enrolment). Open the boxes and poly bags in the test block. Distribute the booklets version-wise as, A, to student 1, B to student 2, then A to student 3 and B to student 4 and so on. Read aloud the instructions written on the front page of the test booklet to the students sitting in your test block Ask students if instructions are clear. Instruct the students to ask you, in case of confusion and not to talk to a class-fellow or student sitting next or behind. Help Students in properly filling up the MCQs and attempting the CRQs, monitor their response making throughout the test. Starting the Test Ensure that students correctly fill in the face sheet of the test booklet Check the following on the answer sheet of every student and if there is any mistake, correct it accordingly before starting the test, Booklet ID (to be written by the Invigilator) Student s Name Father s Name Father s Contact Number School Name (Invigilator should write this on the board) School SEMIS ID (Invigilator should write this on the board) Class (Invigilator should write this on the board) 111

136 Medium (Invigilator should write this on the board) Head Teacher Name Teacher Name (Who taught Language, Math and to him/her in Class V and VIII with CNIC number) District Name (Invigilator should write this on the board) Gender Age The Actual Test is of three hours duration.the distribution of the time is as under, Filling-up of Face sheet 10min Practice Test 10min Invigilator s Review Time 10min Language 50min Math 45min 45min Break after the language and Math Sections 10min Total Time 180min (3 hours) You will announce the starting and finishing time for each section of the test in your test block. Ensure that every student should be on that specific section in the allotted time. Also make sure that students get 10 minute break after Language and Math tests; however they must be sitting on their seats. Do not sit on the chair during the invigilation time The test booklet for students contains four sections; a practice test from three subjects (Language, Math and ) and three subject sections in following order, Language Math Each section of the paper has Multiple Choice Questions (MCQs) and Constructed Response Questions (CRQs) or Extended Response Questions (ERQs) MCQs You should write on the board that how to fill the circle of an MCQ 112

137 Each MCQ has four options; A, B, C and D. Ensure that the students select one option as the best answer and fill the circle of the selected option with a black pencil/pen in a correct way as shown below:. CRQs/ERQs Ensure that the students write the answer to each Constructed Response Question in the space given below it Students can use black pencil or black pen to write the responses. Students should not use glue or pin on the test booklet Take Attendance of all students who appeared in the test. Also put your Invigilator s ID & signature, get signature and stamp of the Head Teacher on the student attendance sheet. Finishing the Test Before collecting booklets from students make sure that the students have properly filled the face sheet. Ensure, all aspects of required information have been checked and the student had left nothing unchecked or empty. Ensure the count of test booklets according to the attendance of the students. Ensure that bar coded material is not torn or folded as that makes scanning difficult. Put your name, ID no and signature on every test booklet of the students. 113

138 Collect the test booklets pack them in extra available Poly bags(version-wise), keep them in small boxes, seal them, put the sealed small boxes in large boxes and seal them The unfilled booklets (if any) should be packed in boxes. Attendance Sheets should be packed in the envelope/s. Take all unfilled booklets boxes, Attendance Sheets, Stationary packets or any other material from the school. No material should be left at the school Write FILLED COPIES over the boxes of filled test booklets and write UNFILLED COPIES over the boxes of unfilled test booklets with green or red marker. Some other Important Points Put your Invigilator Card at the time of entering in school premises Coordinate with head teacher, teachers and other staff members of the school in a humble and professional way Cooperate fully with SAT office Sukkur IBA Monitoring teams, who will be visiting your test centers during the test As per the policy of Sukkur IBA there is zero tolerance for cheating during the test or using any other unfair means If any case of cheating, or any other use of unfair means will be founded at your test centre then the test of that day will be cancelled and re-test will be arranged at that certain test centre. You will also be penalized as per the policy of Sukkur IBA. Note that your invigilation payment is linked to professionally acting upon the all given instructions in this manual and specifically appropriate completion of the following, i. Face Sheet of Test Booklet (all fields are mandatory, if students have not filled anyone or all of them, then it is Invigilator s responsibility to fill-in ii. Attendance Sheet (With Stamp and Signature of Center Head Teacher/FA/Incharge/Senior Teacher 114

139 115

140 Appendix E (Monitoring Report Pro-forma) Sukkur Institute of Business Administration Standardized Achievement Test Project Monitoring Report Pro-forma SAT-IV ( ) Actual Test Administration Date of Visit District Taluka School Name New SEMIS Code Monitored Class V Monitored Class VIII Invigilators' Names (ClassV) Invigilators' Names(Class VIII) Sr. MONITORING CHECKLIST YES NO COMMENTS 1 Invigilator team arrived on time 2 Invigilators were having their ID Cards 3 Test began at the prescribed time (10:00 AM) 4 Stationery boxes were provided to students 6 Instructions were communicated to students appropriately 7 Students were seated in the appropriate sequence (i.e. as per medium of instruction) 8 Students received test booklets as per their medium of instruction 9 Number of test booklets matched the number of students 10 Students received test booklets in A and B sequence 11 Students filled their information appropriately on Student Face Sheet. 12 Students attempted questions appropriately 13 Test Centre environment is calm 14 Test Centre is adequately furnished 116

141 Sr. MONITORING CHECKLIST YES NO COMMENTS 15 Seats are appropriately arranged in Test Blocks 16 Were arrangements made for students with special needs? 17 Did you witness any form of misconduct by the invigilator or the students? 18 Was Head Master/Mistress present in the school at the time of the test? 19 Head Master/Mistress was informed about the schedule of SAT Phase IV test 20 Who informed Head Master/Mistress about the day, date and time of the test 21 Have you taken photos of: (a) School main gate (b) Test block boards (c) Students and Invigilators RSU / ELD SIBA Please put a tick mark Did you encounter any issues during test monitoring? Suggestions for improvement? Name of the Monitoring Officer Signature of the Monitoring Officer Date 117

142 Appendix F (Development, Printing and Dispatch Plan for SAT IV ( ) Student Report Cards) As per the ToRs, SAT Office Sukkur IBA is required to develop, print and dispatch Student Report Cards (SRCs) to the parents/guardians of every student who appeared in the test through Head Masters/Mistresses. This practice was done in SAT I, ( ), SAT II ( ), SAT-III ( ) and same will be replicated in SAT IV ( ). The proposed mechanism for SAT-IV SRCs is as under: 1. Development of SRCs SAT office has developed a software program to prepare SAT IV SRCs, with the support of SAT IT team, the software contains following main features. a. Generating Student Report Card as per medium of instruction of student. b. Generating Contend-strand wise percentage scores of Language, Math & in each Student Report Card. c. Generating Overall percentage average scores of each subject for student d. Generating overall percentage averages of each subject for school. 2. Development of School Performance Report 2.1 Sukkur IBA has designed School Performance Report for all the secondary& primary schools which participated in SAT-IV exam. 2.2 The School Performance Report contains the percentage average scores in all contend-strands of Language, Math & subjects along with overall subject average percentages. 2.3 The aim of sharing school performance report is to aware the Head Teacher regarding performance of students in each subject category, so that he/she can bring reforms at school level by analyzing the SAT results. 2.4 School Performance Report is for school record. 2.5 Following this, the soft folders of SRCs are sent to the Printing Company. 3. Printing of SRCs a. The Printing Company starts the printing of SRCs 3.2 After printing job the company sort out the school-wise SRCs of individual students 118

143 3.3 Prepare school-wise envelopeswith having the dispatch address of the school along with the name and contact no of the Head Master/Mistress (If available in RSU data file) 3.4 The Printing Company keeps following documents in each school-wise SRC envelope 3.5 One colored SRC of each individual student of the school 3.6 One copy of SAT Instruction Letter to Head Master/Mistress 3.7 One copy of SAT Instruction Letter to Assistant District Officers/Taluka Education Officers (ADOEs/TEOs) Male & Female. 3.8 After keeping all above mentioned documents in school-wise envelopes, they are sealed and ready for dispatching. 4. Printing of School Performance Report a. One pager school performance report will also be shared with School Head Teacher for office record. 5. Dispatch of SRCs a. Conducting Pre-dispatch Meeting at District Level i. Meetings at district level will be conducted with TEOs Male/Female (Primary/Secondary) in collaboration with Reform Support Unit. LSU Staff Members, DEO Primary, DEO Secondary, TEOs and Sukkur IBA representative will be part of this meeting. ii. Sukkur IBA representative will share the complete process of SRC distribution with all concerned. iii. RSU will develop district wise and region wise schedule of such meetings and will issue letters to LSU, DEOs, TEOs and Sukkur IBA regarding meeting. Dispatch of SRCs to Class V & VIII-Primary & Secondary Schools 5.1 school-wise envelopes, which contain class V & VIII report cards, are dispatched to the office addresses of concerned Taluka Education Officers (Primary & Secondary) Male/Female in entire Sindh province. 5.2 All School envelopes of boys primary schools will be delivered to TEO Primary (Male) 5.3 All School envelopes of girls primary schools will be delivered to TEO Primary (Female) 5.4 All School envelopes of boys secondary schools will be delivered to TEO Secondary (Male) 119

144 5.5 All School envelopes of girls secondary schools will be delivered to TEO Secondary (Female) 5.6 Sukkur IBA will use avail services of TCS Pvt Limited in dispatching the SRCs to offices of TEO Primary (M/F) and TEO Secondary (M/F) 5.7 RSU will share the updated addresses of TEO Primary/Secondary (Male & Female) with SAT office Sukkur IBA on prescribed format. 6. Distribution Mechanism of SRCs a. Distribution of Class V SRCs through TEO primary (Male/Female) i. After meetings, Taluka Coordinator of SAT office Sukkur IBA will coordinate with TEO Primary (Male/Female) and select a day on which TEO primary will call all Head Teachers of the Taluka to come to TEO primary (Male/Female) office to collect Student Report Card. The receiving will be taken from Head Teachers and original receiving will be shared with Sukkur IBA Taluka Coordinator, TEO can keep its Xerox copy. ii. Sukkur IBA Taluka Coordinator will also be available during distribution process. 6.2 Distribution of Class VIII SRCs through TEO secondary (Male/Female) Same Taluka Coordinator will also coordinate with TEO (Male/female) Secondary to select a day on which TEO Secondary (Male/Female) will call all Head teachers of Taluka to come to TEO Secondary (Male/Female) office to collect and discuss Student Report Cards. The receiving will be taken from Head Teachers and will be shared will RSU and Sukkur IBA Sukkur IBA Taluka Coordinator will also be available during distribution process. Discussion on Results SAT office also requests all TEOs that they should discuss the SAT results with the Head Masters/Mistresses of their talukas/towns and thus try to take school-based reform in order to improve the quality of education delivery in the schools of their respective talukas/towns However, in some cases, If it is not possible for them, then SAT office requests them to distribute the SRCs to their Head Masters/Mistresses through Supervisors Primary Education. 7. Distribution of SRCs to parents through Head Teachers 120

145 a. After receiving the Student Report Cards, Head Teacher will organize Parents Day at school or may also call Parent-teacher meeting in school. b. Head Teacher will discuss the results of each student with Parents & teachers. c. Head Teacher will identify in which subject student can improve, based on SAT results. d. Head Teacher will distribute the Student Report Cards to parents. e. Head Teacher will get receiving signature/thumb impression from parents when distributing the report card, and will share the same receiving sheet to concerned TEO office with in 10 working days. 8. Additional Information on School-wise Student Report Cards Envelopes: Each envelope contains following information and suggested action S# Information type Description Suggested action 01 Student Report Cards 02 School Performance Report 03 Letter (Guidelines for distribution of SRC) 04 List of Students with Space for Parents Signature. Sukkur IBA provides report cards of students who appeared in test Sukkur IBA provides school performance report on one page. Sukkur IBA provides guidelines to Head Teacher for distribution of SRC to Parents Sukkur IBA provides list of all students who appeared in SAT-IV with space for signature/thumb impression of parents when receiving report card of their children. Head Teacher will share these report cards with parents of students. Head Teacher must review the report and take measures to improve the weak areas in Language, & Maths. Head teacher must review it and act accordingly. Head teacher must taken signature of student s parent while sharing the student report card. Same receiving sheet will be handed over to concerned TEO office with in 10 working days. 121

146 Appendix G (District Profiles of Class V & VIII) District West Karachi Table 56 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average Average District's Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Orangi Town SITE Town Baldia Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 122

147 Table 57 All s Based Analysis and Taluka Based Overall Scores of Class VIII Language Math District's Difference From District's Reading Writing Number & Operation Algebra Geometry Information Handling Life Standard Deviation Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Orangi Town SITE Town Baldia Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 123

148 District Malir Karachi Table 58 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Bin Qasim Town Gadap Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 124

149 Table 59 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Average Standard Deviation Language Reading Writing Number & Operation Math Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Bin Qasim Town Gadap Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 125

150 District Korangi Karachi Table 60 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average District's Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Korangi Town Shah Faisal Town Landhi Town Malir Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 126

151 Table 61 All s Based Analysis and Taluka Based Overall Scores of Class VIII Language Math District's Difference From Reading Writing Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space District's Standard Deviation Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Shah Faisal Town Korangi Town Landhi Town Malir Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 127

152 District Sujawal Table 62 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average Difference From District's Difference From Standard Deviation Language Reading Writing Number & Operation Measurement Math Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Sujawal Mirpur Bithoro Jati Shah Bundar Kharo Chann Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 128

153 Table 63 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Sujawal Shah Bundar Mirpur Bithoro Jati Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 129

154 District South Karachi Table 64 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Difference From Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Saddar Town Lyari Town Kemari Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 130

155 Table 65 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Saddar Town Kemari Town Lyari Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 131

156 District Central Karachi Table 66 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average Difference From District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall New Karachi Town North Nazimabad T Liaqatabad Town Gulberg Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 132

157 Table 67 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Average District's Difference From Standard Deviation Language Reading Math Writing Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall North Nazimabad Town Liaqatabad Town New Karachi Town Gulberg Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 133

158 District East Karachi Table 68 All s Based Analysis and Taluka Based Overall Scores of Class V Language District's Average Reading Writing Difference From District's Average Average Standard Deviation Math Number & Operation Measuremen t Algebra Geometry Information Handling Life Physical Earth & Space Taluka Taluka Based Overall Average Percentage of Class V Language Math Average Jamshed Town Average Overall Average District s Overall Gulshan-e-Iqbal Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points

159 Table 69 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Difference From Standard Deviation Language Reading Writing Number & Operation Math Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Gulshan-e-Iqbal Jamshed Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 135

160 District Tharparkar Table 70 All s Based Analysis and Taluka Based Overall Scores of Class V S-ubject District's Difference From District's Average Difference From Standard Deviation Language Reading Writing Number & Operation Measurement Math Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Mithi Diplo Nagarparkar Chachro Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 136

161 Table 71 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Average Standard Deviation Language Math Reading Writing Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Diplo Mithi Chachro Nagar parkar Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 137

162 District Noushero Feroze Table 72 All s Based Analysis and Taluka Based Overall Scores of Class V Language District's Reading Writing Number & Operation District's Average Difference From Standard Deviation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Bhirya Moro Naushero Feroz Mehrabpur Kandiaro Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points

163 Table 73 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Moro Bhirya NausheroFeroz Kandiaro Mehrabpur Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 139

164 District Jacobabad Table 74 All s Based Analysis and Taluka Based Overall Scores of Class V District's Difference From District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Garhi Khairo Thull Jacobabad Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 140

165 Table 75 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Difference From Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Jacobabad Thull GarhiKhairo Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 141

166 District Umerkot Table 76 All s Based Analysis and Taluka Based Overall Scores of Class V District's Difference From District's Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Kunri Samaro Pithoro Umerkot Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 142

167 Table 77 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Difference From Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Kunri Pithoro Samaro Umerkot Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 143

168 District Jamshoro Table 78 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average District's Average Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Thana Bula Khan Manjhand Kotri Sehwan Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 144

169 Table 79 All s Based Analysis and Taluka Based Overall Scores of Class VIII Language Math District's Reading Writing Number & Operation Algebra Geometry Information Handling Life District's Difference From Average Standard Deviation Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Kotri Thana Bula Khan Manjhand Sehwan Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 145

170 District Badin Table 80 All s Based Analysis and Taluka Based Overall Scores of Class V District's Difference From District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Tando Bago Matli Talhar Badin Golarchi S.F.Rao Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 146

171 Table 81 All s Based Analysis and Taluka Based Overall Scores of Class VIII Language Math District's Average Reading Writing Number & Operation Algebra Geometry Information Handling Life District's Standard Deviation Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall TandoBago Talhar Matli Golarchi-S.F.Rao Badin Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 147

172 District Shaheed Benazirabad Table 82 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Sakrand Kazi Ahmed Daur Nawab Shah Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 148

173 Table 83 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Difference From Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Kazi Ahmed Sakrand Daur Nawab Shah Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 149

174 District Matiari Table 84 All s Based Analysis and Taluka Based Overall Scores of Class V District's Difference From District's Average Difference From Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Bin Qasim Town Gadap Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 150

175 Table 85 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Average District's Difference From Standard Deviation Language Reading Writing Number & Operation Math Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Bin Qasim Town Gadap Town Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 151

176 District Tando Allahyar Table 86 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Average Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Jhando Mari Tando Allah Yar Chamber Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 152

177 Table 87 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Tando Allah Yar Chamber Jhando Mari Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 153

178 District Sanghar Table 88 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life * Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Khipro Sanghar Tando Adam Jam Nawaz Ali Sinjhoro Shahdadpur Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 154

179 Table 89 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Average Difference From Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Khipro Sanghar Sinjhoro Jam Nawaz Ali Tando Adam Shahdadpur Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 155

180 District Dadu Table 90 All s Based Analysis and Taluka Based Overall Scores of Class V District's Difference From District's Difference From Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Mehar Johi Dadu K N Shah Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 156

181 Table 91 All s Based Analysis and Taluka Based Overall Scores of Class VIII Language Math District's Average Reading Writing Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space District's Standard Deviation Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Mehar Dadu K N Shah Johi Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 157

182 District Mirpur Khas Table 92 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Jhuddo Digri Sindhri Mirpur Khas Kot Ghulam Mohd Hussain Bux Mari Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 158

183 Table 93 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Average Difference From Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Digri MirpurKhas Jhuddo Sindhri Kot Ghulam Mohd HussainBux Mari Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 159

184 District Thatta Table 94 All s Based Analysis and Taluka Based Overall Scores of Class V District's Difference From District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Keti Bundar Ghorabari Mirpur Sakro Thatta Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 160

185 Table 95 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Keti Bundar Ghorabari Mirpur Sakro Thatta Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 161

186 District Ghotki Table 96 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Ubauro Ghotki Mirpur Mathelo Khan Garh Daharki Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 162

187 Table 97 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall MirpurMathelo Khan Garh Ghotki Ubauro Daharki Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 163

188 District Tando Mohd Khan Table 98 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average Difference From District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Tando Ghulam Hyde Tando Mohd Khan Bulri Shah Karim Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 164

189 Table 99 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Tando Ghulam Hyde Bulri Shah Karim Tando Mohd Khan Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 165

190 District Kambar Shahdadkot Table 100 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Kambar Naseerabad Miro Khan Warrah Sijawal Junejo Shahdadkot Qubo Saeed Khan Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 166

191 Table 101 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Naseerabad Kambar SijawalJunejo Warrah Miro Khan Shahdadkot Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 167

192 District Kashmore Table 102 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average District's Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Kashmore Kandhkot Tangwani Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 168

193 Table 103 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Kashmore Kandhkot Tangwani Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 169

194 District Shikarpur Table 104 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average Difference From District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Khanpur Garhi Yasin Shikarpur Lakhi Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 170

195 Table 105 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's District's Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Shikarpur Garhi Yasin Lakhi Khanpur Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 171

196 District Khairpur Mirs Table 106 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Nara Kot Diji Kingri Mirwah Gambat Sobhodero Faiz Ganj Khairpur Mirs Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 172

197 Table 107 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Average District's Difference From Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Gambat Sobhodero Mirwah FaizGanj KotDiji Nara Kingri KhairpurMirs Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 173

198 District Sukkur Table 108 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average District's Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall SALEHPAT CITY SUKKUR PANO AKIL NEW SUKKUR ROHRI Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 174

199 Table 109 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Average District's Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Salehpat City Sukkur Rohri Pano Akil New Sukkur Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 175

200 District Hyderabad Table 110 All s Based Analysis and Taluka Based Overall Scores of Class V District's District's Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Qasimabad Latifabad Hyderabad City Hyderabad Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 176

201 Table 111 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Difference From District's Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall Qasimabad Latifabad Hyderabad City Hyderabad Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 177

202 District Larkana Table 112 All s Based Analysis and Taluka Based Overall Scores of Class V District's Average District's Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class V Taluka Language Math Average Average Overall Average District s Overall Rato Dero Larkana Dokri Bakrani Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 178

203 Table 113 All s Based Analysis and Taluka Based Overall Scores of Class VIII District's Average District's Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space Taluka Based Overall Average Percentage of Class VIII Taluka Language Math Average Average Overall Average District s Overall RatoDero Larkana Dokri Bakrani Notes: 1. The Talukas are ranked on the basis of overall average of Talukas 2. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 3. All averages and differences are given in percent points 179

204 Appendix H (Gender Wise Based Results) Table 114 All Based Analysis of Female Students of Class V Gender Average Difference From Gender Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Table 115 All Based Analysis of Female Students of Class VIII Gender Gender Average Standard Deviation Language Reading Writing Number & Operation Math Algebra Geometry Information Handling Life Physical Earth & Space

205 Table 116 All Based Analysis of Male Students of Class V Gender Difference From Gender Difference From Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Table 117 All Based Analysis of Male Students of Class VIII Gender Average Difference From Gender Standard Deviation Language Reading Writing Number & Operation Math Algebra Geometry Information Handling Life Physical Earth & Space

206 Appendix I (Location Wise Based Results) Table 118: All Based Analysis of Rural Students of Class V Language Math Location Difference From Reading Writing Number & Operation Measurement Algebra Geometry Information Handling Life Physical Location Difference From Standard Deviation Earth & Space Notes: 1. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 2. All averages and differences are given in percent points. 182

207 Table 119: All Based Analysis of Rural Students of Class VIII Language Math Location Difference From Reading Writing Number & Operation Algebra Geometry Information Handling Life Location Difference From Standard Deviation Physical Earth & Space Notes: 1. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 2. All averages and differences are given in percent points. 183

208 Table 120: All Based Analysis of Urban Students of Class V Language Math Location Difference From Reading Writing Number & Operation Measurement Algebra Geometry Information Handling Life Location Difference From Standard Deviation Physical Earth & Space Notes: 1. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 2. All averages and differences are given in percent points. 184

209 Table 121: All Based Analysis of Urban Students of Class VIII Language Math Location Difference From Reading Writing Number & Operation Algebra Geometry Information Handling Life Location Difference From Standard Deviation Physical Earth & Space Notes: 1. Positive difference means score points higher than district s overall average and negative difference means score points lower than district s overall average 2. All averages and differences are given in percent points. 185

210 AppendixJ (School Type Wise Based Results) Table 122 All Based Analysis of Boys Schools Students of Class V Boys Average Boys Difference From Language Reading Writing Number & Operation Standard Deviation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Table 122 All Based Analysis of Boys Schools Students of Class VIII Boys Average Boys Average Standard Deviation Language Reading Writing Math Number & Operation Algebra Geometry Information Handling Life Physical Earth & Space

211 Table 123 All Based Analysis of Girls Schools Students of Class V Girls Girls Average Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Table 124 All Based Analysis of Girls Schools Students of Class VIII Girls Average Girls Difference From Standard Deviation Language Reading Writing Number & Operation Math Algebra Geometry Information Handling Life Physical Earth & Space

212 Table 125 All Based Analysis of Mixed Schools Students of Class V Mixed Average Mixed Difference From Standard Deviation Language Reading Writing Number & Operation Math Measurement Algebra Geometry Information Handling Life Physical Earth & Space Table 126 All Based Analysis of Mixed Schools Students of Class VIII Mixed Average Difference From Mixed Difference From Average Standard Deviation Language Reading Writing Number & Operation Math Algebra Geometry Information Handling Life Physical Earth & Space

213 189

EDUCATION MONITOR. Assessment systems in Pakistan: Considerations of quality, effectiveness and use

EDUCATION MONITOR. Assessment systems in Pakistan: Considerations of quality, effectiveness and use EDUCATION MONITOR Assessment systems in Pakistan: Considerations of quality, effectiveness and use The Society for the Advancement of Education (SAHE) is a nongovernmental organization established in 1982

More information

CHALLENGES FACING DEVELOPMENT OF STRATEGIC PLANS IN PUBLIC SECONDARY SCHOOLS IN MWINGI CENTRAL DISTRICT, KENYA

CHALLENGES FACING DEVELOPMENT OF STRATEGIC PLANS IN PUBLIC SECONDARY SCHOOLS IN MWINGI CENTRAL DISTRICT, KENYA CHALLENGES FACING DEVELOPMENT OF STRATEGIC PLANS IN PUBLIC SECONDARY SCHOOLS IN MWINGI CENTRAL DISTRICT, KENYA By Koma Timothy Mutua Reg. No. GMB/M/0870/08/11 A Research Project Submitted In Partial Fulfilment

More information

Guide to Teaching Computer Science

Guide to Teaching Computer Science Guide to Teaching Computer Science Orit Hazzan Tami Lapidot Noa Ragonis Guide to Teaching Computer Science An Activity-Based Approach Dr. Orit Hazzan Associate Professor Technion - Israel Institute of

More information

Knowledge management styles and performance: a knowledge space model from both theoretical and empirical perspectives

Knowledge management styles and performance: a knowledge space model from both theoretical and empirical perspectives University of Wollongong Research Online University of Wollongong Thesis Collection University of Wollongong Thesis Collections 2004 Knowledge management styles and performance: a knowledge space model

More information

THE UNITED REPUBLIC OF TANZANIA MINISTRY OF EDUCATION, SCIENCE, TECHNOLOGY AND VOCATIONAL TRAINING CURRICULUM FOR BASIC EDUCATION STANDARD I AND II

THE UNITED REPUBLIC OF TANZANIA MINISTRY OF EDUCATION, SCIENCE, TECHNOLOGY AND VOCATIONAL TRAINING CURRICULUM FOR BASIC EDUCATION STANDARD I AND II THE UNITED REPUBLIC OF TANZANIA MINISTRY OF EDUCATION, SCIENCE, TECHNOLOGY AND VOCATIONAL TRAINING CURRICULUM FOR BASIC EDUCATION STANDARD I AND II 2016 Ministry of Education, Science,Technology and Vocational

More information

Availability of Grants Largely Offset Tuition Increases for Low-Income Students, U.S. Report Says

Availability of Grants Largely Offset Tuition Increases for Low-Income Students, U.S. Report Says Wednesday, October 2, 2002 http://chronicle.com/daily/2002/10/2002100206n.htm Availability of Grants Largely Offset Tuition Increases for Low-Income Students, U.S. Report Says As the average price of attending

More information

success. It will place emphasis on:

success. It will place emphasis on: 1 First administered in 1926, the SAT was created to democratize access to higher education for all students. Today the SAT serves as both a measure of students college readiness and as a valid and reliable

More information

For information only, correct responses are listed in the chart below. Question Number. Correct Response

For information only, correct responses are listed in the chart below. Question Number. Correct Response THE UNIVERSITY OF THE STATE OF NEW YORK 4GRADE 4 ELEMENTARY-LEVEL SCIENCE TEST JUNE 207 WRITTEN TEST FOR TEACHERS ONLY SCORING KEY AND RATING GUIDE Note: All schools (public, nonpublic, and charter) administering

More information

Colorado State University Department of Construction Management. Assessment Results and Action Plans

Colorado State University Department of Construction Management. Assessment Results and Action Plans Colorado State University Department of Construction Management Assessment Results and Action Plans Updated: Spring 2015 Table of Contents Table of Contents... 2 List of Tables... 3 Table of Figures...

More information

BENG Simulation Modeling of Biological Systems. BENG 5613 Syllabus: Page 1 of 9. SPECIAL NOTE No. 1:

BENG Simulation Modeling of Biological Systems. BENG 5613 Syllabus: Page 1 of 9. SPECIAL NOTE No. 1: BENG 5613 Syllabus: Page 1 of 9 BENG 5613 - Simulation Modeling of Biological Systems SPECIAL NOTE No. 1: Class Syllabus BENG 5613, beginning in 2014, is being taught in the Spring in both an 8- week term

More information

Inquiry Learning Methodologies and the Disposition to Energy Systems Problem Solving

Inquiry Learning Methodologies and the Disposition to Energy Systems Problem Solving Inquiry Learning Methodologies and the Disposition to Energy Systems Problem Solving Minha R. Ha York University minhareo@yorku.ca Shinya Nagasaki McMaster University nagasas@mcmaster.ca Justin Riddoch

More information

2013/Q&PQ THE SOUTH AFRICAN QUALIFICATIONS AUTHORITY

2013/Q&PQ THE SOUTH AFRICAN QUALIFICATIONS AUTHORITY 2013/Q&PQ THE SOUTH AFRICAN QUALIFICATIONS AUTHORITY Policy and Criteria for the Registration of Qualifications and Part Qualifications on the National Qualifications Framework Compiled and produced by:

More information

Field Experience and Internship Handbook Master of Education in Educational Leadership Program

Field Experience and Internship Handbook Master of Education in Educational Leadership Program Field Experience and Internship Handbook Master of Education in Educational Leadership Program Together we Shape the Future through Excellence in Teaching, Scholarship, and Leadership College of Education

More information

GUIDE TO EVALUATING DISTANCE EDUCATION AND CORRESPONDENCE EDUCATION

GUIDE TO EVALUATING DISTANCE EDUCATION AND CORRESPONDENCE EDUCATION GUIDE TO EVALUATING DISTANCE EDUCATION AND CORRESPONDENCE EDUCATION A Publication of the Accrediting Commission For Community and Junior Colleges Western Association of Schools and Colleges For use in

More information

Test Administrator User Guide

Test Administrator User Guide Test Administrator User Guide Fall 2017 and Winter 2018 Published October 17, 2017 Prepared by the American Institutes for Research Descriptions of the operation of the Test Information Distribution Engine,

More information

TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE. Pierre Foy

TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE. Pierre Foy TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE Pierre Foy TIMSS Advanced 2015 orks User Guide for the International Database Pierre Foy Contributors: Victoria A.S. Centurino, Kerry E. Cotter,

More information

Procedures for Academic Program Review. Office of Institutional Effectiveness, Academic Planning and Review

Procedures for Academic Program Review. Office of Institutional Effectiveness, Academic Planning and Review Procedures for Academic Program Review Office of Institutional Effectiveness, Academic Planning and Review Last Revision: August 2013 1 Table of Contents Background and BOG Requirements... 2 Rationale

More information

UNIVERSITY OF DERBY JOB DESCRIPTION. Centre for Excellence in Learning and Teaching. JOB NUMBER SALARY to per annum

UNIVERSITY OF DERBY JOB DESCRIPTION. Centre for Excellence in Learning and Teaching. JOB NUMBER SALARY to per annum UNIVERSITY OF DERBY JOB DESCRIPTION JOB TITLE DEPARTMENT / COLLEGE LOCATION Associate Professor: Learning and Teaching Centre for Excellence in Learning and Teaching Kedleston Road JOB NUMBER 0749-17 SALARY

More information

Effectiveness of in-service teacher education programmes offered by the University of Education, Lahore

Effectiveness of in-service teacher education programmes offered by the University of Education, Lahore Effectiveness of in-service teacher education programmes offered by the University of Education, Lahore A report of an evaluation study carried out by the Aga Khan University Institute for Educational

More information

ADDENDUM 2016 Template - Turnaround Option Plan (TOP) - Phases 1 and 2 St. Lucie Public Schools

ADDENDUM 2016 Template - Turnaround Option Plan (TOP) - Phases 1 and 2 St. Lucie Public Schools ADDENDUM 2016 Template - Turnaround Option Plan (TOP) - Phases 1 and 2 St. Lucie Public Schools The district requests an additional year to implement the previously approved turnaround option. Evidence

More information

Production of Cognitive and Life Skills in Public, Private, and NGO Schools in Pakistan

Production of Cognitive and Life Skills in Public, Private, and NGO Schools in Pakistan The Pakistan Development Review 42 : 1 (Spring 2003) pp. 1 28 Production of Cognitive and Life Skills in Public, Private, and NGO Schools in Pakistan G. M. ARIF and NAJAM US SAQIB * The share of private

More information

Practical Research. Planning and Design. Paul D. Leedy. Jeanne Ellis Ormrod. Upper Saddle River, New Jersey Columbus, Ohio

Practical Research. Planning and Design. Paul D. Leedy. Jeanne Ellis Ormrod. Upper Saddle River, New Jersey Columbus, Ohio SUB Gfittingen 213 789 981 2001 B 865 Practical Research Planning and Design Paul D. Leedy The American University, Emeritus Jeanne Ellis Ormrod University of New Hampshire Upper Saddle River, New Jersey

More information

South Carolina English Language Arts

South Carolina English Language Arts South Carolina English Language Arts A S O F J U N E 2 0, 2 0 1 0, T H I S S TAT E H A D A D O P T E D T H E CO M M O N CO R E S TAT E S TA N DA R D S. DOCUMENTS REVIEWED South Carolina Academic Content

More information

Developing an Assessment Plan to Learn About Student Learning

Developing an Assessment Plan to Learn About Student Learning Developing an Assessment Plan to Learn About Student Learning By Peggy L. Maki, Senior Scholar, Assessing for Learning American Association for Higher Education (pre-publication version of article that

More information

DEVM F105 Intermediate Algebra DEVM F105 UY2*2779*

DEVM F105 Intermediate Algebra DEVM F105 UY2*2779* DEVM F105 Intermediate Algebra DEVM F105 UY2*2779* page iii Table of Contents CDE Welcome-----------------------------------------------------------------------v Introduction -------------------------------------------------------------------------xiii

More information

Audit Of Teaching Assignments. An Integrated Analysis of Teacher Educational Background and Courses Taught October 2007

Audit Of Teaching Assignments. An Integrated Analysis of Teacher Educational Background and Courses Taught October 2007 Audit Of Teaching Assignments October 2007 Audit Of Teaching Assignments Audit of Teaching Assignments Crown copyright, Province of Nova Scotia, 2007 The contents of this publication may be reproduced

More information

How to Judge the Quality of an Objective Classroom Test

How to Judge the Quality of an Objective Classroom Test How to Judge the Quality of an Objective Classroom Test Technical Bulletin #6 Evaluation and Examination Service The University of Iowa (319) 335-0356 HOW TO JUDGE THE QUALITY OF AN OBJECTIVE CLASSROOM

More information

McDonald's Corporation

McDonald's Corporation McDonald's Corporation Case Writeup Individual Case # 2 The George Washington University Executive MBA Program EMBA 220: Operations Management Professor Sanjay Jain, Ph.D. February 20, 2010 Robert Paul

More information

Accounting 380K.6 Accounting and Control in Nonprofit Organizations (#02705) Spring 2013 Professors Michael H. Granof and Gretchen Charrier

Accounting 380K.6 Accounting and Control in Nonprofit Organizations (#02705) Spring 2013 Professors Michael H. Granof and Gretchen Charrier Accounting 380K.6 Accounting and Control in Nonprofit Organizations (#02705) Spring 2013 Professors Michael H. Granof and Gretchen Charrier 1. Office: Prof Granof: CBA 4M.246; Prof Charrier: GSB 5.126D

More information

Integrating Common Core Standards and CASAS Content Standards: Improving Instruction and Adult Learner Outcomes

Integrating Common Core Standards and CASAS Content Standards: Improving Instruction and Adult Learner Outcomes Integrating Common Core Standards and CASAS Content Standards: Improving Instruction and Adult Learner Outcomes Linda Taylor, CASAS ltaylor@casas.or Susana van Bezooijen, CASAS svanb@casas.org CASAS and

More information

I set out below my response to the Report s individual recommendations.

I set out below my response to the Report s individual recommendations. Written Response to the Enterprise and Business Committee s Report on Science, Technology, Engineering and Maths (STEM) Skills by the Minister for Education and Skills November 2014 I would like to set

More information

(ALMOST?) BREAKING THE GLASS CEILING: OPEN MERIT ADMISSIONS IN MEDICAL EDUCATION IN PAKISTAN

(ALMOST?) BREAKING THE GLASS CEILING: OPEN MERIT ADMISSIONS IN MEDICAL EDUCATION IN PAKISTAN (ALMOST?) BREAKING THE GLASS CEILING: OPEN MERIT ADMISSIONS IN MEDICAL EDUCATION IN PAKISTAN Tahir Andrabi and Niharika Singh Oct 30, 2015 AALIMS, Princeton University 2 Motivation In Pakistan (and other

More information

DG 17: The changing nature and roles of mathematics textbooks: Form, use, access

DG 17: The changing nature and roles of mathematics textbooks: Form, use, access DG 17: The changing nature and roles of mathematics textbooks: Form, use, access Team Chairs: Berinderjeet Kaur, Nanyang Technological University, Singapore berinderjeet.kaur@nie.edu.sg Kristina-Reiss,

More information

Programme Specification

Programme Specification Programme Specification Title: Accounting and Finance Final Award: Master of Science (MSc) With Exit Awards at: Postgraduate Certificate (PG Cert) Postgraduate Diploma (PG Dip) Master of Science (MSc)

More information

ACADEMIC AFFAIRS GUIDELINES

ACADEMIC AFFAIRS GUIDELINES ACADEMIC AFFAIRS GUIDELINES Section 8: General Education Title: General Education Assessment Guidelines Number (Current Format) Number (Prior Format) Date Last Revised 8.7 XIV 09/2017 Reference: BOR Policy

More information

SASKATCHEWAN MINISTRY OF ADVANCED EDUCATION

SASKATCHEWAN MINISTRY OF ADVANCED EDUCATION SASKATCHEWAN MINISTRY OF ADVANCED EDUCATION Report March 2017 Report compiled by Insightrix Research Inc. 1 3223 Millar Ave. Saskatoon, Saskatchewan T: 1-866-888-5640 F: 1-306-384-5655 Table of Contents

More information

Listening and Speaking Skills of English Language of Adolescents of Government and Private Schools

Listening and Speaking Skills of English Language of Adolescents of Government and Private Schools Listening and Speaking Skills of English Language of Adolescents of Government and Private Schools Dr. Amardeep Kaur Professor, Babe Ke College of Education, Mudki, Ferozepur, Punjab Abstract The present

More information

ASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE

ASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE ASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE March 28, 2002 Prepared by the Writing Intensive General Education Category Course Instructor Group Table of Contents Section Page

More information

School Inspection in Hesse/Germany

School Inspection in Hesse/Germany Hessisches Kultusministerium School Inspection in Hesse/Germany Contents 1. Introduction...2 2. School inspection as a Procedure for Quality Assurance and Quality Enhancement...2 3. The Hessian framework

More information

(Effective from )

(Effective from ) PADHO PARDESH - SCHEME OF INTEREST SUBSIDY ON EDUCATIONAL LOANS FOR OVERSEAS STUDIES FOR THE STUDENTS BELONGING TO THE MINORITY COMMUNITIES (Effective from 2013-14) GOVERNMENT OF INDIA MINISTRY OF MINORITY

More information

A Pilot Study on Pearson s Interactive Science 2011 Program

A Pilot Study on Pearson s Interactive Science 2011 Program Final Report A Pilot Study on Pearson s Interactive Science 2011 Program Prepared by: Danielle DuBose, Research Associate Miriam Resendez, Senior Researcher Dr. Mariam Azin, President Submitted on August

More information

CONNECTICUT GUIDELINES FOR EDUCATOR EVALUATION. Connecticut State Department of Education

CONNECTICUT GUIDELINES FOR EDUCATOR EVALUATION. Connecticut State Department of Education CONNECTICUT GUIDELINES FOR EDUCATOR EVALUATION Connecticut State Department of Education October 2017 Preface Connecticut s educators are committed to ensuring that students develop the skills and acquire

More information

IMPROVING STUDENTS SPEAKING SKILL THROUGH

IMPROVING STUDENTS SPEAKING SKILL THROUGH IMPROVING STUDENTS SPEAKING SKILL THROUGH PROJECT-BASED LEARNING (DIGITAL STORYTELLING) (A Classroom Action Research at the First Grade Students of SMA N 1 Karanganyar in the Academic Year 2014/2015) A

More information

5 Early years providers

5 Early years providers 5 Early years providers What this chapter covers This chapter explains the action early years providers should take to meet their duties in relation to identifying and supporting all children with special

More information

LAW ON HIGH SCHOOL. C o n t e n t s

LAW ON HIGH SCHOOL. C o n t e n t s LAW ON HIGH SCHOOL C o n t e n t s I BASIC PROVISIONS... 101 The Scope (Article 1)... 101 Aims (Article 2)... 101 Types of High Schools (Article 3)... 101 The Duration of Education (Article 4)... 101 The

More information

Update on Standards and Educator Evaluation

Update on Standards and Educator Evaluation Update on Standards and Educator Evaluation Briana Timmerman, Ph.D. Director Office of Instructional Practices and Evaluations Instructional Leaders Roundtable October 15, 2014 Instructional Practices

More information

MSW POLICY, PLANNING & ADMINISTRATION (PP&A) CONCENTRATION

MSW POLICY, PLANNING & ADMINISTRATION (PP&A) CONCENTRATION MSW POLICY, PLANNING & ADMINISTRATION (PP&A) CONCENTRATION Overview of the Policy, Planning, and Administration Concentration Policy, Planning, and Administration Concentration Goals and Objectives Policy,

More information

Assessment System for M.S. in Health Professions Education (rev. 4/2011)

Assessment System for M.S. in Health Professions Education (rev. 4/2011) Assessment System for M.S. in Health Professions Education (rev. 4/2011) Health professions education programs - Conceptual framework The University of Rochester interdisciplinary program in Health Professions

More information

Course Specification Executive MBA via e-learning (MBUSP)

Course Specification Executive MBA via e-learning (MBUSP) LEEDS BECKETT UNIVERSITY Course Specification Executive MBA via e-learning 2017-18 (MBUSP) www.leedsbeckett.ac.uk Course Specification Executive MBA via e-learning Faculty: School: Faculty of Business

More information

EXECUTIVE SUMMARY. TIMSS 1999 International Science Report

EXECUTIVE SUMMARY. TIMSS 1999 International Science Report EXECUTIVE SUMMARY TIMSS 1999 International Science Report S S Executive Summary In 1999, the Third International Mathematics and Science Study (timss) was replicated at the eighth grade. Involving 41 countries

More information

THE PROMOTION OF SOCIAL AWARENESS

THE PROMOTION OF SOCIAL AWARENESS THE PROMOTION OF SOCIAL AWARENESS Powerful Lessons from the Partnership of Developmental Theory and Classroom Practice Robert L. Selman Russell Sage Foundation New York The Russell Sage Foundation The

More information

Conceptual Framework: Presentation

Conceptual Framework: Presentation Meeting: Meeting Location: International Public Sector Accounting Standards Board New York, USA Meeting Date: December 3 6, 2012 Agenda Item 2B For: Approval Discussion Information Objective(s) of Agenda

More information

Educational system gaps in Romania. Roberta Mihaela Stanef *, Alina Magdalena Manole

Educational system gaps in Romania. Roberta Mihaela Stanef *, Alina Magdalena Manole Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Scien ce s 93 ( 2013 ) 794 798 3rd World Conference on Learning, Teaching and Educational Leadership (WCLTA-2012)

More information

USER ADAPTATION IN E-LEARNING ENVIRONMENTS

USER ADAPTATION IN E-LEARNING ENVIRONMENTS USER ADAPTATION IN E-LEARNING ENVIRONMENTS Paraskevi Tzouveli Image, Video and Multimedia Systems Laboratory School of Electrical and Computer Engineering National Technical University of Athens tpar@image.

More information

International Journal of Innovative Research and Advanced Studies (IJIRAS) Volume 4 Issue 5, May 2017 ISSN:

International Journal of Innovative Research and Advanced Studies (IJIRAS) Volume 4 Issue 5, May 2017 ISSN: Effectiveness Of Using Video Presentation In Teaching Biology Over Conventional Lecture Method Among Ninth Standard Students Of Matriculation Schools In Coimbatore District Ms. Shigee.K Master of Education,

More information

Faculty Athletics Committee Annual Report to the Faculty Council September 2014

Faculty Athletics Committee Annual Report to the Faculty Council September 2014 Faculty Athletics Committee Annual Report to the Faculty Council September 2014 This annual report on the activities of the Faculty Athletics Committee (FAC) during the 2013-2014 academic year was prepared

More information

content First Introductory book to cover CAPM First to differentiate expected and required returns First to discuss the intrinsic value of stocks

content First Introductory book to cover CAPM First to differentiate expected and required returns First to discuss the intrinsic value of stocks content First Introductory book to cover CAPM First to differentiate expected and required returns First to discuss the intrinsic value of stocks presentation First timelines to explain TVM First financial

More information

INDIAN STATISTICAL INSTITUTE 203, BARRACKPORE TRUNK ROAD KOLKATA

INDIAN STATISTICAL INSTITUTE 203, BARRACKPORE TRUNK ROAD KOLKATA INDIAN STATISTICAL INSTITUTE 203, BARRACKPORE TRUNK ROAD KOLKATA 700 108 A D V E R T I S E M E N T Applications are invited from Indian Nationals for recruitment of following posts required at Kolkata,

More information

Punjab Education and English Language Initiative (PEELI) 1

Punjab Education and English Language Initiative (PEELI) 1 GLOSSARY ABLE CELTA CPD DSD DTE ELT EMI ESIA GoP MOOCs MOU PCTB PEC PEELI PD PST SLO SPELT Activity Based Learning in English Certificate in Teaching English to Speakers of Other Languages Continuous Professional

More information

Delaware Performance Appraisal System Building greater skills and knowledge for educators

Delaware Performance Appraisal System Building greater skills and knowledge for educators Delaware Performance Appraisal System Building greater skills and knowledge for educators DPAS-II Guide for Administrators (Assistant Principals) Guide for Evaluating Assistant Principals Revised August

More information

ABET Criteria for Accrediting Computer Science Programs

ABET Criteria for Accrediting Computer Science Programs ABET Criteria for Accrediting Computer Science Programs Mapped to 2008 NSSE Survey Questions First Edition, June 2008 Introduction and Rationale for Using NSSE in ABET Accreditation One of the most common

More information

THE PENNSYLVANIA STATE UNIVERSITY SCHREYER HONORS COLLEGE DEPARTMENT OF MATHEMATICS ASSESSING THE EFFECTIVENESS OF MULTIPLE CHOICE MATH TESTS

THE PENNSYLVANIA STATE UNIVERSITY SCHREYER HONORS COLLEGE DEPARTMENT OF MATHEMATICS ASSESSING THE EFFECTIVENESS OF MULTIPLE CHOICE MATH TESTS THE PENNSYLVANIA STATE UNIVERSITY SCHREYER HONORS COLLEGE DEPARTMENT OF MATHEMATICS ASSESSING THE EFFECTIVENESS OF MULTIPLE CHOICE MATH TESTS ELIZABETH ANNE SOMERS Spring 2011 A thesis submitted in partial

More information

MMU/MAN: MASINDE MULIRO UNIVERSITY OF SCIENCE AND TECHNOLOGY

MMU/MAN: MASINDE MULIRO UNIVERSITY OF SCIENCE AND TECHNOLOGY MMU/MAN: 502001 MASINDE MULIRO UNIVERSITY OF SCIENCE AND TECHNOLOGY EXAMINATION HANDBOOK 2014 2019 2 VISION To be a centre of Excellence in Science and Technology responsive to development needs of society

More information

EXPO MILANO CALL Best Sustainable Development Practices for Food Security

EXPO MILANO CALL Best Sustainable Development Practices for Food Security EXPO MILANO 2015 CALL Best Sustainable Development Practices for Food Security Prospectus Online Application Form Storytelling has played a fundamental role in the transmission of knowledge since ancient

More information

Evaluation of Teach For America:

Evaluation of Teach For America: EA15-536-2 Evaluation of Teach For America: 2014-2015 Department of Evaluation and Assessment Mike Miles Superintendent of Schools This page is intentionally left blank. ii Evaluation of Teach For America:

More information

GCSE English Language 2012 An investigation into the outcomes for candidates in Wales

GCSE English Language 2012 An investigation into the outcomes for candidates in Wales GCSE English Language 2012 An investigation into the outcomes for candidates in Wales Qualifications and Learning Division 10 September 2012 GCSE English Language 2012 An investigation into the outcomes

More information

MMOG Subscription Business Models: Table of Contents

MMOG Subscription Business Models: Table of Contents DFC Intelligence DFC Intelligence Phone 858-780-9680 9320 Carmel Mountain Rd Fax 858-780-9671 Suite C www.dfcint.com San Diego, CA 92129 MMOG Subscription Business Models: Table of Contents November 2007

More information

Initial teacher training in vocational subjects

Initial teacher training in vocational subjects Initial teacher training in vocational subjects This report looks at the quality of initial teacher training in vocational subjects. Based on visits to the 14 providers that undertake this training, it

More information

Culture, Tourism and the Centre for Education Statistics: Research Papers

Culture, Tourism and the Centre for Education Statistics: Research Papers Catalogue no. 81-595-M Culture, Tourism and the Centre for Education Statistics: Research Papers Salaries and SalaryScalesof Full-time Staff at Canadian Universities, 2009/2010: Final Report 2011 How to

More information

BENCHMARK TREND COMPARISON REPORT:

BENCHMARK TREND COMPARISON REPORT: National Survey of Student Engagement (NSSE) BENCHMARK TREND COMPARISON REPORT: CARNEGIE PEER INSTITUTIONS, 2003-2011 PREPARED BY: ANGEL A. SANCHEZ, DIRECTOR KELLI PAYNE, ADMINISTRATIVE ANALYST/ SPECIALIST

More information

Introducing the New Iowa Assessments Mathematics Levels 12 14

Introducing the New Iowa Assessments Mathematics Levels 12 14 Introducing the New Iowa Assessments Mathematics Levels 12 14 ITP Assessment Tools Math Interim Assessments: Grades 3 8 Administered online Constructed Response Supplements Reading, Language Arts, Mathematics

More information

GOING GLOBAL 2018 SUBMITTING A PROPOSAL

GOING GLOBAL 2018 SUBMITTING A PROPOSAL GOING GLOBAL 2018 SUBMITTING A PROPOSAL Going Global provides an open forum for world education leaders those in the noncompulsory education sector with decision making responsibilities to debate issues

More information

Karla Brooks Baehr, Ed.D. Senior Advisor and Consultant The District Management Council

Karla Brooks Baehr, Ed.D. Senior Advisor and Consultant The District Management Council Karla Brooks Baehr, Ed.D. Senior Advisor and Consultant The District Management Council This paper aims to inform the debate about how best to incorporate student learning into teacher evaluation systems

More information

Referencing the Danish Qualifications Framework for Lifelong Learning to the European Qualifications Framework

Referencing the Danish Qualifications Framework for Lifelong Learning to the European Qualifications Framework Referencing the Danish Qualifications for Lifelong Learning to the European Qualifications Referencing the Danish Qualifications for Lifelong Learning to the European Qualifications 2011 Referencing the

More information

National and Regional performance and accountability: State of the Nation/Region Program Costa Rica.

National and Regional performance and accountability: State of the Nation/Region Program Costa Rica. National and Regional performance and accountability: State of the Nation/Region Program Costa Rica. Miguel Gutierrez Saxe. 1 The State of the Nation Report: a method to learn and think about a country.

More information

Delaware Performance Appraisal System Building greater skills and knowledge for educators

Delaware Performance Appraisal System Building greater skills and knowledge for educators Delaware Performance Appraisal System Building greater skills and knowledge for educators DPAS-II Guide (Revised) for Teachers Updated August 2017 Table of Contents I. Introduction to DPAS II Purpose of

More information

Dissertation submitted In partial fulfillment of the requirement for the award of the degree of. Of the Tamil Nadu Teacher Education University

Dissertation submitted In partial fulfillment of the requirement for the award of the degree of. Of the Tamil Nadu Teacher Education University INFLUENCE OF MATHEMATICS TEXTBOOK LAYOUT IN MATHEMATICS LEARNING ABILITY OF 8 TH STANDARD STUDENTS IN GOVERNMENT AIDED AND CORPORATION SCHOOLS Dissertation submitted In partial fulfillment of the requirement

More information

DEPARTMENT OF EXAMINATIONS, SRI LANKA GENERAL CERTIFICATE OF EDUCATION (ADVANCED LEVEL) EXAMINATION - AUGUST 2016

DEPARTMENT OF EXAMINATIONS, SRI LANKA GENERAL CERTIFICATE OF EDUCATION (ADVANCED LEVEL) EXAMINATION - AUGUST 2016 DEPARTMENT OF EXAMINATIONS, SRI LANKA GENERAL CERTIFICATE OF EDUCATION (ADVANCED LEVEL) EXAMINATION - AUGUST 2016 Applications of private candidates for the above examination will be received from 01.02.2016

More information

Post-16 transport to education and training. Statutory guidance for local authorities

Post-16 transport to education and training. Statutory guidance for local authorities Post-16 transport to education and training Statutory guidance for local authorities February 2014 Contents Summary 3 Key points 4 The policy landscape 4 Extent and coverage of the 16-18 transport duty

More information

Improving the impact of development projects in Sub-Saharan Africa through increased UK/Brazil cooperation and partnerships Held in Brasilia

Improving the impact of development projects in Sub-Saharan Africa through increased UK/Brazil cooperation and partnerships Held in Brasilia Image: Brett Jordan Report Improving the impact of development projects in Sub-Saharan Africa through increased UK/Brazil cooperation and partnerships Thursday 17 Friday 18 November 2016 WP1492 Held in

More information

STUDENT ASSESSMENT AND EVALUATION POLICY

STUDENT ASSESSMENT AND EVALUATION POLICY STUDENT ASSESSMENT AND EVALUATION POLICY Contents: 1.0 GENERAL PRINCIPLES 2.0 FRAMEWORK FOR ASSESSMENT AND EVALUATION 3.0 IMPACT ON PARTNERS IN EDUCATION 4.0 FAIR ASSESSMENT AND EVALUATION PRACTICES 5.0

More information

EDUCATION AND DECENTRALIZATION

EDUCATION AND DECENTRALIZATION EDUCATION AND DECENTRALIZATION Skopje, 2006 Education and Decentralization: User-friendly Manual Author: Jovan Ananiev, MSc. Project management: OSCE Spillover Monitor Mission to Skopje/Confidence Building

More information

INTRODUCTION TO TEACHING GUIDE

INTRODUCTION TO TEACHING GUIDE GCSE REFORM INTRODUCTION TO TEACHING GUIDE February 2015 GCSE (9 1) History B: The Schools History Project Oxford Cambridge and RSA GCSE (9 1) HISTORY B Background GCSE History is being redeveloped for

More information

School Size and the Quality of Teaching and Learning

School Size and the Quality of Teaching and Learning School Size and the Quality of Teaching and Learning An Analysis of Relationships between School Size and Assessments of Factors Related to the Quality of Teaching and Learning in Primary Schools Undertaken

More information

Navitas UK Holdings Ltd Embedded College Review for Educational Oversight by the Quality Assurance Agency for Higher Education

Navitas UK Holdings Ltd Embedded College Review for Educational Oversight by the Quality Assurance Agency for Higher Education Navitas UK Holdings Ltd Embedded College Review for Educational Oversight by the Quality Assurance Agency for Higher Education February 2014 Annex: Birmingham City University International College Introduction

More information

The Talent Development High School Model Context, Components, and Initial Impacts on Ninth-Grade Students Engagement and Performance

The Talent Development High School Model Context, Components, and Initial Impacts on Ninth-Grade Students Engagement and Performance The Talent Development High School Model Context, Components, and Initial Impacts on Ninth-Grade Students Engagement and Performance James J. Kemple, Corinne M. Herlihy Executive Summary June 2004 In many

More information

IMPORTANT GUIDELINE FOR PROJECT/ INPLANT REPORT. FOSTER DEVELOPMENT SCHOOL OF MANAGEMENT, DR.BABASAHEB AMBEDKAR MARATHWADA UNIVERSITY,AURANGABAD...

IMPORTANT GUIDELINE FOR PROJECT/ INPLANT REPORT. FOSTER DEVELOPMENT SCHOOL OF MANAGEMENT, DR.BABASAHEB AMBEDKAR MARATHWADA UNIVERSITY,AURANGABAD... 1 FOSTER DEVELOPMENT SCHOOL OF MANAGEMENT, DR.BABASAHEB AMBEDKAR MARATHWADA UNIVERSITY,AURANGABAD... IMPORTANT GUIDELINE FOR PROJECT/ INPLANT REPORT. In partial fulfillment of requirement of Dr.BABASAHEB

More information

Ministry of Education, Republic of Palau Executive Summary

Ministry of Education, Republic of Palau Executive Summary Ministry of Education, Republic of Palau Executive Summary Student Consultant, Jasmine Han Community Partner, Edwel Ongrung I. Background Information The Ministry of Education is one of the eight ministries

More information

University of Toronto Mississauga Degree Level Expectations. Preamble

University of Toronto Mississauga Degree Level Expectations. Preamble University of Toronto Mississauga Degree Level Expectations Preamble In December, 2005, the Council of Ontario Universities issued a set of degree level expectations (drafted by the Ontario Council of

More information

Higher Education / Student Affairs Internship Manual

Higher Education / Student Affairs Internship Manual ELMP 8981 & ELMP 8982 Administrative Internship Higher Education / Student Affairs Internship Manual College of Education & Human Services Department of Education Leadership, Management & Policy Table

More information

REVIEW CYCLES: FACULTY AND LIBRARIANS** CANDIDATES HIRED ON OR AFTER JULY 14, 2014 SERVICE WHO REVIEWS WHEN CONTRACT

REVIEW CYCLES: FACULTY AND LIBRARIANS** CANDIDATES HIRED ON OR AFTER JULY 14, 2014 SERVICE WHO REVIEWS WHEN CONTRACT REVIEW CYCLES: FACULTY AND LIBRARIANS** CANDIDATES HIRED ON OR AFTER JULY 14, 2014 YEAR OF FOR WHAT SERVICE WHO REVIEWS WHEN CONTRACT FIRST DEPARTMENT SPRING 2 nd * DEAN SECOND DEPARTMENT FALL 3 rd & 4

More information

Pragmatic Constraints affecting the Teacher Efficacy in Ethiopia - An Analytical Comparison with India

Pragmatic Constraints affecting the Teacher Efficacy in Ethiopia - An Analytical Comparison with India Pragmatic Constraints, Affecting the Teacher Surapaneni B. & Sisay S. 81 REVIEW ARTICLE Pragmatic Constraints affecting the Teacher Efficacy in Ethiopia - An Analytical Comparison with India Surapaneni

More information

Early Warning System Implementation Guide

Early Warning System Implementation Guide Linking Research and Resources for Better High Schools betterhighschools.org September 2010 Early Warning System Implementation Guide For use with the National High School Center s Early Warning System

More information

Standards and Criteria for Demonstrating Excellence in BACCALAUREATE/GRADUATE DEGREE PROGRAMS

Standards and Criteria for Demonstrating Excellence in BACCALAUREATE/GRADUATE DEGREE PROGRAMS Standards and Criteria for Demonstrating Excellence in BACCALAUREATE/GRADUATE DEGREE PROGRAMS World Headquarters 11520 West 119th Street Overland Park, KS 66213 USA USA Belgium Perú acbsp.org info@acbsp.org

More information

FINNISH KNOWLEDGE IN MATHEMATICS AND SCIENCES IN 2002

FINNISH KNOWLEDGE IN MATHEMATICS AND SCIENCES IN 2002 FINNISH KNOWLEDGE IN MATHEMATICS AND SCIENCES IN 2002 FINAL REPORT OF LUMA PROGRAMME LUMA SUPPORT GROUP FINAL REPORT OF LUMA PROGRAMME 1 2 FINAL REPORT OF LUMA PROGRAMME ABSTRACT On the basis of the public

More information

Ex-Post Evaluation of Japanese Technical Cooperation Project

Ex-Post Evaluation of Japanese Technical Cooperation Project Bangladesh Ex-Post Evaluation of Japanese Technical Cooperation Project Project for Strengthening Primary Teacher Training on Science and Mathematics External Evaluator: Yuko Aoki, Kokusai Kogyo 0. Summary

More information

MASTER S COURSES FASHION START-UP

MASTER S COURSES FASHION START-UP MASTER S COURSES FASHION START-UP Postgraduate Programmes Master s Course Fashion Start-Up 02 Brief Descriptive Summary Over the past 80 years Istituto Marangoni has grown and developed alongside the thriving

More information

EXECUTIVE SUMMARY. TIMSS 1999 International Mathematics Report

EXECUTIVE SUMMARY. TIMSS 1999 International Mathematics Report EXECUTIVE SUMMARY TIMSS 1999 International Mathematics Report S S Executive Summary In 1999, the Third International Mathematics and Science Study (timss) was replicated at the eighth grade. Involving

More information

Stakeholder Engagement and Communication Plan (SECP)

Stakeholder Engagement and Communication Plan (SECP) Stakeholder Engagement and Communication Plan (SECP) Summary box REVIEW TITLE 3ie GRANT CODE AUTHORS (specify review team members who have completed this form) FOCAL POINT (specify primary contact for

More information

Bergen Community College Division of English Department Of Composition and Literature. Course Syllabus. WRT 206: Memoir and Creative Nonfiction

Bergen Community College Division of English Department Of Composition and Literature. Course Syllabus. WRT 206: Memoir and Creative Nonfiction Bergen Community College Division of English Department Of Composition and Literature Course Syllabus WRT 206: Memoir and Creative Nonfiction Instructor: Office: Phone: Office Hours: WRT-206: Memoir and

More information