Data-based Decision Making for Instruction and Professional Development

Data-based Decision Making for Instruction and Professional Development Jeanne Wanzek, Ph.D. Principle 3 Provide effec+ve demonstra+ons, professional development, and leadership support to teachers on the necessity of using data to inform, plan, and adjust instruc+on, in addi+on to other areas. 1

Principle 5 Implement ongoing, intensive professional development that targets what teachers are expected to teach; that aligns with district, state, and na+onal standards; and that matches teacher and student needs. Evidence for Data-based Decision Making Teachers who monitor the effec=veness of instruc=on tend to achieve significantly higher rates of student learning than teachers who rely on more tradi=onal assessments (Conte & Hintze, 2000; Fuchs, Fuchs, HamleM, & Allinder, 1991; Stecker, Lembke, & Foegen, 2008) Teachers using progress- monitoring measures tend to be more realis=c when es=ma=ng a student's rate of progress and are able to adjust instruc=onal goals accordingly (Fuchs, Deno, & Mirkin, 1984; Fuchs, Fuchs, HamleM, & Stecker, 1991) 2

Evidence for Data-based Decision Making (cont d) Make data part of an ongoing cycle of instruc=onal improvement Teach students to examine their own data set learning goals Establish a clear vision for schoolwide data use Provide supports that foster a data- driven culture within the school Develop and maintain a districtwide data system Hamilton et al., 2009 Common Pitfalls Overwhelmed by data Overreliance on using tes=ng for instruc=on Lack of knowledge for using the available data Use of data for evalua=ve purposes only 3

Leadership Leaders play a crucial role in: What data are collected How data are used Culture for the use of data Resources for using data Practices Using Data Provide effec2ve demonstra2ons, professional development, and support to teachers on the necessity of using data to inform, plan, and adjust instruc2on. Lead teachers and school staff members through the process of using data to iden2fy and plan for changes in the instruc2onal program. 4

Practices (cont d) Professional Development Ins2tute frequent and ongoing site- based professional development. Provide 2me and resources for professional development that focuses on the subject maber content teachers are expected to teach and that aligns with district, state, and na2onal standards. Provide targeted professional development in an intensive format that is con2nuous throughout the year. Monitor implementa2on of the prac2ces from professional development and related teacher and student outcomes for at least 2 years to determine the associa2on between them. Addressing Needs Determine sources of data available Iden=fy what is collected and why Reduce duplica=on or data that are not useful Skalski & Romero, 2011 5

Ongoing Cycle of Instructional Improvement Collect and prepare a variety of data about student learning Hamilton et al., 2009 Interpret data and develop hypotheses about how to improve student learning Modify instruc=on to test hypotheses and increase student learning Multiple Types of Data Student achievement measures Teacher prac=ce measures Demographic informa=on Percep=ons, beliefs, and aetudes 6

Consider the Student Assessment Data You Have or Need for Decision-Making Screening Diagnos=c Progress Monitoring Outcome HELPING TEACHERS UNDERSTAND THE DATA FOR DECISION-MAKING 7

Know Your Assessment What is the assessment designed to measure? What types of decisions can be made with the assessment? How has this assessment typically been used in research or prac=ce? What is our confidence in the assessment and the decisions we are making? How does this assessment relate to instruc=on? Know The Meaning of the Assessment Scores What types of scores are available? How is the score calculated? What on the assessment causes change in a score? 8

Instructional Decisions Current Instruc=on What instruc=on is currently happening? What areas of instruc=on could be adapted? There is no point in tes=ng if you don t look at the data, don t understand it, and don t change. Chuck Watson, Principal Kennewick School District Fielding, Kerr, & Rosier, 2007 9

6/4/14 HELPING TEACHERS USE ASSESSMENT TO INFORM INSTRUCTION VIDEO http://www.youtube.com/watch?v=21jdvdoayha 10

Key Questions When Examining Data In what areas are students on track? In what areas do students need addi=onal instruc=on? What specific skills or prac=ces have been mastered? What instruc=on can be provided? Which students have similar instruc=onal needs and will form an appropriate group for instruc=on? Reading First Initiative: Secretary s Leadership Academy Types of Decisions Using Data District, School, or Grade Level Decisions Classroom Decisions Individual Student Decisions 11

District or School Level Decisions Need data from all students in the school or district (separated by grade level) Key areas: Are more students geeng on track in reading? Are significant numbers of students in at- risk or categories? Are significant numbers of students on the bubble for risk? Are par=cular students not doing well? ONE SCHOOL 12

Historical Sixth Grade Data 40 35 Total Score 30 25 20 Fall 15 Spring 10 5 0 Computa=on Concepts and Applica=ons Classroom Observations and Interviews: Sixth Grade Math Ra+os and Propor+onal Rela+onships: ra=o concepts The Number System: focus on accuracy, focus on complex problems, frac=on mul=plica=on and division procedures Expressions and Equa+ons: algebraic expressions and equality with an unknown variable Geometry: procedures for determining area and volume Sta+s+cs and Probability: limited instruc=on, focus on comple=ng ac=vi=es in the program 13

Concerns Instruc+onal Components Fluency of procedural knowledge in the number system and computa=on Consistent applica=on of knowledge to problem solving, real world situa=ons, and use of mathema=cs language Sta=s=cs instruc=on Instruc+onal Delivery Modeling of procedural flexibility Explicit connec=ons between previous knowledge and new knowledge (e.g. extending understanding of mul=plica=on and division) Prac=ce opportuni=es for students to verbalize decisions and solu=ons to math problems with feedback Instructional Decisions Professional Development for Sixth Grade Teachers Sta=s=cs Instruc=on Organizing Knowledge Across Concepts in Math Instruc=on Teaching for Accuracy and Fluency Progress Monitoring Differen=a=ng Instruc=on 14

Fall Data: Sixth Grade 40 35 30 Score 25 Historical 20 Cohort I 15 10 5 0 Computa=on Concepts and Applica=ons Spring Data: Sixth Grade 40 35 30 Score 25 Historical 20 Cohort I 15 10 5 0 Computa=on Concepts and Applica=ons 15

Sixth Grade Historical Math Data Percent of Students 100 90 80 70 60 50 40 30 20 10 0 At Risk OnTrack Computation Concepts and applications Sixth Grade Cohort I 100 Percent of Students 90 80 70 60 50 At Risk 40 30 On Track 20 10 0 Computations Concepts and Applications 16

CLASSROOM DECISIONS Classroom Decisions Need data for all students in the class Key Areas: Is most of the class at or above grade level? What areas are low for many students in the class? What areas are high for many students in the class? Who is falling behind? 17

Mr. Valenzuela Fall Data Student Oral Reading Fluency Maze Comprehension Spelling 120 24 ESSENCE 81 7 45 ANTONIA 139 1 120 ESTHER 165 28 106 PHILUP 103 11 80 LILLIAN 146 24 106 JONATHAN 112 14 77 MARIA 124 18 67 JESSICA 142 40 112 SHYDESHIA 126 20 85 SADIE 122 20 101 KAYLA 106 18 60 ONICA 98 21 85 TRE 175 38 135 RYAN 110 19 79 ALEJANDRO 163 32 104 75 13 51 JAMES DEVIN 110 Instructional Decisions Oral Reading Fluency Prac=ce reading connected text Instruc=on in fluency Instruc=on in decoding mul=syllabic words Integrate decoding and spelling of mul=syllabic words Targeted word recogni=on work for students with significant accuracy work Reading Comprehension Sentence comprehension and inferencing buildups Integrated vocabulary with decoding of mul=syllabic words Reading strategy work for comprehension monitoring 18

Mr. Valenzuela: Winter Student Oral Reading Fluency Maze Comprehension Spelling 138 24 ESSENCE 89 5 62 ANTONIA 150 27 128 ESTHER 171 27 128 PHILUP 137 20 131 LILLIAN 162 30 140 JONATHAN 116 12 125 MARIA 145 27 103 JESSICA 150 38 136 SHYDESHIA 141 24 102 SADIE 136 22 105 KAYLA 117 18 104 ONICA 112 28 118 TRE 170 32 137 RYAN 116 19 129 ALEJANDRO 169 34 121 97 15 101 JAMES DEVIN 134 Classroom Observations Majority of instruc=onal =me on word study, fluency, and independent work. Limited integra=on of text reading comprehension instruc=on Comprehension instruc=on consists mainly of asking students ques=ons and comple=ng worksheets Explicit vocabulary instruc=on including games/incen=ves throughout the day for using and applying new words Individual students in the class receive mul=ple opportuni=es to read connected text with feedback each day. Targeted instruc=on incorporated for students needing instruc=on in skills the rest of class has mastered 19

Instructional Decisions Oral Reading Fluency Reduce =me on fluency instruc=on Maintain connected text reading integrated with comprehension instruc=on Con=nue instruc=on and prac=ce in decoding and spelling of mul=syllabic words Reading Comprehension Increase emphasis on comprehension instruc=on Explicit instruc=on in prac=ces for monitoring and understanding text with modeling and supported prac=ce prior to independent work Increase review on newly taught comprehension prac=ces Explicit instruc=on in independent vocabulary strategies Mr. Valenzuela: Spring Student Oral Reading Fluency Maze Comprehension Spelling JAMES 160 25 139 ESSENCE 124 15 108 ANTONIA 175 31 140 ESTHER 200 35 146 PHILUP 198 26 151 LILLIAN 177 29 132 JONATHAN 151 18 139 MARIA 156 28 131 JESSICA 174 37 142 SHYDESHIA 165 28 135 SADIE 162 29 136 KAYLA 149 24 130 ONICA 154 30 128 TRE 189 35 142 RYAN 159 24 138 ALEJANDRO 169 36 134 DEVIN 110 21 112 20

INDIVIDUAL STUDENT DECISIONS When we want improvements and we keep doing the same things and keep geeng the same results who, really, are the slow learners? Dave Montague, Principal Kennewick School District Fielding, Kerr, & Rosier, 2007 21

Individual Student Decisions Need data for specific students who are below grade level expecta=ons (use screening and progress monitoring assessments) Key areas: In what instruc=onal areas is this student progressing well? In what instruc=onal areas is this student progressing inadequately? Are the instruc=onal changes or interven=on effec=ve? Derek Derek's Writing Correct Word Sequences 60 50 40 30 20 10 0 Weeks 22

Amy Amy s Oral Reading Fluency 150 130 110 90 70 50 30 10-10 Weeks Instructional Decisions Instruc=onal Components Provide prac=ce reading regular and irregular words mixed prior to text reading Strategies for decoding mul=syllabic words Include fluency prac=ce with modeling of fluent reading Instruc=onal Delivery Decrease group size to increase opportuni=es to prac=ce Break instruc=on into smaller steps and increase pace of instruc=on to increase opportuni=es to prac=ce Goal seeng focused on overall reading (not speed) 23

Amy s Oral Reading Fluency 150 130 110 90 70 50 30 10-10 Weeks 24

Activity Use the class data to: Iden=fy assessment informa=on teachers need to consider to work with the data Iden=fy suppor=ng data that could further inform decision making Iden=fy key areas/concepts you want teachers to consider with these data (how you will model) Iden=fy 3 (or more) ques=ons you would ask teachers when discussing these data Guidelines When using data to measure a school s academic achievement goals, principals should: Model examples on how to use data to make instruc=onal decisions. Ensure that mul=ple sources of data are collected and used to assess student performance (i.e., forma=ve and summa=ve assessments, observa=ons, surveys, and test scores). Engage the en=re staff and other stakeholders in analyzing data to make decisions about future instruc=onal planning, professional development, resource allotment, and curriculum adjustments. Make teachers and other stakeholders accountable to regularly iden=fy the data they use in making an instruc=onal decision or curriculum change. Evaluate the assessment competencies of teachers to accurately use data in their instruc=onal planning and support gaps with effec=ve professional development. 25

Additional Resources Middle School MaMers Field Guide (and listed resources) The Research Ins=tute on Student Progress Monitoring's (RIPM) website hmp://www.progressmonitoring.net/ Interven=on Central hmp://www.interven=oncentral.org Hamilton et al., 2009 Using student achievement data to support instruc=onal decision making, IES Prac=ce Guide hmp://ies.ed.gov/ncee/wwc/prac=ceguide.aspx?sid=12 Goals Three goals you have around data- based decision making/professional development implementa=on in your school One ac=on for each goal 26