Grade Level Teams and Multi-Tiered Systems of Support: Driving the Bus to Proficiency Matthew Burns, Ph.D. University of Minnesota Contributions to Learning Hattie 2009 The student d =.40 The school d =.23 The teacher d =.49 The curriculum d =.45 1
Interventions for Children with LD Reading comprehension 1.13 Direct instruction.84 Psycholinguistic training.39 Modality instruction.15 Diet.12 Perceptual training.08 Kavale & Forness, 2000 Special Education Meta-Analysis d = -.12 What is special education??? 2
Individualized instruction, at no cost to the parents or guardians, to meet the unique needs of a child with a disability. Keys to Success St. Paul Pioneer Press June 4 th 2006 Reading Above All Else Emphasize reading and writing especially K-2 Beyond the Classroom After school programs and social services Continuous Assessment/Small-Group Instruction Formal and informal assessments to provide an appropriate level of challenge Effective Staff Strong leadership and cohesive staff with co-planning Structured, Disciplined Environment 3
RTI = MTSS The systematic use of assessment data to most efficiently allocate resources in order to enhance learning for all students. Burns & VanDerHeyden, 2006 MTSS and Problem-Solving TIER III TIER I I TIER I 4
Problem Solving Tier I Identify discrepancy between expectation and performance for class or individual (Is it a classwide problem?) Tier II Identify discrepancy for individual. Identify category of problem. (What is the category of the problem?) Tier III Identify discrepancy for individual. Identify causal variable. (What is the causal variable?) Monitor Screening/ Monitor Progress Progress Benchmark Diagnostic Skill General Emergent Alphabetic Quick Weekly Every other week (Typically K-1) Principle (PA) Phonemic DIBELS PSF DIBELS PSF PA to decoding Awareness (Specific PA task (QPA) e.g., Rhyming Task, ) Beginning ORF QPA, NWF, & Weekly Every other week (Typically 1 st -2 nd ) WTW DIBELS NWF ORF Decoding (Specific NWF - e.g., long vowel sounds) 5
Monitor Screening/ Monitor Progress Progress Benchmark Diagnostic Skill General Transitional ORF & MAP MAP, ORF, & Weekly Every other (Typically 2 nd 3 rd ) Word Their DIBELS NWF or week Decoding to Fluency Way (WTW) DIBELS ORF Instructional-level ORF Intermediate ORF & MAP MAP, ORF, & Weekly Every other (Typically 3 rd ) WTW DIBELS week Fluency to Comprehension Instructional-level ORF ORF PLC Meetings: Agenda PLC: 1 st weekly meeting of the month (Content Focus) PLC: 2 nd weekly meeting of the month RTI (Core Instruction Literacy Focus) PLC: 3 rd weekly meeting of the month (Content Focus) PLC: 4 th weekly meeting of the month RTI (Data Analysis) Grade level teams and coaches with additional personnel as appropriate School-site established PLC focus on various topics (e.g., math, STEM, behavior, environment, or other school topical initiatives) Grade level teams and coaches with additional personnel as appropriate Examine various formal and informal data to drive core instruction Agenda will include embedded professional development on topics that address opportunities and challenges for core instruction Grade level teams and coaches with additional personnel as appropriate School-site established PLC focus with schools studying varied topics Grade level teams and coaches with additional personnel as appropriate (data management team) Analyze screening/benchmark data Analyze progress monitoring data Discuss, monitor and adjust tiered interventions. 6
Grade Level Team Meeting Is there a classwide problem? Who needs Tier 2? Did we miss anyone? What should we do for Tier 2? Should we go to Tier 3? FIRST QUESTION CLASSWIDE OR INDIVIDUAL PROBLEM 7
Developmental Activities 1 st grade Phonemic awareness and phonics instruction 2 nd grade Explicit phonics instruction, writing, and fluency 3 rd grade Fluency and comprehension 4 th grade Read to learn Upper elementary & Middle School Vocabulary and comprehension High school Comprehension and application Screener MAP < 25 th %ile MAP > 25 th %ile Total Oral Reading Fluency (ORF) ORF < Benchmark Goal 276 145 421 A B ORF > Benchmark Goal 46 501 547 C D Total 322 646 968 Informal Reading Inventory (RI) RI < Benchmark Goal 90 189 279 A B RI > Benchmark Goal 200 367 567 C D Total 290 556 846 Sensitivity = a / (a + c) =.86 for ORF and.31 for F&P, Specificity = d / (b + d) =.78 for ORF and.66 for F&P, Overall Correct Classification = (a + d) / N =.80 for ORF and.54 for F&P 8
Assessment - Screening Measures of early numeracy Oral Counting Missing Number Number Identification Quantity Discrimination Monitoring Basic Skills Progress Math Computation Math Application Star Math Assessment Screener Multi-skill computation probe GOM www.mathfactcafe.com 25 problems Skill by columns 4 minutes 9
Meta-Analysis: Curriculum Vocabulary Instruction d =.67 Phonics Instruction d =.60 Comprehension Instruction d =.58 Whole Language d =.06 Keys to Effective Reading Curriculum Explicit Phonics Decodable Text 10
Curriculum Non-decodable/ Non-instructed words Harcourt Brace 32% Houghton Mifflin 52% Macmillan/ McGraw-Hill 57% Open Court 02% Scholastic 56% Scott, Foresman 51% Silver Burdett Ginn 39% 11
Teacher Roles Activator Facilitator Feedback d =.72 Meta-cognition d =.67 Direct Instruction d =.59 Mastery Learning d =.57 Form Assess. d =.46 Simulation/game d =.32 Inquiry-based d =.31 Class size d =.21 Problem-based d =.15 Inductive teach d =.06 Total d =.60 Total d =.17 12
Classwide Need and Instructional PLC What do highly effective teachers do? What will we as a TEAM do? How will we know if it works? What data can we collect (outcome)? For what will we look (process)? How will coach provide feedback? What will we do next? What is the implementation plan (e.g., observe, first steps, etc.)? Coaches role (what will be modeled/shared)? Who else will help? What process and outcomes will be reported at the next meeting? National Reading Panel Google National, reading, panel, and teachers Tim Shanahan Get PLCs using this 13
Reading Instruction in Elementary School Two hours each day Explicit instruction Free-choice reading Word study Writing Classwide Intervention http://kc.vanderbilt.edu/pals 14
WRC WRC after PALS Student 1 48 92 Student 2 122 142 Student 3 126 147 Student 4 82 113 Student 5 102 117 Student 6 77 97 Student 7 51 70 Student 8 84 95 Student 9 80 82 Student 10 102 127 Student 11 83 106 Student 12 38 47 Student 13 104 115 Student 14 152 161 Student 15 143 158 Student 16 115 125 Student 17 142 160 Student 18 114 127 Student 19 13 40 Student 20 75 92 Student 21 141 136 Student 22 87 105 Student 23 49 47 Median 87 113 15
STEP 2 WHO NEEDS TIER II ALSO DID WE MISS ANYONE? No Classwide Problem Lowest 20%! Examine the margins Did we miss anyone?? 16
Step 3 What Should We Do? Assess 4 NRP Areas Phonemic Awareness Phoneme segmentation fluency Phonics Nonsense word fluency Fluency Oral reading fluency Vocabulary/Comprehension 17
Category of Problem MN HS 9-12 with approximately 1600 students 69.2% pass reading 9 th -10 th grade 28% low on MAP (~225) 45% Low on TOSCRF (~100) 64% low on phonics (~65) 36% acceptable phonics (~36) Targeted Interventions Control Waitlist Control Variable Mean SD Mean SD Mean SD Fluency Pretest 90.17 7.65 89.88 9.73 na na Fluency Posttest 98.33 7.27 94.32 8.77 na Na MAP Fall 206.00 9.25 211.00 10.11 210.37 6.56 Map Winter 217.21 7.56 212.40 8.06 212.78 6.04 ANCOVA for fluency F (1, 42) = 4.98, p <.05, d =.50 ANCOVA for MAP F (2, 74) = 5.84, p <.05, partial eta squared =.14. 18
Grade Phonemic Awareness Phonics Fluency Vocabulary Comprehension Kindergarten EIR K EIR K NA Text Talk NA ` First Grade Road to the Code Road to the Code NA Text Talk NA Second Fast Forward Corrective Six Minute Building Vocabulary Comprehension Grade Language Reading Solution Skills Plus Third Grade Fast Forward Corrective Six Minute Building Vocabulary Comprehension Language Reading Solution Skills Plus Fourth NA REWARDS Six Minute Building Vocabulary Comprehension Grade Solution Skills Plus Fifth Grade NA REWARDS Six Minute Solution Building Vocabulary Skills Comprehension Plus Should we go to Tier 3? 19
Pre Intervention Measure k Correlation with Post Intervention Fluency r r 2 IQ 37 -.46 a.21 Word Reading SS 39.53 a *.28 Reading Comprehension SS 27 -.24.06 Reading Fluency SS 14.70*.49 Word Attack SS 14.54.29 CBM-ORF 97.60*.36 % of Comprehension 26.72*.52 Questions Answered Correctly Reading Accuracy 62.45*.20 * p <.003 Correlation with Reading Growth Pre Intervention Measure k r r 2 IQ 37 -.11 a.01 Word Reading SS 39.12 a.01 Reading Comprehension SS 27 -.18.03 Reading Fluency SS 14.37.14 Word Attack SS 14.36.13 CBM-ORF 97.09 <.01 % of Comprehension 26.32.10 Questions Answered Correctly Reading Accuracy 62.02 <.01 * p <.003 20
Meta-Analysis based on Feifer, 2008 Variable k Median Hedges s g 95% CI Use of Data Screening 30.41.31 to.51 Designing Interventions 4.42 -.05 to.89 Type of Assessment Cognitive Functioning 3.09 -.50 to.68 Phonological/Phonemic Awareness 11.44.24 to.64 Rapid Naming 2.48.03 to.93 Verbal Memory 1.20 NA Reading Fluency 11.43.29 to.57 Attention 1.13 NA Mixed 5.33.13 to.53 21
BURNS258@UMN.EDU 22