DELIBERATE PRACTICE The Marzano Causal Teacher Evaluation Model
Teacher Evaluation Metrics Focus: Instructional Practice Student Growth Instructional Practice Instructional Practice is where classroom observations and feedback are provided to teachers throughout the year. 2
Review: Last Summer s Scoring and Weighting Workshop - FLDOE Recommendation Year 1 Year 2 Instructional Practice 50% Status Score 100% Instructional Practice 50% Status Score 60% Deliberate Practice Score 40% 3
Why do we need Deliberate Practice? 4
What if? What if every teacher engaged in a self assessment of their classroom practice? What if the Individual Professional Development Plan was aligned to the teacher evaluation system to help teachers measurably improve the Instructional Practice score? 5
The Deliberate Practice Plan may be used as an option for districts in place of their current IPDP if: Districts follow the FLDOE-approved model as presented At least one of the Deliberate Practice growth targets is developed with consideration of appropriate student growth data 6
What is Deliberate Practice? 7
Deliberate Practice Deliberate practice is a way for teachers to grow their expertise through a series of planned activities, reflection, and collaboration. Involved in the series is a protocol: setting personal goals, focused practice, focused feedback, observing and discussing teaching, and monitoring your progress 8
Making the Connections Deliberate Practice Teacher Behavior Student Achievement 9
Domain 1
Domains 2-4 11
Marzano Teacher Evaluation Model When these strategies are used, here is the typical effect on raising student achievement (percentile gain corrected): Note Taking 17% Practice 14% Setting Goals/Objectives 25% Student Discussion/Chunking 17% Summarizing 19% Tracking Student Progress and Using Scoring Scales 34% Building Vocabulary 20% Effort and Recognition 14% Graphic Organizers 13% Homework 15% Identifying Similarities and Differences 20% Interactive Games 20% Nonlinguistic Representations 17%
Deliberate Practice Involves: Focused Feedback Focused Practice 13
Remember the Goal An expectation that all teachers can increase their expertise from year to year which produces gains in student achievement from year to year with a powerful cumulative effect 14
Fundamentals of Deliberate Practice Deliberate Practice begins with empowering teachers! Teachers should take the lead in identifying their personal growth goals, and collaborate with their principals on their goals. Principal must approve the IPDP Deliberate Practice should be structured, resourced and monitored by the principal. 15
Teacher Growth Must Occur in Three Major Areas: Major Areas: 1. Scaffolding of Unit Content (around Unit Learning Goals) into Daily Lessons that support student learning 2. Implementation and Use of Instructional Strategies 3. Deliberate Practice of Strategies 16
Steps for Developing a Deliberate Practice Plan 1. Self Assessment 2. Identify Focus Strategies 3. Create Measurable Goals 4. Actions in the Classroom 5. Reflection 6. Tracking Progress and Celebrating Success 17
Linking Performance Scales to Teacher Reflection and Deliberate Practice Autonomous Phase Shaping Phase Cognitive Phase 18
Rating Scale for Domain Elements (State Model Teacher Evaluation Scale) 4 3 2 1 0 Formative Ratings Used for Each Domain Element Autonomous Phase Shaping Phase Cognitive Phase Innovating Applying Developing Beginning Not Using 19
Linking Performance Scales to Teacher Reflection and Deliberate Practice Highly Effective Effective Needs Improvement/D eveloping Unsatisfactory Formative Ratings Used for Each Domain Element Autonomous Phase Shaping Phase Cognitive Phase 20
21
Self-Assessment Example 22
23
Identify Focus Strategies Example 24
25
Write Measurable Goals Example 26
27
Action Steps Example 28
29
Reflection Example 30
31
Tracking Progress Example 32
Appendix Tools Recommendations for Developing Goals and Resources Goal #1 Progress Check-In and Reflection Log Goal #2 Progress Check-In and Reflection Log Goal #3 Progress Check-In and Reflection Log Video Self-Observation Guide (Optional) Peer Observation Guide (Optional) Instructional Rounds Guide (Optional) Glossary of Terms 33
Recapping the Benefits of Deliberate Practice Empowers teachers to take responsibility for their own professional growth and development Generates sources of evidences for other domains (planning/preparing, reflection/professionalism, etc.) As teachers increase their effectiveness with target strategies, it tends to lift their overall teaching 34
Scoring and Calculation DELIBERATE PRACTICE
Review: Last Summer s Scoring and Weighting Workshop FLDOE Recommendation Year 1 Year 2 Instructional Practice 50% Status Score 100% Instructional Practice 50% Status Score 60% Deliberate Practice Score 40% 36
5 Steps to Calculate the Deliberate Practice Score Step 1 Step 2 Step 3 Step 4 Step 5 District or teacher identifies target strategies following district policies Obtain at least 2 data points for each target strategy For each element, determine the number of growth levels from the first data point to the last data point Use the average growth level and the final data points against the scale to obtain the Deliberate Practice Score for each target element Average the Deliberate Practice Scores for each target element for the final element score.
Example Step 1 District or teacher identifies target element(s) following district policies Teacher identifies the following targets: Domain1 #1 Providing clear learning goals and scales (rubrics) #2 Tracking student progress #3 Celebrating success 38
Example Step 2 Obtain at least 2 data points for each element Domain 1: #1 Providing clear learning goals and scales (rubrics) Domain 1: #2 Tracking student progress October Data Point 1 March Data Point 2 0 3 2 3 Domain 1: #3 Celebrating success 1 3 Note: Scores are based on the Marzano scale: Innovating (4), Applying (3), Developing (2), Beginning (1) and Not Using (0) 39
Example Step 3 For each element, determine the number of growth levels from the first data point to the last data point using the Marzano Scale Domain 1: #1 Providing clear learning goals and scales (rubrics) Domain 1: #2 Tracking student progress October Data Point 1 March Data Point 2 Note: Scores are based on the Marzano scale: Innovating (4), Applying (3), Developing (2), Beginning (1) and Not Using (0) Growth Levels 0 3 3 2 3 1 Domain 1: #3 Celebrating success 1 3 2 40
Example Step 4 Use the scale to obtain the Deliberate Practice Score for each target element Highly Effective (4) Effective (3) Needs Improvement or Developing (2) Unsatisfactory (1) Grows 3 levels Grows 2 levels Grows 1 level Achieves no growth Note: The district may decide which rule takes precedence Or grows to Level 4 Or grows to Level 3 Or grows to Level 2 Or scores at Level 1 41
Example Step 5 Average the growth levels across target elements Domain 1: #1 Providing clear learning goals and scales (rubrics) Domain 1: #2 Tracking student progress Levels Grown Final Level Deliberate Practice Score 3 3 4* 1 3 3 Domain 1: #3 Celebrating success 2 3 3 Final Deliberate Practice Score: 3.33 * This score may be vary depending on the precedence of the scoring rules. This scenario uses the highest scoring rule. 42
Deliberate Practice Score Highly Effective Effective Needs Improvement Or Developing Unsatisfactory 3.5-4 2.5-3.4 1.5-2.4 1-1.4
Issue: How to Handle No Growth Two Options: Score as Unsatisfactory 1 Point Score as Unsatisfactory, but allow for one target element with no growth to be forgiven if multiple elements were targeted
No Growth Sample Scenarios Deliberate Practice Score Start Finish No Growth = Unsatisfactory Forgive One Element 3, 3, 3 3, 3, 3 1 (Unsatisfactory) 1 (Unsatisfactory) 3, 3, 3 3, 3, 4 2 (Needs Improvement) 2.5 (Effective) 3, 3, 3 3, 4, 4 3 (Effective) 4 (Highly Effective) 2, 2, 2 2, 2, 2 1 (Unsatisfactory) 1 (Unsatisfactory) 2, 2, 2 2, 2, 3 1.6 (Needs Improvement) 2 (Needs Improvement) 2, 2, 2 2, 3, 3 2.3 (Needs Improvement) 3 (Effective) 2, 2, 2 2, 3, 4 2.7 (Effective) 3.5 (Highly Effective) 3, 3 3, 3 1 (Unsatisfactory) 1 (Unsatisfactory) 3, 3 3, 4 2.5 (Effective) 4 (Highly Effective) 2, 2 2, 2 1 (Unsatisfactory) 1 (Unsatisfactory) 2, 2 2, 3 2 (Needs Improvement) 3 (Effective) 2, 2 2, 4 2.5 (Effective) 4 (Highly Effective) 3 3 1 (Unsatisfactory) 1 (Unsatisfactory) 2 2 1 (Unsatisfactory) 1 (Unsatisfactory) Highly Effective Effective Needs Improvement Unsatisfactory 45
Two Methods for Calculating Instructional Practice When Including Deliberate Practice Additive: Status Score + Addition of Deliberate Practice = Final Instructional Practice Score Inclusive: Status Score + Deliberate Practice = Final Instructional Practice Score Deliberate Practice Deliberate Practice Status Score Status Score Final Instructional Practice Score Final Instructional Practice Score 46
Additive Method Considerations: Deliberate Practice is added to the Instructional Practice Score Performance in Deliberate Practice only adds to the Instructional Practice score; it is not punitive Top scores are possible without growth in Deliberate Practice High reward for high growth More teachers will rank higher on the performance scale Deliberate Practice Status Score Final Instructional Practice Score 47
Inclusive Method Considerations: Deliberate Practice is a percentage of the Instructional Practice Score Performance in Deliberate Practice can be punitive if the teacher shows no growth. Top scores are not possible without growth in Deliberate Practice Reward for high growth and high status score More teachers will rank lower on the performance scale Deliberate Practice Status Score Final Instructional Practice Score 48
Sample Scenarios Typical Teacher Deliberate Practice 2.5 Status Score 3.1 Additive Score: Inclusive Score (40%, 60%): Difference:.74 points 3.60 (Highly Effective) 2.86 (Effective) The Additive method puts the teacher in the Highly Effective range rather than the middle of the Effective range.
FLDOE Recommendation 2012/13 2013/14 Additive Inclusive OR 2012/13 2013/14 2014/15 Pilot Additive Inclusive 50
Next Steps Implementing the Monitoring Plan Monitoring for results and making adjustments Identifying and sharing best practices Celebrating successes 51
Professional Development Deliberate Practice for Administrators Deliberate Practice for Teachers Deeper Connections Planning and Creating Units of Instruction