Building Leaders Evaluations in KEEP June 7, 2013 at Manhattan; Bill Bagshaw, KSDE; Kayeri Akweks, KSDE; Mick Lowe Available online at http://www.ksde.org/default.aspx?tabid=4400
WAIVER - Principle 3 Supporting Effective Instruction and Leadership Implement teacher and principal evaluation and support systems that: Are used for continual improvement of instruction Use at least 3 performance levels Use multiple measures including student growth as significant factor Are used to evaluate on a regular basis Provide clear, timely, and useful feedback Are used to inform personnel decisions
Districts Have Chosen Their Evaluation Systems for 2013-2014 As of June 3, 2013 278 districts have submitted their Assurances Form 267 districts have had their Assurances Form approved 93 districts will be using the KEEP Repository 146 districts will be using vendors 46 districts will be using locally created evaluation systems
Evaluation Systems per Districts as of 6-4-2013
5 Topics to Prioritize 1. Multiple Measures 2. Inter-Rater Reliability 3. Evaluation Goal Selection 4. Evaluating the Building Leader 5. KEEP Repository
Multiple Measures Consider state assessments as expected Include assessment measures currently in use in your district Shared credit/responsibility for student growth Time for student growth 1-3 years
Sample Measures by KSDE from the Field Academic Measures State Assessments History and Government State Assessment ESOL State Assessment Reading State Assessment Mathematics State Assessment Science State Assessment Writing State Assessment Academic Measures Not State Assessments Common Academic Assessments ACT/SAT scores Aimsweb AP scores CETE Formative Assessments DIBELS District wide Common Assessments Fitness Grams Lexile Scores Measures of Academic Progress (MAP) Other Academic Assessments Student constructed response with rubric for assessment KWIET portfolio Performance based measures Project Rubrics Other Student Knowledge and Skills Measures College and Career Ready Measures Industrial Certifications assessments (Technical Skills) Interpersonal communication skills (Interpersonal Qualities) WorkKeys (Career Interest Development) Other Non Academic Measures Sportsmanship rubric Life skills (nutrition, physical activity) Occupational therapy skills 21st century skills Library usage (using library tools to find resources)
Sample Measures for Building Leaders Evaluation Percent of growth of Program- Enrollment/Participation Amount of time engaged with data material online products Anecdotal Notes Artifacts Attendance Data Awards and Accomplishments PE Attendance Career Readiness/Success Rates past Graduation Building test Scores Report Card Data Classroom Observations Preformed Climate Surveys Communication of Professional Information Contact Log Discipline Data Dual Credit Course Enrollment Engagement with families Extended Learning Opportunities Graduation Rates Increased # of research-based instructional practices implemented Instructional Coach - # of times in the classroom Involvement in professional organizations # of student involved in extracurricular activities Number of students who went to college Parent Involvement
Multiple Measures Recent Developments Focus Groups provided a list of possible measures KSDE collaborates with REL to modify list of measures - Collected KSDE will identify a default list of measures See Measures Chart KSDE will identify a default matrix of significant See Examples KSDE Flexibility Waiver work
Multiple Measures Currently Used Examples Should Coincide Use Multiple Measures including student growth as significant factor. State Assessments must be used. Other Default Measures May Include: Student Portfolio s Common Assessments MAPS Lexile Reading Scores
Other Multiple Measures We are looking at data that measures more than just academic preparedness, such as 21 st Century Skills Critical Thinking Employability Technical Skills SBoE has previously approved the College and Career Ready definition.
Builder Leaders and District Leaders Co-Construct the Educator Evaluation Multiple Measures District Selections from default list or KSDE other approved measures Validation REL, KSDE content area specialists, or LEA able to meet valid and reliable criteria Significant Student Growth Determining significant Matrix, Other Samples Establishing timeline for growth Student Growth Percentile
Significance Definition The change in student achievement for an individual student between two points in time, determined using multiple measures To include gains and progress toward postsecondary and workforce readiness To include progress in academic and functional goals in an individualized education program or meeting academic student growth objectives
5th Grade Curriculum Standards 5.00 4.12 4.11 4.10 4.09 4.08 4.07 4.06 4.05 4.04 4.03 4.02 4.01 4.00 85% 85% Aug Sept Oct Nov Dec Jan Feb March April May Assuming 85% of students exiting 4 th grade accomplished 4 th grade curriculum, the expectation would be at least the same amount of growth would occur by completion of the 5 th grade, or on any given measure used. Example: In a class of 24 students, 20 students would be above the Grade Level Expectation line by the end of the Academic Year. 24 x.85 = 20.2 This scenario would indicate significance. Reference: Blue Print for Reform
Graduation Rates/Attendance Rates 100% 90% 80% 70% 60% 50% 40% 30% 20% 2009 2010 2011 2012 2013 10% 0% High School 1 High School 2 High School 3 High School 4 High School 5 State Graduation Rates
16
Suggestions for Using Multiple Measures Note: Multiple Measures are only part of the Educator Evaluation 17
Evaluation Goal Selection District Goals Building Goals Individual Goals It is recommended that each Educator selects two goals per evaluation cycle: A district or building level goal, A personal goal mutually agreed upon by the Evaluator and the Evaluatee.
Multiple Measures and Significance Summary Teachers and Leaders evaluations include multiple measures as evidence. Significance refers to the need to demonstrate student growth using MORE than one measure.
Multiple Measures Summary Must consider state assessments May include assessment measures currently in use in your district Significance must be pre-determined for any appropriate measure Districts determine credit/responsibility for student growth (This was asked of the TIK II Group) Time for student growth 1-4 years
Inter-Rater Reliability DEFINITION: Reliability refers to the consistency of an assessment. VALIDITY vs. RELIABILITY: Factual vs. Consistent EXPECTATION: School district evaluators attend professional learning activities that address the issue of reliability relative to using the KEEP Rubrics. The same expectations apply to districts using an evaluation system other than KEEP.
Evaluating the Building Leader Thinking through and discussing the Process - readiness per year? Multiple Measures selected? Timeline for Evaluation? 1 Cycle 2 Cycles
Building Leader Process May 2013 Handbook, page 32 Required Steps Implementation Ideas
Building Leader Constructs
Building Leader Rubric
Repository Processes A Repository is NOT??? ANSWER: NOT entire KEEP process. How is a Data Repository used? USES Holds DATA Generates Reports Access for Educator Involvement Unified System Organizational Tools
Building Leaders Assessment Rubric
Assessment Rubric Comments, File, Save and Print
Assessment Rubric with 1 Goal Checked and I have completed my self assessment checked
Assessment Rubric with Comments Box filled and Artifact Uploaded
Goals Select Goals, Write Text for Expected Outcome, Add
Goals After Adding, then Complete and Save, can Print
Artifacts Select Component and Source of Evidence
Artifacts Ready to Upload
Artifact Uploaded in table
Cycles of Conferences - Beginning, Mid, End
Summary Rating Sheet Construct #1
Summary Rating Sheet Construct #2
Summary Rating Sheet Construct #3
Summary Rating Sheet Construct #4
Summary Rating Sheet Signatures
NEW!! KEEP Guided Practice New Online Training Individualized and Repeatable Will include multiple forms of Learning Will be available from a link on the KEEP Webpage To be Released in July 2013
The KEEP Webpage http://www.ksde.org/default.aspx?tabid=4400 1. News and Announcements 2. KEEP Repository Registration 3. KEEP Training Materials and Schedule 4. Assurances Information 5. Kansas Flexibility Waiver Materials 6. Archives with Materials of Previous Trainings and Meetings
Questions?? Contacts: Bill Bagshaw, Assistant Director Teacher Licensure & Accreditation bbagshaw@ksde.org 785.296.2198 Kayeri Akweks, Education Program Consultant Teacher Education and Licensure kakweks@ksde.org 785.296.5140