Partnership for Educator Preparation Meeting #14 March 27, 2019 If you are joining by phone and computer, please link your phone number and video. You can do so by going to Audio Options, choosing Telephone Audio, and following the directions in the pop up box.
Today s Agenda 2 1 Welcome, objectives and agenda 10 min 2 Status updates and plan for PEP in 2019 25 min 3 4 5 Principal Preparation Program Indicators and Measures Illinois Preparation Profile Continuous Improvement and Accountability System Illinois Preparation Profile Public Reporting in 2020 and Beyond 15 min 80 min 45 min Next Steps --
Today s meeting objectives 3 PEP Members will: Review and provide feedback on Principal Indicator Guide Review example performance measures and data from the Illinois Preparation Profile Continuous Improvement and Accountability System Provide recommendations for timing and release of public reports Provide recommendations for ISBE research and future metric development
Norms 4 Push and probe each other s thinking respectfully Seek to understand context and look for general principles that apply Name the perspective you bring Equity of voice Openly share resources and ideas Add questions to the chat box, when appropriate
ISBE: Vision, Mission and Goals 5 VISION Illinois is a state of whole, healthy children nested in whole, healthy systems supporting communities wherein all people are socially and economically secure. MISSION Provide leadership and resources to achieve excellence across all Illinois districts by engaging legislators, school administrators, teachers, students, parents, families, and other stakeholders in formulating and advocating for policies that enhance education, empower districts, and ensure equitable outcomes for all students.
ISBE: Vision, Mission and Goals 6 GOALS Every child in each public school system in the State of Illinois deserves to attend a system wherein All kindergartners are assessed for readiness. Ninety percent or more of third-grade students are reading at or above grade level. Ninety percent or more of fifth-grade students meet or exceed expectations in mathematics. Ninety percent or more of ninth-grade students are on track to graduate with their cohort. Ninety percent or more of students graduate from high school ready for college and career. All students are supported by highly prepared and effective teachers and school leaders. Every school offers a safe and healthy learning environment for all students.
The Whole Child 7 A child within an ecology of multiple and interconnected parts nested in overlapping systems Cognitive Community Social School Home Physical Emotional
Today s Agenda 8 1 Welcome, objectives and agenda 10 min 2 Status updates and plan for PEP in 2019 25 min 3 4 5 Principal Preparation Program Indicators and Measures Illinois Preparation Profile Continuous Improvement and Accountability System Illinois Preparation Profile Public Reporting in 2020 and Beyond 15 min 80 min 45 min Next Steps --
Since the last PEP Meeting, ISBE launched the spring data collection phase 9 Spring Data Collection System Development
and has continued to develop and refine the Annual Progress Reporting (APR) 2.0 system to improve the collection process. 10 Spring Data Collection System Development
In 2019, PEP will meet at strategic intervals to support ISBE in the final pilot year Data collection window ISBE releases reports to programs ISBE prepares the system for full implementation in 2020 Mar Apr May Jun Jul Aug Sept Oct Nov Dec 2019 Spring (Virtual) PEP Meeting to: Discuss Principal guide Review some of the accountability structure Provide recommendations on communications Discuss potential future research Late Summer (F2F) PEP Meeting to: Review 2020 IPP continuous improvement and accountability system with contextual data Winter (Virtual) PEP Meeting to: Review draft public reports Provide recommendations on communications and messaging
Q & A: Vision and Strategy for 2019 12
Today s Agenda 13 1 Welcome, objectives and agenda 10 min 2 Status updates and plan for PEP in 2019 25 min 3 4 5 Principal Preparation Program Indicators and Measures Illinois Preparation Profile Continuous Improvement and Accountability System Illinois Preparation Profile Public Reporting in 2020 and Beyond 15 min 80 min 45 min Next Steps --
Discussion #1: ISBE, with the support of Matt Clifford and the PPP Subcomittee, has also drafted the Principal Preparation Indicators Guide 14 What are your reactions to the draft Principal Preparation Program Guide? Thank you to Matt Clifford and to the PPP Subgroup for their thoughtful efforts in supporting the development of this guide
Discussion #1: Whole group discussion notes 15 10 min What are your reactions to the draft Principal Preparation Program Guide?
Today s Agenda 16 1 Welcome, objectives and agenda 10 min 2 Status updates and plan for PEP in 2019 20 min 3 4 5 Principal Preparation Program Indicators and Measures Illinois Preparation Profile Continuous Improvement and Accountability System Illinois Preparation Profile Public Reporting in 2020 and Beyond 15 min 90 min 45 min Next Steps --
The Annual Program Reporting System that ISBE is building, with the support of the PEP committee, seeks to serve the following three capacities: 17 Educative Equitable Restorative
ISBE has begun developing a report that illustrates the continuous improvement and accountability system, based on PEP feedback and suggestions in 2018 Report will be the focus of Summer PEP meeting. Feedback cycle in Summer- Winter 2019 includes: ISBE PEP IHEs 30 day Public Comment
Most of the indicators (13) will be considered in the 2020 IPP Continuous Improvement and Accountability System 19 As a reminder, each domain is comprised of three to six indicators that specify the various aspects of programs performance that are to be measured. There are a total of 18 proposed indicators for the IPP Continuous Improvement and Accountability System. There are eleven indicators that ISBE already collected or for which data was readily available. ISBE identified three indicators that were not previously collected, but will be available in 2020. ISBE will continue to pursue the remaining five indicators for a comprehensive Continuous Improvement and Accountability System IPP release in the future.
ISBE has made progress towards collecting some of the indicators that are currently unavailable 20 2020 Indicators Collection Context Impact on K-12 Students ISBE is exploring the use of PARCC/IAR data for those programs that prepare teachers tested areas (ELA and MATH 3 rd -8 th grade). Preparedness, Completer Survey Data only available 2017-2018 and 2018-2019. Preparedness, Novice Teacher Survey Future Indicators Teaching Promise Preparedness, Novice Teacher Survey Preparedness, Supervisor Survey K-12 Perceptions of Teachers Persistence in Teaching- Beyond year 5 Beginning December 2019, a link to the novice teacher survey will be embedded into the 5Essentials survey for identified novice (2 nd year) teachers that completed educator preparation programs in Illinois. Data will be collected until April 30, 2020 and will be reported to EPPs in June 2020. Progress towards Collection A working group of 15 individuals from EPPs are collaborating to identify common elements embedded within current disposition survey administered across educator preparation. Recommendation for this indicator will be provided to ISBE this summer. Beginning December 2019, a link to the novice teacher survey will be embedded into the 5Essentials survey for identified novice (2 nd year) teachers that completed educator preparation programs in Illinois. Data will be collected until April 30, 2020 and will be reported to EPPs in June 2020. ISBE is exploring how to leverage a system to track the completion of surveys for identified novice teachers. May include pursuit of this survey data during 5 Essential collection period. The K-12 Perceptions of Teachers indicator as defined by TPA recommendations cannot be captured. ISBE is exploring the inclusion of applicable 5Essentials Survey data to be used for continuous improvement not accountability. ISBE does not have the volume of data in 2020 to satisfy this indicator.
ISBE has provided brief look at four indicators and performance measures. As we walk through them, keep this question in mind: 21 How might you recommend ISBE approach combining programs with small N-sizes in this structure? Note: Currently we only have 3 years of data collected. In 2020 data set will include 5 years (2014-2015 through 2018-2019). Example: ISBE might combine all Foreign Language Programs at an IHE to create a composite measure of >10
Program and Provider Context 22 PROGRAMS: 607 total programs (2014-15 through 2016-17) 321 programs (53%) completed 9 or less candidates across 3 years, Of those, 237 programs (40%) completed 5 or less candidates across 3 years, and Of those, 128 programs (21%) have an average of 1 completer per year Projection: In 2020 40% of programs will complete <10 candidates across 5 years (2014-15 through 2018-19). PROVIDERS: 57 total providers (2014-15 through 2016-17) 38 providers (67%) complete 100 or less candidates a year, 30 providers (53%) complete 60 or less candidates a year, Of those, 22 providers (39%) complete 30 or less candidates a year, Of those, 12 providers (21%) complete 20 or less candidates a year, and Of those, 5 providers (9%) complete 10 or less candidates a year *Candidates across all programs at an IHE
Candidate Selection-Academic Strength-GPA 23 Indicator Name Academic Strength-Candidate Entry GPA Reported here is the percentage of candidates enrolled in a preparation program that had a cumulative GPA of 3.0 or higher upon entry to the Indicator Description institution as a whole, in the last three years (14-15 through 16-17). GPA is inclusive of most recent GPA prior to entry including high school or college. Minimum Standard 67% State Target 100% Programs Impacted Number of Programs Impacted: 49 programs out of 607 (8%) Not reported due to n-size <10: 321 programs (53%)
Candidate Selection-Academic Strength-Institution Admission Test 24 Indicator Name Academic Strength-Candidate Entrance Test Reported here is the cohort average of candidates enrolled in a preparation program (at an institution that requires ACT, SAT, GRE or Indicator Description MAT upon admission) that scored at or above national average 1 for test completers on the ACT or SAT or GRE or MAT over the last five years 2 in the last three years (14-15 through 16-17). Minimum Standard 67% State Target 100% Programs Impacted Number of Programs Impacted: 15 programs out of 607 (2%) Not reported due to n-size <10: 321 programs (53%) 1 National average for each test is considered to include the most current national average for the report year. Date of test administration is not collected. 2 SAT test redesign occurred during the 2016-2017 academic year. 2014-2015 through 2015-2016 includes a range of up to 2400. 2016-2017 through 2018-2019 includes a range of up to 1600. Date of test administration is not collected.
Knowledge and Skills for Teaching-Mastery of Teaching Subjects (Content Test) 25 Indicator Name Indicator Description Mastery of Teaching Subjects Reported here is the percentage of candidates who passed the content area exam on the first attempt, second, and third or more attempts, in the last three years (14-15 through 16-17). Minimum Standard 80% State Target 100% Programs Impacted Number of Programs Impacted: 44 programs out of 607 (7%) Not reported due to n-size <10: 321 programs (53%)
Knowledge and Skills for Teaching-General Teaching Skill (edtpa) 26 Indicator Name Indicator Description General Teaching Skill Reported here is the percentage of candidates who passed the edtpa area exam on the first attempt, second, and third or more attempts, in the last three years (14-15 through 16-17). Minimum Standard 80% State Target 100% Programs Impacted Number of Programs Impacted: 54 programs out of 607 (9%) Not reported due to n-size <10: 321 programs (53%)
State Performance for Selected Indicators 27
Clarifying questions? 28
Discussion #2: In small groups, discuss 29 10 min How might you recommend ISBE approach combining programs with small N-sizes in this structure? Note: Currently we only have 3 years of data collected. In 2020 data set will include 5 years (2014-2015 through 2018-2019). Example: ISBE might combine all Foreign Language Programs at an IHE to create a composite measure of >10
Discussion #2: Whole group discussion notes: 30 How might you recommend ISBE approach combining programs with small N-sizes in this structure?
Moving forward: Prioritization 31
Discussion #3: In small groups, discuss 32 10 min How would you rate the four domains in order 1-4? Which domain is most important? Why? Do you believe that any are of equal importance? Why?
Whole group discussion notes: 33 Candidate Selection Click to add text Performance as Classroom Teachers Click to add text Candidate Knowledge Selection and Skills for Teaching Contribution to State Needs Click to add text Click to add text
Finally, as the state transitions from pilot to full implementation, ISBE plans to seek out research support to answer key questions 34 Potential Research Topics How might ISBE obtain more reliable comparable teacher performance data? Are there any structural differences (program policies, procedures, etc.) between the highest and lowest performing IL programs? How do IL candidates with lower academic skills (GPA, test scores, etc.) perform in comparison to candidates with higher academic skills? Are there any correlations between edtpa score and other accountability measures?
Discussion #4: Whole group discussion 35 20 min What are your reactions to the proposed research questions? What other areas should ISBE consider investigating?
Discussion #4: Whole group discussion notes 36 What are your reactions to the proposed research questions? What other areas should ISBE consider investigating? Notes Potential Research Topics How might ISBE obtain more reliable comparable teacher performance data? Are there any structural differences (program policies, procedures, etc.) between the highest and lowest performing IL programs? How do IL candidates with lower academic skills (GPA, test scores, etc.) perform in comparison to candidates with higher academic skills? Are there any correlations between edtpa score and other accountability measures?
Today s Agenda 37 1 Welcome, objectives and agenda 10 min 2 Status updates and plan for PEP in 2019 25 min 3 4 5 Principal Preparation Program Indicators and Measures Illinois Preparation Profile Continuous Improvement and Accountability System Illinois Preparation Profile Public Reporting in 2020 and Beyond 15 min 80 min 45 min Next Steps --
Beginning in 2020, ISBE will release public reports for educator preparation programs statewide 38 2019 In 2019 ISBE will engage PEP subcommittee to support the design and development of a mock report. Partnering with North Third Statewide feedback from EPPs Fall 2019 PEP feedback Winter 2019 2020 Communication Plan 2020 In 2020, data reports will be publicly available that will include qualitative and quantitative data and information about colleges and universities with approved preparation programs aligned to 13 performance indicators and measures. Primary Content-Teaching Phased in Content-Administrative and School Support Personal
ISBE plans to release reports at varying grain sizes to meet the needs of various audiences 39 Public Reports Statewide Report IHE Report Designed for Potential Audiences Teacher Candidates Parents School and District Staff Program Report Policymakers Media
2020 proposed public report release Illinois Preparation Profile (IPP) Data collection window (18-19) Public Context ISBE Context Review & Finalize Public Reports IPP Release 9/1/2020 Jan Feb Mar Apr May Jun Jul Aug Sept Oct Nov Dec 2020 2020 reports will include past five years of data (14-15 through 18-19). The design is in development but will include: Tier at each domain Classification of each Program or each IHE Programs that have a low n-size, are discontinued or are recently approved may not receive a report. *Tier *Classification *% of Points Possible 4 Exemplary 70% -100% 3 Satisfactory 55%-69% 2 Developing 40%-54% 1 Low Performing 0%-39% *Example Only
41
In small groups: 42 15 min Discuss how the proposed plan addresses the needs of each target audience. Group Assignments: Group 1 Policymakers & Media Group 2 Teacher Candidates Group 3 School and District Staff Group 4 Parents and the General Public Consider: When is your audience making key decisions or taking action? Will the reports be available at the right time for your audience to use them? What other events might your audience be paying attention to? What key messages should ISBE keep in mind for your audience?
Whole group discussion notes: 43
Today s Agenda 44 1 Welcome, objectives and agenda 10 min 2 Status updates and plan for PEP in 2019 25 min 3 4 5 Principal Preparation Program Indicators and Measures Illinois Preparation Profile Continuous Improvement and Accountability System Illinois Preparation Profile Public Reporting in 2020 and Beyond 15 min 80 min 45 min Next Steps --
Next Steps 45 Full Group Our next meeting will be in the Late Summer and will focus on the Illinois Preparation Profile Continuous Improvement and Accountability system as a whole. Subcommittees We plan to engage the principal and APR subcommittees throughout the spring and summer. Meeting details forthcoming.
46 Thank you! Please complete your exit slip before you log off.