PTESS Implementation Survey on Teacher Evaluation

PTESS Implementation Survey on Teacher Evaluation Year two of implementation of the North Dakota Principal and Teacher Evaluation Guidelines Monitored through state report on model next year and AdvancED site visits

AdvancED 2018

PTEST Implementation Survey on Teacher Evaluation Conducted in April, 2017 1156 responses on teacher evaluation 898 teachers 81 certified staff 120 principals 24 superintendents 32 others

Sch Districts School Size Students ND % of Districts Student Population Stud Pop Total fo ND % of Students 40 23% 0-100 9,044 103,840 9% 40 23% 101-200 2,038 103,840 2% 38 21% 201-300 5,981 103,840 6% 45 25% 301-1,000 20,958 103,840 20% 14 8% 1,000 + 65,816 103,840 63% under 300 118 67% 18,823 103,840 17%

Responses by position and size of school by percent of position Count of 3. What is the size of your school district? Row Labels 1-300 301-500 501-1000 1000 + Grand Total Certified Staff (Counselor,Librarian, Etc) 21% 23% 13% 44% 100% Other 19% 0% 16% 66% 100% Principal or Assistant Principal 45% 14% 8% 33% 100% Superintendent or Assistant Superintendent 50% 17% 17% 17% 100% Teacher 27% 16% 7% 50% 100% Grand Total 29% 16% 8% 48% 100%

% Cross Section of Years Experience 50% Years Experience 45% 40% 35% 30% 25% 20% 0-3 4-10 11-20 21-30 15% 31+ 10% 5% 0% Certified Staff (Counselor,Librarian, Etc) Other Principal or Assistant Principal Axis Title Superintendent or Assistant Superintendent Teacher

Axis Title Survey Reponses by Model and School Size 2017 30.0% 25.0% 20.0% 15.0% 10.0% 5.0% 0.0% 1-300 K-12 students 301-500 K-12 students 501-1,000 K-12 students 1,001+ K-12 students Danielson 2.3% 1.3% 1.2% 26.8% Marshall 14.8% 7.5% 3.0% 6.1% Marzano 9.4% 7.3% 3.2% 17.3%

Was individual goal setting required of teachers? 1. No 2. Yes

PERCENT Individual Goal Setting Required (Teachers) 2017 100% 90% 80% 70% 91% 84% 60% 50% 40% 30% 64% 20% 26% 10% 0% 7% 3% 10% 8% 7% Danielson Marshall Marzano No 7% 26% 8% Unsure 3% 10% 7% Yes 91% 64% 84%

Percent Individual Goal Setting Required (Principals) 2017 90% 80% 70% 79% 77% 60% 50% 58% 40% 30% 31% 20% 21% 23% 10% 11% 0% 0% 0% Danielson Marshall Marzano No 21% 23% 31% Unsure 0% 0% 11% Yes 79% 77% 58%

Title Goal Setting by size of School District 100% 90% 80% 70% 60% 69% 65% 80% 77% 69% 70% 75% 88% 50% 40% 30% 35% 20% 10% 0% 26% 6% 0% 1-300 K-12 students 301-500 K-12 students 10% 10% 501-1,000 K-12 students Principal or Assistant Principal 23% 23% 0% 8% 1,001+ K-12 students 1-300 K-12 students 301-500 K-12 students Teacher 501-1,000 K-12 students 1,001+ K-12 students No 26% 35% 10% 23% 23% 18% 23% 7% Unsure 6% 0% 10% 0% 8% 12% 2% 6% Yes 69% 65% 80% 77% 69% 70% 75% 88% 18% 12% 23% 2% 7% 6%

TITLE Self-assessment Required (Teachers) 2017 100% 90% 80% 70% 94% 87% 77% 60% 50% 40% 30% 20% 10% 13% 4% 1% 1% 10% 3% 0% 9% 0% 0% Danielson Marshall Marzano No 4% 10% 13% Unsure 1% 3% 9% Yes 94% 87% 77% (blank) 1% 0% 0%

TITLE Self-assessment Required (Principal) 2017 100% 90% 80% 88% 85% 70% 60% 50% 40% 30% 42% 20% 10% 13% 15% 0% 0% 3% 0% Danielson Marshall Marzano No 13% 15% 42% Unsure 0% 0% 3% Yes 88% 85% 56% 56%

TITLE How Successful was this year of Implementation of the new system? 70% 60% 50% 58% 55% 56% 40% 47% 47% 47% 30% 37% 35% 33% 37% 38% 20% 25% 17% 10% 12% 13% 9% 7% 7% 6% 0% 2% 3% 4% 6% 0% Danielson Marshall Marzano Danielson Marshall Marzano Principal or Assistant Principal Teacher 1 Not successful 0% 2% 3% 7% 13% 9% 2 A little success 25% 37% 35% 33% 47% 47% 3 Quite a bit of success 58% 55% 56% 47% 37% 38% 4 Really successful 17% 7% 6% 12% 4% 6%

TITLE To what degree did evaluation sysem change your practice? 2017 60% 57% 50% 50% 48% 47% 47% 40% 30% 38% 35% 36% 36% 31% 32% 30% 27% 20% 19% 22% 10% 8% 9% 0% 5% 6% 4% 3% 3% 2% 4% Danielson Marshall Marzano Danielson Marshall Marzano Principal or Assistant Principal Teacher 1 No changes 8% 5% 9% 31% 32% 27% 2 38% 57% 36% 36% 47% 47% 3 50% 35% 48% 30% 19% 22% 4 Many changes 4% 3% 6% 3% 2% 4%

TITLE Should more training be provided? 2017 80% 70% 71% 60% 50% 54% 53% 40% 45% 39% 38% 30% 33% 35% 32% 29% 29% 27% 27% 27% 20% 19% 20% 10% 13% 9% 0% Danielson Marshall Marzano Danielson Marshall Marzano Principal or Assistant Principal Teacher No 13% 29% 20% 39% 27% 35% Not sure 33% 19% 9% 29% 27% 27% Yes 54% 53% 71% 32% 45% 38%

TITLE How Many Formal Observations? (Teachers) 2017 45% 40% 35% 30% 25% 39% 36% 34% 31% 29% 40% 35% 20% 15% 10% 17% 13% 5% 7% 6% 2% 1% 3% 2% 1% 0% Danielson Marshall Marzano Teacher 3% 3% 0 17% 34% 13% 1 39% 31% 40% 2 36% 29% 35% 3 6% 3% 7% 4 2% 2% 3% 5 or more 1% 1% 3%

TITLE How Many Formal Observations? (Principals) 2017 70% 60% 63% 50% 53% 40% 42% 30% 33% 31% 27% 20% 20% 10% 0% 0% 4% 0% 0% 7% 2% 3% 8% 6% 3% 0% Danielson Marshall Marzano 0 0% 20% 8% 1 33% 27% 53% 2 63% 42% 31% 3 4% 7% 6% 4 0% 2% 3% 5 or more 0% 3% 0%

TITLE How Many Mini (In-formal) Observations? (Principals) 2017 50% 45% 40% 46% 35% 30% 36% 36% 25% 20% 15% 25% 23% 20% 23% 18% 10% 13% 5% 8% 8% 8% 7% 4% 0% 4% 0% 6% 3% 0% Danielson Marshall Marzano 0 4% 0% 6% 1-2 25% 8% 36% 3-4 46% 23% 36% 5-6 8% 20% 8% 7-8 0% 23% 3% 9-10 4% 18% 0% 11+ 13% 7% 11% 0% 11%

TITLE How Many Mini (In-formal) Observations? (Teachers) 2017 45% 40% 35% 30% 36% 41% 38% 25% 20% 15% 25% 21% 25% 25% 18% 10% 10% 11% 11% 12% 5% 4% 0% 2% 1% 5% 3% 3% 2% 2% 2% 2% 1% 0% Danielson Marshall Marzano 0 25% 11% 18% 1-2 36% 41% 38% 3-4 21% 25% 25% 5-6 10% 11% 12% 7-8 4% 5% 2% 9-10 0% 3% 2% 11+ 2% 3% 2% (blank) 1% 2% 1%

TITLE Marshall How Many Mini (In-formal) Observations? (Teachers) 2017 45% 77% fewer than 5 mini-observations 66% fewer than 5 mini-observations + 1 formal observation 40% 41% 35% 30% 25% 20% 15% 25% 10% 11% 11% 5% 0% Marshall 0 11% 1-2 41% 3-4 25% 5-6 11% 7-8 5% 9-10 3% 11+ 3% (blank) 2% 5% 3% 3% 2%

TITLE How Many Walk-Through Observations? (Teachers) 2017 45% 40% 35% 40% 30% 34% 25% 28% 20% 22% 24% 22% 19% 15% 16% 14% 14% 10% 12% 10% 5% 8% 6% 6% 3% 5% 5% 3% 3% 0% Danielson Marshall Marzano 0 19% 14% 16% 1-2 34% 28% 40% 3-4 22% 24% 22% 5-6 12% 14% 10% 7-8 6% 6% 3% 9-10 3% 5% 3% 11+ 5% 8% 6% 6%

TITLE How Many Walk-Through Observations? (Principals) 2017 35% 30% 25% 20% 29% 21% 21% 23% 25% 25% 28% 19% 15% 17% 17% 17% 10% 12% 12% 8% 5% 7% 5% 4% 0% 3% 3% 0% Danielson Marshall Marzano 0 0% 5% 3% 1-2 8% 7% 25% 3-4 29% 12% 28% 5-6 17% 23% 17% 7-8 21% 12% 3% 9-10 4% 17% 6% 11+ 21% 25% 19% 6%

TITLE Feedback Provided Formal Observation (Principals) 2017 80% 70% 75% 60% 50% 56% 40% 30% 38% 45% 20% 21% 28% 10% 0% 10% 11% 0% 4% 7% 6% Danielson Marshall Marzano Not provided 0% 7% 6% Written 4% 10% 11% Face-to-face 21% 38% 28% Both face-to-face and written 75% 45% 56%

TITLE Feedback Provided Formal Observation (Teachers) 2017 80% 70% 75% 60% 50% 56% 63% 52% 61% 40% 45% 38% 30% 28% 20% 21% 20% 19% 20% 15% 16% 10% 10% 11% 10% 9% 0% 4% 7% 6% 8% 8% 0% Danielson Marshall Marzano Danielson Marshall Marzano Principal or Assistant Principal Teacher Not provided 0% 7% 6% 10% 19% 9% Written 4% 10% 11% 8% 8% 15% Face-to-face 21% 38% 28% 20% 20% 16% Both face-to-face and written 75% 45% 56% 63% 52% 61%

TITLE Feedback Provided Formal Observation (Teachers) 2017 80% 70% 75% 60% 63% 61% 50% 56% 52% 40% 30% 38% 45% 28% 20% 21% 20% 19% 20% 15% 16% 10% 10% 11% 10% 0% 7% 8% 8% 9% 4% 6% 0% Danielson Marshall Marzano Danielson Marshall Marzano Principal or Assistant Principal Teacher Not provided 0% 7% 6% 10% 19% 9% Written 4% 10% 11% 8% 8% 15% Face-to-face 21% 38% 28% 20% 20% 16% Both face-to-face and written 75% 45% 56% 63% 52% 61%

TITLE Feedback Provided Min-Informal Observation 2017 45% 40% 35% 38% 39% 35% 30% 25% 30% 26% 26% 28% 27% 25% 28% 31% 28% 25% 31% 28% 20% 22% 21% 22% 21% 20% 15% 17% 17% 10% 5% 7% 8% 0% Danielson Marshall Marzano Danielson Marshall Marzano Principal or Assistant Principal Teacher Not provided 17% 7% 8% 35% 31% 28% Written 26% 28% 39% 22% 17% 31% Face-to-face 26% 38% 25% 21% 28% 20% Both face-to-face and written 30% 27% 28% 22% 25% 21%

Teacher Comments Danielson How has it helped you? As a lifelong learner, I've been reflecting more frequently. As a new teacher I do think that it has helped point out areas of strengths and areas of improvements.

Teacher Comments Danielson How has it helped you? collaborate goal setting with my team has pushed us to grow together and as individuals Focusing on 2 or 3 specific areas has made adjustments and reflections easier. This has caused the growth or changes to happen more rapidly

Teacher Comments Danielson How has it helped you? I have measured things I may not have measured. It has helped me be more self-evaluative. It has also helped me feel less afraid of evaluations.

Teacher Comments Danielson How has it helped you? It held me accountable for setting and meeting professional goals Yes, absolutely. I love hearing feedback on what I can do to improve. It will make me a better teacher!

Teacher Comments Danielson What should be changed? Need peer observations. A separate evaluation tool or extension that is also geared toward special education practices Administrators need to be aware of the current best practices and whether or not their teachers are using them.

Teacher Comments Danielson What should be changed? Better PLCs, time to meet just to talk about how to improve our instruction, brainstorm solutions to current problems with other teachers. There needs to be camaraderie among teachers and there is none at our school..

Teacher Comments Danielson What should be changed? Everything I've read about walk-throughs and observations includes the visitors to the classroom always providing some sort of feedback, usually in the form of praise plus a question. I had people in and out of my room all year observing the work we were doing in my class, but I was always left wondering what they saw. What was good? What suggestions do they have? What questions do they have? What did I miss?

Teacher Comments Danielson What should be changed? Feel like observations should be drop-in as well as scheduled

Teacher Comments Danielson What should be changed? how do we evaluate or principals and supt? they need to participate is 360 evals. Quite honestly, as it was my first year teaching and getting through the year was stressful enough in itself, the extra work of making and preparing goals was overwhelming.

Teacher Comments Marshall What has helped? Allowed me to see through another s eyes what I am doing and what I could be doing better/differently Being more aware of what needs to be done

Teacher Comments Marshall What has helped? As a professional I feel that the Marshall system helps me become a reflective thinker, especially when considering instruction and modes of assessment. It gives me an open line of communication with my administrator and allows us to work together to find what best suites our learners. Our ideas together help drive instruction in my classroom and measures my professional progress accurately and fairly.

Teacher Comments Marshall What has helped? Face-to-face feedback has been most beneficial for me at a teacher. I was given specific and direct feedback on how to improve. Completing a self assessment helped me be mindful of what is expected of me.

Teacher Comments Marshall What has helped? Goal setting and visiting with another set of eyes that goes into many classrooms is very helpful. good self reflection I appreciate the goal setting. I gives a focus of things to improve upon.

Teacher Comments Marshall What has helped? I have not been evaluated in 5 years. I think it creates a lot of unnecessary stress. I do like the idea of the walk-through and quick eval sessions though. When I look at the evaluation tool itself, I find it too much. It hasn t. She doesn t observe, then fills out an evaluation that has no merit

Teacher Comments Marshall What has helped? I'm a tough critic on myself. Personal goals are what make me grow. It gives me time to talk/visit with my principal about aspects of the classroom It has made me aware of the differentiated learners in my room.

Teacher Comments Marshall What has helped? Marshall eval should have at least 10 mini observations to be effective. I've heard many teachers say they have had one. Last year I had one. This year I've had 2 for sure, and maybe a couple pass-bye check ins during the passing period just to ask "what are you doing in class today". To be effective, it must be used as recommended, otherwise it doesn't fir the Marshal eval model.

Teacher Comments Marshall What has helped? The Marshall rubrics are EXCELLENT! They present an extremely well-rounded view of the characteristics of a great teacher. By having us score ourselves on the Marshall rubric at the beginning of the year, it reminds us of what we should be doing throughout the year. I keep my self-assessment and then when I re-assess at the end of the year, I can compare areas that I feel that I've grown in. I also love taking the self-assessment Marshall rubric and comparing it with my principal's rubric. It incites excellent discussion about areas of discrepancies. This process is a great improvement over the "formal" evaluation model, which involved a pre-scheduled eval. day and a discussion that related ONLY to the lesson. In the the Marshall model, we get to discuss all aspects of my teaching, and this has been extremely valuable.

Teacher Comments Marshall What should be changed? A new evaluation process for Specialist and Special Ed. Teachers A way to make it for time efficient for administrators. Better understanding of what is on the Marshall model

Teacher Comments Marshall What should be changed? Any sort of evaluation would help. There is absolutly no accountibility in our administration. It is all teacher driven if any sort of professional development plan is to be implemented.

Teacher Comments Marshall What should be changed? Actually do the evaluation as it's meant to be done. If an administrator can't get to my room 10 times for 5-10 minutes or 1 time for 30-60 minutes, they have no right to tell me they have any teaching advice to give that is specific to how I run my classroom.

Teacher Comments Marshall What should be changed? Face - to - face discussion of mini observations Goal setting and a follow-up on the goals set I think it would help to have a mid-year check in. I think we should be using more technology (i.e. recording lessons, etc.)

Teacher Comments Marshall What should be changed? More collaboration time. more info on the Marshal The evaluation is very subjective. The principal also did not even remember what they had given me on the first evaluation. So, they didn't realize that the scores dropped or have a reason why.

Teacher Comments Marshall What should be changed? The rubric leaves a lot to interpretation and I disagree with some of the criteria that makes a teacher effective. I don't think that permitting a student to take a test as many times as necessary is best practice. There should be goals set and they should continue across years

Teacher Comments Marshall Other Comments? getting my principal into my classroom more often I thought we were suppose to get observed up to 10 times. Perhaps further explanation from someone outside the school would be helpful or more information from someone outside our school in some form.

Teacher Comments Marshall Other Comments? Why aren't teachers given the opportunity to evaluate administrators with a similar evaluation model? Continual growth is impossible. I will always strive to do better, but I don't see how continual growth is possible forever. That's a ridiculous expectation..

Teacher Comments Marzano What has helped? aware of the good things I was doing Being more thoughtful of my goals, as well as how I am trying to improve my classroom and teaching.

Teacher Comments Marzano What has helped? By gaining feedback I see what I need to improve on. Feedback through iobservation was helpful. Helps keep me focused on the primary objective each day and helped in dealing with "gray areas".

Teacher Comments Marzano What has helped? I am doing more self evaluation on my lessons and am more aware of having the students do more self assessment also. This makes them take more ownership of their learning. I am more aware of student engagement and the strategies I use to engage my students

Teacher Comments Marzano What has helped? I get more out of when my principal evaluates me. He is honest and professional and I respect his constructive criticism. I like having the Marzano model to follow to clearly know classroom expectations I thought the growth plans were helpful.

Teacher Comments Marzano What has helped? It helps me self reflect and not become complacent. It's nit picky. Evaluator is looking at meaningless details, almost as if they are trying to find something wrong. I know we're supposed to be open for feedback, but in the big picture of what we do, the nit picky faults are insulting.

Teacher Comments Marzano What should be changed? It's nit picky. Evaluator is looking at meaningless details, almost as if they are trying to find something wrong. I know we're supposed to be open for feedback, but in the big picture of what we do, the nit picky faults are insulting. Actually, it steered me in a direction that I felt was not student centered instruction

Teacher Comments Marzano What should be changed? A clear expectation of each domain Applying to PE area Face-to-face visits Focus on less domains each year.

Teacher Comments Marzano What should be changed? I believe a grade shouldn't be given I don't feel taking teachers away from their students to 'evaluate' peers is productive. This is what administrators are trained to do. Let us teach our students.

Teacher Comments Marzano What should be changed? I like IMMEDIATE feedback after an observation - it would be nice if the results were available right away. I think a different method of evaluation would be more effective. This process is too long and unattainable.

Teacher Comments Marzano What should be changed? More examples of "innovative" performance Train evaluators on how to implement these models effectively, and also train them that nothing should be black or white in an evaluation.

Teacher Comments Marzano What should be changed? Go back to the old way of doing evaluations where the administrator came in, observed you teaching a whole lesson and the reflection was a written comment piece instead of it being a grading scale as to how many of the key components were touched on in a twenty minute period of time. The evaluation should look at the teacher over a period of time just like we look at our students. A twenty minute observation once or twice a year shouldn't define a teachers ability to teach effectively. Teachers need to feel supported all year long.

Teacher Comments Marzano What should be changed? Actual informative feedback. Marazano is ineffective as a teacher evaluation format. Having the principal report on the classroom activities and then discuss with the teacher is much more effective. Number scales are not beneficial to anyone. Principals who frequent the classrooms know what is occurring and should know what is or is not occurring in a classroom. Teachers should not be informed in advance of a visit. The visit is then contrived.

Teacher Comments Marzano What should be changed? Formal administrative observations always seem to pose an awkward scenario in general, I don't wish to speak for everyone, but I don't think many would disagree. I feel like the unannounced, more frequent, but more brief visits illustrate a truer snapshot of the teaching and learning taking place in a class. It would be great to see those visits, noted and compiled, then examined in a professional growth portfolio.

Implications from the Survey?