Starting the Conversation about Feedback Jennifer Marten Plain Talk About Reading February 9-11, 2015 New Orleans
About the Presenter Jennifer Smithers Marten Jennifer Smithers Marten is the gifted and talented coordinator and online school coordinator for the Plymouth Joint School District in Plymouth, Wisconsin. She is part of the district s Professional Development Council, helping to develop building an district level professional learning. Jennifer holds a BA in Education from the University of Dallas, a Master s in Education and Teaching from The University of Texas at Arlington, and has earned National Board Certification. She is currently working toward a PhD in Curriculum and Instruction Leadership at Marian University in Fond du Lac, Wisconsin. About CDL Founded in 1992, the Center for Development and Learning (CDL) is a results-driven 501(c)(3) nonprofit organization. CDL s mission is to improve the life chances of all children, especially those at high risk, by increasing school success. We believe that all children, regardless of how they look, where they come from, or how they learn, can and will achieve school success when provided with highly effective teachers and positive, supportive learning environments. CDL s services fall into three silos: 1. Evidence-based professional development for teachers, principals, teacher leaders, related specialists, paraprofessionals, parents and caregivers 2. Direct services to students 3. Public engagement of stakeholders at all levels CDL s professional learning services comprise approximately 85% of our work. For over 18 years, we have been a trusted source of specialized professional learning services for educators. CDL s professional learning is designed, facilitated, evaluated and adjusted to meet the needs of the learners. In collaboration with school and district leaders and teachers, we examine student and teacher data and build professional learning in response to student and teacher performance. We evaluate progress frequently and adjust accordingly. We have special expertise in literacy, building collaborative capacity, leadership and talent management, high-yield teaching strategies and tactics, differentiated instruction, and learner-specific instruction. Call us we are ready to serve you. One Galleria Blvd., Suite 903 Metairie, LA 70001 Phone: (504) 840-9786 Fax: (504) 840-9968 Email: learn@cdl.org Web: www.cdl.org
Star ng the Conversa on About Feedback All of the resources referenced in this presenta on can be found on my weebly Feedback as a Teaching Strategy h p://feedbackasateachingstrategy.weebly.com/ Jennifer Smithers Marten GT Coordinator/Online School Coordinator Plymouth Joint School District Plymouth, Wisconsin Think- Pair- Share What is your biggest frustra on with giving students feedback? Why do I take the me to write comments on their papers? The students who need it, don t read it. 1
A Li le Bit of Research (Butler, 1988) Even the good kids just flip through to find the grade. Students who received specific feedback tailored to their performance showed significant increase in scores (almost 30%) Students who received only le er grades showed a significant decline in scores. Students that received both grades and comments also showed a significant decline in scores. "The effects of feedback depend on the nature of the feedback. Feedback can be the informa on that drives the process or the stumbling block that derails the process." ~ Susan Brookhart 2
3- point conven ons score measures Punctua on Grammar Capitaliza on Spelling 6- point composi on score measures Purpose Organiza on Content development Sentence fluency Word choice WHAT WE KNOW ABOUT EFFECTIVE FEEDBACK 3
Evalua ve Feedback Tells learners how they compare to others Provides a judgment summarizing the quality of the learning Is a direct result of summa ve assessment Descrip ve Feedback Provides specific informa on in the form of wri en comments or conversa ons Helps the learner understand what he or she needs to do to improve Is a crucial part of forma ve assessment Interven on Feedback Tells the student what needs improving Gives enough informa on so the student knows what to do next Achievement Feedback Tells the student what was done well Praises the work or process, not the student Three Ques ons Where am I going? How am I going? Where to next? Task and Product Level Indicates correct/incorrect Needs more or different responses Provides more/different informa on Relevant to task Builds task knowledge Ha e & Timperley (2007) 4
Self- Regula on or Condi onal Level Self Level Helps students iden fy feedback themselves Provides opportuni es and awareness of deliberate prac ce/effort Develops confidence to pursue the learning O en used to comfort or support O en directs a en on away from the task, process, or self- regula on Praise should not be given as part of feedback. It dilutes the power of feedback Focused Lis ng Step One: Take 5 minutes to brainstorm examples of feedback you have used in your classroom. Step Two: Take 5 minutes to sort them into Ha e s and Timperley s four levels. Just as a thermostat adjusts a room temperature, effec ve feedback helps maintain a suppor ve environment for learning. ~ Dylan Wiliam Step Three: Do you see any pa erns? How Feedback Varies Timing Amount Mode Audience Focus Comparison Func on Valence Clarity Specificity Tone Brainstorm: Feedback Varia ons Random Name Selector Think about what you teach. What are some ways you already use this feedback varia on? What are some new ways you could use this varia on? Adapted from Brookhart, Susan (2008) How to Give Effec ve Feedback to Your Students 5
Real World Examples 13 Concrete Examples of Be er Feedback for Learning Think- Pair- Share Pick one example and discuss with a partner A ributes of Effec ve Feedback Clear Builds Trust User- friendly Specific Focused Differen ated Timely Invites Follow- Up Tomlinson & Moon, 2013 Ques oning Techniques Closing the Gap Feedback Feedback Starters 10 Points for Giving Construc ve Feedback Five Powerful Ques ons Teachers Can Ask Students Twelve Ac ve Learning Strategies Feedback Forms & Videos I Like, I Wish, I Wonder Four, Three, Two Bounce Card Glow and Grow SWOT Analysis Stars & Stairs Feedback Sandwich Feedback Sandwich Scaffold P.A.T.S on the Back ABC Feedback Model Online Op ons Voice Comments on Google Docs Evernote Educlipper App Kidblog Schoolology Student- To- Student Feedback Rubric to Decide on Appropriate Peer Feedback Rubric Source: Ha e, John. Visible learning (p. 149) 2012 Used with permission of Routledge, an imprint of the Taylor and Francis Group Pyramid - A 3D organizer that helps students contrast, reflect, and predict. It is a great way to refocus in the middle of a lesson/unit. Kind, Helpful, Specific - would make a great wall graphic Five Simple Ques ons (Thanks to @mrkempnz & @Jus nrushton for sharing this via Twi er) Response Partners (from a school in Merton, England during my teacher exchange in 1993) Empowering Students to Provide Peer Feedback Peer- To- Peer Feedback Receiving and Giving Effec ve Feedback The Art of Feedback: 5 Tac cs that Work Three Things to Do Before a Feedback Discussion Building Trust Through Feedback Ge ng Feedback from Students Surveys Reflec ons Notes 6
If You Could Ask One More Ques on Aus n s Bu erfly "The most powerful single moderator that enhances achievement is feedback." ~ John Ha e Let s con nue the conversa on Twi er: Blog: Skype: Websites: Contact Info @jenmarten teach from the heart jenmarten Feedback Tech in the Classroom Linkedin: jenmarten Email: jmarten@tds.net 7
13 Concrete Examples Of Better Feedback For Learning Grant Wiggins By Grant Wiggins As readers may know, my article on feedback in the September edition of Educational Leadership has been one of the most widely read and downloaded articles of the year, according to ASCD data. That s gratifying feedback! I blogged about it here, while also providing the longer article I originally provided the editors they cut my piece in half for publication, as editors are wont to do and also shared in the blog a wonderful follow-up email from a teacher on how to use the contents of the article. But numerous people have also written saying that while they liked the piece, they wished that I had provided more specific examples of how to design in such feedback, how it all works in practice. So: Voila! Below, find thirteen examples of how teachers have made feedback (as opposed to advice and evaluation) more central to their work with students: 1. In a welding class, the teacher gives students a performance task. The work is done when it is up to professional welding standards for that type of weld. The students receive a description of the standard in writing, with a drawing. But the key is the last phase. When you think your weld is up to standard, put it on this table, and sign it with the magic marker signifying it is up to standard. On the table students will also find some welds up to standard from previous years and some that are not, marked as such. I watched a boy who thought his was ready. But upon getting to the table and closely inspecting all the welds on the table, he went back to his station (having realized his was not up to standard) to work further. 2. A 6th-grade teacher of writing teaches his students to peer review and self-assess. All papers after that training only go to him for final review after the paper has first gone through the review process: a) Student gives the peer group the draft of the paper. The cover sheet states the purpose and audience of the writing, and the student asks for targeted feedback. b) The peer group reads and does 2 things notes places where purpose was best achieved and not achieved. They also mark places on the paper where they lost interest and they explain why orally to the writer. c) The writer decides which feedback (and advice) to take and which not; revises the paper, and attaches to it a self-assessment along with a brief statement as to which feedback they accepted, which feedback they rejected and why and then hand this all in to the teacher. 3. In a class of 1 st graders, pairs must create a simple map of the whole school, with concentration on a map of a room in the building. The map s success is assessed, in part, by other students ability to use the map to find something, using the map key and compass rose. After each team has had others use their map, students self-assess using a few prompts (with smiley faces or sad faces for each criterion to be circled reflecting their self-assessment as to how helpful and clear their map was. 8
4. After a 10-minute summary by the Physics professor of the textbook reading (and focused on student questions emailed in advance), college students in a class of 175 are given a multiple-choice problem related to the content (and focused on a common misconception). Students use their cellphones to vote, graphs of their votes appear on the big screen in real time, and students are asked to discuss their answers in small groups. They are not only asked to re-vote after discussion, but they are asked to vote on their confidence in their initial and final answers. The correct answer is finally revealed, a brief discussion ensues, and the process is repeated with a 2 nd problem before a summarizing mini-lecture ends the class. (The teacher has a record of each student s responses in his computer). 5. 7th-graders research and discuss the problem of pollution in science class. Then, they prepare for an oral editorial for a mock TV newscast What Should We Do About Garbage? The speech is videotaped. They review the videotape with a teacher, para-professional, or administrator. They look at two model videos. They self-assess their performance against rubrics. They propose revisions, and give the talk again. The rubric for the talk stresses the thoughtfulness of the self-assessment and the deliberate self-adjustments, not just the quality of the speech. (A similar process was used with 2nd graders in which students had to make an audio recording of a reading of a story. Fluency was the focus: students were told that the recording would be available for younger children not yet able to read.) 6. Twice a week 9 th -grade English students engage in entirely student-run discussions. The teacher graphically records the conversation, using a coding system as to the flow of conversation and in reference to key behaviors (reference to the text, interruption of people speaking, etc.) At the end of 30 minutes, she comments on what she heard and saw, and shares with students the graphical feedback. Two grades are regularly given: group grades and individual grades. (This example comes from my daughter. You can read more about the process and her other work with feedback derived from models in her blog here.) 7. 5 th -grade students are given challenging social studies tasks throughout the year. There are three rubrics: one for the quality of the final product and performance, one for the quality of the research, and one for student independence in doing the work. Students score their own work before handing it in against the rubrics. Part of their final grade reflects the accuracy of their self-assessment as compared to peer scores and teacher scores. Here is the gist of the rubric for independence: 1: student completed the task successfully with no help or hints from the teacher. 2: the student needed a minor hint (e.g. a question or indirect reminder) to complete the task. 3: the student needed 2-3 hints/cues/scaffolds to complete the task. 4: the student could only complete the task with significant prompting and cueing by the teacher. 5: Even with significant prompting, the student could not complete the task. 8. 4 th -graders take a math quiz on a computer, immediately find out which answers were correct and which incorrect once the quiz is completed, and work to correct the incorrect answers, using clues provided by the software. The final number of correct answers is reported along with how many clues were needed. Students also learn at what level of difficulty each problem is pegged and where they stand in terms of degree of difficulty generally that they can handle. 9
9. Every week in art class, middle school students have their most recent work critiqued by a team of other students in terms of criteria and purpose that the artist has put forward for the review. (The process used is a modification of the process used at the Rhode Island School of Design). 10. At the half-time of every soccer game, the coach asks the players: What s working for us? What s not working for us? What s working for the other team? Players only answer the questions, and players propose the advice that follows form the feedback on what to work on in the 2 nd half. The same questions are re-asked and discussed the next day in practice in the post-mortem of the game, with the coach asking players to re-create successes and failures in walk-thru simulations. 11. For each paper in a 4th grade class, the teacher places samples of work on past papers (same genre or prompt but different topics) onto a big archery target. The exemplars are placed in terms of to what extent they hit the target for the assignment. The teacher places the papers in the proper place, then asks students in groups to study the samples and to be prepared to explain why each paper was placed on the target where it was. Then when their own papers are finished, they must post it where they think it best belongs on the target. 2 students provide feedback on this selfassessment by either placing a check mark or an arrow (the direction of the arrow signaling whether the paper should be placed closer to the bulls-eye or further away from it). 12. For the past three years all 8th graders in a district have spent the last week of school working in teams in a simulation of the UN Development Grant funding process. Teams represent countries trying to convince a panel (adult judges brought in and trained for the work by project coordinators) to fund their ideas. Students get feedback from other students during the week; look at models and non-models of past presentations; teachers merely observe unless their is a pressing need to intervene. The judges give detailed feedback against rubrics for the quality of the presentation and ideas. The winning country gets to Skype with staff from the White House and the UN. (Though no final letter grade is given for the work, the students work with enormous energy and focus, in the last week of school. I can vouch for it: I have been a judge twice and an observer of the work in progress each year. Contact Mark Wise in West Windsor Plainsboro Schools of NJ for further information.) 13. Every Friday, teachers collect index cards in response to two questions they pose to their 6th graders: What worked for you this week? What didn t work for you this week (and why)? Teachers report back to students on Monday, with a summary of adjustments that the teachers might be making, based on the feedback. Readers: please place your own examples in the comments. This will thereby become a very useful page for educators everywhere. Oh and, of course, feedback is welcome! This article was originally published on Grant s blog; Image attribution flickr user peteselfchoose; 13 Concrete Examples Of Better Feedback For Learning 10
Levels of Feedback Task and Product Level indicates correct/incorrect needs more or different responses provides more/different information relevant to task builds task knowledge Process Level provides connections between ideas employs task strategies for identifying errors provides cues about different strategies Self- Regulation or Conditional Level helps students identify feedback themselves provides opportunities and awareness of deliberate practice/effort Develops confidence to pursue the learning Self Level comfort or support attention away from the task, process, or selfregulation be given as part of feedback. It dilutes the power of often used to often directs praise should not feedback 11