Georgia Milestones Assessment System Preplanning July 2014 DRAFT

Georgia Milestones Assessment System Preplanning July 2014 DRAFT

Goals for this Session: By the end of this session, participants will be able to: 1. Explain the composition and purpose of the Georgia Milestone Assessment System (GMAS); 2. Outline the specific types of items that students can expect on the exam; 3. Identify ways to find resources to support and prepare students for the Georgia Milestone Assessment System; 4. Discuss with colleagues ways in which they can create similar assessment items for student practice; 5. Discuss with colleagues how GA students performed on the pilot of the Next Generation assessment items and make a plan to ensure stronger results for APS' students.

Our Assessment Landscaping is Changing From a set of long-standing, mature programs -Districts, schools, students, parents, and the public are familiar with and know what to expect This transition provides Georgia with an opportunity -However, as with any change, there will be periods of uncertainty and discomfort

What is the Georgia Milestones Assessment System? The Georgia Milestone Assessment System known as Georgia Milestones will replace the CRCT, EOCT and Writing Assessment, beginning in the 2014-15 school year. The 3,5 and 8 th grade Writing Assessment and the CRCT-M will no longer be administered. This test will offer consistent expectations and rigor to position Georgia students to compete with peers nationally and internationally

Georgia Milestones Assessment System Increase expectations for student learning and achievement; Embed norm-referenced items to provide a national comparison; Align expectations with other external measures to send consistent signal of how Georgia students are doing compared to their peers; and Involve University System of Georgia (USG) and Technical College System of Georgia (TCSG) in the development to ensure the assessments signal college and career readiness.

Comprehensive, Coherent, Consolidated Single program; not a series Combine ELA, Reading and Writing into one assessment. Consistent expectations and rigor to position students to compete nationally and internationally Georgia has the lowest achievement expectations in the nation [cut scores]; but we do not have the lowest performance in the nation. Consistent message about students preparedness for the next level and their achievement within systems and external (NAEP, PSAT, SAT, ACT)

Georgia Milestones Assessment System Grades 3 8 th Georgia Milestones End of Grade (EOG) tests will be administered in language arts, mathematics, science and social studies. High School Georgia Milestones End of Course (EOC) tests will be administered in 9 th Grade Literature and Composition, American Literature and Composition, Coordinate Algebra, Analytic Geometry, Physical Science, Biology, US History and Economics.

How will the Georgia Milestones be Administered? The Georgia Milestones will transition to an online administration over a five year period. In Year One, 30% of students are expected to take the tests online. By Year Three, 80% of students are expected to take the tests online. By Year Five, 100% of students are expected to take the tests online. Paper/pencil versions will be available for the small number of students who cannot interact with computers due to their disability. Braille forms will be available.

Key Points to Remember New program; not reinvention of the CRCT Online testing protocols will need to be developed to support open ended test items Growth percentiles will continue to be calculated Reporting timelines will likely be delayed because of the technical work which will need to occur

Key Points to Consider Impact of the review of content standards that the governor has requested is unknown o would not introduce completely new content standards o might be some shifts in grade levels o assessment will reflect any changes Calculators will be allowed on certain assessments and at certain grade levels; policy will be shared once it has been finalized Scores will be delayed the first year Funds are being allocated to address the infrastructure from the state level; districts will be responsible for the devices for assessment purposes

What Types of Test Items Will be on the Georgia Milestones? Constructed-response in ELA and mathematics Selected response items in all content areas Evidence-based selected response in ELA Extended response in ELA and Mathematics A writing component (in response to text) at every grade level and course within the ELA assessments Norm-referenced items in every grade and content area to complement the criterion-referenced information and to provide a national comparison Technology-enhanced items, beginning 2016-17.

Reading/ELA Assessment Item Multiple-Parts Text Dependent Questions Deeper Understanding

Mathematics Assessment Item Scaffolded Constructed Response Students explain their responses Students show work

Time to Reflect... Turn and talk to the teachers at your table: How are these items different from CRCT test items (Coach books, practice test items used in the past, etc.)? What must we do differently, as part of our assessment practices?

How Do We Prepare for the Georgia Milestones? Content standards should be used to drive instruction including frameworks, formative lessons CRCT Readiness Indicators Provides a good idea as to who will struggle A score of 800 will not be sufficient in the future Lexile Levels

CRCT Readiness Indicators: Reading, ELA, Mathematics Indicators were designed to send a signal to stakeholders about where students are relative to where they need to be headed Indicators provide feedback about our preparedness for the increase in rigor and expectation for student achievement that is on the horizon Feedback consists of the percent of students who achieved each readiness level state, district, and school levels for instructional planning purposes While we cannot guarantee that students who achieve the On-Track level will be proficient on the new assessment, we do know they will be better prepared and positioned to be successful.

CRCT Readiness Indicators: Reading, ELA, Mathematics For instructional planning and decision making: Needs Additional Support: The student has demonstrated that his or her command of the knowledge and skills described in the CCGPS warrants additional instructional supports. On Track: The student has demonstrated that his or her command of the knowledge and skills described in the CCGPS is sufficient; the student is on track for success at the next level. Commendable: The student has demonstrated that his or her command of the knowledge and skills described in the CCGPS is exemplary.

Time to Reflect... Turn and talk to the teachers at your table: What is the impact on how teachers provide instruction and assess student mastery? What are some specific ways in which teacher instruction and assessment will have to change to prepare students for these new assessments?

19

Overall ELA Phase I Pilot Summary Data Grade Number and Percent of Students Achieving Each Score Point Total student N/ % 0 1 2 3 4 3 475 1613 713 202 45 3048 15.60% 52.90% 23.40% 6.60% 1.50% 100% 4 323 1518 814 199 83 2937 11.00% 51.70% 27.70% 6.80% 2.80% 100% 5 367 1100 901 518 125 3011 12.20% 36.50% 29.90% 17.20% 4.20% 100% 6 155 960 811 418 111 2455 6.30% 39.10% 33.00% 17.00% 4.50% 100% 7 218 1387 1275 617 146 3643 6.00% 38.10% 35.00% 16.90% 4.00% 100% 8 264 1140 1029 338 89 2860 9.20% 39.90% 36.00% 11.80% 3.10% 100% 9-10 175 1016 783 361 81 2416 7.20% 42.10% 32.40% 14.90% 3.40% 100% 11-12 376 1018 763 196 46 2399 15.70% 42.40% 31.80% 8.20% 1.90% 100%

Overall ELA Phase II Pilot Summary Data Grade Number and Percent of Students Achieving Each Score Point 0 1 2 3 4 Total Student N/ % 3 812 1107 762 174 26 2881 28.18% 38.42% 26.45% 6.04% 0.90% 100% 4 906 1145 765 168 63 3047 29.73% 37.58% 25.11% 5.51% 2.07% 100% 5 839 948 1294 537 183 3801 22.07% 24.94% 34.04% 14.13% 4.81% 100% 6 626 1467 1028 408 86 3615 17.32% 40.58% 28.44% 11.29% 2.38% 100% 7 695 1002 1035 515 140 3387 20.52% 29.58% 30.56% 15.21% 4.13% 100% 8 1116 1534 827 391 80 3948 28.27% 38.86% 20.95% 9.90% 2.03% 100% 9-10 1262 1816 559 106 9 3752 33.64% 48.40% 14.90% 2.83% 0.24% 100% 11-12 739 1389 1175 388 131 3822 19.34% 36.34% 30.74% 10.15% 3.43% 100%

Overall Mathematics Phase I Pilot Summary Data Grade Number and Percent of Students Achieving Each Score Point Total student N/ % 0 1 2 3 4 3 771 667 373 81 36 1928 40.00% 34.60% 19.30% 4.20% 1.90% 100% 4 795 800 360 87 58 2100 37.90% 38.10% 17.10% 4.10% 2.80% 100% 5 548 513 252 124 44 1481 37.00% 34.60% 17.00% 8.40% 3.00% 100% 6 927 768 269 65 14 2043 45.40% 37.60% 13.20% 3.20% 0.70% 100% 7 896 632 243 62 11 1844 48.60% 34.30% 13.20% 3.40% 0.60% 100% 8 984 791 314 100 51 2240 43.90% 35.30% 14.00% 4.50% 2.30% 100% 9-10 798 697 186 45 27 1753 45.50% 39.80% 10.60% 2.60% 1.50% 100% 11-12 690 602 178 63 9 1542 44.70% 39.00% 11.50% 4.10% 0.60% 100%

Overall Mathematics Phase II Pilot Summary Data Grade Number and Percent of Students Achieving Each Score Point 0 1 2 3 4 Total Student N / % 3 1378 1152 539 121 47 3237 42.57% 35.59% 16.65% 3.74% 1.45% 100% 4 1323 1264 325 83 25 3020 43.81% 41.85% 10.76% 2.75% 0.83% 100% 5 1351 1049 391 64 15 2870 47.07% 36.55% 13.62% 2.23% 0.52% 100% 6 1579 1171 370 135 53 3308 47.73% 35.40% 11.19% 4.08% 1.60% 100% 7 1602 856 219 72 36 2785 57.52% 30.74% 7.86% 2.59% 1.29% 100% 8 1529 1049 619 217 88 3502 43.66% 29.95% 17.68% 6.20% 2.51% 100% 9-12 2570 1435 299 59 23 4386 58.60% 32.72% 6.82% 1.35% 0.52% 100%

Time to Reflect... Turn and talk to the teachers at your table: Discuss what you see in the data slides that were just presented. What surprises you about the data? Think about your school/class data from the previous school year. What projections can you make about your school s data, if teaching and assessment practices do not change to meet the demands of the Georgia Milestones?

Key Findings From Pilots of Formative Open-Ended Items Overall performance shortfalls Students are not familiar with these types of items Many respond DNK as in do not know Don t seem to understand the need to show their work, detail their thoughts, rationales, cite evidence to support their answer or claim Tendency is to cite answer only as if a multiple-choice item Don t read carefully and answer all parts of the question/item

Resources Sample Assessment Items Georgia OAS - https://www.georgiaoas.org/servlet/a2l PARCC - http://www.parcconline.org/samples/math SBAC - http://www.smarterbalanced.org/sample-items-andperformance-tasks/ Kentucky - http://education.ky.gov/aa/items/pages/k- PREPItems.aspx New York - http://www.engageny.org/resource/new-york-statecommon-core-sample-questions NAEP - http://nces.ed.gov/nationsreportcard/about/booklets.asp

Resources Formative Assessment Sample items: www.atlantapublicschools.us/testing Sample items available: PARCC SBAC Georgia OAS Other states (Kentucky, NY) NAEP released items GADOE Benchmark assessments GA DOE Formative Instructional Practices: http://www.gadoe.org/curriculum-instruction-and- Assessment/Assessment/Pages/GeorgiaFIP.aspx

Resources Available Soon - GA DOE Sample items specific to Georgia Milestones Ancillary support resources, such as -Content Descriptions (test blueprints) -Student Study Guides -Technology Specifications -Accommodations Guidelines -Assessment for Learning Modules [types of items to elicit evidence of student learning] -Informational videos [parents & public/educators] Focus on teaching and learning: Eliciting evidence of student learning during instruction and adjusting as needed.

Georgia Milestones In closing, some reminders: New program new development [not redevelopment] Georgia Milestones replaces the CRCT, EOCT, and Writing Assessments in grades 3, 5, and 8 o Writing, in response to text, will be assessed as part of the ELA assessment in each grade and course o The Georgia High School Writing Test (GHSWT) will be administered and remains a diploma requirement for the 2014-2015 school year

Georgia Milestones Assessment System Georgia Milestones represents a significant change and importantly an opportunity for our state. This opportunity allows us to recalibrate, as a state, and refocus on teaching and learning as a primary emphasis with assessment and accountability serving a supporting role.

Georgia Milestones Assessment System If you have questions about the Georgia Milestones Assessment System, please contact: Joe Blessing jblessing@atlanta.k12.ga.us The full recording of the GaDOE presenting the Georgia Milestones can be found at: -https://sas.elluminate.com/mr.jnlp?suid=m.b36cc562f3e222ed2 3607F67A649AD&sid=2012003