Ohio Achievement Assessments

Ohio Achievement Assessments

Definitions

Testing Group Testing Group is defined as any location within the school where an OAA test administration is being conducted.

Scorable Materials Scorable materials are the test booklets (grades 3 and 4) and answer documents (grades 5-8) in which students have recorded their responses with a No. 2 pencil.

Secure Materials All test booklets, used and unused, are considered secure materials at all times.

Overage Shipment Additional test materials, which include test booklets (grades 3 and 4), tests and answer sheets (grades 5-8), blank school/class header sheets, and the district overage security checklist.

Field Test Question

Helpful Terms OAA Ohio Achievement Assessment (formerly Ohio Achievement Test) AIR American Institute for Research contractor who develops OAA and OGT exams DRC Digital Research Corporation contractor who scores OGT exams Pearson Contractor who scores OAA exams EMIS Education Management Information System 8

Helpful Terms DTC District Test Coordinator STC School Test Coordinator BTC Building Test Coordinator DFA Directions for Administration TA Test Administrator TIDE Test Information Distribution Engine online system to order test materials managed by AIR OGT Ohio Graduation Tests 9 Note: in Community Schools, DTC, STC, and BTC refer to the same roles: Test Coordinator. The state has multiple roles for use in districts with numerous buildings, a central office, etc.

10 Test Coordinator

Week of April 5th TC receives and checks test materials: TC also will receive a shipment of overage test materials to supplement, if needed Verify total number of boxes per school School Packing Lists are provided OAA Pre-ID labels and generic labels are shipped separately 11

Before Testing TC takes inventory of district s overage shipment: Open shipment and take inventory of contents Check each item on the District Packing List* to verify receipt of correct quantity Do not open shrink-wrapped packages Check security numbers on materials received against the District Security Checklist* Complete Secure Material Resolution Form* Notify vendor of any discrepancy * Retain documentation for returning materials after testing. 12

Before Testing TC takes inventory of school shipment: Open shipment and take inventory of contents Check each item on the School Packing List* to verify receipt of correct quantity Do not open shrink-wrapped packages Check security numbers on materials received (security range sheets visible through shrink-wrap) against the School Security Checklist* * Retain documentation for returning materials after testing. 13

Before Testing TC takes inventory of school shipment: Keep materials in locked storage (secure) until day of testing Keep all boxes in which test materials were delivered to return scorable materials after testing 14

Document Non-receipt of any materials listed on packing list Discovery of damaged or defective test booklets or answer documents Discovery of missing or duplicate sequence numbers on booklets or answer documents 15

Using the Pre-ID Label Pre-ID labels are available to districts if ordered through TIDE ODE recommends affixing Pre-ID labels after the test administration; labels must be aligned carefully for machine scoring Do not place Pre-ID labels over the security number preprinted on the front of the document 16

Using the Pre-ID Label Testing time should not be used to apply the Pre-ID labels or to complete demographic information For those districts choosing not to use a Pre-ID label, all information will need to be gridded in on the back cover of the students test booklets (grades 3 and 4) or answer documents (grades 5 8). 17

Generic Labels Can be used when no Pre-ID label was created Contains district and school names and IRNs Still requires bubbling of all other information on the back of the two-sided demographic page 18

Packaging and Returning Materials Collect all test booklets or answer documents from TAs, confirming receipt of all materials distributed To avoid incorrect reporting, compare student name on front of book to name on Pre-ID label (and as gridded on demographic page, if present) Separate scorable and nonscorable materials Separate scorable materials by grade 19

Returning Scorable Materials Complete at least one school/class header sheet for each grade tested, bubbling grade and number of scorable test booklets or answer documents Header sheets are used for accountability of materials; their use is required. Double-check the count of scorable documents under each header and make sure the gridded number corresponds 20

Returning Scorable Materials (OAA) Administrator name may be gridded for school s organizational purposes but will not be reported. Testing unit (spring only) must be gridded. Return all scorable materials to the TC 21

Returning Nonscorable Materials Use Security Checklists to account for all materials. Arrange secure materials by sequence number, including any supplied by the DTC to make up for shortages. Locate special version items such as CDs and oral scripts these are secure and must be returned. Unused answer documents are not secure for OAA and should be destroyed after the test administration. 22

Returning Nonscorable Materials Manuals DTC, BTC, STC, and DFA manuals should be destroyed after the test administration Grade 8 and OGT Mathematics Reference Sheets are not secure unless they have student writing on them; if written on, they must be returned. Carriers require 24 hours notice to schedule pickups (call in advance). BE SURE THERE ARE NO SCORABLES IN NONSCORABLE BOXES; if scorables are discovered, remove and send them separately to contractor. 23

24 Test Administrator

General Information Students are not allowed to talk during the test administration. Direct students to raise their hands if they finish a test before the other students have finished. Collect their test booklets and answer documents and direct them to take out their silent work. All electronic devices (cell phone, ipod, etc.) must be collected from students prior to the test administration.

Breaks It is a security violation to have a lunch or recess break during the test administration. Breaks should be for the entire group; however, an individual student may need a break for medical reasons, and this should be noted prior to the test administration. Students under an IEP or 504 Plan or LEP students who have extended time as an accommodation should be allowed a lunch break. The students should be observed during the lunch break to ensure that they do not discuss the test The directions for providing a break are in the Directions for Administration Page 12

General Information During each test administration, a TA must be in the room at all times. If students are allowed to leave the room while testing is in progress, they must first turn in their test materials. The TA must account for all test materials before dismissing students The TA must be an employee of the district and hold a license/certificate issued by the Ohio Department of Education (ODE) For any group of more than 30 students, a monitor must assist the TA

Security Violations Reviewing the test before the administration and creating a study guide or in some way releasing the test questions to the students; Describing the test questions in a letter, discussing the test questions or photocopying the test questions prior to the public release of the test questions Standing by a student s desk and indicating in some manner that the student s answer is incorrect, blank or deficient; Reviewing different test booklets or discussing the forms of the test to compare field-test questions.

Security Violations Discussing test questions with colleagues or students after the test has been administered but before the test is released to the public which may affect students who were absent or allow students to change answers on a test in the same booklet Describing the test questions in a letter, discussing the test questions or photocopying the test questions prior to the public release of the test questions Altering a student s response after the student has turned in the test booklet and answer document.

Basic Guidelines Testing Room Preparation page 8 DFA Oral Script - all information to be read aloud to students is printed in bold type When the allotted time for a test has elapsed, collect test booklets and answer documents Before dismissing students, carefully count the test booklets and answer documents to ensure that all student materials have been collected TAs must affix the Pre-ID label or complete the demographic information on the back cover and inside back cover of each answer document.

Basic Guidelines - Math Use of Protractors - students need access to a protractor when taking the Grade 5 Mathematics Achievement Assessment (DFA page 8) Criteria for Calculators - Students may use calculators on the Grades 6, 7 and 8 Mathematics Achievement Assessments (DFA page 9) The grade 8 Mathematics Reference Sheet is provided with all grade 8 test; sheets with student notations are considered secure nonscorable materials. Clarifications Office of Curriculum and Instruction- Mathematics 614-466- 1317

32 Scheduling Spring 2010

OAC Spring 2010 Schedule Change OAC 3301-13-02 Section (A) (4) (b) The second test administration period each year shall begin not earlier than Monday of the week containing April twenty-fourth and the make-up testing shall be completed by the Friday of the week following the regular test administration. A participating school may schedule the regular administration of the test on any day of this test administration period, but the regular administration of the test shall occur on the same day throughout all buildings of each participating school as defined in paragraph (A)(14) of rule 3301-13-01 of the Administrative Code.

OAC Spring 2010 Schedule Change OAC 3301-13-02 Section (A) (4) (b) The new text gives districts more options in administering the OAA in spring 2010. Districts may choose to begin the initial administration on any date within the test window April 19 April 30. The tests may be administered on non-consecutive days. Testing materials will arrive in districts the week of April 5, 2010.

Conditions that must be followed The starting date for each grade-level test administration must be the same district-wide. All schools within a district must test the same grade level content area on the same day. The testing sequence must be reading, mathematics and science. Any make-up test may be administered after the test has been initially administered to the entire grade level.

Conditions that must be followed The week of May 3 should be used for make-up testing, not initial testing, which should be done the weeks of April 19 and 26. Initial testing involves the entire grade level; make-up testing only involves individual students who were absent at the time of the initial testing. Please note that make-up tests may be given on the in between days if tests are administered on non-consecutive days.

Conditions that must be followed Scorable materials must be returned no later than Friday, April 30; Monday, May 3; or Tuesday, May 4 (subject to the rolling pickup provision below). The return schedule for the initial test administration, excluding make-up testing, is based on K 12 school enrollment as follows: Fewer than 2,500 students no later than Friday, April 30.

Examples of Test Schedules The following charts give possible EXAMPLES of test schedules that have been suggested by districts. These examples are not specifically recommended by the Office of Assessment. It is the districts choice there is no need to obtain approval from the Office of Assessment. Districts will be able to schedule mathematics on different days to allow for shared use of calculators.

Examples of Test Schedules Consecutive days starting on April 19 Start Date Subject Grade Level Monday, April 19 Reading 3, 4, 5, 6, 7, 8 Tuesday, April 20 Math 3, 4, 5, 6, 7, 8 Wednesday, April 21 Science 5 and 8

Examples of Test Schedules Consecutive days starting on April 20 Start Date Subject Grade Level Monday, April 19 Reading 3, 4, 5, 6, 7, 8 Wednesday, April 21 Math 3, 4, 5, 6, 7, 8 Friday, April 23 Science 5 and 8

Examples of Test Schedules Non-consecutive days starting on April 19 Start Date Subject Grade Level Tuesday, April 19 Reading 3, 4, 5, 6, 7, 8 Wednesday, April 21 Math 3, 4, 5, 6, 7, 8 Thursday, April 22 Science 5 and 8

Examples of Test Schedules Non-consecutive days starting on April 21 Start Date Subject Grade Level Wednesday, April 21 Reading 3, 4, 5, 6, 7, 8 Friday, April 23 Math 3, 4, 5, 6, 7, 8 Monday, April 26 Science 5 and 8

Examples of Test Schedules Non-consecutive days, with reading starting on multiple days for varying grade levels. Start Date Subject Grade Level Monday, April 19 Reading 3, 4, 5 Wednesday, April 21 Reading 6, 7, 8 Friday, April 23 Math 3, 4, 5, 6, 7, 8 Monday, April 26 Science 5 and 8 Reading must always be administered first at each grade level, but all grade levels do not have to administer reading on the same day. This example may be used with consecutive days as well.

New or Revised Procedures 44

Test Booklets Test booklets will be spiraled within shrink-wrapped packages and will be numeric; procedures that must be followed for testing in grades 5 through 8: On the first day of testing, students should write their names on the front of the test booklet and on the front and back of the answer document Each test booklet and answer document should be returned to the same student on the subsequent days of testing.

Test Booklets Because there may be three to seven different forms within a test building, it is essential that Box J (Form) be bubbled accurately on the back of the answer document. It is recommended that staff, not students, bubble the information on the demographic pages.

Test Booklets Multiple forms of test booklets will be assigned to each test building There will be field-test questions Within a classroom, there may be three to seven different forms of a test booklet for distribution Students using a special version or who have a Read Aloud accommodation must use Form SV; forms from the spiraled packet must not be used

Read-Aloud Accommodation The Test Coordinator (TC) and the Test Administrator (TA) must not take test booklets from the spiral packets to be used with the special versions or the read-aloud accommodation the questions and passages will not match. If forms from the spiral packets are used, the students will discover this during testing and it will cause confusion and frustration. Only Form SV should be used with the special versions or accommodations. 48

New or Revised Procedures New or Revised Procedure DTC Manual Page Suspended Assessments Grades 4 and 7 Writing Grades 5 and 8 Social Studies Testing Group Number - Revised 5 School/Class Header Sheet - Revised 4 5

Suspended Assessments Due to cuts to the Ohio Department of Education (ODE) budget, administration of the grades 4 and 7 Writing tests and grades 5 and 8 Social Studies tests will be suspended for the next two school years (2009 2010 and 2010 2011).

Testing Groups Test booklets for 3 and 4 and answer documents for 5-8 will have a testing group number (Box G) to be completed Sample testing group roster can be downloaded from www.ohiodocs.org Testing group documentation should not be returned Test booklets and answer documents returned without Box G completed, the TC may be contacted to provide the information.

Testing Group Roster District Name: District IRN: School Name: School IRN : Districts should retain this list. Do not return it with your test materials. Testing Group Number Test Location Subject Date and Time Test Administered

School/Class Header Sheet Use of a School/Class Header Sheet is required Separate headers are not required for each class or small group administration. One per grade is sufficient On the School/Class Header Sheet, Box 4 labeled Contact Name may be completed with the name of any person who has knowledge of the testing process at the school The district must maintain a list showing which TA administered the tests for each class The header sheet does not generate teacher core reports

Important Information Spring 2010 54

Spring 2010 Test Schedule Date By April 5, 2010 April 19-May 7, 2010 April 30, 2010 By May 7, 2010 When testing is complete, but no later than May 10, 2010 Activity TCs receive test materials from Pearson Test administration dates TCs send all Early Return scorable materials to Pearson TCs send all Regular Return scorable materials to Pearson DTCs return nonscorable secure materials to Pearson

Important Contact Information For information about The Ohio Achievement Assessments or testing policy Accommodations Accelerated testing Receiving and returning shipments Returning the Material Resolution Form Ordering additional materials Ordering optional services Contact Ohio Department of Education Office of Assessment Phone: 614-466-0223 Fax 614-995-5568 Web site: education.ohio.gov Pearson Phone: 800-627-7990 State Code 836 Email: Ohiok-8@support.pearson.com American Institutes for Research (AIR) Email: ohhelpdesk@air.org Phone: 888-944-5001

Sources Slides 5-18 from the Ohio Department of Education, New Test Coordinator Presentation and Powerpoint, September 2009. Slides 20-28 information from K-8 District Test Coordinator and Ides of ODE newsletters. Slides 31-41, 43-51, 53, and 54 Ohio Department of Education, Ohio Documents Assessment Resources at www.ohiodocs.org including District Test Coordinator Manual and Directions for Administration.