Assessment Updates. January 12 th, , Florida Department of Education. All Rights Reserved.

Transcription

1 Assessment Updates January 12 th, 2016

2 Computer Based Testing Updates 2

3 Computer Based Testing The following Spring 2016 assessments are computerbased: Grades 8 10/Retake FSA ELA Writing Grades 4 10 FSA ELA Reading Grade 4 Reading on computer for the first time Grades 5 8 FSA Mathematics FSA EOC Assessments (Algebra 1, Geometry, Algebra 2) NGSSS EOC Assessments (Algebra 1 Retake, Biology 1, Civics, U.S. History) FCAT 2.0 Reading Retake 3

4 Computer Based Testing New Student Interface shell for Universally accessible De emphasize navigation components by using lighter colors Item tools menu All tools now consolidated in a single location under a menu button in the top right corner of the item. 4

5 Computer Based Testing Item Response Recovery For FSA ELA Writing, students may restore previously saved versions of their writing responses (during the same sitting) Responses save every two minutes Tool is also available on open response items for ELA Reading and Mathematics assessments 5

6 Computer Based Testing FSA Session Transitions Beginning with the Winter FSA EOCs, the process for moving from Session 1 to Session 2 includes the following changes: Students no longer have the option to click Next on the Session Review screen. Students will select End Session (to pause their tests) and test administrators will take no further action (other than to stop the session). 6

7 Computer Based Testing Listening Items Grades 4 10 ELA Reading Listening items may appear in either or both sessions of the ELA Reading tests Schools must provide headphones/earbuds, or students may use their own Headphones/earbuds should be plugged in and system settings checked (e.g., volume not muted) PRIOR to launching the secure browser American Sign Language (ASL) Videos will be available for eligible students taking CBT or PBT accommodated ELA Reading tests PBT accommodated students will have access to listening items (audio) on a computer through a secure site 7

8 Computer Based Testing FDOE s IT team is involved in overseeing all technology related processes and changes for AIR and Pearson. All system changes and improvements proposed by the contractor must be reviewed and approved by FDOE IT staff. FDOE will closely monitor testing to ensure that all systems work as expected, and to troubleshoot any issues that arise. 8

9 Additional Fall/Winter Updates FSA ELA Test Item Specifications Slight revisions made to format and other minor details ELA Test Design Summary and Blueprint Remove Grade 11; update Writing administration time to 120 minutes; update Technology Enhanced Item Descriptions for ; update language regarding the weighting of the ELA writing component; provide additional language regarding cognitive complexity 9

10 FSA ELA Writing Scoring Samplers Now available on the FSA Portal Grade 4 Opinion; Grade 5 Informative; Grade 6 Informative; Grade 7 Argumentation; Grade 8 Informative; Grade 9 Argumentation; Grade 10 Informative Examples of student responses that represent various score point combinations Not intended to provide a full spectrum of examples Do not necessarily represent highest or lowest examples of score points Passage sets are permissioned pieces and will be available via a hyperlink. (Printing is available via the URL.) 10

11 New FSA CBT Practice Tests Now available on the FSA Portal FSA practice tests available for each grade; replaces the Training Tests Online FSA Reading practice tests divided into two sessions to allow Test Administrators practice with logging students in and out of sessions SESSION LENGTH AND CONTENT ARE NOT REPRESENTATIVE OF THE OPERATIONAL ASSESSMENTS! CBT students required to participate in a practice test prior to testing 11

12 More FSA ELA Writing Practice Tests Grade 4 Informative Grade 5 Opinion Grade 6 Informative Grade 7 Argumentation Grade 8 Informative Grade 9 Argumentation Grade 10 Informative 12

13 Accommodations For students with IEP or 504 plan that specifies this accommodation, Text to Speech (TTS) functionality will be available for all computer based FSA ELA Reading and Writing components. Passages/text sets are not read to students. Items and options are read to students. Prompt wording is read to students. American Sign Language (ASL) videos provided for listening items on the CBT and PBT ELA Reading tests (SPRING 2016) Students with PBT accommodations have access to the listening items via a secure interface. 13

14 FSA ELA Writing Condition Codes Totally blank no valid ELA score because student did not attempt to take the Writing portion of the ELA assessment If 0 reported = attempt to respond, but response earned condition code resulting in zero points out of 10 points possible Entire response written in a language other than English = 0 Totally illegible, incomprehensible, insufficient, or copied from the sources with no original writing = 0 Totally off topic = conventions domain is still scored, resulting in 0, 1, or 2 points 14

15 FSA Writing Reminders to Students Read prompt first! Read the passage set carefully, taking notes Think about the purpose, audience, and task. Reread the prompt. Plan the response. Draft a response, read your draft, then revise and edit as needed. 15

16 Handheld Calculators FDOE provided an approved list of calculator models for the FSA assessments The list can be found in the following document on the FSA Portal: Calculator and Reference Sheet Policies for Florida Standards Assessments (FSA) Mathematics Assessments (shown on next slide as well) FDOE will review/approve additional models for the list once annually; however, districts may provide calculators if mathematics specialists in the district determine that they meet the published specifications (provided on later slides) Handheld calculators are OPTIONAL 16

17 Updated Calculator Policy The following handheld scientific calculators are FDOE approved calculators for the school year. Texas Instruments TI 30Xa Casio fx 260 solar Casio fx 82 solar Sharp EL 510R Sharp EL 510RN

18 Updated Calculator Policy Schools may use calculators that are not on the approved list if district mathematics specialists determine they meet the required specifications. Students are not allowed to share calculators. Not every test item in the calculator section will require the use of a calculator. See the calculator and reference sheet policy on the portal.

19 Handheld Calculators Calculators are allowed for certain grades and subjects, and for only certain FSA sessions: Grades 7 and 8 Mathematics SESSIONS 2 and 3 ONLY FSA EOCs SESSION 2 ONLY NGSSS EOCs (Algebra 1 Retake, Biology 1) 4 function handheld Tests for students who have access to a calculator during non calculator sessions OR who have access to a calculator with prohibited functionalities must be invalidated 19

20 Handheld Calculators

21 Handheld Calculators Prohibited Functionality

22 Assessment FSA Calculator Summary Calculator Permitted Grades 3 and 4 Mathematics Grades 5 and 6 Mathematics Grades 7and 8 Algebra 1 Algebra 2 Geometry PBT: Paper Based Test PBT None CBT None Computer based scientific calculator or hand held scientific calculator CBT: Computer Based Test

23 Practice Using the Online Calculator The online scientific calculator for grades 7and 8, and FSA EOCs can be found at:

24 Accessing Resources in the FSA Portal Sign up Click here for. Updated!

25 Accessing Resources in the FSA Portal Resources include: Equation editor item tutorial; FSA Mathematics policies and materials; FSA scientific calculator

26 Questions About These Assessment Topics? Vince Verges Assistant Deputy Commissioner, Accountability, Research, and Measurement 26

27 Florida Standards Alternate Assessment

28 Florida Standards Alternate Assessment IEP determines if: The student has a significant cognitive disability Even with appropriate and allowable instructional accommodations, assistive technology, or accessible instructional materials, the student requires modifications to grade level general state content standards The student requires direct instruction in academic areas of English language arts, mathematics, social studies, and science based on access points in order to acquire, generalize, and transfer skills across settings

29 2016 FSAA FSAA Performance Task 99% of students meeting the criteria for needing instruction in Access Courses and being assessed on alternate achievement standards will participate in the performance task assessment FSAA Datafolio Trial Administration designed to provide a second option for assessing students with the most significant cognitive disabilities for whom no formal mode of communication has been established.

30 Performance Task: Milestone Timeline Blueprints and Alignment Study Summer 2014 Items Developed Winter Summer 2015 Item Review Committee June 2015 and July 2015 Construct Test Forms and Production Summer Fall 2015 Administer Test Spring 2016 New assessment blueprints developed for Mathematics, ELA, and HS Biology New blueprints for ELA and Mathematics are aligned to the Florida Standards Access Points New blueprint for Biology based on NGSSS Alignment study determined which items currently in bank are aligned to new blueprints

31 Content Areas & Grades Assessed Grade Level ELA Mathematics Science EOC Algebra 1 EOC Geometry EOC Biology 3 X X 4 X X 5 X X X 6 X X 7 X X 8 X X X 9 X 10 X HS X X X Civics EOC, US History EOC, and Algebra 2 portfolio introduced in Operational field test for Writing in

32 Performance Task Overview Accessibility for all students: Universal Design concepts Tactile/Braille materials contracted and non contracted Gradual transition to Unified English Braille Tactile materials for non braille readers American Sign Language videos in Administration Modes Paper administration in 2016 Transition to optional online computer based administration 2017

33 Performance Task Design Overview 2016 Operational Field Test Design Goals of 2016 Operational Field Test Test the item tiers and complexity assumptions Establish the psychometric scale for future assessment Administration procedures will change Each content will be separated into 2 or 3 sessions Each session will follow different administration procedures

34 FSAA Datafolio Trial Administration FSAA Datafolio Trial Administration 120 participating teachers 160 participating students Participating teachers will provide feedback throughout the process on: Training Materials, Samples and the Resource Guide (RG) Blueprints & Activity Choices Participation Guidelines Levels of Assistance Scoring

35 Important Dates Resources Resources Accommodated Materials Ordering Window Tactile Graphic Materials Uncontracted Braille/Tactile Graphic Materials Contracted Braille/Tactile Graphic Materials One-Sided Response Booklet Ordering Train the Trainer Resources available on the Measured Progress FTP Site Administration manuals (TAMs) arrive in districts September 21 November 2, 2015 November 2, 1015 April 3, 2015 Website (URL): November 18-19, 2015

36 Important Dates Resources Resources Administration Training Modules and Support Documents posted to the FSAA Training Website December 1, 2015 FSAA Online System s Assessment Registration December 2 30, 2015 Print-based Practice Materials arrive in districts December 3 & 4, 2015 Practice materials/tutorial available in the FSAA Online System Distribution of Object Exchange List and List of Cards and/or Strips and Teacher-Gathered Materials Mid- to late December 2015 No later than January 15, 2016 FSAA Online System training for AACs\Teachers January 20, 2016\February 1, 2016

37 FSAA Important Dates Elementary and Middle Elementary and Middle School (Grades 3-8) Materials in Districts February 19 24, 2016 Student Testing Window February 29 April 15, 2016 Student Responses Entered into Online System Return of Test Materials to Piedra Data Services No later than 11:59 PM EST on April 15, 2016 No later than May 13, 2016

38 FSAA Important Dates High School High School ELA (Grades 9 & 10), Algebra 1, Geometry, and Biology 1 Materials in Districts March 15 17, 2016 or March 21 23, 2016 Student Testing Window Upon receipt of materials through April 29, 2016 Student Responses Entered into Online System Return of Test Materials to Piedra Data Services No later than 11:59 PM EST on April 29, 2016 No later than May 13, 2016 Student Reports in districts Week of June 6, 2015

39 Standard Setting and Reporting Standard setting will be conducted after the administration. Reports will be in schools the week of June 6 Until standard setting is conducted and cut scores determined, student reports will include student raw score and percentile ranking per content area

40 FSAA Contact Information Angela Nathaniel (850)

41 Assessing Communication and Comprehension in English State to State for English Language Learners 2.0 (ACCESS for ELLs 2.0)

42 ACCESS for ELLs 2.0 Assessments Based on the WIDA English Language Development Standards and are used to measure students progress in learning English. Three components: Kindergarten ACCESS for ELLs, paper based assessment for Kindergarten ACCESS for ELLs 2.0 Paper, paper based assessment for Grades 1 12 Alternate ACCESS for ELLs, paper based assessment for students in Grades 1 12 who have significant cognitive disabilities

43 Important Resources Florida s WIDA webpage: Florida specific information regarding the administration of the ACCESS for ELLs 2.0. WIDA Secure Portal: Online training modules and certification to district and school personnel for the ACCESS for ELLs 2.0. WIDA Assessment Management System (WIDA AMS): ams.us Administrative portal is to order test materials, edit student demographic information and accommodations, and download the Spring 2016 ACCESS for ELLs 2.0 Score Reports.

44 Students to be Tested All students enrolled in the district (grades K 12) and classified ELL, with a code of LY on the 1 st day of the test administration window, must be administered the ACCESS for ELLs 2.0. Students with disabilities participate in the statewide assessment program by taking one of the following: ACCESS for ELLs 2.0 without accommodations, ACCESS for ELLs 2.0 with accommodations, or Alternate ACCESS for ELLs Important: All determinations regarding participation and accommodations in the statewide assessment program must be documented in the student s IEP or Section 504 Plan, and the student s ELL Plan.

45 ACCESS for ELLs 2.0 Schedule Event Date Delivery of 2016 Administration Materials January 15, ACCESS for ELLs 2.0 Test Administration Window February 8, 2016 March 25, 2016 Return of Materials February 9, 2016 April 1, 2016 Pre Reporting Data Validation Window April 20, 2016 April 26, 2016 Delivery of 2016 ACCESS for ELLs 2.0 Score Reports May 20, 2016 Post Reporting Data Validation Window May 23, 2016 June 3, 2016 Final Data Available to State June 13, 2016 Bridge Study (conducted by Center for Applied Linguistics) June 14, 2016 September 30, 2016 Standard Setting October 2016

46 Test Overview Kindergarten ACCESS for ELLs is an individually administered, adaptive assessment designed to take an average of 45 minutes per student. The Test Administrator scores all sections, including the Writing test, on site. ACCESS for ELLs 2.0 Paper is available in three tiered forms within a grade level cluster. Tier refers to the form of the test administered that roughly correspondences to a student s position along the second language continuum: Tier A (Beginning); Tier B (Intermediate); or Tier C (Advanced). Grade Level Clusters: 1, 2, 3, 4 5, 6 8, 9 12 The Speaking section is individually administered and scored by the Test Administrator. The Listening, Reading, and Writing sections can be group administered. Alternate ACCESS for ELLs is an individually administered, semi adaptive assessment. Grade Level Clusters: 1 2, 3 5, 6 8, 9 12 The Test Administrator scores all sections..

47 Training and Certification Requirements for Test Administrators via WIDA Secure Portal WIDA requires that all Test Administrators score 80% or higher on the appropriate quiz to become a certified Test Administrator. For some educators, one or more quizzes are required. Kindergarten ACCESS for ELLs: Kindergarten Training Module and take the Kindergarten quiz ACCESS for ELLs 2.0 Paper: Speaking Assessment Scoring Module and take the appropriate quiz There are five Speaking Assessment Scoring Modules that cover the grade level clusters (Grade 1, 2 3, 4 5, 6 8, 9 12), which takes approximately 90 minutes to complete all modules. These modules provide sample student responses for Test Administrators to practice scoring. The Speaking Quiz is provided in two grade level clusters (Grades 1 5 or 6 12). Note: If a Test Administrator is not administering the Speaking section, the Speaking quiz is not required. Alternate ACCESS for ELLs: Alternate ACCESS for ELLs Training Module and take the Alternate ACCESS for ELLs quiz

48 2016 ACCESS for ELLs 2.0 Regional Training Sessions Location Assessment(s) Date Tallahassee Gainesville Kissimmee Kindergarten ACCESS for ELLs ACCESS for ELLs 2.0 Paper Kindergarten ACCESS for ELLs ACCESS for ELLs 2.0 Paper Kindergarten ACCESS for ELLs ACCESS for ELLs 2.0 Paper December 14, 2015 December 15, 2015 December 17, 2015 Kissimmee Alternate ACCESS for ELLs December 18, 2015 Boca Raton Kindergarten ACCESS for ELLs ACCESS for ELLs 2.0 Paper January 11, 2016 Boca Raton Alternate ACCESS for ELLs January 12, 2016 Online Training Kindergarten ACCESS for ELLs ACCESS for ELLs 2.0 Paper Alternate ACCESS for ELLs October 5, 2015 March 25, 2016

49 2016 ACCESS for ELLs 2.0 Score Reports Individual Student Report (ISR): Scores are reported as Proficiency Levels and as Scale Scores of four individual language domains and combined domains. Note: For Alternate ACCESS for ELLs, the ISR is referred to as the Parent/Guardian Report. Student Roster Report: Lists individual scale scores along with their corresponding ELP levels for each grade according to grade level clusters. Teacher Report: Provided for Alternate ACCESS for ELLs. School Frequency Report: Shows the distribution of ELLs according to their language proficiency levels for each language domain and combination of domains in a stated grade of a specified school. District Frequency Report: Shows the distribution of ELLs according to their language proficiency levels for each language domain and combination of domains in a stated grade of a specified district. Important: Districts are scheduled to receive one hardcopy of each score report on May 20, 2016, but additional reports can be printed via WIDA AMS.

50 Contact Information Florida Department of Education Office of Assessment Sabrina Read, WIDA Florida ACCESS Test Trainer Telephone Number: