STAAR Reporting The information in this document is provided as a resource to district personnel in making informed decisions about reporting STAAR and EOC based on Spring 2012 testing. If you have questions, please contact: Jennifer Drumm, Sr. Coordinator ESC Region XIII jennifer.drumm@esc13.txed.net Ed Vara, Deputy Executive Director ESC Region XIII ed.vara@esc13.txed.net ACKNOWLEGEMENTS This information is adapted from material received from ESC 10, Thorndale ISD, and ESC Region XIII.
BACKGROUND Recently, we have fielded numerous inquiries about the STAAR 3-8 reports. Because raw scores are the only available measures available until January 2013, two questions continue to surface in our conversations with districts. First, what exactly are districts required to report to stakeholders and parents? Second, should districts disseminate raw score results to parents when those are received? This determination is based locally, and before deciding, districts should consider the following: Timeline: Districts will receive preliminary raw score reports for STAAR and STAAR L May 23, 2012. Districts will receive updated preliminary raw score reports in June. These reports will provide raw score results for STAAR Modified and STAAR Alternate. Districts will receive final results with performance standards in January 2013. Only at this time will it be possible to determine pass/fail (officially whether a student met the satisfactory standard or not). Reporting Requirements Districts have a requirement to report STAAR 3-8 results to parents and trustees ONLY after they receive the final set of reports (January 2013). Districts are NOT required to notify parents/trustees of raw score information. It is a local decision as to whether this information will be disseminated AT ALL. It is important to consider that distribution of raw score information could lead to much confusion and/or concern because performance standards are based on a scale score not a raw score [if you proceed, proceed with caution]. Additional information Preliminary raw score information will NOT be available on the student data portal. Final student results will be available on the data portal January 2013. The raw score information remains PRELIMINARY until the final results are received in January 2013; therefore, distributing the initial run of data to parents will not be officially accurate. 1 STAAR Reporting ESC Region XIII
CONSIDERATIONS Because parents are accustomed to receiving student results in a timely manner, districts are in a conundrum as to how to proceed. Region 10 staff has worked to provide you with several options that we project as scenarios. These follow, and we lay out cautions as we see them. Scenario 1 The District takes no official action until the final results are received in January 2013. No letters or other communications are sent home to parents. In this scenario, it is likely that campuses will field calls regarding scores. Leadership should ensure campus staff are prepared to solicit the appropriate response. [If a parent calls desiring to see data, then the district could invite the parents in to discuss raw scores on a case- by- case basis. A clear expectation of what will be discussed/ distributed should be predetermined.] Scenario 2 The District sends out a communication explaining why parents will not be receiving scores. We have attached sample letters to that effect. These letters are templates only. Districts may locally determine what information to include/add/omit. This letter should emphasize the preliminary nature of the data, provide some comfort as to the impact of the data on individual students, and a rationale for not releasing the data at the end of the school year. [As in Scenario 1, if a campus receives a call from a parent requesting data, then the parent could be invited in for a conference.] Scenario 3 While we do not recommend sending home any of the raw score data, a district may decide this is the best course in response to parent concerns. If the district sends out raw scores, documents would have to be locally developed. Strongly consider the format of any communication disseminating raw scores. The basic score on any test is the raw score, which is the number of questions answered correctly regardless of difficulty level. Again the passing standards to be released later are based upon scale scores. A scale score is a conversion of the raw score onto a scale that takes into account the difficulty level of the specific set of questions used on a test in any given year. A scale- score system allows every test to have exactly the same passing standard, or level of performance required, even though the raw score needed to pass the test may vary slightly from year to year. This is the major reason we do not recommend releasing the raw scores. Note Consider the options within your local data system to determine the best format for these reports. Will the report be just the raw score? Will it be raw score by student expectation? Will it be raw score by reporting category? An overall evaluation of a student s strong reporting categories coupled with a reporting category that will continue to need attention? With the sample letter for parents, a listing of the types of data available through the eduphoria! Aware system is included along with specific questions to ask of other data providers so that it is clear what types of information will be available on individual students. We have provided the eduphoria information because some of our Region XIII districts use the system. In summary, because performance standards are based on scale scores and not raw scores, it is the recommendation of Region 10 that districts do not disseminate raw score results. However, districts should be prepared to explain the process in this transition year. 2 STAAR Reporting ESC Region XIII
INDIVIDUAL STUDENT REPORTING OF STAAR DATA FOR GRADES 3-8 In the eduphoria! aware data system Based on the data we believe we will get from Pearson, eduphoria! Aware will be able to provide the following student data: Number of question correct/incorrect by SE. The student report will show the SE with the number of questions aligned to this SE and the number of these questions the student got right. If a student misses one or more questions aligned to the SE then the numbers will be color coded red. 3 STAAR Reporting ESC Region XIII
The example shown below is with TAKS Objectives. The same will be available for STAAR Reporting Categories 1. The percent of questions the student answered correctly on the test. (i.e. 73%) 2. The raw score based on the number of questions on the test. (i.e. 35/48) Number of questions/correct answers in each Reporting Category Comparative performance by Reporting Category student, campus, district The default color coding is as follows: 100% - Green, 71-99% - Blue, 0-70% Red
QUESTIONS TO ASK OF YOUR DATA SYSTEM These questions are for non- eduphoria users and are intended to guide users in obtaining critical information to determine how the district s data information system can assist in generating reports. 1. Will the data system provide a list of item numbers coded to SE and whether the student got each item correct or not? 2. Will the data system provide aggregated data by reporting category so that teachers will know how many questions there were in a category and the number of items individual students got correct? 3. Will the data system allow the student s performance to be compared to the average campus and average district performance? 4. Will the percent of questions the student answered correctly on the test be given? 5. Will the raw score based on the number of questions on the test be given? ONLINE RESOURCES RELATED TO STUDENT REPORTING AND PERFORMANCE STANDARDS STAAR, 2012 www.tea.state.tx.us/student.assessment/staar/ STAAR Performance Labels and Policy Definitions (PDF updated 04/24/12) STAAR Performance Level Descriptors (PDF updated 05/04/12) STAAR EOC Standard Setting Questions and Answers (PDF updated 04/25/12) STAAR EOC Standard Setting Process Overview (PDF posted 04/24/12 STAAR EOC Performance Standards Chart (PDF posted 04/24/12) STAAR EOC Phase- in Illustration (PDF posted 04/24/12) STAAR Assessment- Related Graduation Requirements (PDF updated 04/26/12) To the Administrator Addressed Letter Dated April 25, 2012 www.tea.state.tx.us/taa_letters.aspx Choose: 4/25/2012: Reporting of Student Results for 2012 STAAR Grades 3-8 Assessments 1 STAAR Reporting ESC Region XIII
SUGGESTIONS FOR PARENT CONFERENCES Be sure that the resources listed above are available in order to assist in answering questions about pass/fail, performance standards, reports, etc. Obtain data that may be available from your data management system related to the test key information (Item #, SE#, correct or incorrect.) This data is too cumbersome for use from the data file, but your system provider will likely provide an individual student report with this information. Be sure to check, though, for the date this information will be available. (See section above on eduphoria reports and questions to ask about your data system.) It is likely best to ascertain prior to a parent conference whether the teacher knows if the student finished within the time limit. This will only be known if the student told the teacher, as of course, the teacher did not look at the answer key. Naturally, if a student did not finish in the allotted time, the raw score will be lower. Provide information in broad categories: Areas according to the data where your child did well (based on preliminary data) and areas that may need strengthening through interventions next fall. Provide one or two suggestions for summer learning experiences based on the data as well as can be predicted. Re- explain the limits of the data provided and re- emphasize that the district will make every effort to adjust learning plans when more detailed data is available. Include any local data that may give a fuller picture of student performance at the end of the school year. 2 STAAR Reporting ESC Region XIII
SAMPLE LETTERS In this section, districts will find several sample communications to consider in relaying information to parents. These are offered as samples only and are not to be construed as required or TEA approved communication formats. Districts may also choose to craft their own unique version. 3 STAAR Reporting ESC Region XIII
Date: To: From: Re: STAAR Results for Students in Grades 3-8 As you are aware, your child or children recently were administered the STAAR (State of Texas Assessment of Academic Readiness). Since this assessment is a replacement for the former TAKS, you may be expecting to see your child s test results at the end of the school year. This year, however, is a phase- in year, so no parent information is being provided by the Texas Education Agency for Grades 3-8 until a later date. The only information we currently have is a number indicating how many questions your child answered correctly in each subject test. Since questions on a state assessment are weighted for easier and harder questions, and since the test is new, it will take months to determine exactly where the Agency will set a passing score. Everyone at the Texas Education Agency and the assessment company want to be very sure that appropriate, fair, and valid reporting is done and that no children are penalized if the assessment turns out to be more difficult than anticipated. To this end, you will receive no STAAR student results until the official data is received in January of 2013. We care deeply about the success of every student and will make all necessary adjustments to your child s education plan in order to insure that success. (This example is a very simplified version. Districts may wish to include additional information.) 4 STAAR Reporting ESC Region XIII
(insert district information) INDEPENDENT SCHOOL DISTRICT May 25, 2012 Dear <district name> ISD Parents, This spring students in grades 3-9 participated in a new state assessment system: The State of Texas Assessments of Academic Readiness or STAAR. <district name> ISD is committed to sharing information and resources regarding these new assessments with students, parents, and community as it becomes available. In a new assessment system there are many steps in creating performance standards and setting scale scores in order to accurately represent student success across the life of the assessment system. The performance standards have been set and scale scores are available for the end- of- course assessments. The district will be able to communicate this information with parents in June. Scale scores for grades 3-8 will not be available until January of 2013. Due to these timelines the district will not have available scale scores or passing information to share with parents of students in grades 3-8 until the spring of next year. When information is available, student success will be communicated through the following performance categories: Level III - Advanced Academic Performance Performance in this category indicates that students are well prepared for the next grade or course. Level II - Satisfactory Academic Performance Performance in this category indicates that students are sufficiently prepared for the next grade or course. Level I - Unsatisfactory Academic Performance Performance in this category indicates that students are inadequately prepared for the next grade or course. The passing standards for each of these levels for EOC were recently released by TEA. There will be a three step phase- in of the passing standards over the next several years to assist with the transition to the new assessment system. Each assessment for end- of- course has a different scale score for each of the levels above. This information is available on a chart located at http://www5.esc13.net/staar/resources.html ( Phase- in and Final Recommended Performance Standards STAAR EOC). If you have questions regarding your student s performance please visit with <insert contact name(s)>. Students who do not meet the passing standard for STAAR EOC will have additional opportunities to re- take the assessments. The first opportunity to re- take an assessment for STAAR EOC will be July 9th - July 13th of 2012. <district name> ISD will be offering support opportunities to assist students in passing these assessments. There are also requirements for students in grades 5 and 8 to pass the state assessments in reading 5 STAAR Reporting ESC Region XIII
There are two new requirements for high school students passed by the 81st Texas Legislature: The score a student receives on each of the EOC assessments must be counted as 15% of the student s final grade for the course. The scores a student receives on each EOC for a content area must be equal to a determined cumulative score in order for the student to graduate from high school. The Commissioner of Education allowed districts the option to waive the 15% rule for this school year as it was the first implementation of EOC assessments. Beginning next year this requirement will be in effect for all students taking high school EOC assessments. <District Name> elected to waive the 15% requirement for the 2011-2012 school year. In order to determine a student s cumulative score each assessment in a content area will be totaled and compared to a baseline cumulative score. For example: Students who began taking mathematics EOC assessments in the 2011-2012 school year must meet a scale score of at least 3500 to reach a Level II Performance Category (pass the assessment). Algebra I 3500 Geometry 3500 Algebra II 3500 Total = 10500 The cumulative score on the mathematics assessments for a student who began taking EOCs this year will need to be greater than or equal to 10500 in order for the student to meet graduation requirements. There are different requirements for students who may be graduating under the minimum high school program or the distinguished high school program. Resources to assist your understanding of STAAR are available from ESC Region XIII as well as the Texas Education Agency. ESC Region XIII STAAR Parent Brochure - www5.esc13.net/staar/parent_resources.html STAAR FAQ - www5.esc13.net/staar/parent_resources.html STAAR Performance Standards video - www5.esc13.net/staar/resources.html (look for the video icon) Information on performance standards and phase in scores for EOC - www5.esc13.net/staar/resources.html There are also requirements for students in grades 5 and 8 to pass the state assessments in reading and mathematics in order to be promoted to the next grade level. Due to the late notification of student success on the STAAR 3-8 assessments this requirement will not be in effect for the 2011-2012 school year. 6 STAAR Reporting ESC Region XIII
Do all kids take STAAR? The short answer is yes, the vast majority of students will be taking STAAR. Under STAAR, students in grades 3-8 will take exams in reading, math science and social studies just as they do in the current TAKS. Spanish versions of the STAAR exams in grades 3 through 5 will be available for English Language Learners. Students receiving Special Education services will have the decision as to which exam they will be taking determined by the Admissions, Review and Dismissal Committee (ARD), in which parents are invited to participate. High school students beginning with the freshman class of 2011-2012 will see the most changes. As a result of changes enacted by the 81st Legislature, high school students will take more exams. These exams, called end- of- course exams, will be taken by students enrolled in the following courses: English I, II, III Algebra I, II Geometry Biology Chemistry Physics U.S. History World History World Geography U.S. History If you have questions regarding STAAR assessments please contact any of the following: <insert contact names and phone number and email address> Sincerely, Superintendent Superintendent <insert district name> v (This example contains many details. Districts may wish to edit this version to reflect critical components.) STAAR Confidential Student Report 7 STAAR Reporting ESC Region XIII
UPDATED AAR The updated Minimum Standards for the Academic Achievement Record (AAR) are posted on the TEA website: http://www.tea.state.tx.us/index2.aspx?id=5974 The T 8 STAAR Reporting ESC Region XIII