Acuity Reports **please note: almost al reports in Acuity are available at the school, classroom, and individual student level To access Acuity in district type acuity in the address bar, from home, www.acuityathome.com make sure to check the box for my district uses single sign on Class Roster Class Roster Use the Roster Report for a quick glance to see how your students did by scale score and Report (real percent correct. Use the sort option to sort by scale score in order to find the cut points of the assessment. Look at the students who are near a cut point to determine if they would greatly time) benefit from remediation. By selecting a student s name on the Roster Report, the system will take you to the student s Individual Assessment Report. Student Assessment Report (static) Use this report to look at a student s results overall in more detail, down to the concept. Look at the prediction bar to determine the student s range of what he/she is predicted to get on the TCAP assessment. Verify if the student is on the fence - meaning the prediction range is between two levels. Align instruction accordingly to students who are struggling. *The Individual Student Assessment Report is available to the student under his/her Acuity user account. Class Item Analysis Report (static) The Item Analysis Report will show you how your students performed on each test item down to the performance objective. Use this report to determine the common error for each test item by using the Distractor Analysis provided under this report. Classroom Matrix Report (real time) Student Portfolio Report Student Progress Report The Classroom Matrix Report is a combination of all of the reports above. The data is extracted from Acuity and placed in Microsoft Excel so you are not able to link into the individual test items nor can you assign instruction from this report. By a glance, this report groups students very easily. It will give you the most commonly selected incorrect answer and when used with the Distractor Analysis will give you a good starting point. It also shows you how each student answered each test item, down to the performance objective. If printing this report first follow the instructions located at: http://assessment.aurorak12.org/acuity/ or else it will take 40 or so pages without following those instructions for printing. Use the Portfolio Report to compare results on all assessments including Predictive, Diagnostic and Custom tests across grade levels. This is a great report to use for a snapshot of time. It can also be used to share with parents. The Student Progress Report compares the student s last six assessments by scale score and percentage correct. It also provides students and parents with a paragraph explaining what the student is predicted to get on the TCAP assessment. *The Student Progress Report is available to the student under his/her Acuity user account. 1 Aurora Public Schools, September 2012
Acuity Class Roster Report Path: Reports/Assessment Reports/Student Assessment Report To access this report select: Reports Roster Reports Class Roster Report Use the Roster Report for a quick glance to see how your students did by scale score and percent correct. Use the sort option to sort by scale score in order to find the cut points of the assessment. Look at the students who are near a cut point to determine if they would greatly benefit from remediation. By selecting a student s name on the Roster Report, the system will take you to the student s Individual Assessment Report. is the predicted performance on the TCAP for my class? How does each student rank compared to other students in my class (scale score)? Do I have students who are teetering between two prediction levels? Click on a student s name to go to the Individual Assessment Report to see the predicted range. Do not just assume they are going to meet or exceed without looking at the predicted range. This is the minimum scale score a student could get on this assessment. This is your class average by scale score. Click on this button to re-sort by scale score. This is the maximum scale score a student could get. If your students took the TCAP test the day this predictive assessment was given, this is the expected performance for your class. Find the cut points this one is between 371 390. The 371 student is at approaches and the 390 student is at meets. Click on the two students above the cut point and the two students below. These will more than likely be your students who are teetering between two predicted levels. 2 Aurora Public Schools, September 2012
Acuity Student Assessment Report Path: Reports/Assessment Reports/Student Assessment Report To access this report select: Reports Assessment Reports Student Assessment Report This report allows you to look at performance overall by state standard strand and concept. The percent of points obtained can show you relative areas of strength and weakness overall and by strand. Note, however, that when there are few items per concept the percentages may be very high or very low. Use this report to look at a student s predicted range to determine if the student is teetering between two predicted ranges. If the student could easily fall back or advance to the next level, scroll down to see in what areas the student could use help. This could be useful to discuss with parents the student s mastery of the state standards, down to the concept and where there are strengths (higher % points obtained) and areas for improvement (low % points obtained). is the average percent correct? Is the student teetering between two predicted levels? holes do I need to fill with this student? Where should I start with this student? Where did a student score higher by strand and concept (higher percent of points obtained) and where did the student score less well? John Doe This shows how the student is predicted to do on TCAP. Students who scored the same in the past were proficient 54% of the time, advanced 1%, partially proficient 38% and unsat 7% of the time. The gray shaded area is where this student is most likely to score this student is teetering between meets and exceeds. On the prior screen it predicted exceeds for this student. However, they could easily fall back to meets. This shows the student did better than percent of students in the school and district. Look at results by grade level, strand and concept. See the areas the student is struggling in. Report Levels Student: percent correct, school and district percentile ranks (how the student compares to students in the school and district), number of items, number of points, number of items left blank, assign instructional activities. Class: overall class results, percent of students in each tier, click on a tier and see individual student results, assign instructional activities. The number of items omitted can indicate the student found the item difficult or, if the item is at the end of the test (look at the item number), the student may not have finished. If that is the case you can t tell if the student did not know the concept or just didn t have enough time. 3 Aurora Public Schools, September 2012
Acuity Item Analysis Report Path: Reports/Item Analysis Reports/Student Item Analysis Report To access this report select: Reports Item Analysis Reports Class Item Analysis Report Use this report when you want to see how your class performed on each test item, down to the performance objective. Determine the common errors by using the Distractor Analysis located under this report. You can also use the report once you identify a weak concept to see the type of items under that concept that students got wrong. How did my class perform on each item? common error did students make when they chose a wrong option? (using the distractor analysis sheet) are the gaps? Open and print the Distractor Analysis before looking at this report. It will assist you in finding the common error and give you a good starting point. The results are organized by grade level, Colorado state standard and performance objective. Click on the underlined number to see the actual item and the options students chose. This green box indicates the correct response. If you see low percentages in the green boxes look at the common error. In this case, 47% of the students got it right, but 28% of them answered A over the correct choice. Look at the Distractor Analysis to determine the common error. Report Levels Student: overall percent correct, the option the student chose for each item, and whether it was correct or not. Used with the distractor analysis report you could review with a student or parent what the student got wrong. Class: the number tested, the percent who chose each item, what the item looked like, who chose each distractor (if you click on the percentage). 4 Aurora Public Schools, September 2012
Acuity Distractor Analysis Report To access this report select: Reports Item Analysis Report Class Item Analysis Report View Distractor Analysis CTB s tests are designed by first identifying and specifying common errors and then writing the items to include those mistakes. Use this report when you want to see what error a student made when selecting an incorrect choice on the test. We recommend you print a copy of this report and keep it handy as you review the item analysis report. How did a student perform on each item? mistake did a student make when he/she chose a wrong option? We highly recommend that you print this report when viewing the Item Analysis and the Classroom Matrix Report. The green box is the correct The Distractor Analysis is specific to each grade level assessment. 5 Aurora Public Schools, September 2012
Acuity Classroom Matrix Report This report shows how each student did on each item and how the class as a whole did on each item. Scan down the column to look at an individual item. Scan across to see how an individual student or the overall class did on each item. To access this report select: Reports Item Analysis Reports Classroom Matrix Report Use this report to look in more detail on how your class did on each item. percent got an item right? Were there some items that most students, including those who scored high, got wrong? Did they make common mistakes as indicated by the wrong option chosen? Use it with the Distractor Analysis Report to understand common errors. percent of students got an item correct? distractor did students choose? (print out the distractor analysis so you can quickly see what mistake that student made when she/he chose that distractor) Were there some concepts that most got wrong that I need to re-teach? were individual student s mistakes and areas of strength? Did the students get an item wrong or did they just not answer? You can quickly see the prediction of TCAP performance based on this test score. Shaded items (in green) show correct answers. Few students got #4 right, and most chose A. There may be a need for reteaching. Use the distractor analysis to see what common error A represents. # omitted (left blank) - a hard question or students stopped answering The # and % of students getting each item correct. Report Levels Class: The bottom of the report shows the class averages for points obtained and, for each item, the number of students choosing a correct answer and the percent choosing correctly and the number of students with incorrect answers. 6 Aurora Public Schools, September 2012
Acuity Student Portfolio Report To access this report select: Reports Portfolio Report Student Portfolio Report Use the portfolio report to compare results on all assessments including Predictive, Diagnostic and Custom tests across grade levels. This is a great report to use for a snapshot of time. It can also be used to share with parents. is the average percent correct for the student overall on all assessments, all subjects? How does the performance on current assessments compare to prior ones? How is the student s growth overtime? This report will show all subjects on one report. Student Portfolio Report SAMPLE This report lists all of the assessments for the current school year associated with the student on one screen. Click on the blue title to go to the student assessment report. This report allows you to drill down to the summary reports for each assessment. Shows the overall percentage points for each assessment the student completed within the current school year. 7 Aurora Public Schools, September 2012
Acuity Student Progress Report To access this report select: Reports Portfolio Report Student Progress Report Use this report when you want to see how a student performed on each test across the grade levels. This report also gives you the student s percentage points obtained per grade level strand across the assessments given at each grade level. Additionally, this report provides two bar graphs showing the student s growth over time based on scale score and percentage obtained per assessment. This is a great tool for visual presentation with parents. How did a student perform on each assessment over time? How did a student perform on each grade level strand across assessments? was the student s overall scale score over time? Student Progress Report SAMPLE Shows the percentage obtained by the student for each assessment completed. The bar graph is comparing the last few assessments the student completed. In this case it was three 4 th grade assessments and one 5 th grade assessment. SCALE SCORE: This bar graph shows the students growth across grade levels by scale score. The scale goes from 3 rd grade to 8 th grade, so you would expect slight increases each time. CTB created one scale from grade three to eight so you can track performance over time. Scaled scores, not raw scores, are the only way that scores can be compared and that student progress can be measured accurately. Notice: The bar graph is comparing the last four assessments completed by the student. This example is showing the student completed three 4 th grade assessments and one 5 th grade assessment. To ensure that scores from assessment A, B and C are comparable, the raw score for each assessment is converted using a special formula to come up with the scale score. This allows the system to measure students growth over time. Since all scale scores are on the same scale scores should increase slightly over time. PERCENT CORRECT: Percent correct scores are not comparable over time because the test changes in difficulty. The first test (Form A) has 2/3rds prior grade level items and 1/3 rd current grade level items. Form B has 2/3rds current grade level items and Form C has 100% current grade level items. 8 Aurora Public Schools, September 2012
Acuity Student Progress Report Shows the scale score grouping that the student fell into. Based on that grouping, the system also lists whether the student is predicted to Fall far below, Approach, Meet or Exceed the performance level on the upcoming TCAP assessment. Compares the last 4 assessments completed by the student. Shows the overall percentage obtained by the student for each assessment completed. Allows you to drill down to each assessment report. This report shows the overall scale score for each assessment completed. Compares the last 4 assessments completed by the student. These are the test form numbers. This report will list all of the grade level strands that were covered in the listed assessments. In this example, this student took Form A in the beginning of her 4 th grade year which covered both 3 rd and 4 th grade material. Form B covered both 3 rd and 4 th grade as well. Form C covered 4 th grade material only. This report lists all of the grade level strands and compares them from assessment to assessment, from grade level to grade level by percentage. Gives you the overall percentage the student obtained for each assessment. 9 Aurora Public Schools, September 2012
Acuity Batch Reports To save you some time, Acuity allows you to print multiple individual student reports with short, easy steps. Step 1 Go to the Reports tab on the left navigational tool bar Step 2 Select the report you would like to print Step 3 Scroll down to see the Batch Reports option and select Step 4 Enter the criteria for the test results you would like to print Step 5 Select the date you would like the reports to be generated Step 6 Add a unique extract name using characters, numbers, underscores and dashes. Do not include any spaces. Step 7 Click on Create Batch at the bottom of the page Once the reports have been generated, you will find the completed job under the Management tab on the left navigational tool bar. Step 8 Select the Batch Reports tab Step 9 You should see your report batch listed. Once the Status column lists the job as being Complete you can print and/or save it. o o Batch Job: Multiple PDF s this option will create a PDF for EACH student. Example: you will have a file and pdf for John and one for Sally and one for Brian, etc. This would be ideal if you were emailing the results to parents. Batch Job: Single PDF this option will create one PDF for ALL of your students in one report. Each student will still have their own report in the PDF; however, you will only have one file and one PDF to print. This is ideal if you are printing out the reports. Batch Reports will remain under the Batch Reports tab for 14 days. So, please make sure you save the reports to your computer and/or print them out prior to the expiration. Accessing Acuity from Home You have the ability to allow students to access their individual results from home. The url is www.acuityathome.com *Note: if school staff member is signing on from home you must check the box my district uses single sign on. If you inform parents about this and send home the student s Acuity login name and password, parents can have access also. The reports that they will have access to under the VIEW REPORTS option are: The Student Individual Assessment Report (with the individual prediction bar) The Student Progress Report (showing the last six assessments) Custom Test Reports 10 Aurora Public Schools, September 2012