Student Assessment of Growth and Excellence (SAGE)

Transcription

1 Student Assessment of Growth and Excellence (SAGE) Online Reporting System User Guide Updated November 4, 2014 Prepared by the American Institutes for Research Utah State Office of Education, 2015 Descriptions of the operation of the Online Reporting System and related systems are property of the American Institutes for Research (AIR) and are used with the permission of AIR.

2 Table of Contents Introduction to this User Guide... 5 User Guide Organization... 5 Section I. Overview of the Online Reporting System... 6 System Requirements... 6 User Roles in the ORS... 7 Section II. Navigating the Online Reporting System... 8 Switching Between SAGE Systems... 9 Logging out of the ORS Accessing ORS Reports from the Welcome Screen Understanding the ORS Layout Banner General Tools Section III. Score Reports Score Reports Home: Getting Started Select Test and Administration Understanding the Home Page Dashboard Report Tables Score Reports Layout and Features Data Exploration via an Exploration Menu About Score Reports Dimensions Breakdown By Demographic Subgroup Show/Hide Comparison Data Data Sorting Show/Hide Columns Reports in the Who Dimension: Subject Detail Reports Sample School Listing Report Sample Teacher Listing Report Sample Roster Listing Report Sample Student Listing Report Sample Individual Student Report Reports in the What Dimension: Reporting Categories Sample Strengths and Weaknesses by Content Standard Report Finding Resources in SAGE Formative Reports in the When Dimension: Trends (Longitudinal) Trend Report Features Select Administrations to Plot Choose Who to Graph Viewing Data by Demographic Subgroup

3 Dimensions Choose What to Graph Dropped Students Why Students Are Dropped Hiding Trend Lines Zoom Feature Sample LEA Trend Report Sample Teacher Trend Report Sample Roster Trend Report Sample Student Listing Trend Report Section IV. Manage Rosters Creating and Managing Rosters Creating a New Roster Editing an Existing Roster Deleting a Roster Printing a Roster Section V. Test Management Center Summary Statistics Generating a Summary Statistics Report Retrieve Student Results Generating a Data File Select Data File Parameters Inbox Opening and Viewing the Data File Plan and Manage Testing Generating a Plan and Manage Testing Report Selecting the Parameters for Your Report Understanding Your Participation Report Online Testing Progress Report Features of the Online Testing Progress Report TA Report Features of the TA Report Exporting Plan and Manage Testing Data into Excel Test Completion Rates Generating the Test Completion Rates Report Select Test Completion Rates Report Parameters Test Status Code Report Generating the Test Status Code Report

4 Section VI. Search Students Searching for Students Understanding Student Search Results and Selecting a Test Viewing a Selected Student s Test Results Appendix A. Student Data File Layouts Common Columns Grade- or Course-Specific Data File Columns Appendix B. User Support

5 Introduction to this User Guide The purpose of this user guide is to describe the features of the Online Reporting System (ORS), a webbased system that enables teachers and administrators to view student score reports and performance data for each student who completed a Student Assessment of Growth and Excellence (SAGE) operational field test ( ) and who complete a SAGE operational test ( ). The ORS also includes participation reports to determine which students have completed testing, need to complete testing, or need to take another test opportunity in a subject. User Guide Organization This user guide provides information about all the ORS features that are available to authorized LEA and school personnel and includes instructions on viewing test management resources, creating and editing rosters, and searching for students. This user guide is organized as follows: Section I, Overview of the Online Reporting System, provides a brief introduction to the ORS and describes the user roles for performing different tasks in the ORS. Section II, Navigating the Online Reporting System, includes instructions on how to log in and log out of the ORS and switch between different SAGE systems. It also describes the layout and features of the ORS. Section III, Score Reports, includes an in-depth overview of the score reports available in the ORS. Section IV, Manage Rosters, provides instructions on how to create and manage student rosters. Section V, Test Management Center, describes how to generate different types of test participation reports. Section VI, Search Students, includes instructions on how to search for students in the ORS. The appendices provide additional information including Help Desk information. Table 1. Key Icons and Elements Icon Description Warning: This symbol accompanies important information regarding actions that may cause errors. Caution: This symbol accompanies important information regarding a task. Note: This symbol accompanies helpful information or reminders. Tip: This symbol accompanies useful information on how to perform a task. Text that appears in shaded boxes provides instructions relevant to the task described: Numbered (ordered) lists provide step-by-step instructions. Bulleted lists provide instructions that do not need to be performed in a specific order. [Text] Text in brackets is used to indicate a button or link that is clickable. 5

6 Section I. Overview of the Online Reporting System SAGE The ORS is the gateway to viewing score data for students who have been identified to take the SAGE Summative, Interim 1 or Interim 2 tests for ELA Grades 3 11; Mathematics Grades 3 8 and Secondary Mathematics I, II, and III; and Science Grades 4-8, Earth Science, Biology, Chemistry, and Physics. The ORS also includes participation reports that enable users to determine which students have completed or need to complete testing. Students who do not test are not included in the ORS. The ORS contains two major features: Score Reports and the Test Management Center. Score Reports: Provide score data for each of the SAGE tests. Users can compare score data between individual students and the school, LEA, or overall state average scores. Information on content standards strengths and weaknesses is also available by reporting category. Test Management Center: Provides participation data for students participating in SAGE. Users can determine which students need to complete testing and who may need to take another opportunity of a test, if applicable. Users can also view participation summary statistics (count and percentages) of students who tested in a selected subject and grade level or course as well as download student data files. System Requirements This user guide does not provide information on computer or system requirements for accessing the ORS. Complete details on the operating systems and web browsers are outlined in the System Requirements for Online Testing, available on the SAGE Portal (SAGE Portal > Technology Coordinators > Technology Resources> Online Systems) at 6

7 User Roles in the ORS SAGE The ORS is a secure, role-based system. Your access to reports and data in the system depends on your user role and your school and LEA associations. For example, LEA users can view data for all schools, teachers, rosters, and students in their LEA; school users can view data only for teachers, rosters, and students in their school. Table 2 describes the user roles within the ORS and the reports and features that are accessible to each user role. Table 2. User Roles and Access in the Online Reporting System LEA Administrator LEA Reports Viewer (LRV) School Administrator (SA) School Reports Viewer (SRV) Procter (PR) Teacher (TE) Score Reports School Listing Teacher Listing Roster Listing Student Listing Individual Student Score Report Test Management Center Summary Statistics Retrieve Student Results Plan and Manage Testing Test Completion Rates Test Status Code Report Manage Rosters Search Students 7

8 Section II. Navigating the Online Reporting System SAGE To log into the ORS, users must have an authorized username and password. If you have not yet received your login information, contact your School Administrator or LEA Administrator as you will need to be added to the Test Information Distribution Engine (TIDE) before you can access the ORS. Warning: Do not share your login information with anyone. All SAGE systems provide access to student information, which must be protected in accordance with federal privacy laws. To log in to the ORS: 1. Open your web browser and navigate to the SAGE portal ( Figure 1. User Cards on Portal 2. Click either the [Teachers], [Test Administrators] or [Assessment Directors] card to access the Online Reporting System and other applications. 3. Click the [Online Reporting System (ORS)] button. You will be directed to the Single Sign On (SSO) screen. Figure 2. ORS Card on Portal SSO allows you to log into the SAGE systems. After you log in, you can switch between systems that you have access to without having to log in and out of each system. For more information, refer to Switching Between SAGE Systems. 4. Enter your username ( address) in the Username field. Figure 3. Single Sign On Screen 5. Enter your password in the Password field. 6. Click the [Log In] button. You will be directed to the ORS Welcome screen provided you have entered the correct login credentials. 8

9 Alert: Important Information Regarding Your Password If you are a user who has recently been added to TIDE, you should have received an from SAGE-DoNotReply@airast.org that contains a temporary password and a link to sign in to SAGE systems. You must log in with your temporary password within three days of receiving the in order to activate your account. The temporary password is valid for three (3) days. You will be prompted to update your password and select and answer a security question. Did your first temporary password expire? If you did not log in within three days of receiving the first password and activate your account, you must contact the SAGE Help Desk. You can only reset your password after you have selected a security question and answer. The SAGE Help Desk will send you a new with a different temporary password. You MUST log in within three days to activate your account. Did you forget your password? If you forgot your password, you can reset it. Click the [Forgot Your Password?] button on the Single Sign On screen and then enter your address into the Address field. You will receive another containing a new temporary password, which also expires in three days. (It may take up to 10 minutes to receive the new .) Did you not receive an containing a temporary password? s from Single Sign On come from SAGE-DoNotReply@airast.org. Check your spam folder to make sure your provider did not categorize it as junk mail. If you still do not have an , contact your Assessment Director to make sure you were added to TIDE. Only users who have been added to TIDE will receive an account with a temporary password. Additional Help If you are unable to log in, contact the SAGE Help Desk for assistance. You must provide your name and address. Contact information is available in the User Support section of this user guide. Switching Between SAGE Systems After you have logged in to a SAGE system, you can switch between applications without needing to log out or log in again as long as one of your browser windows remains on a SAGE system. Single Sign On (SSO) is designed to ease the login process and simplify navigation between SAGE systems. SSO integrates the following: SAGE Test Administration (TA Interface) TIDE (Test Information Distribution Engine) Online Reporting System (ORS) SAGE Formative TA Training Site Note: Access to these systems and their features is dependent on your user role. 9

10 To switch between the SAGE systems: 1. Navigate to the drop-down menu on the top left corner of your browser that lists the systems discussed above. Figure 4. Single Sign On Drop-Down Menu 2. Select the system you want to use from this menu. You will be directed to the selected application and will not have to log in again. Caution: Although navigating to another system is easy, understanding how the system operates is important in order to avoid unintended consequences of switching systems. For example, if you are using the TA Interface or TA Training Site and you navigate away from it, your session will stop and all students in the session will be logged out. You cannot resume your session. You will have to create a new session, and your students will have to log in to the new session to resume testing. 10

11 Logging out of the ORS SAGE For security purposes, it is essential that you log out of the ORS to ensure that the reports cannot be accessed by unauthorized users. To log out of the system: 1. Click the [Log Out] button on the top right hand corner of the screen. A warning message will appear, advising you that you will be logged out of all SAGE systems. Figure 5. Logout Warning Message 2. Click the [Logout] button in the lower right corner of the warning message. This will log you out of all SAGE systems and direct you to the SAGE portal. Caution: The system has an automatic timeout feature that automatically logs you out of the system if you are inactive for 20 minutes. 11

12 Accessing ORS Reports from the Welcome Screen When you first log in to the ORS, the Welcome screen is displayed that allows you to select the type of reports that you want to view. Figure 6. Welcome Screen To view the ORS reports: To view score reports, click the [Score Reports] button. To view participation data, click the [Plan and Manage Testing] button. You will be taken to the appropriate report based on your selection. Caution: For users who are associated with multiple LEAs or schools, a drop-down list will be displayed on the Welcome screen. You will need to select an LEA or school, as applicable, from the drop-down list before you can click the button for the report type you want to view. For example, if you are LEA-level user with access to multiple LEAs, you will need to select the LEA whose reports you want to view. The drop-down list will not be displayed if you are associated with only one entity. 12

13 Understanding the ORS Layout SAGE The Welcome screen that allows you to select the report you want to view is only displayed when you first log in to the ORS. You will be able to access other ORS reports and features at any time by clicking the links and buttons in the SAGE banner at the top of all other ORS screens. Warning: Use the on-screen buttons and tools to navigate within the ORS. Do not use your web browser s back button. Banner The banner provides links to all the ORS reports and features. Figure 7. SAGE Banner The [Score Reports] button links to the Home Page Dashboard screen (see Figure 10). The Test Management Center drop-down menu displays the following Test Management Center report options: o Summary Statistics o Retrieve Student Results o Plan and Manage Testing o Test Completion Rates o Test Status Code Report Note: The Test Status Code Report is only available to LEA- and school-level users. The [Inbox] button links to the Retrieve Student Results screen where you can access student performance data files. The [Search Students] button opens a pop-up window that allows you to search for a student by SSID or by first or last name and access his or her test results. The [Manage Rosters] button allows authorized users to add and manage their own rosters. 13

14 General Tools SAGE The banner also consists of several tools. The tools that are available may vary from screen to screen. Figure 8. General Tools The [Help] button links to this ORS user guide. When you click the [Help] button, the ORS user guide is displayed in a new tab. The [Print] button enables you to print the current screen. When you click the [Print] button, a dialog box is displayed that enables you to specify your print options. The dialog box may vary slightly depending on the browser that you are using. Note: Additional printing options are displayed when you click the [Print] button on the Student Listing Report and Individual Student Report screens, which enable you to generate different score reports in PDF format. For more information, refer to Score Reports. Tip: Depending on the report, you may need to set your print options to landscape or horizontal mode to accommodate the various columns in the report. To preview and adjust the scale of the content, use your browser s Print Preview feature. Caution: The Family Educational Rights and Privacy Act (FERPA) prohibits the release of any personally identifiable information. Printed reports that contain personally identifiable student data must be securely stored or destroyed. The [Export] button enables you to export the data displayed on the current screen. The data is exported in a Microsoft Excel (.xls) file. Caution: As is true with printed reports, Excel files should not be shared electronically or stored on computers accessible to individuals who are not authorized to view confidential student information due to FERPA regulations. 14

15 The [Definitions] button provides definitions for terms specific to the report you are viewing. This button may not appear on every screen. When you click the [Definitions] button, a pop-up window appears. This window contains definitions of the different terms used in the report. To close the pop-up window, click the [X] button in the upper right corner. Figure 9. Sample Definitions Window 15

16 Section III. Score Reports Score reports allow authorized users to view aggregated scores for LEAs, schools, teachers, and rosters, as well as individual student performance data for the Summative and Interim ELA, Math, and Science SAGE operational tests and operational field test. Users can take advantage of data analyses to determine what strategies may need to be implemented to improve teaching and learning. Data can be compared with the overall state and LEA average for the test you are analyzing. Additionally, you can view performance trends and determine whether overall performance is increasing. Caution: About Score Reports The ORS provides dynamic data that can be used to gauge students achievement on various assessments. However, the data in this system are not to be used for official accountability purposes (AYP). USOE provides official accountability data. State averages will not be available for comparison until all statewide testing is completed. Score reports present data at the student level and at different levels of aggregation, which includes LEA, school, teacher, and roster. All score reports data, except for individual students score reports, can be disaggregated into subgroups for detailed analysis. For example, you can view a Grade 5 Mathematics report for a roster, for all of a teacher s students, for an entire school, or for an LEA. Note: The ORS also allows you to create custom groups of students so that you can analyze aggregated data based on shared characteristics, such as student athletes in an enrolled grade. Refer to Manage Rosters for additional information. Table 3 provides an overview of the types of reports available through the Score Reports feature and the levels of aggregation at which they can be viewed (LEA, school, teacher, and roster). Table 3. Available Score Reports Report Level of Aggregation LEA School Teacher Roster Student Home Page Dashboard Summary of performance (to date) across grades and subjects or courses for the current administration Subject Detail Data for a subject within a particular grade or course for the current administration, presented in roster format. Reporting Category Level Detail Reporting category-level scores for a subject within a particular grade or course for the current administration, presented in roster format. 16

17 Report Level of Aggregation LEA School Teacher Roster Student Content Standard Level Detail Content Standard-level scores along with relative strengths and weaknesses for a subject within a particular grade or course for the current administration, presented in roster format. Trend Longitudinal comparison of scores for a selected administration (across time) Student Listing Roster of all students who belong to a school, teacher, or class with their associated subject or course (and strand, if applicable) scores for the current administration Student Detail Detailed information about a selected student s performance in a specified subject or course (and strand, if applicable) 17

18 Score Reports Home: Getting Started SAGE The Home Page Dashboard screen displays the overall summary of score data and testing progress for your LEA or school, and is the starting point for data analysis. Figure 10. Home Page Dashboard Screen To view the Home Page Dashboard screen immediately after logging in to the ORS: 1. From the drop-down list on the Welcome screen (see Figure 6), which is displayed when you first log in to the ORS, select the entity whose score reports you want to view. The drop-down list is only displayed if you are associated with multiple entities and is dependent on your user role. For example, if you are a school-level user associated with multiple schools, the drop-down list will display all the schools that you are associated with. Again, if you are an LEA-level user associated with multiple LEAs, the drop-down list will display all the LEAs that you are associated with. 2. Click the [Score Reports] button. 18

19 To view the Home Page Dashboard screen at any time: Click the [Score Reports] button on the SAGE banner. Caution: The score data you see are dependent on your role; for example, a school administrator will only see his or her school s aggregate data. Select Test and Administration From the Home Page Dashboard screen, you can select the test and administration for which you want to view score data. Note: If you currently have a student who did not test in the selected test and administration, no data will be displayed for that student. Examples include students who moved to your school or LEA from out of state. Figure 11. Home Page Dashboard Screen: Select Test and Year 19

20 To select the test and administration: 1. From the Test drop-down list, select a test. By default, SAGE Summative will be selected. 2. From the Administration drop-down list, select an administration. By default, the current administration will be selected. 3. Select the appropriate radio button for the category of students whose scores you wish to view. Note: This feature is particularly helpful for school personnel who want to see how students currently assigned to the user s class roster performed in previous grades, even if students were enrolled in different schools or LEAs during those previous administrations. Scores for students who were mine at the end of the selected administration o This view allows you to see score data for those students who tested in the selected test and administration. o Note: This option enables you to see data only for those students who were associated with your school or LEA at the end of the selected test and administration. Scores for my current students o This option allows you to immediately view score data for those students who are associated to your current rosters, even if they were previously enrolled in a different school or LEA. o This view enables you to see your current students previous strengths and weaknesses before they begin testing this year. For example, a middle school teacher wanting to see how current 6th grade students performed on the SAGE Summative tests in 5th grade could select SAGE Summative and from the Test and Administration dropdown lists. Scores from the teacher s current 6th grade students who tested as 5th graders in will be displayed in the score reports for 5th grade. Scores for students who were mine when they tested during the selected administration o This view allows you to see score data for those students who were associated with your LEA, school, or roster when they were tested in the selected test and administration. Note: You can also search for individual students scores. For more information, refer to Search Students. 20

21 Understanding the Home Page Dashboard Report Tables The Home Page Dashboard screen displays aggregate data for each subject in a separate table. Caution: Data on this screen and all other score reports are based on the total number of students whose tests have been scored. Students who have completed their tests but not submitted them for scoring will not be included in these data. The columns constituting each of these tables are: Grade This column displays the grade or course to which the score data belongs. Percent of Students Proficient This column displays the percentage of students to date who have scored proficient (Proficient or Highly Proficient) on each test. Percent of Students Tested This column displays the percentage of students to date who have completed and submitted their tests for scoring. The percentage of students who tested is calculated out of the total number of students who are currently associated with your school or LEA and eligible to take the specified test. o Note: This column is not displayed if the [Scores for my current students] radio button is selected. To access score reports for a particular subject- or course-based test: Click a cell that contains a percentage value. You will be directed to the selected Subject Detail Report. 21

22 Score Reports Layout and Features SAGE All score reports except individual student reports are in table format. Most of the score reports share similar features and allow the following: Data Exploration via an Exploration Menu; Breakdown By Demographic Subgroup; Show/Hide Comparison Data; Data Sorting; and Show/Hide Columns Other common features of the score reports are the following: Name: The name of the score report, the test, the administration, and the entity (e.g., LEA, school, teacher, or roster) are displayed on the top of the report. Report Format: All score reports except individual student reports are in table format where the first column displays the name or entity, such as LEA, school, or teacher, to whom the scores belong. Time Stamp: A time stamp is included at the bottom of every report to indicate when the report was generated. Legend: A legend is displayed on top of each report page to describe the color codes that correspond to each test-specific performance level and can help you understand the data presented on the report. Note: About Score Report Legends Legends may not be displayed on all the reports. For example, the Student Listing Report does not display a legend. The legends vary between assessments and report types. Figure 12. Sample Legend 22

23 Data Exploration via an Exploration Menu You can navigate from one score report to another using the Exploration Menu. A magnifying glass icon [ ] is displayed next to each entity, such as a school or personnel, in the Name column of a score report. When you click the icon, it brings up the Exploration Menu, which displays the reports that are available to you. You can click the appropriate cell on the Exploration Menu to navigate to a report. About Score Reports Dimensions Score reports use three dimension categories as the primary means of navigating between report levels: Who, What, and When. These dimensions are described in Table 4. This feature allows users to view data that can be analyzed appropriately, depending on whether the focus is on testing group (e.g., school or roster), or period of time (trend). Note: Not all dimension categories are available at all times. Available categories are dependent on your user role and the report type and level you are viewing. A cell that has been grayed out on the Exploration Menu and displays the text N/A means that you cannot navigate any further up or down in that dimension. Accessing Exploration Menu Exploration Menu Levels Less Detailed More Detailed Who What When Table 4: Score Reports Dimensions Dimension Description Categories/Reports Who What When Lets users see the data for institutions and groups (LEA-level, school-level, teacher-level, roster-level, and individual students). Lets users explore the data by reporting categories and content standards within the selected subject/content area. Lets users see the data either as a snapshot of performance in the current test window or as a historical trend (for the subject/content area you are viewing). View School View Teacher View Class View Student View Subject View Reporting Categories View Content Standards View Trend View Testing Window 23

24 Breakdown By Demographic Subgroup The Breakdown By filter allows you to disaggregate the score data by a specific demographic subgroup category. Selecting a filter will expand the report you are viewing to display the data for each subgroup. For example, if you select Special Education and click the [Go] button, the report will display the associated score data for Special Education and General Education students as shown. Figure 13. Sample Score Report with Breakdown By Special Education The demographic subgroup categories are listed in Table 5. Table 5. Demographic Subgroups LEP Ethnicity Special Education LEP Not LEP Asian African American American Indian Caucasian Hispanic Pacific Islander Special Education General Education 24

25 Show/Hide Comparison Data By default, each of the score reports provide overall score data of the state, LEA, and/or school that are displayed in the top rows above the green line. This can be used for comparing your results to the parent entity. If the comparison data are displayed in the same table as the rest of the report, you can choose to show or hide the comparison data when viewing the report. You can click the [Comparison] button above the report to show or hide the comparison rows. When the [Comparison: On] button is displayed, the comparison rows are visible on the report. Figure 14. Sample Score Report with Comparison On When the [Comparison: Off] button is displayed, the comparison rows are hidden from view. Figure 15. Sample Score Report with Comparison Off 25

26 Data Sorting Users can sort the data displayed in the different columns in the report in ascending or descending order by clicking the column header. Show/Hide Columns The score reports contain a number of columns. You can show or hide columns displayed on the report by clicking the arrow icon [ ] in the top right corner of the table. When you click the arrow, a list of the columns constituting the table is displayed. You can uncheck the check boxes next to the columns that you wish to hide. This will remove the columns from view. By default, all the columns are checked. To remove the list from view, move your cursor away from the arrow icon. 26

27 Reports in the Who Dimension: Subject Detail Reports SAGE When you click a cell containing a percentage value for a selected grade- or course-based test from the Home Page Dashboard screen, you are taken to the selected Subject Detail Report. The subject detail report name consists of the following components: The score report name is Student Performance At Each Proficiency Level. How did my [entity] perform overall in [Subject or Course], where the text within brackets indicates variables that change based on the test that you have selected Each report also indicates the test name (subject and grade or course), the administration, and the entity (e.g., LEA, School, teacher, or roster) for whom the report has been generated. The title of the score report table is Average Scale Score and Percent at Each Proficiency Level [Subject or Course] Test for Students in [Entity], where the text within brackets indicates variables that change based on the test that you have selected. These Subject Detail Reports display overall student performance for the selected test. All data are based on the total number of students who have taken and completed the test and submitted it for scoring. All the Subject Detail Reports display the columns described in Table 6. Table 6. Subject Detail Report Columns Column Name Grouping Student Count Average Scale Score Percent (%) Proficient Percent (%) at Each Proficiency Level Description The name of the entity/individual you are viewing (e.g., LEA, school, teacher, class, student). The demographic subgroup whose data you are viewing. This column is only displayed if you have disaggregated the data using the Breakdown By filter. The number of students to date who have submitted the selected test for scoring. The average scale score of students who have completed the selected test. The percentage of students to date who have scored proficient (Proficient or Highly Proficient) on the selected test. The distribution of students across each of the four proficiency levels. 27

28 Sample School Listing Report The School Listing Report is the default for state- and LEA-level users and shows data for the subject- or course-based test selected on the Home Page Dashboard screen. A school s performance data in the selected grade and subject or course is displayed together with the associated LEA s and state s performance in the selected grade and subject or course for the purpose of comparison. Authorized users can view the data for each school in the selected LEA. You can continue to lower levels of this report and view data at the teacher, class, and student levels using the Exploration Menu. You can also switch to the Reporting Categories report or the Trend (Longitudinal) report for subjects or courses where longitudinal data is available. Figure 16. Sample Subject Detail Report: School Listing Report 28

29 Sample Teacher Listing Report The Teacher Listing Report is the default for school-level users and teachers and shows data for the grade and subject or course selected on the Home Page Dashboard screen. The Teacher Listing Report displays all the teachers in the selected school who have students who have completed the selected test. To navigate to the Teacher Listing Report from the School Listing Report, click the magnifying glass icon [ ] next to a school name, and then click [View Teacher]. Figure 17. Sample Subject Detail Report: Teacher Listing Report Similar to the School Listing Report, you can continue to lower levels of this report and view data at the class and student levels using the Exploration Menu. You can also switch to the Reporting Categories report or the Trend (Longitudinal) report. 29

30 Sample Roster Listing Report The Listing Report displays the selected teacher s class rosters; these rosters include students who have completed the selected test. For information on how to create rosters, refer to Manage Rosters. To navigate to this report from the Teacher Listing Report, click the magnifying glass icon next to a teacher s name and then click [View Class]. Figure 18. Sample Subject Detail Report: Roster Listing Report Tip: To view all the rosters in a school, click the magnifying glass next to the school s name and click the [View Class] button. 30

31 Sample Student Listing Report The Student Listing Report displays all the students in the selected roster who have completed the selected test. To navigate to this report from the Roster Listing Report, click the magnifying glass icon [ class name and then click [View Student]. ] next to a Note: You can see each student s scores as well as the average scores for the state, LEA, school, teacher, and roster. However, unlike other subject detail reports, you will not be able to hide the comparison data. Figure 19. Sample Subject Detail Report: Student Listing Tip: To view all the students in a school or all the students associated with a teacher, click the magnifying glass next to the school s name or teacher s name as applicable, and then click the [View Student] button. 31

32 About the Student Listing Report The Student Listing Report provides details about each student. The report is available for all students in a roster. The Student Listing Report provides the following information: The student s name and student ID. The student s scale score. The proficiency level classification associated with the student score. The Student Listing Report has several key differences from the higher-level subject detail reports: The name of the report is Summary of Overall Student Performance. How did my students perform on the [Subject] test, where the text within brackets indicates variables that change based on the test that you have selected. The title of the score report table is Scale Score and Proficiency Levels [Subject] Test for Students in [Entity], where the text within brackets indicates variables that change based on the test that you have selected. Students SSIDs are displayed. The scores displayed are for individual students, and are not mean scores. The comparison scores for the state, LEA, school, teacher, and roster cannot be hidden from view. The [Print] tool on the Student Listing Report allows you to print the current screen and also allows you to generate a PDF file of individual student reports of all the students in the roster. When you click the [Print] button on the Student Listing Report, a pop-up window is displayed that enables you to specify the report you wish to print. To print the data displayed on the screen, click the [Print this Page] button. To generate a PDF report of all the listed students, click the [Print Individual Student Reports] button. The PDF reports can be accessed from the Inbox section of the Retrieve Student Results screen. For more information, refer to Inbox. Caution: All student data are confidential. If you export or print these student reports, ensure that they are kept in a secure place where others cannot access them. 32

33 Sample Individual Student Report The Individual Student Report displays the breakdown of the student s scale score; proficiency level descriptors for the selected subject- or course-based test; and performance at each reporting category. The report includes average scale scores for the State and LEA for comparison purposes and may also include a graph to display the student s performance on the test over time. Caution: Average scores are compiled from the scores of those students who have taken the same test to date; averaged computations do not include those students who have not taken or completed the test. To navigate to this report from the Student Listing Report, click the magnifying glass icon next to a student s name and then click [View Student]. Figure 20. Sample Subject Detail Report: Individual Student Report 33

34 About the Individual Student Report The Individual Student Report provides the following information: Student Test Performance This table includes: o The student s name and student ID. o The student s birth date. o The student s overall scale score. o The proficiency level classification associated with the student score. Scale Score and Overall Performance This barrel chart visually depicts the student s proficiency level based on his overall scale score. Reporting Categories This table includes: o The student s scale score in each of the reporting categories for the selected test. o A strength and weakness indicator is also provided for each reporting category. Refer to the legend on the top of the report for understanding the data represented. Note: If scale scores are not available for a particular reporting category, the scale score column will be empty and the [ ] indicator will be displayed to indicate that scores are not available. For example, if a student completes the Writing portion of an ELA test and not the Reading portion, scale score will be reported for the writing reporting category but not the Reading reporting categories and overall scale score. Standard Error of Measurement Text This table includes: o Text about the SAGE standard error of measurement. Comparison Scores This table includes: o Average scale score and percent proficient for the state Caution: The average scale score and percent proficient for the state will only be available after all state testing has been completed. o Average scale score and percent proficient for the LEA with which the student is associated. o Average scale score and percent proficient for the school with which student is associated. 34

35 Student Performance on Writing This table provides information about the student s performance on the Writing test, which includes two essays. Caution: This table is only displayed for ELA tests. For ELA Grades 3 5, students will be required to write an informative and an opinion essay; for ELA Grades 6 11, students will be required to write an informative and an argumentative essay. Student Performance Over Time This graph plots the scale scores for the student at each point in time (across test administrations both within and between school years) and visually depicts his performance over time. Caution: About the Trend Graph The trend graph is not available for Science tests. The line may be broken if data is not available for a particular test administration. 35

36 Reports in the What Dimension: Reporting Categories SAGE The Reporting Categories reports show the overall performance of your students in each of the reporting categories for the selected test. This report displays the number of students who have completed the test (student count), the percentage of students tested, the scale score of these students together with the corresponding strength and weakness indicator for each reporting category. You can access this report from any of the Subject Detail Reports, except for the Individual Student Report, by clicking the [View Reporting Categories] button on the Exploration Menu. The reporting category report name consists of the following components: The score report name is [Entity] Performance for Each Reporting Category. What are my [entity] strengths and weaknesses in [Subject or Course], where the text within brackets indicates variables that change based on the test that you have selected. Each report indicates the test name (subject and grade or course), the administration, and the entity (e.g., LEA, School, teacher, or roster) for whom the report has been generated. The title of the score report table is Average Scale Score and Performance on Each Reporting Category [Subject or Course] Test for Students in [Entity], where the text within brackets indicates variables that change based on the test that you have selected. Figure 21. Sample Reporting Categories Report As with the Subject Detail Reports, you can also use the Exploration Menu to view data at the teacher, roster, or student level. You can also switch to the Content Standards report or the Trend report. 36

37 Sample Strengths and Weaknesses by Content Standard Report To navigate to this report from the main Reporting Categories report, click the magnifying glass icon next to a school name and then click [View Content Standards]. This report will display all the content standards for each of the reporting categories in the selected test. The data shown in the Comparison Scores table are the average subject scores and percent proficient for the state, LEA, school, teacher, and roster. Figure 22. Sample Strengths and Weaknesses by Content Standard Report The performance levels indicated on this report are relative to the test as a whole. Unlike performance levels provided at the subject level, these strengths and weaknesses do not imply proficiency. Instead, they show how a group of students performance is distributed across content standards relative to their overall subject performance on a test. For example, a group of students may have performed very well in a subject, but performed slightly lower in several content standards. Thus, the minus sign for a content standard does not imply a lack of proficiency. Instead, it simply communicates that these students performance on that standard was statistically lower than their performance across all other content standards put together. Though the students are doing well, an educator may want to focus on these areas. Definitions for each performance level are described in Table 7. 37

38 Table 7. Content Standard Level Legend Descriptions Benchmark Level Better than performance on the test as a whole Similar to performance on the test as a whole Description This content standard is a relative strength. The group of students performed better on items from this content standard than they did on the rest of the test as a whole. This content standard is neither a relative strength nor a relative weakness. The group of students performed about as well on items from this content standard as they did on the rest of the test as a whole. Worse than performance on the test as a whole Too Few Items or Too Few Students This content standard is a relative weakness. The group of students did not perform as well on items from this content standard as they did on the rest of the test as a whole. Not enough information is available to determine whether this content standard is a relative strength or weakness. Finding Resources in SAGE Formative The Content Standard Level Report also enables you to directly link to Mathematics, Reading, and Science resources for each content area standard in the SAGE Formative system. Click the [Find Resources] button for any content standard to open a new browser window or tab. You will be automatically directed to the Browse Resources screen in the SAGE Formative. The associated resources for the topic you selected will be automatically displayed. For information about using SAGE Formative and creating assignments using available resources, refer to the SAGE Formative User Guide found on the SAGE Portal. 38

39 Reports in the When Dimension: Trends (Longitudinal) SAGE Trend or Longitudinal reports display the overall performance of a student or group of students in the selected subject throughout the administrations using graphs and tables. The average scale score for each testing window is plotted. Scores from previous years represent a group s average score or a student s individual score from that year s testing window. All tests taken within the current school year are valid only for individual student trends. Caution: Trend reports are not available for Science tests as these tests do not use a vertical scale that can be used for comparisons across grades, between test administrations, and over time. The trend report name consists of the following components: The score report name is Longitudinal Report. How did my students perform over time? Each report also indicates the subject or course and the entity (e.g., LEA, School, teacher, or roster) for whom the report has been generated. The title of the score report table is Student Scale Scores on [Subject or Course] Test Over Time, where the text within brackets indicates variables that change based on the test that you have selected. Figure 23. Sample Trend Report: LEA-Level Report 39

40 The trend report shows the trend of performance for the LEA, school, teacher, class (roster), and/or student you are analyzing. The graph plots the data points for the selected groups of students or individual students at each point in time (across test administrations both within and between school years). The red line in the graph is the performance level for the current grade. Placing the mouse over a point on the line graph will allow you to see details of that score. Trend Report Features Trend reports are interactive. You can choose the tests that should be plotted on the graph. Users can also use the Choose Who to Graph and What to Graph (if available) features to plot specific data on the historical graph. The notable trend report features are described below. Select Administrations to Plot By default, the trend report is set to plot summative and interim administrations on the graph. However, you may choose to only plot the administration selected on the Home Page Dashboard screen. To plot only the administration selected on the Home Page Dashboard, from the Display dropdown list, select Selected Test. Click the [Go] button. The trend report will plot the data points for the selected administration. Choose Who to Graph In this section, you may select up to five entities to compare at one time. Due to space constraints, you cannot select more entities. A trend line for each selected entity will appear on the graph and will be color coded. You can select an entity by clicking the checkbox next to the entity from the Choose Who to Graph box. Viewing Data by Demographic Subgroup As with the subject and reporting categories reports, you may also choose to plot data points by subgroup, for example, ethnicity. When a subgroup is selected, the Choose Who to Graph box will display the options for each entity. Select the combination of entity and subgroup(s) that you want to plot. Dimensions Each entity listed in this box also displays the magnifying glass icon. You can elect to drill down and view trend data at the teacher, roster, or student levels. Choose What to Graph In this section, you may select the overall test subject data (default) or individual reporting categories to plot. 40

41 Dropped Students All trend report pages include a column called Dropped Students. A [View] button in the Dropped Students column indicates that some students were not included in the trend report. If the column displays N/A, then no students were dropped or excluded from the trend report. Students in the aggregate grouping are dropped from a trend report if they have not completed the selected test across all charted test windows. For example, a student who took the Grade 5 Mathematics test in the window, but not in the window will be excluded from a trend report that includes both testing windows. To see the students who were not included, click the [View] button. A pop-up window will appear showing the names of the students. Why Students Are Dropped When looking at data for a group of students over time, it is important to look at the same sample of students. If a student was not present for all testing windows displayed in your trend report, then that student will be omitted from the calculation of the mean scores. This helps to ensure that observed changes in mean scores are the result of actual differences in performance and not the result of the absence of a student during a testing window. Because of this, the average score on the trend report may not always match what you observe in the Subject Detail Report, especially if many students were omitted from the trend calculations. Hiding Trend Lines After you have plotted trend lines, you may want to temporarily hide a trend line to better view data. To do so, navigate to the box below the graph that contains the legend for the trend lines. Figure 24. Sample Trend Line Box To hide/unhide the trend lines: 1. Locate the box listing the trend lines for the report (see Figure 24). 2. Click the trend(s) you want to hide. The trend you have selected will become grayed out and the line will disappear from the graph. 3. To display the trend line again, click the trend name again. The line will reappear on the graph. 41

42 Zoom Feature Sometimes data points are plotted very close to one another, and it can be difficult to discern what points belong to which entity and/or reporting category. You can use your computer s mouse to zoom in on different areas of the graph. To zoom in or out of a trend graph: 1. To zoom in, click your mouse's left button and drag the mouse over an area of the graph that has at least one data point. You may repeat this action until you are satisfied with the view. 2. To zoom out and return to the full trend graph, click the [Reset zoom] link at the upper left corner of the graph. 42

43 Sample LEA Trend Report This report is available to state- and LEA-level users who have access to viewing data for an LEA. Figure 25. Sample Trend Report: LEA-Level Report You can view trends by reporting categories. Simply click the magnifying glass icon next to the LEA, school, teacher, or class name to open the Exploration Menu and click [View Reporting Categories]. This feature is available for all trend report levels. As with Subject Detail Reports, you can also filter trend reports by a selected subgroup using the Breakdown By feature. 43

44 Sample Teacher Trend Report To navigate to this report, click the magnifying glass icon next to a school name and then click [View Personnel]. The data shown are the average scale scores for the selected school. To plot trends for specific teachers, click the check box next to each roster for which you want to view data points. Figure 26. Sample Trend Report: Teacher-Level Report 44

45 Sample Roster Trend Report To navigate to this report, click the magnifying glass icon next to a teacher s name and then click [View Class]. The data shown are the average scale scores of all classes or rosters for the selected teacher. To plot trends for specific rosters, click the check box next to each roster for which you want to view data points. Figure 27. Sample Trend Report: Roster-Level Report 45

46 Sample Student Listing Trend Report To navigate to this report, click the magnifying glass icon next to a class name and then click [View Student]. By default, the trend line displayed is for the first student shown at the top of the list in the Choose Who to Graph box. To plot trends for specific students, click the check box next to each student whose data points you want to view. Figure 28. Sample Trend Report: Student Listing Report 46

47 Section IV. Manage Rosters SAGE This feature of the ORS allows you to create custom groupings of students for analyzing aggregate score data. Rosters can be used to track students test scores easily. For example, the ORS can generate a report of all of a teacher s students who have been tested in a given grade and subject or course. School-level users can create a roster if they want to view a report that lists all students in a specific grade who have tested. You can also create a custom list of students in order to track their performance as a group. For example, users may wish to create rosters that contain only students receiving special instruction or who belong to an extracurricular program. This feature is accessible at all times except when the Test Information Distribution Engine (TIDE) system is unavailable as a result of scheduled maintenance. Creating and Managing Rosters Authorized users can manage rosters and create new rosters for themselves as long as they have a direct relationship to a school and students. These rosters can be used for reporting in the ORS as well as for student assignments in the SAGE Formative system. You can access this feature by clicking the [Manage Rosters] button in the banner. When you click the button, a pop-up window is displayed as shown in Figure 29, where you can create and manage your rosters. Figure 29. Manage Rosters Pop-up Window 47

48 Creating a New Roster You can create multiple rosters of students associated with you. Rosters may also include students from different grades. Note: The score reports display data only for a single subject and grade (NOT grade band) or course at one time. If a roster includes students from multiple grades, you will see only the roster-level data that correspond to the subject- or course-based test you selected on the Home Page Dashboard screen. For example, if a roster includes students from grades 3 and 4, and you select a Grade 3 Math test, you will see data only for the students who tested in grade 3. Caution: Users cannot add students from another school to their roster unless they are associated with that school. Teachers cannot create rosters for other teachers. You can select the students you want to include in the roster from the Manage Rosters: Roster Settings pop-up window (see Figure 30) that can be accessed from the Manage Rosters pop-up window (see Figure 29). Figure 30. Manage Rosters: Roster Settings 48

49 To create a roster: 1. Click the [Manage Rosters] button. The Manage Rosters pop-up window (see Figure 29) will open. 2. From the District drop-down list, select your LEA. The drop-down list will only display the LEAs you are associated with. For most users the LEA will be pre-selected. 3. From the School drop-down list, select your school. The drop-down list will only display the schools you are associated with. If you are associated with multiple schools, you may only create and manage rosters for one school at a time. 4. From the Roster drop-down list, select ADD NEW ROSTER. 5. Click the [Next] button. The Manage Rosters: Roster Settings pop-up window (see Figure 30) will load. 6. In the Roster Name field, enter a name for the group. The roster name must be between five and 100 characters. 7. From the Teacher Name drop-down list, select a teacher. The drop-down list will only display personnel who are identified as teacher users and who are associated with the selected school. 8. Mark the check boxes for all the grade(s) from which you wish to build the roster. The Available Students box will display the names of all the available students in the selected grades. 9. From the Available Students box, select the students you want to include in the roster. o To select a range of students (inclusive), select the first student and last student you want to include while holding down the [Shift] key on your keyboard. All students between the first and last student selected will be highlighted. o To select multiple individual students (not in a range), select the first student and then hold down the [Ctrl] key as you select additional students. 10. Click the [Move In >>] button. The selected students names will appear in the Students in This Roster box. 11. To save the roster, click the [Save] button. 49

50 Editing an Existing Roster Authorized users can edit existing rosters. Caution: Please edit only rosters created by LEA- or school-personnel. Do not edit rosters created by USOE. Any changes to existing rosters will also appear in the SAGE Formative system. Figure 31. Manage Rosters: Edit/Delete Rosters Pop-up Window 50

51 To edit an existing roster: 1. Click the [Manage Rosters] button. The Manage Rosters pop-up window (see Figure 29) will open. 2. From the District drop-down list, select your LEA. The drop-down list will only display the LEAs you are associated with. For most users the LEA will be pre-selected. 3. From the School drop-down list, select your school. The drop-down list will only display the schools you are associated with. If you are associated with multiple schools, you may only create and manage rosters for one school at a time. 4. From the Roster drop-down list, select the name of the roster you wish to edit. a. Optional: If you want to view system generated rosters in the drop-down list, mark the checkbox for Show System Defined Rosters. Note: System defined rosters cannot be edited or deleted. 5. Click the [Next] button. The Manage Rosters: Edit/Delete Rosters pop-up window (see Figure 31) will load. 6. Optional: In the Roster Name field, change the roster s name if required. 7. Optional: From the Teacher Name drop-down list, select a different teacher if required. 8. Optional: Remove a student from the roster if required, following these steps: a. From the Students in Roster box, select the student you want to remove. b. Click the [<< Move Out] button. The student should no longer appear in the Students in Roster box. 9. Optional: Add students to the roster if required, following these steps: a. Mark the check box(es) for the appropriate grade(es). The Available Students box will populate with a list of students in the selected grade(es). b. Select each student you want to add to the roster. c. Click the [Move In >>] button. The student(s) you selected should now appear in the Students in This Roster box. 10. To save the updates, click the [Save] button. 51

52 Deleting a Roster You can delete a roster if required. Caution: This action cannot be undone. Please take care when deleting rosters and only delete LEA- and school-created rosters. Deleting a roster from the ORS will also remove it from the SAGE Formative system. Deleting a roster will not remove your association with the students in that roster. To delete a roster: 1. Click the [Manage Rosters] button. The Manage Rosters pop-up window (see Figure 29) will open. 2. From the District drop-down list, select your LEA. The drop-down list will only display the LEAs you are associated with. For most users the LEA will be pre-selected. 3. From the School drop-down list, select your school. The drop-down list will only display the schools you are associated with. If you are associated with multiple schools, you may only manage rosters for one school at a time. 4. From the Roster drop-down list, select the name of the roster that you want to delete. 5. Click the [Next] button. The Manage Rosters: Edit/Delete Rosters pop-up window (see Figure 31) will load. 6. Click the [Delete] button. A pop-up message will appear that asks whether you are sure you want to delete the roster. 7. To delete the roster, click the [OK] button. Printing a Roster You can print a roster if required. To print a roster: 1. Click the [Manage Rosters] button. The Manage Rosters pop-up window (see Figure 29) will open. 2. From the District drop-down list, select your LEA. The drop-down list will only display the LEAs you are associated with. For most users the LEA will be pre-selected. 3. From the School drop-down list, select your school. The drop-down list will only display the schools you are associated with. 4. From the Roster drop-down list, select the name of the roster that you want to print. 5. Click the [Next] button. The Manage Rosters: Edit/Delete Rosters pop-up window (see Figure 31) will load. 6. Click the [Print] button. You can print the roster list report that displays in a new window. 52

53 Section V. Test Management Center SAGE The Test Management Center allows authorized users to generate customized participation reports to determine which students have completed testing or need to complete testing; view summary statistics; retrieve student results; check test completion rates by school, grade, subject, course and opportunity; and generate a test status report that lists all tests that have not been completed, as well as tests that have been invalidated. From the Test Management Center drop-down list in the banner, select the report type you want to generate. Each of the available reports is discussed below. Summary Statistics The Summary Statistics section allows you to view the statistics for students who have tested for a selected test by administration year and test name (grade and subject or course). Note: Depending on the amount of data being processed, the report may take a few seconds or longer to display. Figure 32. Sample Summary Statistics Screen 53

54 Generating a Summary Statistics Report To generate a summary statistics report: 1. From the Test Management Center drop-down list, select Summary Statistics. This will take you to the Summary Statistics screen (see Figure 31). 2. From the Test, Administration, and Test Name drop-down lists, select the parameters for your report. 3. Click the [Generate Report] button. The report will be displayed on the screen. Table 8 describes the columns available in the Summary Statistics screen. Table 8. Summary Statistics Column Descriptions Data Column % Tested at each opportunity and count 0 the % of students whose tests have not yet reached Reported status. (This includes students who have not started the test opportunity.) 1 completed (reported) first opportunity Description This section displays the percent of students whose tests are in reported status for the corresponding opportunity. For example, the value next to opportunity number 1 indicates the percentage of students whose tests are in reported status for the first opportunity. Reminder: Only one opportunity is available for SAGE operational tests. [#] Student count The student count column shows the number of students who have completed each opportunity in brackets. The student count displayed for 0 opportunity is the number of students who have not yet started the first opportunity. % Proficient This column displays the percentage of students who have met (or exceeded) proficiency for the selected test. This calculation is based on the number of tests that have been completed and scored. 54

55 Retrieve Student Results SAGE This feature of the ORS allows you to download student data for a selected test window by LEA, school, teacher, or roster. The data will include students personal information, including enrolled school and LEA and grade level, and the selected test scores and content standard scores (if applicable). Note: You can also retrieve batch PDF files of individual student reports that have been generated from the Student Listing Report screen. Figure 33. Sample Retrieve Student Results/Inbox Page Generating a Data File To generate a data file: 1. From the Test Management Center drop-down list, select Retrieve Student Results. This will take you to the Retrieve Student Results screen. 2. Select the parameters for your file. For more information on how to select parameters, refer to Select Data File Parameters. 3. Click the [Download Roster] button. A message will be displayed to inform you that your request has been queued and that you will be informed via once the file is ready. 4. Once the file has been generated, it will be displayed in the Inbox section on the Retrieve Student Results screen. You can download the data file by clicking the [Download] link for the data file. Your files will be available for 30 days. 55

56 Select Data File Parameters Step 1: Choose What Select the test(s), grade(s), and other variables for which you want to generate a report. 1. From the Test drop-down list, select an assessment (e.g., SAGE Summative). 2. From the Administration drop-down list, select a test window. 3. Optional: From the Tested Grade drop-down list, select the grade or grade band for which you want to generate the report. Alternatively, select All Grades to create a separate file for each available tested grade. These files will be provided in a Zip file. 4. Optional: Select a date range for when students were tested. To specify a date range, click the [Date Range] button and select the start and end dates from the pop-up calendar. 5. From the Download Format drop-down list, select a download file format. The default is an Excel (.xls) spreadsheet file. 6. Optional: From the Filter By drop-down list, select a specific demographic subgroup to filter the report if required. You may also select All, which is the default. o If you do select a demographic subgroup, a Values field will be displayed. You can select the required filter criteria from the options available for the specified subgroup. Note: The Values field does not have an All option. Step 2: Choose Who Select which LEA, school, teacher, and class should be included in the report. Note: For most users, the LEA or school you are associated with will be pre-selected and the drop-down lists will be grayed out. Verify that the selections are accurate. LEA and school users with access to multiple LEAs or schools will need to select a LEA and/or school. 1. From the LEA drop-down list, select a LEA if applicable. 2. From the School drop-down list, select a school if applicable. The drop-down list displays all the schools with which you are associated. You can also select All to generate a report that includes all your schools. 3. Optional: If a school was selected, choose a teacher from the Teacher drop-down list. The default is set to All and includes all teachers associated with the school. 4. Optional: If a teacher was selected, choose a class or roster from the Class drop-down list. The default is set to All and includes all rosters associated with the selected teacher. 56

57 Inbox This section of the Retrieve Student Results screen lists the data files that you requested. Note: You can access the Inbox in two ways: From the Test Management Center drop-down list, select Retrieve Student Results. Click the [Inbox] button on the banner. The number in parenthesis next to the [Inbox] button displays the number of files existing in the Inbox that are yet to be downloaded. For example, if the Inbox consists of two files of which one has previously been downloaded, (1) will be displayed next to the [Inbox] button. Figure 34. Inbox The files in the Inbox display the following information: The entity name (e.g., LEA, school, teacher, or class) The type of data file you requested (e.g., LEA, school, teacher, or class) The test type (e.g., SAGE Summative, SAGE Interim) The administration or test window (e.g., ) The grade level of the students in the data file The date and time the data file was created The status of the request To access a data file: Click the [Download] link in the Status column. 57

58 Opening and Viewing the Data File You can download your requested student data file in either.xls or.csv format. You may also choose to download it in another format (e.g.,.txt file type). If you choose to download the file as a.txt file, then you will need to follow the instructions below to view the file in Microsoft Excel or a similar spreadsheet program. Figure 35. Sample Data File Output Downloading and viewing a.txt file: 1. Save the file to your desktop or other desired location on your computer. 2. Open Microsoft Excel. 3. Navigate to File > Open. 4. A drop-down list displaying file types will appear next to or below the File Name box. Select Text Files (*.prn; *.txt; *.csv). The.txt file that you saved should now appear in the location in which you saved it. 5. Select the file and click [Open]. 6. The Text Import Wizard will open. You will have to navigate through three steps: a. Make sure Delimited is selected and click [Next]. b. Click the check box next to Other, enter the symbol (this is often on the same key as the forward slash \ ), and click [Next]. c. Click [Finish]. 7. The data will populate in separate columns in Excel. For ease in opening this file in the future, you may want to re-save the file as an Excel Workbook (.xls or.xlsx) file. This will prevent you from having to import the data again. 58

59 Plan and Manage Testing SAGE This feature of the ORS allows users to generate customized participation reports showing their students testing activity. You can determine which students have completed testing and which students have yet to begin or complete a test opportunity. Note: Participation data is only available for the tests being administered during the current administration. Figure 36. Sample Plan and Manage Testing Screen Generating a Plan and Manage Testing Report To generate a plan and manage testing report: 1. From the Test Management Center drop-down list, select Plan and Manage Testing. This will take you to the Plan and Manage Testing screen. You can also access this screen by clicking the [Plan and Manage Testing] button on the Welcome screen (see Figure 6) that is displayed when you first log in to the ORS. 2. Select the parameters for your report. For more information on how to select parameters, refer to Selecting the Parameters for Your Report. 3. Click the [Generate Report] button to view the report on the screen. Alternatively, you can click the [Export Report] button to open the report in Microsoft Excel. For information, refer to Exporting Plan and Manage Testing Data into Excel. Caution: The displayed information reflects current data as of the time you generated the report. To update the information displayed in your report, you must generate a new report. 59

60 Selecting the Parameters for Your Report Step 1: Choose What Select the test(s) and variables that should be used to generate the basic parameters for the report. 1. From the Test drop-down list, select an assessment. The default is set to SAGE Summative. 2. From the Administration drop-down list, select a test window. 3. Optional: From the Test Name drop-down list, select the test (subject and grade) for which you want to generate the report. The default is set to All. 4. Optional: From the Enrolled Grade drop-down list, select the grade for which you want to generate the report. The default is set to All. 5. Optional: From the Test Settings drop-down list, select a test setting or accommodation. The default is set to All. Step 2: Choose Who Select which LEA, school, and teacher should be included in the report. Note: For most users, the LEA or school you are associated with will be pre-selected and the drop-down lists will be grayed out. Verify that the selections are accurate. LEA and school users with access to multiple LEAs or schools will need to select a LEA and/or school. 1. From the LEA drop-down list, select a LEA if applicable. 2. From the School drop-down list, select a school if applicable. The drop-down list displays all the schools with which you are associated. You can also select All to generate a report that includes all your schools. 3. Optional: If a school was selected, choose a teacher from the Teacher drop-down list. The default is set to All and includes all teachers associated with the school. Step 3: Get Specific Select the report filter option that best matches your needs. Each filter will generate a report containing students whose information matches the parameters you have selected. To select the parameters in this section: 1. Click the radio button for the row that has the parameters you wish to use. 2. Specify the parameter values for the available parameters. The different report filter options are listed below. The values in braces {} are the parameter values that are available for selection. 60

61 students who {have/have not} {completed/started} the {1 st } opportunity in the selected administration. This filter allows you to o determine which students have completed testing; or o determine which students have or have not started testing. students on their {1 st } opportunity in the selected administration, and have a status of {student test status}. This filter allows you to o determine which students have a specified test status for the selected test opportunity. For a list of test statuses and their definitions, refer to Table 9 or click the [Definitions] button on the Plan and Manage Testing screen. students whose most recent {Session ID/TA Name} was between {start date} and {end date}. This filter allows you to o search for students who were in a specific session and view their current test status. This report returns the most recent participation data for students who have taken the selected test. To view this report: Optional: Specify whether you wish to search by Session ID or Test Administrator (TA) and enter the Test Administrator s Session ID or name as applicable. Click the date fields to view the calendar and select the time frame. If the Session ID or TA name is not specified, you will be limited to a date range search of 15 days. search student(s) by {SSID/Name}:. This filter allows you to o search for specific names by their SSIDs or names. To view this report: Specify whether you wish to search by SSID or name. If SSID is selected, enter up to 20 SSIDs. If Name is selected, enter partial first or last names or the full name in Lastname, Firstname format. Table 9. Test Status Definitions Status Approved Completed Denied Expired Invalidated Definitions The TA has approved the student for the session, but the student has not yet started or resumed the test. The student has submitted the test for scoring. No additional action can be taken by the student. The TA denied the student entry into the session. If the student attempts to enter the session again, this status will change to Pending until the TA approves or denies the student. The student s test has not been completed and cannot be resumed because the test has expired. The test result has been invalidated. 61

62 Status Paused Pending Reported Rescored Review Scored Started Submitted Definitions The student s test is currently paused (as a result of one of the following): o The student paused his or her test by clicking the [Pause] button. o The student idled for too long (more than 30 minutes) and the test was automatically paused. o The Test Administrator paused the session. o The Test Administrator paused the individual student s test. o The student s browser or computer shut down or crashed. The student is awaiting TA approval for a new test opportunity. The student s score for the completed test has been submitted to the Online Reporting System and can be viewed by authorized users. The test was rescored. The student has answered all test items and is currently reviewing his or her answers before submitting the test. (A test with a review status is not considered complete.) The test will display a scored status, followed by the student s score. The student has started the test and is actively testing. The test has been submitted for quality assurance review and scoring before it is sent to the Online Reporting System. Note: All tests go through an internal scoring process during quality assurance review. When standard setting is completed, final scores will be generated. Suspended The student is awaiting TA approval to resume a testing. 62

63 Understanding Your Participation Report Upon clicking [Generate Report], the participation report displays data based on your selected parameters. Each report includes a list of all students who meet your selected parameters. If no students are listed, this means that no students matched your report criteria. You can generate the following two types of reports from the Plan and Manage Testing screen: Online Testing Progress Report TA Report Online Testing Progress Report The Online Testing Progress Report is generated when you select the first two radio buttons or last radio button in Step 3: Get Specific section of the Plan and Manage Testing screen. Figure 37. Online Testing Progress Report 63

64 Features of the Online Testing Progress Report The features of the Online Testing Progress Report are as follows: The search results table consists of 14 columns. To view all the data, you will need to use the horizontal scroll bar at the bottom of the report. The constituent columns are described in Table 10. You can show or hide columns in the table by clicking the arrow [ ] icon in the top right corner of the table. When you click the arrow, a list of the columns in the table is displayed. You can uncheck the check boxes next to the columns that you wish to hide. This will remove the columns from view. To remove the list from view, move your cursor away from the arrow icon. You can sort data in ascending or descending order for all the columns. Click the column header to sort data in ascending (A Z; 1 10) or descending (Z A; 10 1) order. The default sort is by Student Name, in ascending order by last name. The Online Testing Progress Report also provides you with access to General Tools that include Help, Print, and Definitions. For information on the functionality of each of these tools, refer to General Tools. You can return to the Plan and Manage Testing screen using the [Back] button at the bottom of the report. Table 10. Participation Report Column Attribute Definitions Attribute Student Name State Student Identifier Enrolled Grade Description Student s legal name (Last Name, First Name). Student s seven-digit State Student Identification Number. The grade in which a student is enrolled. Test Test name for this student record (e.g., ELA Grade 3 ). Results ID Date Started Date Completed Language TA Name Session ID Status Restarts The unique identifier linked to the student s results for that specific opportunity. The date when the first test item was presented to the student for that opportunity. The date when the student submitted the test for scoring. The language setting that was assigned to the student (English or Braille). The Test Administrator who created the session in which the student is currently testing (or in which the student completed the test). The Session ID to which the test is linked. The status for that specific opportunity (see Table 9 for status definitions). The total number of times a student has resumed a test (e.g., if a test has been paused three times and the student has resumed the test after each pause, this column will show three Restarts ). (This includes Restarts Within Grace Period see below.) 64

65 Attribute Restarts Within Grace Period Last Activity Description The total number of times a student has resumed an opportunity within 20 minutes after a test was paused (e.g., if a test has been paused three times and the student resumed the opportunity within 20 minutes of two pauses but 30 minutes after the third pause, then this column will show 2 Restarts Within Grace Period). A student has a grace period of 20 minutes to pause the test and return to the test item he or she was on. However, if a test is paused for more than 20 minutes, the test session will expire and the student will not be able to review any of his or her previous answers. Note: ELA-Writing tests do not have a pause limit. The date of the last activity for that opportunity/record. A completed test can still have activity (as it goes through the QA and reporting process). 65

66 TA Report The TA Report is generated if you select the third radio button in Step 3: Get Specific section of the Plan and Manage Testing screen. The TA Report provides information about the test sessions that match the specified parameters, the name of the Test Administrator for the sessions, and the number of students associated with each of those sessions. Figure 38. TA Report Features of the TA Report The features of the TA Report are as follows: The columns constituting the search results table are described in Table 11. You can generate or export the Online Testing Progress Report for the selected TA and session. For more information, refer to Table 12. Similar to the Online Testing Progress Report you can show or hide columns in the table by clicking the arrow [ ] icon in the top right corner of the table. When you click the arrow, a list of the columns in the table is displayed. You can uncheck the check boxes next to the columns that you wish to hide. This will remove the columns from view. To remove the list from view, move your cursor away from the arrow icon. You can also sort data displayed in the columns in ascending or descending order. Click the column header to sort data in ascending (A Z; 1 10) or descending (Z A; 10 1) order. The TA Report also provides you with access to General Tools that include Help, Print, and Definitions. For information on the functionality of each of the tools, refer to General Tools. 66

67 Table 11. TA Report Columns Column Test Administrator Name Session ID Description Test Administrator s name (first name, last name). The session ID to which the tests are linked. # of Students in Session The number of students testing or tested in the specified session. # of Test IDs in Session The number of test IDs that have been generated for the session. Table 12. TA Report Icons Icon Description Enables you to generate the Online Testing Progress Report for the selected TA and session. For information on the Online Testing Progress Report, refer to Online Testing Progress Report section. Enables you to export the Online Testing Progress Report for the selected TA and session. 67

68 Exporting Plan and Manage Testing Data into Excel You can export the plan and manage testing data into an Excel file. 1. To export plan and manage testing data, perform one of the following: o To export the Online Testing Progress Report, click the [Export Report] button on the Plan and Manage Testing screen. o To export the TA Report, click the export [ ] icon on the TA Report. 2. From the pop-up window that appears, specify whether you would like to open or save your file. The report data will be exported as a Microsoft Excel (.xls) file. Note: You can also export results for all students in your school who are participating in online testing; however, this may take some time, depending on the amount of data involved. Below is a sample report exported into Microsoft Excel. Figure 39. Sample Participation Report Exported to Excel: Students Who Have Completed the First Opportunity 68

69 Test Completion Rates SAGE School and LEA users can create an Excel file showing the number of students who have completed each test. LEA-level users can create a file either for a specific school or for the whole LEA. You can also generate this report for all tests or for one specific test. These files can be viewed in Excel or uploaded into most data analysis programs. Refer to Table 13 for descriptions of the columns in the file. Figure 40. Sample Test Completion Rates Page Generating the Test Completion Rates Report To generate the test completion rates report: 1. From the Test Management Center drop-down list, select Test Completion Rates. This will take you to the Test Completion Rates screen. 2. Select the parameters for your report. For more information on how to select parameters, refer to Select Test Completion Rates Report Parameters. 3. Click the [Export Report] button. This will generate a pop-up window that enables you to open or save the Test Completion Rates Report. Select Test Completion Rates Report Parameters 1. From the Report drop-down list, select the report that you wish to generate. The reports available to you are determined by your user role. When you select a report, additional fields are displayed on the screen based on your selection. 2. From the LEA drop-down list, select the required LEA. This is only applicable if you are associated with more than one LEA. You can select a particular LEA or all the LEAs that you are associated with. 3. Optional: From the School drop-down list, select the required school. This is only applicable if you are associated with more than one school. You can select a particular school or all the schools that you are associated with. This option is only displayed when generating the School Test Completion Rates Report. 4. Optional: From the Test Name drop-down list, select the test (subject and grade or grade band) for which you want to generate the report. The default is set to All. 69

70 Figure 41. Sample Completion Rates Report for All Schools in Demo LEA Table 13. School Test Completion Rates Report Columns Column Date Test Name LEA Name LEA ID School Name School ID Opportunity Total Student Total Student Started Total Student Completed Percent Started Percent Completed Description The date and time that the file was generated. The grade, test, and subject that are being reported. The name of the reported LEA. The two-character LEA identification number. The name of the reported school. The three-character school identification number. The test opportunity number that is being reported. The number of students with an active relationship to the school in TIDE. This may include students with end-dated SSIDs. (Students with end-dated SSIDS are inactive but still associated with the school in which they were most recently enrolled.) The number of students who have started the test. The number of students who have finished the test and submitted it for scoring. The percentage of students who have started the test out of the total number of students with an active relation to the school in TIDE. The percentage of students who have completed the test out of the total number of students with an active relation to the school in TIDE. 70

71 Test Status Code Report LEA- and school-level users can also generate a test status code report. The report includes all tests for which a student is eligible. From the Test Status Code Report screen, authorized users can generate the test status code report. For each listed test, the report provides the student s information, test name, current test status, and the special code assigned, if applicable. This report works similarly to the Test Completion Rates report. While LEA users can generate a report for all students in their LEA, school-level users can generate a report for all students in their school. Figure 42. Test Status Report Screen Generating the Test Status Code Report To generate the Test Status Code Report: 1. From the Test Management Center drop-down list, select Test Status Code Report. This will take you to the Test Status Code Report screen. The Test Status Report screen displays. 2. From the Test drop-down list, select the required assessment name (e.g., SAGE Summative). 3. From the Administration drop-down list, select the required administration. 4. Click either [Generate Report] or [Export Report]. Note: About Exporting Data Generating or exporting the report may take time, depending on the amount of data included in the report. The report is exported as an Excel file. The file contains several columns including the student's name and SSID. For column definitions, see Table

72 Figure 43: Test Status Code Report Table Table 14: Test Status Code Report Columns Attribute Student Name SSID Test Name Test Status Date Started Special Code Assigned School ID Assigned School Name Description Student s legal name (Last Name, First Name). Student s seven-digit State Student Identification Number. Test name for this student record (e.g., Grade 3 ELA or Earth Science ). Test status for the test record (e.g., Paused 9/65). If a number is displayed after the status, the student has initiated testing. If no number is displayed, the student has not started the test opportunity. The numerator is the number of items that the student has responded to. The denominator is the total number of items on the test. The date when the first test item was presented to the student. When applicable, this column will list the special codes applied to a student s test record at the time of testing. The ID of the school the student is enrolled in. The name of the school the student is enrolled in. 72

73 Section VI. Search Students SAGE The ORS includes a feature to search for students by SSID, first name, or last name, or wildcard (letters or numbers). This is especially useful if you need to find a student s score reports but do not know the student s grade or school. This feature searches for score report results for students, not their test status(es) for the current test window. Note: You cannot view students who are not associated with your school or LEA. Searching for Students You can access this feature by clicking the [Search Students] button in the banner. When you click the button, a pop-up window is displayed as shown in Figure 46, where you can search for the required student(s). Figure 44. Student Search Pop-up Window To search for students: 1. Click the [Search Students] button. 2. Select the school year you want to limit your search to (e.g., ; ). 3. Enter one of the following search criteria: Enter up to 20 students full or partial SSIDs. If you are entering multiple queries, you must separate each one with a comma (e.g., , ). Enter a student s first name or last name, but not both. Enter a wildcard using letters or numbers (e.g., first three digits of a student s SSID or first four letters of a student s last name). 4. Click the [Search] button. If the search results in a match, those students information will be displayed on the Student Search Results screen (see Figure 47). 73

74 Understanding Student Search Results and Selecting a Test The Student Search Results screen shows a list of students who matched your search. If you entered a single, full SSID for an active student, this student will be the only one displayed. Figure 45. Student Search Results Screen To view the tests a student has taken, click the [+] icon in the first column. This will expand the student row. To view the student s score results for a test, click the test name button (e.g., Grade 6 Math). You will be taken to the Individual Student Report screen for the selected test. Note: When selecting a test, be sure to note the test administration for the test that you are selecting (listed in the left column). If you are selecting a student s test that is from a different administration than the one that was selected on your home screen, you will be prompted with a message asking you to confirm that you want to change test administrations. Click [OK] to continue. The student s score report will load. 74

75 Viewing a Selected Student s Test Results The Individual Student Report displays the student s score results for the test that you selected. Figure 46. Score Report for a Selected Student s Test As with any individual student score report, you can compare the selected student s performance with the school s and LEA s average performance listed in the Comparison Scores box. To return to the search results page, click the [Back to search results] link above the Student Test Performance table. 75