Digital Desk Instructor Manual

Transcription

1 Digital Desk Instructor Manual Indiana University Bloomington Indiana University Blooming Evaluation Services and Testing

2 TABLE OF CONTENTS What is Digital Desk?...2 Digital Desk Features...2 Preparing your exams for Scanning Services...3 Preparing your Answer Key for Scanning...4 Submitting Alternate Forms... 6 Logging into Digital Desk...8 View Exam Reports Adding Bonus Points Change an individual student answer Review, Generate, and Customize Reports Review and Edit an Answer sheet Assigning Partial Credit to an answer Assigning a Teaching Assistant to a section How to export Exam Grades to Canvas Digital Desk Instructor Manual 1

3 WHAT IS DIGITAL DESK? Digital Desk is a scanning software designed to streamline the exam scanning process for instructors. With an online profile, instructors will have the ability to access and review their scores through comprehensive exam analysis reports consisting of Standard Deviation, Cronbach s Alpha, Distractor Analysis and much more. Instructors will save time through Digital Desk s ability to generate and distribute reports to instructors and students via and transfer grades from their Digital Desk profile to their Canvas profile. DIGITAL DESK FEATURES Digital Desk offers instructors several ways to analyze and manage their exams. 1. Integrates with Canvas to streamline exam processing 2. Rescore exams, adding bonus points to all or to individual students 3. Review student responses, make corrections to responses or demographic information and reassign students to different answer key 4. Run reports (all or individual), release student score reports, produce customize report export 5. Modify answer keys, point values, multiple correct responses, partial and bonus points Digital Desk Instructor Manual 2

4 PREPARING YOUR EXAMS FOR SCANNING SERVICES 1. Complete the Digital Desk Scoring request cover sheet. To locate this form go to Please attach this cover letter to your answer key. Scantrons will not be scored without a cover letter. 2. The cover letter requires the following department information: A. Date B. Department Code C. Instructor Name (Please provide the full name of the instructor on file) D. Course Number E. Section number F. Number of versions G. Number of Keys H. Return options I. Faculty J. Number of questions K. Points per question (If this section is left blank each question will be scored for one point) L. Total points possible M. Special Instructions (If you are using alternative forms, please notate this here) Digital Desk Instructor Manual 3

5 PREPARING YOUR ANSWER KEY FOR SCANNING For the User ID Kelley School of Business Form or New General Purpose form: 1. In the Name section (required): Please bubble in four X s followed by a space and your first and last name. 2. In the User Name section (required): Students must correctly bubble in their user name). 3. In the Version field: If multiple keys of the exam are used, bubble in a key number in the version field. 4. Please have your student fill in the version field with the number of the key against which you want the students examine key to be scored. For example, if you have two keys label one key 01 in the version field and the other 02. Have your students bubble in 01 if there examined will be scored against Key In the Section number: Bubble in your course section number For Alternate forms: Please notate in the Special Instructions Section on the Scanning request form. Please confirm that your students bubble in the type of alternate form (1-4) they are using in the version field of the Scantron. Warning: Alternate forms can only be used for exams with an even number of questions. Digital Desk Instructor Manual 4

6 For the Student ID General Purpose Answer Sheet* 1. In the Name section (required): Please bubble in four X s followed by a space and your first and last name. For your students (required): Please have them bubble in their student identification number in the Identification Number section. For Alternate forms: Please notate in the Special Instructions Section on the Scanning request form. Confirm that your students bubble in the type of alternate form (1-4) they are using in the P or far right column of the Special Codes field. Warning: Alternate forms can only be used for exams with an even number of questions. *If you are still using this form, we strongly recommend that you change your Scantrons to the New General Purpose form shown on page 4. Digital Desk Instructor Manual 5

7 SUBMITTING ALTERNATE FORMS Alternate forms is a special feature within Digital Desk that allows up to four versions of the same test to be scored together. Alternate forms can only be used for exams with an even number of questions. Note that you must notify the scanning technician if you wish your test to be scored by notating it on the Digital Desk Scoring Request form! There are four forms, or orderings of the items, available, as indicated in Figure 1. All forms are scored from the same key sheet. Digital Desk will rearrange student answers to correspond to the Form 1 order before scoring. Thus, the list of responses on the Digital Desk printout will be in the rearranged order. 1. Instructor must first prepare test booklets that arrange the questions into at least two of the forms listed in the table below. 2. Alternate Forms scoring requires that each student's answer sheet must indicate which form of the test the student took. The number of the form is marked in VERSION field of the new General Purpose Form or column P of the SPECIAL CODES box on the old General Purpose form. Please see pages 4 and 5 for examples on notating your scantron. Thus, if there is a 1, 2, 3, or 4 in that position on a student sheet, it will be assumed that the order of questions on the test corresponds to the designated order for the desired alternate form. The students answers are then rearranged in the order of Form 1 before the tests are scored. Note: If the P code position or the version field on a student answer sheet is blank or contains anything other than a 1, 2, 3, or 4 it will be assumed that the test is Form 1. Form 1 Form 2 Form 3, even # of items Form 4, even # of items The original test. The items of the original test (Form 1) appear in reverse order. The original test is divided in half and the last half is presented followed by the first half. The original test is divided in half and the items of the first half of the original test appear in reverse order followed by the items of the second half of the original in reverse order. Digital Desk Instructor Manual 6

8 Please review the example below to insure that their arrangement of test forms is valid. Any error in the rearrangement of the test questions will invalidate the results. If this occurs, each test form will have to be run separately, with a separate key for each. Alternate forms can only be used for exams with an even number of questions. FORM 1 (Original Test) FORM 2 Reversed FORM 3 Split FORM 4 Reverse/Split 1. ITEM 1 2. ITEM 2 3. ITEM 3 4. ITEM 4 5. ITEM 5 6. ITEM 6 7. ITEM 7 8. ITEM 8 9. ITEM ITEM ITEM ITEM 9 3. ITEM 8 4. ITEM 7 5. ITEM 6 6. ITEM 5 7. ITEM 4 8. ITEM 3 9. ITEM ITEM 1 1. ITEM 6 2. ITEM 7 3. ITEM 8 4. ITEM 9 5. ITEM ITEM 1 7. ITEM 2 8. ITEM 3 9. ITEM ITEM 5 1. ITEM 5 2. ITEM 4 3. ITEM 3 4. ITEM 2 5. ITEM 1 6. ITEM ITEM 9 8. ITEM 8 9. ITEM ITEM 6 Digital Desk Instructor Manual 7

9 LOGGING INTO DIGITAL DESK To access Digital Desk 1. Go to and search for Digital Desk in the What would you like to do? search box. 2. Click on Scanning Results and once logged into the Central Authentication Service, use the Duo Two-factor Authentication Prompt to verity your identity. Information on enrolling in Duo Two-factor Authentication can be found at if you are not currently enrolled. Digital Desk Instructor Manual 8

10 3. Once logged into the Central Authentication Service, use the Duo Authentication Prompt to verify your identity. 4. The Digital Desk Instructor Tools Dashboard will be presented upon successful authentication and authorization. The dashboard displays the current status of exams processed for that day. Messages from the system administration will be displayed here. Digital Desk Instructor Manual 9

11 VIEW EXAM REPORTS 1. Click on the Rescore panel to review your examination. 2. Click on the Current semester icon to review exams for this semester. To review previous exams, click on the Previous Exams icon. 3. Use the drop down menu to select your exam Your students exams scores will appear on the right hand side. Digital Desk Instructor Manual 10

12 ADDING BONUS POINTS 1. Click on the Rescore panel. 2. If you wish to add bonus points, check the box to Add Bonus Points under the Rescore panel on the dashboard. Digital Desk Instructor Manual 11

13 3. Enter the number of bonus points you wish to assign. 4. Click Rescore Exams. Digital Desk Instructor Manual 12

14 5. Bonus Points will be displayed in the Bonus points column. 6. The resulting grade with the bonus points is now updated in the Grade column. Digital Desk Instructor Manual 13

15 7. To add bonus points to an individual student, select the box labelled Individual. 8. Select the desired student. 9. Enter the number of bonus points in the Add Bonus Points window. 10. Click Rescore Exams. The resulting grade with bonus points for that individual is updated. Digital Desk Instructor Manual 14

16 CHANGE AN INDIVIDUAL STUDENT ANSWER 1. Click on the Sheet Data panel. 2. Use the dropdown to select your exam. Student exam results will be listed here. 3. Click on any student record. The selected student demographic and test item selection will be displayed in the Sheet Responses section. Digital Desk Instructor Manual 15

17 4. To change a student s response, click on the student s response item. 5. Click the dropdown to correct any response error. 6. Press Update and Save. Student response and grade will update. Digital Desk Instructor Manual 16

18 7. To change a student s demographic information (such as student ID, Name, Admin); click Edit in the Student Responses section. 8. Make desired changes and click Save. Digital Desk Instructor Manual 17

19 REVIEW, GENERATE, AND CUSTOMIZE REPORTS 1. Click on the Reports panel. 2. Use the dropdown to select your exam. 3. Double click on the Exam to see the student results listing. 4. Student results list will appear. Digital Desk Instructor Manual 18

20 5. To filter results by section, in the Exams panel click the selection window. Select the section. 6. To filer by Form, select the form by clicking on the form window. 7. Click Back to Exams to return to exam listing. 8. Check the box corresponding to the section for which you want reports. Digital Desk Instructor Manual 19

21 9. To select the type of reports, select the reports underneath the Report Options section. 10. Report Types a) Student Score Report: creates a one-page PDF for each student with grade information and the questions the student missed as well as the correct answer for missed questions. b) Roster Report: Creates a PDF with a line for each student. Contains number of questions missed, points, and score. c) Exam Analysis: a PDF containing statistics including mean, median, as well as information on how many people selected each option for a question. d) CSV Score Export: Creates two CSV files. Score Export has a row for each student and contains information in the Roster Report as well as any bonus points awarded. The Score Export- Missed Response Analysis contains a row for each student and lists the answer they selected on the questions they missed as well as grade received. e) Data Export: CSV file with a row for each student containing their answer for every question. f) Score Graph: a PDF with a bar graph showing the relationship between grade and frequency. Digital Desk Instructor Manual 20

22 11. Click Run. 12. The Downloads tab will display the number of reports generated. 13. Click the Downloads tab to view generated reports. 14. Click the Download button to retrieve the desired report. Digital Desk Instructor Manual 21

23 15. Click the Custom tab to list Canvas Report. 16. Click Run to generate the Canvas Report. 17. Your custom report will be listed in the Available Reports section. Digital Desk Instructor Manual 22

24 REVIEW AND EDIT AN ANSWER SHEET Click on the Answer Key panel in the Instructor Dashboard. 1. Use the dropdown to select your Exam ID and Key Form. 2. The Answer Key will display in the questions section on the right hand side of your screen. Digital Desk Instructor Manual 23

25 3. Click on an item to change the key. 4. The key with point value is displayed in the Modify value item section on the lower left hand side of your screen. Digital Desk Instructor Manual 24

26 5. Input new responses and review. Click Update and then Save. 6. Click Yes to Do you want to Create/Update a Scoring Profile for Exam? 7. Click Yes to rescore all exams. 8. The update Answer Key is now updated in the Questions section. ASSIGNING PARTIAL CREDIT TO AN ANSWER 1. Click on the question underneath the Questions panel. 2. Click Partial Credit for selecting the answer letter. 3. Click Update. 4. Update Key will display in the Questions section on the right hand side of the screen. 5. Click Save to save the new key values. 6. You will be prompted to confirm your changes. 7. Click Yes to confirm. 8. You will be promoted to Rescore student exams. 9. Click Yes to rescore. Digital Desk Instructor Manual 25

27 ASSIGNING A TEACHING ASSISTANT TO A SECTION 1. Click on the Settings panel on the instructor dashboard. 2. To review your sections, please click on the dropdown. Teacher Assistants can search by course. 3. Select desired section. 4. Enter the TA user name, address or ID number. 5. Click Search. 6. You will be prompted to confirm your selection. 7. Click Add TA. 8. The TA is now associated with this section. Digital Desk Instructor Manual 26

28 HOW TO EXPORT EXAM GRADES TO CANVAS 1. Click on the Reports panel on the instructor dashboard. 2. Select your exam through the drop down menu. To search for the current or previous semester select their respective icon. Select instructor name, instructor id, or exam id by clicking on their respective icon. Digital Desk Instructor Manual 27

29 3. The exam will appear under the exams panel. Check the box corresponding to your exam. 4. Select Custom under the Report Options panel. Digital Desk Instructor Manual 28

30 5. Click Run for the Canvas Report. 6. The Downloads tab will display the selected report generated. Digital Desk Instructor Manual 29

31 7. Click the Downloads tab to view generated reports. 8. Click download. The Canvas Report excel file will download to your computer. 9. Save the file to your desktop or documents folder. 10. Use this file to import your grades into canvas. To import your grades to Canvas follow the directions in this link Digital Desk Instructor Manual 30

32 Digital Desk Instructor Manual 31