Guide to Managing a Workshop Activity

Similar documents
How to set up gradebook categories in Moodle 2.

INSTRUCTOR USER MANUAL/HELP SECTION

Many instructors use a weighted total to calculate their grades. This lesson explains how to set up a weighted total using categories.

Managing the Student View of the Grade Center

PowerTeacher Gradebook User Guide PowerSchool Student Information System

Skyward Gradebook Online Assignments

Adult Degree Program. MyWPclasses (Moodle) Guide

Moodle 2 Assignments. LATTC Faculty Technology Training Tutorial

New Features & Functionality in Q Release Version 3.2 June 2016

Moodle MyFeedback update April 2017

/ On campus x ICON Grades

Create Quiz Questions

MOODLE 2.0 GLOSSARY TUTORIALS

MyUni - Turnitin Assignments

ecampus Basics Overview

TeacherPlus Gradebook HTML5 Guide LEARN OUR SOFTWARE STEP BY STEP

Appendix L: Online Testing Highlights and Script

WiggleWorks Software Manual PDF0049 (PDF) Houghton Mifflin Harcourt Publishing Company

Your School and You. Guide for Administrators

STUDENT MOODLE ORIENTATION

Introduction to Moodle

New Features & Functionality in Q Release Version 3.1 January 2016

Preferences...3 Basic Calculator...5 Math/Graphing Tools...5 Help...6 Run System Check...6 Sign Out...8

CHANCERY SMS 5.0 STUDENT SCHEDULING

Connect Microbiology. Training Guide

Creating Your Term Schedule

POWERTEACHER GRADEBOOK

DegreeWorks Advisor Reference Guide

Schoology Getting Started Guide for Teachers

Millersville University Degree Works Training User Guide

Field Experience Management 2011 Training Guides

Preparing for the School Census Autumn 2017 Return preparation guide. English Primary, Nursery and Special Phase Schools Applicable to 7.

The Moodle and joule 2 Teacher Toolkit

Using SAM Central With iread

Moodle Student User Guide

Getting Started Guide

Changing Majors. You can change or add majors, minors, concentration, or teaching fields from the Student Course Registration (SFAREGS) form.

i>clicker Setup Training Documentation This document explains the process of integrating your i>clicker software with your Moodle course.

User Guide. LSE for You: Graduate Course Choices. London School of Economics and Political Science Houghton Street, London WC2A 2AE

Using Blackboard.com Software to Reach Beyond the Classroom: Intermediate

SCT Banner Student Fee Assessment Training Workbook October 2005 Release 7.2

BLACKBOARD TRAINING PHASE 2 CREATE ASSESSMENT. Essential Tool Part 1 Rubrics, page 3-4. Assignment Tool Part 2 Assignments, page 5-10

SECTION 12 E-Learning (CBT) Delivery Module

SCT Banner Financial Aid Needs Analysis Training Workbook January 2005 Release 7

PRD Online

Test How To. Creating a New Test

Intel-powered Classmate PC. SMART Response* Training Foils. Version 2.0

Moodle 3.2 Backup and Simple Restore

Houghton Mifflin Online Assessment System Walkthrough Guide

Setting Up Tuition Controls, Criteria, Equations, and Waivers

Getting Started with MOODLE

Excel Intermediate

Storytelling Made Simple

Creating a Test in Eduphoria! Aware

PEIMS Submission 3 list

Outreach Connect User Manual

Office of Planning and Budgets. Provost Market for Fiscal Year Resource Guide

TxEIS Secondary Grade Reporting Semester 2 & EOY Checklist for txgradebook

PowerCampus Self-Service Student Guide. Release 8.4

Attendance/ Data Clerk Manual.

Creating an Online Test. **This document was revised for the use of Plano ISD teachers and staff.

ACCESSING STUDENT ACCESS CENTER

TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE. Pierre Foy

InCAS. Interactive Computerised Assessment. System

EMPOWER Self-Service Portal Student User Manual

Course Groups and Coordinator Courses MyLab and Mastering for Blackboard Learn

Test Administrator User Guide

Emporia State University Degree Works Training User Guide Advisor

ACADEMIC TECHNOLOGY SUPPORT

Updated: 7/17/12. User Manual v. 2

EdX Learner s Guide. Release

TotalLMS. Getting Started with SumTotal: Learner Mode

Examity - Adding Examity to your Moodle Course

Municipal Accounting Systems, Inc. Wen-GAGE Gradebook FAQs

Shared Portable Moodle Taking online learning offline to support disadvantaged students

Faculty Feedback User s Guide

Beginning Blackboard. Getting Started. The Control Panel. 1. Accessing Blackboard:

Blackboard Communication Tools

Ohio Individualized Education Plan Form Instructions and User Guide IEPPLUS

IVY TECH COMMUNITY COLLEGE

Special Enrollment Petition (SEP): In-Absentia Enrollment

CODE Multimedia Manual network version

Completing the Pre-Assessment Activity for TSI Testing (designed by Maria Martinez- CARE Coordinator)

Donnelly Course Evaluation Process

Once your credentials are accepted, you should get a pop-window (make sure that your browser is set to allow popups) that looks like this:

Closing out the School Year for Teachers and Administrators Spring PANC Conference Wrightsville Beach April 7-9, 2014

Connecting Middle Grades Science and Mathematics with TI-Nspire and TI-Nspire Navigator Day 1

Foothill College Summer 2016

2 User Guide of Blackboard Mobile Learn for CityU Students (Android) How to download / install Bb Mobile Learn? Downloaded from Google Play Store

ALEKS. ALEKS Pie Report (Class Level)

Chamilo 2.0: A Second Generation Open Source E-learning and Collaboration Platform

OFFICE OF THE UNIVERSITY REGISTRAR FACT SHEET ON LINE WAITLISTING

Online Marking of Essay-type Assignments

Getting Started with TI-Nspire High School Science

The Keele University Skills Portfolio Personal Tutor Guide

LMS - LEARNING MANAGEMENT SYSTEM END USER GUIDE

PEIMS Submission 1 list

Sapphire Elementary - Gradebook Setup

End-of-Module Assessment Task

U of S Course Tools. Open CourseWare (OCW)

Transcription:

Guide to Managing a Workshop Activity TABLE OF CONTENTS Key Features... 2 getting started with managing workshop... 2 The Workshop Planner... 3 The Workshop Phases... 4 A note about Permissions... 4 phase one: Setup workshop... 5 Phase two: Submission of student work... 9 About Allocation Methods... 10 Phase three: Assessment... 13 Phase four: Grading and Evaluation... 14 Grading Evaluation Settings... 14 Workshop Grades Report... 15 Viewing a submission and Peer Assessments... 15 Assessing Individual Submissions and Evaluating Peer Reviews... 15 Grading Evaluation Phase Method and Settings... 16 The Workshop toolbox... 16 Phase five: Closed... 17 About Groups and Workshop activity... 18 What is a Grouping?... 18 What is Available for group members only?... 19 Where does group selection drop down menu (for Instructor) appear?... 19 References... 19 Learning, Teaching and Curriculum, Educational Design

KEY FEATURES The Moodle (v.2.7) Workshop activity is designed as an integrated set of activities to facilitate self and peer review of students' work. This guide can be used in conjunction with a Workshop Peer Review activity to streamline and manage the five phases of the peer review process. Table 1 Workshop activity phases and workflow for teachers and students (Adapted with permission from Watkins, S 2015, Enabling Peer Review in Moodle: A Look at the Workshop Activity, DELTAwire NC State University) GETTING STARTED WITH MANAGING WORKSHOP WORKSHOP ACTIVITY PLANNING Decide grading strategy Decide allocation method Decide grades for submission and assessment Create Workshop activity Following the creation of a Workshop peer review activity, additional tasks will need to be completed before students can submit their work. The Workshop Planner (Figure 1) a visual guide for managing these tasks. To access the Workshop Planner for a peer review activity that has been created, click on the name of the activity in the section of your Moodle site. The Workshop Planner will appear at the top of the screen. Settings and options can be modified and updated by clicking on the item in the visual Planner grid. 2 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

The Workshop Planner The Workshop Planner is a visual representation of the workflow of participant activity from setup to close. The active phase is highlighted and task completion is indicated with a tick. The tasks for each phase will have a green tick (ready), grey tick (requires attention) or a red cross (not started). Clicking on any task will open the task settings. For example, to edit the submission instructions, go to the Setup Phase in the Planner and click on Provide instructions for submission. Switching between phases to give students access to the phase they need to work in should be done manually. To activate a phase, click the light bulb icon next to the phase heading (Figure 1). Switching between phases can be done at any time but note that switching from submission to assessment will block students from submitting unless late submissions are allowed. Click light bulb to switch phases Active phase is highlighted Figure 1 Example Visual Workshop Planner Grid Workshop tasks can also be modified and updated from the Workshop Administration block, which can be accessed within the Workshop activity. From the Administration block, select Edit settings to change the Workshop settings; select Edit assessment form to create and edit the peer assessment form; or select Allocate submissions to set up or change the reviewer allocations for the activity (Figure 2). Figure 2 Workshop Administration block 3 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

THE WORKSHOP PHASES A Workshop activity can span several days or weeks with participants progressing from reading instructions, practicing reviews, submitting work, reviewing others work, and finally viewing their marks and feedback. Planning Phase is not part of the Planner but it establishes the parameters for how students will progress to complete their tasks in the other phases. Setup Phase is where the assignment is setup by the instructor and updated in preparation for submission of work. Submission Phase is where students submit their work for peer review. Assessment Phase is where students give feedback on one or more students work. Grading and Evaluation Phase is where the instructor reviews the submissions and peer feedback (assessment), and optionally allocates a grade for submission or assessment or both. Closed Phase allows the instructor to close the activity, at which point the grades and feedback are revealed unless they have been hidden from within the Moodle Gradebook. To check the status of grades in the Gradebook, click the Grades item in the site administration block. Click the Categories and Items tab in the Gradebook and locate the activity in the list. If the eye icon is closed, the grades for that activity are hidden. Click on the eye icon to show or hide grades. A note about Permissions Moodle allows specific roles to be able to change other specific role capabilities based on the context. The UOW Moodle installation does not allow changes to role permissions by users. All role permission changes for the Workshop and other Moodle activities require staff to submit a support ticket to IMTS via the support link at the top of the Moodle home page. For example, an Instructor might want students to submit and assess anonymously. A request can be made to IMTS to hide student names and the change will be reflected in the Workshop permissions. Table 2 shows the different options for single blind and double blind submissions and reviews. Figure 3 shows user permissions where students are not able to view author and reviewer names. Table 2 Student permissions for single blind and double blind submissions and reviews (adapted from Create a UNSW Workshop Activity in Moodle, TELT, University of New South Wales, https://teaching.unsw.edu.au/moodle-unsw-workshop#anonymity). Setup action Remove View author names permission ONLY (single blind) Remove View reviewer names permission ONLY (single blind) Remove BOTH View author and View reviewer permission (double blind) Student reviewer can see authors during Assessment phase authors when activity is Closed reviewers during Assessment phase No No No No Yes Yes No No No No No No reviewers when activity is Closed 4 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 3 Example of Workshop permissions where students have been removed from the list of users who can view author and reviewer names. PHASE ONE: SETUP WORKSHOP Phase 1: Setup Create Workshop description Create Submission instructions Create Assessment Form Create Example Submissions and Assessments (optional) Advance Workshop to Submission Phase 1. SET THE WORKSHOP INTRODUCTION OR DESCRIPTION a. In the Planner, click on Set the workshop description. b. Type the description into the text box. c. To show the description in the site section, check the box Display description on site page. d. Click the Save and display button. 2. PROVIDE SUBMISSION INSTRUCTIONS a. In the Planner, click on Provide instructions for submission. b. In the Submission settings section, add instructions to the Instructions for submission text box. These are the instructions that will be displayed to students who are submitting their work. c. Click the Save and display button. 5 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 4 Example Submission Instructions 3. PREPARE THE ASSESSMENT FORM a. In the Workshop Planner, go to the Setup phase. b. Click on Edit assessment form. c. The assessment form template will display based on the grading strategy selected in the Workshop settings. There are four grading options: Accumulative Comments and a grade are given regarding specified aspects. Comment Comments are given regarding specified aspects but no grade can be given. Number of errors - Comments and a yes/no assessment are given regarding specified assertions. Rubric a level assessment is given regarding specified criteria. ACCUMULATIVE GRADING OPTION (Figure 5) Assessment form is organized into Aspects. For each Aspect, reviewers will give a numerical score and a comment. Aspects can be weighted relative to each other. Total submission grade is weighted mean of normalised Aspect grades. WHAT YOU NEED TO DO: 1. Enter the criterion (details) in the Description for each aspect. 2. Enter the maximum mark for the aspect. Leave the weighting set to 1 for all aspects if they are of equal importance. 3. Click Save and close. 6 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 5 Accumulative Grading Form COMMENTS GRADING OPTION (Figure 6) Assessment form is organised into Aspects For each Aspect, reviewers will give a comment (no numerical scores) Total grade for assessed submission is always 100% WHAT YOU NEED TO DO: 1. Define one or more Aspects - these are the questions or feedback points, which will display to peer markers, with a blank text field under each. NOTE: This is a feedback-only marking strategy so there are no numeric grades or weightings to set. Figure 6 Comments Form NUMBER OF ERRORS OPTION Assessment form is organised into Assertions For each Assertion, reviewers will provide a yes/no response The terms that correspond to Yes or No can be customised (Pass/Fail, Present/Missing, etc.) A Grade Mapping Table is used to convert number of errors to a score Assertions can be weighted relative to each other WHAT YOU NEED TO DO: 7 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

1. Define one or more Assertions along with terms for peer markers to use to indicate whether these have been met or not met. 2. Give each assertion a weighting in relation to the others. 3. Save And Continue Editing to activate the Grade Mapping Table, which turns the weightings you have chosen into a number of possible errors and relates these to the overall number of points available for the Workshop activity. 4. Ensure the values in each menu are the same as their adjacent values. RUBRIC OPTION Assessment form is organised into Criteria. For each Criterion, several descriptive levels are created (e.g., Good, Fair, Poor, etc.). Numerical scores are assigned to each level. Reviewers will grade by selecting a level. Tip: make the lowest level worth zero to avoid confusion. WHAT YOU NEED TO DO: 1. Define your criteria and levels of achievement. 2. Assign a unique grade to each level. Extra levels will appear on demand. 3. First complete those that display by default, then 4. Click Save And Continue Editing. When the page reloads it will display extra blank levels. You will be able to choose whether the rubric should display to students as a (vertical) list or (horizontal) grid (Figure 7 and Figure 8). Figure 7 Assessment Form - List View Tip: List View is the best option if using many levels. 8 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 8 Assessment Form - Grid View 4. PREPARING AND ASSESSING EXAMPLE SUBMISSIONS (OPTIONAL) If you are providing example submissions: 1. In the Example submissions section, click Add example submission. 2. Add a title and content, and upload a file if your submission settings include uploading a file. 3. Click the Save changes button. The Instructor will have to assess the example submission to provide a reference assessment. 4. Click the Continue button to assess the submission. 5. Assess the example submission using the assessment form. 6. When finished, click the Save and close button. When the Setup preparation work is complete, click on the light bulb in the Planner to advance to the Submission Phase. PHASE TWO: SUBMISSION OF STUDENT WORK Phase 2: Submission Create assessment instructions Students submit Set allocation method and allocate submissions Advance Workshop to Assessment Phase Students will only be able to submit their work when the Submission phase is highlighted. Click the light bulb next to Submission to open it for students to submit their work. Ensure that instructions, deadlines and other information is displayed to help students submit their work. In the Planner, the Submission phase displays the status of submission elements. SWITCHING TO SUBMISSION (Figure 9) 1. To access the submission phase tasks, click on the Workshop activity title in the Moodle site. 2. In the Planner, click the light bulb next to Submission phase. Submission phase will be highlighted. 3. Provide instructions for assessment (next phase) if not added previously. 4. Allocate submissions to reviewers. Click on Allocate submissions to open the Allocation options. 5. Review submission open and deadline dates to ensure they are correct. 9 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 9 Edit Allocate submissions in Submission phase ALLOCATION OF PEER REVIEWERS During the submission phase, it is highly recommended that allocation of student submissions be done as close as possible to the submission deadline or after the submission deadline has passed. Submission allocations can be scheduled automatically at the end of the submission phase. NOTE: Information and instructions have been provided in this guide for all of the Workshop activity allocation methods and, where available, the Moodle contextual Help information for some options and settings has been included. If late submissions have been allowed, it is recommended to use the random allocation method where the Instructor randomly allocates once the submission deadline has passed and all late submissions have been accepted because once the assessment phase opens, students can access their allocated submission to review and any random reallocation at this point may result in a different allocation where some reviewers receive an additional submission to review and some submissions are not allocated a reviewer. TO ALLOCATE SUBMISSIONS FOR ASSESSMENT (Figure 10): 1. In the Planner, highlight the Submission phase. 2. Select either Set up scheduled allocation or Allocate submissions. 3. Select an allocation method from the tabbed menu. ABOUT ALLOCATION METHODS Figure 10 Allocation Methods MANUAL ALLOCATION METHOD This option allows an Instructor to choose which student will review another student's work. The participating students are listed in the middle column. A student must submit something before they can be assigned a reviewer, however the Instructor can assign someone to review someone else's work without the reviewer having submitted work. 10 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

To assign a reviewer or reviewee, click on the drop down menu and choose a name. The page will refresh to show the additions and a success message is displayed. To remove a reviewer or reviewee, click the cross next to the student s name. The page will refresh to display a confirmation message. Click Yes, I am sure to complete the removal. RANDOM ALLOCATION METHOD This option allows an Instructor to allocate submissions for assessment automatically with a few specifications. Random allocation will only work after at least one piece of work has been submitted so it is best to wait to do random allocation when the deadline has arrived or has passed. If groups have been set up for the Workshop activity, the allocations can be set to distribute among group members. 1. Select the Random allocation tab. 2. Select the number of reviews and whether this is per submission or per reviewer, i.e. each reviewer assesses 5 submissions OR each submission has 5 reviewers. 3. To specify the Number of reviews per submission or per reviewer, in the Number of reviews drop-down menu, select the number of reviews and whether they are assigned to reviewers or to submissions. 4. Check the Prevent reviews by peers from the same group box to prevent students from reviewing submissions from within their own group. 5. Check the Remove current allocations box to override previous allocations. Overriding previous allocations might be done if, for example, extra submissions have been added. The random allocations will be re-done for all submissions. If this box is left unchecked, only the unallocated submissions will be allocated to reviewers. 6. Check the Participants can assess without having submitted anything box to allow students to assess their peers' submissions without having submitted anything. If this box is not checked, any student who has not submitted will not be allocated a reviewee. 7. Click Save changes to start the random allocation process. When the random allocation has completed a confirmation message will display noting any problems, such as not being able to allocate to individuals who have not submitted. SCHEDULED ALLOCATION METHOD Scheduled allocation, in conjunction with automatic switching from submission to assessment (in Workshop settings) opens the assessment phase for students to start their peer assessment with their own work still fresh in their minds (Figure 11). Scheduled allocation automates a random allocation of submissions and reviewers if a deadline has been set for the submission phase. It is recommended that late submissions not be allowed if scheduled allocation has been selected. If the scheduled allocation method is selected and late submissions are allowed, students who submit late will not be allocated a submission to review. The Instructor will need to allocate submissions manually for each individual student. NOTE: Manually switching to the assessment phase will not trigger scheduled allocation. Use the Random allocation method to open the assessment phase earlier than the deadline or if no deadline has been set. When the Switch to the next phase after the submissions deadline box is ticked, the scheduled allocation option automatically appears in the Workshop Planner. Figure 11 Setting options for scheduled allocation method 11 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

TIPS FOR USING THE SCHEDULED ALLOCATION METHOD Set a Submission Deadline date. Don t allow late submissions. Check the box in the settings to automatically switch phases. Set an Open for Assessment From date. Set a deadline for completion of the peer assessment. HOW TO SET UP SCHEDULED ALLOCATION 1. Click on the Workshop activity name to view the Planner. 2. Click the light bulb to select the Submission phase. 3. Click Allocate submissions or click Set up scheduled allocation. 4. Go to the Scheduled Allocation tab and click Expand all to see all settings (Figure 12). If enabled, the scheduled allocation method will automatically allocate submissions for the assessment at the end of the submission phase. The end date of the phase is defined in the Workshop setting Submissions deadline. The Workshop activity will automatically randomly allocate reviewers and submissions based on the allocation options selected. NOTE: The scheduled allocation is not executed if the Instructor manually switches the Workshop into the assessment phase before the submissions deadline. Submissions and reviewers will have to be allocated by the Instructor (Yourself in that case). Figure 12 Scheduled Allocation Settings 12 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

STEPS TO COMPLETE THE SCHEDULED ALLOCATION SETTINGS: 1. Check the box to Enable scheduled allocation. 2. If the Current status is showing as scheduled allocation disabled, saving the form with the checkbox ticked will reset the current status to enabled and all previous allocation settings will be replaced. 3. Group mode is only activated if groups have been set up for the activity. 4. Select the number of reviews per submission or per reviewer. How many is enough? You need to predict whether all or just some students will do the peer marking. You want to avoid overloading students while ensuring that everybody gets some peer feedback. 5. Check Remove current allocations to remove any existing allocations and reallocate all submissions and reviewers. 6. Check Participants can assess without having submitted anything to allow students to review if they have not submitted their work. 7. Check Add self-assessments if students need to assess their own work. Students will be assigned their own work in addition to other students work. This option will be disabled if you didn t select selfassessment in the Workshop settings. Note: ensure the workload for students is manageable when considering self-assessment. 8. Click Save Changes to activate the scheduled allocation. 9. Go to the Planner to check that the scheduled allocation has been activated. The Planner will show the switch from submission to assessment after the deadline has passed. PHASE THREE: ASSESSMENT Phase 3: Assessment Students assess submissions Advance Workshop to Grading Evaluation Phase In the Planner, click the light bulb for Assessment phase to switch to that phase and open it for students to complete their peer assessments. The criteria for assessment should be expressed as clearly as possible to students. Consider having a class discussion about the assessment criteria prior to using the Workshop activity, or provide example assessments, to help communicate expectations to students as clearly as possible. During the Assessment phase, students assess the submissions they have been allocated. To begin an assessment, students click the Assess button next to the submission. Then, they assess the submission according to the Assessment form that the instructor created during the Setup phase. When a student clicks on the Assess button, the assessment form will open for them to complete. Figure 13 shows a completed assessment form example. When the assessment form is completed and saved, the mark given and feedback can be reviewed and the student can re-assess any time during the assessment phase. Refer to the Student Guide Workshop Peer Assessment for more information on student tasks for submission and assessment. NOTE: When students have been made anonymous, their name does not appear for the submission and/or the review. NOTE: When a student hasn't submitted any work and the Instructor has set the workshop up so that students who haven't submitted can't assess, the student will see a message that there is no assigned submission to assess. 13 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 13 Completed Assessment Form example. PHASE FOUR: GRADING AND EVALUATION Phase 4: Grading Evaluation Set score comparison setting Moodle calculates Assessment score Advance Workshop to Closed Phase In the Planner, click the light bulb for Grading evaluation phase to switch to that phase and evaluate submissions and assessments. When the Workshop is switched to the Grading Evaluation phase, students will no longer be able to submit and assess or make changes, however they will be able to view any submissions and assessments they have completed. In this phase, the instructor evaluates the peer assessments and calculates the final marks for submissions and assessments. For the grade for assessment, the instructor can decide how strict the comparison should be. Grades can be recalculated more than once. THE GRADING AND EVALUATION PHASE ALSO ALLOWS THE INSTRUCTOR TO DO THE FOLLOWING: Manually override the calculated marks. Mark individual submissions (optional). Set selected submissions e.g. high quality submissions, as published so they become available to all Workshop participants in the closed phase. Grading Evaluation Settings The Grading Evaluation settings help to calculate the grades given for assessment, i.e. the grade the students receive for assessing their peers. The formula takes into account all the grades given for a particular submission and compares them to see how close in range the marks are. For example, assume there are four assessments in total with a range of marks as follows: 90, 92, 89, and 68. The mark 68 will most likely be flagged and the student who submitted that mark will receive a lower grade because their assessment does not seem to coincide with the other peer assessments. 14 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Workshop Grades Report The Workshop grades report displays the grades received for submission and for assessment in a table format (Figure 14). Figure 14 Workshop Grades Report Viewing a submission and Peer Assessments 1. In the Grading and evaluation phase, go to the Workshop grades report. 2. Click on a submission title. The submission and all peer assessment for that submission will be displayed. NOTE: Students will no longer be able to submit or assess work when this phase is highlighted. Assessing Individual Submissions and Evaluating Peer Reviews PART ONE: ASSESSING A SUBMISSION: 1. With a submission open, click the Assess button to display the assessment form. 2. Complete the assessment form and click Save and close to return to the submission. 3. Scroll down the page to view more options. 4. Select the checkbox to publish the submission (optional). Publishing a submission will make it available to all students as an example assignment after the Workshop activity has been closed (Figure 15). Figure 16 shows what students will see you if publish submissions. 5. Select the new mark from the drop-down menu to override the mark awarded for the submission. 6. Enter feedback for the author of the submission (optional). 7. Click Save and close or complete part two: evaluating peer reviews. PART TWO: EVALUATING PEER REVIEWS FOR A SUBMISSION 8. Click the Assessment settings button for each assessment to evaluate the assessment and override the marks awarded if required and add feedback for the reviewer. 9. Select the mark. 10. Enter feedback. 11. Provide overall feedback (optional). 12. Select the weighting to apply to your evaluation. Leave as 1 to have your mark calculated with the same influence as others assessing the submission. Increasing the weighting will increase the impact your grade has on the overall submission grade for the student. 13. Click Save and close. 15 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 15 Publish submission checkbox available during Grading Evaluation phase Figure 16 Student view of published submissions Grading Evaluation Phase Method and Settings 1. The option for Grading evaluation method will be Comparison with the best assessment. This is the only option that can be selected from the drop down menu for the current version of the Workshop activity. 2. Select the level of strictness of comparison. The more strict the comparison, the more similar the assessments need to be for a high grade to be obtained. 3. Click Re-calculate grades to apply the settings to the assessments (Figure 17). 4. View the grades received for submission and for assessment in the Workshop grades report that appears below the Grading evaluation settings. Figure 17 Grading evaluation setting NOTE: The Comparison of assessments setting allows you to adjust the strictness of the formula. If you choose the comparison to be very strict, students who have a different evaluation that stands out from the other evaluations will be penalised for their assessment. If you choose very lax, then the penalty will not be as high. The setting can be left at the default fair if you are don t know what to choose for the comparison. The comparison method looks for three or more peer assessments. If only two or less assessments are available, the formula is unable to determine which grade is more likely. Students will more than likely receive full marks for the grades given, even if the assessments differ drastically. The Workshop toolbox The Workshop toolbox has options to adjust and re-calculate grades for submissions and for assessments. To clear grades for submission and assessment, click Clear all aggregated grades. The grades can be recalculated any time during the Grading evaluation phase (Figure 18). 16 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 18 Help information for Clear all aggregated grades To delete students assessments, click Clear assessments (Figure 19). The completed assessment form will be kept but the reviewers will need to open the assessment form and enter a grade to have it recalculated for final grades. Figure 19 Question mark icon displays Help information for the Cler Assessments option To override individual grades, enter a grade for the submission in the subject s Moodle Gradebook. Or, to influence the grade, return to the Assessment phase and enter your own assessment with a different weight from those awarded by peer reviewers. The instructor can also return to the Setup phase at any time to adjust activity settings and prevent users from modifying their work. The Workshop does not have to be changed to the Closed phase for the Instructor to temporarily prevent student activity in the Workshop. PHASE FIVE: CLOSED Phase 5: Closed Students can view their grades and assessed work In the Planner, click the light bulb for Closed phase to switch to that phase and end the Workshop activity. When the Workshop is switched to the Closed phase, the final grades calculated in the previous phase will be entered in the Gradebook. At this point, students can view their grades, their submissions, their submission assessments, and any submissions that have been published. Figure 20 shows the student view of Closed phase. To hide marks and release them at a later time, go to the Gradebook, select Categories and Items and click on the eye icon for both the submission and assessment. They eye icon will appear as closed to indicate the marks as hidden. Figure 21 shows student view of grades in the Closed phase, if results have not been hidden. 17 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

Figure 20 Student view of Closed phase Figure 21 Student view of grades in Closed phase if grades are not hidden ABOUT GROUPS AND WORKSHOP ACTIVITY Groups and groupings function within the Workshop activity as categories that the Instructor can select when allocating submissions and reviewers. Group mode has three options, which are the standard options within the Moodle groups feature. Moodle groups is a separate feature within a Moodle site that allows the Instructor to form students into groups. Students will need to be added to groups within the Groups tool to enable the group feature in the Workshop activity to be selected. If groups have not been set up when creating the Workshop activity, the settings will display the no groups option. The Group mode in the Workshop settings has three options: No groups - There are no sub groups, everyone is part of one big community Separate groups - Each group member can only see their own group, others are invisible Visible groups - Each group member works in their own group, but can also see other groups NOTE: The group mode defined at site level is the default mode for all activities within the site. Each activity that supports groups can also define its own group mode, though if the group mode is forced at site level, the group mode setting for each activity is ignored. What is a Grouping? A grouping is a collection of groups within a site. If a grouping is selected, students assigned to groups within the grouping will be able to work together. 18 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)

What is Available for group members only? If this checkbox is ticked, the activity (or resource) will only be available to students assigned to groups within the selected grouping. Where does group selection drop down menu (for Instructor) appear? Submission phase Assessment phase In the Assessment phase, the selected group will only display students who have submitted work. Students who have not submitted work will not be visible in the student list in the allocation table. Any student not added to a group will not be able to see the link to the Workshop activity. The student needs to be added to the group via the group tool in the site. For manual allocation, the groups menu only allows viewing of different groups and the students in those groups. There is no option available in Workshop to manage submission and review of an individual s allocated work within a group. Students can be excluded from the same group reviewing each other s work but they can't be prevented from reviewing the work of students in other groups. If it is intended to keep all groups as separate entities for the purpose of peer assessment, it is recommended to create separate groups, create a new workshop activity for each group (use the Duplicate option in the Edit menu) and allocate one group to each Workshop. REFERENCES Australian Catholic University Library 2016, Adding Resources & Activities: Workshop, viewed 16 May 2016, <http://libguides.acu.edu.au/c.php?g=233995&p=1554192>. City University London 2016, Facilitating Peer Assessment using Workshop, viewed 16 May 2016, <https://moodle28.atlassian.net/wiki/display/moodle/facilitating+peer+assessment+using+workshop>. Colonna, P 2012, Workshop Setup Phase 1/3, 17 December, YouTube, viewed 8 April 2016, <https://youtu.be/19offdbh0wq?list=plcfu7jwbz6s3pr5shtkjtchizo0g3sf90>. Cox, JM, Posada, JP, Waldron, R 2012, Moodle Workshop activities support peer review in Year 1 Science: present and future, in M Brown, M Hartnett & T Stewart (eds.), Future challenges, sustainable futures 2012 Proceedings ascilite, Wellington, New Zealand, pp. 231-235, viewed 9 May 2016, <http://www.ascilite.org/conferences/wellington12/2012/images/custom/cox%2c_julian_moodle.pdf>. Dreschler, M 2010, Moodle Workshop 2.0 - a (simplified) explanation, 1 July, Slideshare, viewed 20 April 2016, <http://www.slideshare.net/mark.drechsler/moodle-workshop-20-a-simplified-explanation>. Moodle.org 2016, Moodle Docs Workshop Settings, viewed 16 May 2016, <https://docs.moodle.org/31/en/workshop_settings>. Strang KD 2013, Exploring summative peer assessment during a hybrid undergraduate supply chain course using Moodle, in H Carter, M Gosper and J Hedberg (eds.), Electric Dreams. Proceedings ascilite 2013 Sydney, pp. 840-853, viewed 8 April 2016, <http://www.ascilite.org/conferences/sydney13/program/papers/strang.pdf>. Thomas, G, Martin, D, & Pleasants, K 2011, Using self- and peer-assessment to enhance students' future- learning in higher education, Journal of University Teaching & Learning Practice, vol. 8, no. 1, pp. 1-17, viewed 8 April 2016, <http://ro.uow.edu.au/jutlp/vol8/iss1/5>. University of New South Wales 2016, Create a UNSW Workshop Activity in Moodle, viewed 8 June 2016, <https://teaching.unsw.edu.au/moodle-unsw-workshop>. University of South Australia 2014, Peer Assessment using Moodle Workshop, viewed 8 April 2016, <https://lo.unisa.edu.au/mod/book/view.php?id=296017&chapterid=48913>. University of Technology Sydney 2013, Giving and receiving feedback, viewed 8 April 2016, <http://www.uts.edu.au/research-and-teaching/teaching-and-learning/assessment-futures/key-assessmentelements/giving-and> University of Wisconsin 2016, Moodle KnowledgeBase Moodle Workshop Module, viewed 8 June 2016, <https://kb.wisc.edu/moodle/page.php?id=32663>. Watkins, S 2015, Enabling Peer Review in Moodle: A Look at the Workshop Activity, DELTAwire NC State University, weblog post, 26 February 2015, viewed 26 April 2016, <https://delta.ncsu.edu/deltawire/enabling-peerreview-in-moodle-a-look-at-the-workshop-activity/> 19 MANAGE WORKSHOP ACTIVITY LEARNING, TEACHING AND CURRICULUM, EDUCATIONAL DESIGN, (SH)