Tracking Student Progress of Noba/ Cerego Online Quizzes

Tracking Student Progress of Noba/ Cerego Online Quizzes

The Purpose of Noba/Cerego Online Quizzes We ve created 20-item quizzes to accompany many of our online learning modules. The quizzes are a form of retrieval practice for students to strengthen their understanding of the concepts they encounter in the text reading. They also offer students a chance to practice metacognition by noting which concepts cause them confusion and which they feel more confident they understand. Instructors may simply encourage their students to take the quizzes independently after reading each module. Or they may choose to make them a formal part of the course by assigning the quizzes for credit. By using a Cerego dashboard, instructors can verify that students are completing assigned quizzes and get insights into individual and class performance. Cerego is a learning platform that allows for long-term study of material over weeks and months (mastery-focus). But the typical use case for these Noba quizzes is to have students engage with the quiz content once or perhaps a few times during a particular week during the semester before moving on to other modules and quizzes in subsequent weeks. One of the key indicators of the dashboard, the Set Goal, has been placed at a level that assumes this sort of short-term use of the quizzes. You ll learn more about the Set Goal and other indicators later in this document. Students can engage with the quiz material as often as they like and over periods longer than a single week of the semester. For example, they may choose to return to the quizzes as a form of review before mid-terms or finals. Even when the Set Goal has been reached or students meet other short-term requirements they retain access to the quizzes for further study if they wish.

Things that you ll need before you start: Access to the email account that you used to register as a Noba instructor-user List of email addresses for all students you wish to track. These email addresses have to be the same ones the students used to sign up and log into the Noba website. Students must register and log into the Noba website to take the quizzes and to enable individual tracking of progress. Collecting these addresses in a comma separated list will be best. List of all Noba modules/quizzes that you will assign to students and track Registration email from Cerego (expect this within 1-2 business days of your initial student tracking request to Noba)

Table of Contents: How to access your Cerego account..pp. 5-6 How to navigate to your course(s)..pp. 7-10 How to add Noba quizzes/sets pp. 11-13 How to add students..pp. 14-16 Publishing your course..pp. 17-18 Info about student progress - Instructor dashboard..p. 19 How to read, understand, and manage reports..pp. 20-27 What students see...pp. 28-30 Additional details to know/share with students.p. 31

How to access your Cerego account Instructions: Go to your email inbox and open the registration email from Cerego. The subject line beings An invitation from.... It will usually arrive 1-2 business days after your initial student tracking request to Noba. Click the link in the email to register on the Cerego website. On the Cerego registration page enter your first and last name, your email, and create a password that you will use to log-in to Cerego each time you want to access your student progress dashboard. Click the green Log In button after you have registered.

For Those Also Using Cerego with Other Content Providers If you are have ever used the Cerego learning platform to access content from another organization, like Cengage, and already have a Cerego account, don t be confused if you log in and can t find your Noba content right away. Sometimes what you need to do is just switch partners. To do that, simply log in to Cerego, navigate to the upper right-hand corner of the page and click on your name. A drop-down menu will appear, click on Switch Partners to switch over to Noba content.

How to navigate to your course(s) Once logged in, you will be taken to Cerego s main page. Click the green button at the top-left labeled Cerego Learn to see the drop-down menu.

Click on the blue icon called Courses under NOBA. This will take you to the list of Noba courses for which you are now a designated instructor.

The Courses page contains the class sections you plan to track. Click on the Unpublished tab (please note that once you ve published a course, it will be moved to the Published tab). The number of courses you administer should be equal to the number of class sections you want to track separately. Please confirm that the correct number of class sections you requested have been created for you. If there s a discrepancy let us know and we can fix it. Please email us if you have any questions at info@nobaproject.com rather than contacting Cerego through the green Support button at the bottom of you page. We will already be familiar with your case and can better assist you.

Click on the name of the course that you wish to work in, and you ll be taken to a set up page that will look like this: Notice that the course status is Unpublished, you will be able to publish it once you add students (called Learners by Cerego) and the Noba module quizzes you plan to assign (called Assignments by Cerego).

How to add Noba quizzes/sets To add Noba module quizzes to your course, scroll to the bottom of the page to the Manage Your Course section and click on the green Edit Assignments button.

Next, click on the green Add Assignments button. Click My Organization Tab. This will open a list of all available quizzes.

Go down the list and check the Noba quizzes (Cerego calls these Sets ) that you wish to add, please note that you can add more than one set at a time. Once you have selected the set(s) that you want, click the green Add Assignments button.

How to add students Navigate back to the Manage Your Course section for the course that you are working on. Click the green Edit Learners button.

Click the green Add Learners button either at the top or middle of the page.

Type or paste a list of your students email addresses below, each separated by a comma, then click the green Add Learners button. Then click Done.

Publishing your course Navigate to your blue Courses tab and go to the Unpublished tab. Put a check mark next the course that you want in the list and press the green Publish button.

Before hitting the green Confirm & Publish button, uncheck the Send email invitations to learners you've added to course rosters checkbox. If your students have registered on the nobaproject.com website Cerego is already enabled to track their progress on quizzes. So students don t need the additional invitation/registration email.

Info about student progress - Instructor dashboard As soon as a student takes her first quiz, her progress towards the Set Goal will be displayed on your dashboard. The default Set Goal of 0.7 (green arrow) is a good target for students to reach for a quiz within a single week. If a student scores all 20 correct on the first attempt she will reach 0.7. If a student scores below 20 correct on the first attempt she will have to return to review the quiz material at least once to reach 0.7. To navigate to your Instructor s Dashboard click Analytics on the left-hand side menu. As you can see from the little silhouette icons, three of this instructor s students have taken the quiz for The Family. You can click on individual icons to see the names of students on the dashboard and some basic info, like how many items they ve studied on a particular quiz. For more in-depth information, you ll need to run a report. Please see the details on the following pages:

How to Read, Understand and Manage Reports: For more student progress information you can access reports. There are 3 different reports you can run: 1. Set Progress 2. Daily Set/Series Study Time 3. Content Insights The first type of report Set Progress displays progress for each student by module/quiz. The second type of report (one that you probably won t use very much) Daily Set/Series Study Time displays the total study time per student per set i.e. how much time each student took to complete each set. The third type of report Content Insights shows you each quiz item in each of the sets and shows you on a group level how many tries it took students to get it right to help you identify problem items/concepts.

To access a particular report, first click Reports in the far left column

Set Progress Report How to run: In Run Report, select Set Progress. Select the Date for which you wish to run the report. In Show, select either All Sets and Series if you want to see a progress report for all sets and series at once, or select the individual Noba module for which you wish to see the report. Then either choose an individual student to run the report for or select All Students. Finally, click the orange Generate button.

What you will see The names and emails of your students (your name will be here also if you have ever taken a quiz on Noba in a given module). Progress to Goal is basically how close students are to achieving the pre-set goal of 0.7. What Set Level they ve reached based on how many questions they ve answered correctly. Set Goal is a pre-set target. For the Noba quizzes the default Set Goal is 0.7. How many questions they ve attempted to answer in % Started. How many questions each student has answered listed as Number of Memories. How long it took the student to complete the quiz in Study Time column. How many Days Since they have taken the quiz (if you see an - next to their name, that means they ve taken the quiz the same day as the report was generated). The Name of the Set or Sets (the quizzes).

Daily Set/Daily Series Study Time Report How to run: Navigate to the Reports page. In Run Report, select Daily Set/Series Study Time from the dropdown menu, then pick the dates (just specify the range of time that you wish to view the report for). In the Show option for this report, you can only run it for one module at a time, so select the Set that you wish to run the report for. Then choose an individual student to run the report for or select All Students. Finally, click the orange Generate button.

What you will see: Names of your students, their Emails and Total Study Time they ve spent on the set/quiz you ve selected.

Content Insights Report How to run: Navigate to the Reports page. In Run Report, select Content Insights from the dropdown menu. In the Show option for this report, you can only run it for one module at a time, so select the set/quiz that you wish to run the report for. Then choose an individual student to run the report for or select All Students. Finally, click the orange Generate button.

What you will see: Columns on the left will show you text and/or images indicating the specific items within the quiz Columns to the right will show you data specific to the item such as o How many times an item has been seen, o How many times it was answered correctly o What percentage of students has answered correctly on the first try o Number of students who have provided an answer on an item The value of running this report is that you can quickly identify at a glance which items in the quiz might be causing your students the most trouble

What students see Students who take Noba quizzes will have access to a dashboard that tracks their individual progress. It will not only show what a student she accomplished but also suggest a time for the next review and notify the student by email or text. Anna Apricot s Dashboard Day 1 this learner got all answers correct (20/20) on the first try: The Set Goal and Set Level lines are overlapping. She has reached the Set Goal of 0.7

Bob Banana s Dashboard Day 1 this learner got 18/20 correct on the first try: Bob has reached the Set Level of 0.6 and will have to return to the quiz at least once in order to meet the Set Goal of 0.7

Curtis Coconut s Dashboard Day 1 this learner got 14/20 correct on the first try: He has reached Set Level 0.5 and will have to return to the quiz at least once in order to meet the Set Goal of 0.7

Additional details to know/share with students Students must create a student account on nobaproject.com in order to take the quizzes and link to the instructor tracking dashboard. It takes less than a minute to sign up and all Noba materials are free. Students should share the email address they used to register on the Noba website with the instructor so they can be added to a Course and tracked as they complete assigned quizzes. The quizzes are found within the individual Noba modules on the Noba website following the main text content. To review quiz material, students must return to the Noba website and navigate to the specific module that needs review. Students can access individual modules either through a link to the Noba book you are using, or by going to the Browse tab on the Noba website and searching for the title of the module you have assigned. o Sample book link http://noba.to/5wjrz72n o Browse page link - http://nobaproject.com/browse-content Noba student quizzes each contain 20 items/questions. However, Cerego encourages micro study sessions to promote better long term retention. The maximum number of items a student can attempt in a single micro-session is 10. More frequent micro-sessions do not always fit with busy student schedules, so it is possible to do two back-to-back sessions of 10 so that all the quiz items can be attempted in a single sitting. The level of accuracy on the first pass through the full 20 items (in 2 micro-sessions) will determine if/when a student must return to review particular items to reach the Set Goal. Students will receive email updates (or text updates if they select this option in their account page) when they reach the suggested review time for a particular quiz. Students can turn off these reminders at any time. Students can see their progress toward the Set Goal as well as the Countdown Clock for the next review by logging into Noba a navigating to any quiz they have attempted.