1 Tips for Creating and Delivering Effective Mobile Assessments Ivan Forward, Questionmark Antonio Herrera, Inlea Copyright Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark
2 Percentage of World s population covered by a mobile signal Slide 2
3 Smartphone usage continues to grow Slide 3
4 2011 Census of South Africa Mobile Phone/Device Usage: Decade of Staggering Growth Rate 84.70% 90% 50% 57% 58.20% 32% % 11.80% % of homes with flush toilets % of homes with electricity % of Higher Education completers % mobile phone ownership Slide 4
5 % of overall website traffic from mobile devices Slide 5
6 Browser Support more important than ever October 2008 October 2012 Source: StatCounter.com Slide 6
7 What we will cover Example applications of mobile assessment Tips from our experience Questionmark support of mobile assessment A real-life example
8 Mobile delivery enables new possibilities Slide 8
9 Inexpensive, very portable Internet-connected mobile devices
10 What are the potential applications? Observational assessments Formative assessment Surveys & Course Evaluation
11 Observational Assessments Slide 11
12 Traditional vs. Observational Assessment Traditional assessment Participant is presented with questions for direct response Observational assessment Observer is presented with questions to rate participant to measure behaviors, skills and abilities Example Applications Certification Process Observational assessments can be used as critical components of the certification process in some cases are required by regulatory authorities. Medical and Dental School exams: Medical and dental schools make extensive use of observational assessments such as the Objective Structured Clinical Examination (OSCE). Equipment operation: Observational assessment can be used to record and rate operators' skills, abilities, safety practices and adherence to required procedures
13 Typical workflow for assessor Assessor logs in Selects assessment Selects participant to be observed Answers/submits responses to questions Results/feedback reported to stakeholders Slide 13
14 Slide 14
15 Slide 15
16 Back Slide 16
17 Formative Assessment Slide 17
18 Quizzes on mobile devices Low stakes and openly available Often appropriate for mobile devices Enables retrieval practice to reduce forgetting Provides the participant with corrective feedback for revision and learning Encourages self-directed and independent learners
19 Surveys and course evaluations Slide 19
20 QR Codes for Launching Assessments Course evaluation example: Embed demographic data in the URL to be saved to special fields in the assessment results, e.g. Course name Instructor name Location If you are delivering a survey (or course evaluation), QR Codes can help by: Increasing response rates because Quick and easy to access the right URL (no typing required) Increasing data captured allows Data easily captured (no typing required) Easier analysis of survey results by demographic is a registered trademark of Questionmark Computing Limited. Slide All 20other trademarks are acknowledged.
21 QR codes enable quick launching of quizzes and course evaluations Books PowerPoint Signage Slide 21 Benefits Ease of access for increased response rates Demographic data easily captured Better data accuracy Easier analysis of survey results by demographic
22 Apps to Scan QR Codes iphone Redlaser Neoreader ScanLife Android Google Goggles QR Droid Scanlife Windows Mobile QR Reader BeeTag Quickmark Blackberry ScanLife BeeTag QR Code Scanner is a registered trademark of Questionmark Computing Limited. Slide All 22other trademarks are acknowledged.
23 The Big Switch Survey
24 Mobile Test Centres Use notebooks/3g laptops/ipads to create mobile test centres Enables greater flexibility in where you deliver assessments Assessments can be conducted in on location environments is a registered trademark of Questionmark Computing Limited. Slide All 24other trademarks are acknowledged.
25 Securing an ipad An app should prevent candidates from easily getting to other URLs But access to home button allows task-switching Hardware solutions are available to enable use of ipad in a kiosk mode is a registered trademark of Questionmark Computing Limited. Slide All 25other trademarks are acknowledged.
26 Secure Browser One Setting Multiple Platforms Prevents. Printing Screen capture Task switching Control/system keys Right-click / context menu options View source Accidentally exiting exam Questionmark Secure for Windows Questionmark Secure for Mac Questionmark Secure for ipad Slide 26
27 Kiosk Mode Apps Padlock App Mobile Kiosk App Kiosk Pro App Lockdown to a website Allow linked websites Custom message if linked website is not allowed Back to home timer Browsing limit timer Custom message when browsing time limit is reached Show address bar Show forward / back page navigation arrows Digital signage mode (non touch) Scale pages to fit Clear local HTML presentation files
28 Tablet Enclosures Slide 28
29 Considerations: The higher the stakes, the higher the propensity to cheat still require human monitoring! Bandwidth Be sure to test the wifi and/or 3G signal strength prior to event is a registered trademark of Questionmark Computing Limited. Slide All 29other trademarks are acknowledged.
30 Tips for Creating and Delivering Effective Mobile Assessments Surveys and course evaluations: Sometimes less is more Think small: Screens, input devices and bandwidth To Flash, or not to Flash? Be aware of what technologies your participants devices support Use feedback carefully and make it short enough to read Test and test again: Try before you deliver! Slide 30
31 Mode of Deployment Mobile (phone) short 1-5 minute modules o Updates on new information o Review of previous curriculum o Learning Check to enhance retention Video (ipad) minute modules o Content involves more explanation o Larger volume of content required to present elearning (computer) minute modules o Difficult or complex content o Requires interaction and instruction o Higher level of security needed Classroom 1hr+
32 True for most surveys; Especially true for mobile surveys Consider your objectives: Keep your surveys brief to help increase response rate Put your most important questions at the start of the survey Include only one concept per question Group related questions together Avoid relying on open-ended questions (e.g. essay ) Slide 32
33 Think small: Screens, input devices and bandwidth
34 Develop for the Device Browser screen 480 pixels Graphics 200 pixels wide Video H.264 Audio mp3 at 22 khz
35 Lay-Out Most important goes high and left (4-5 inch square) Finger size matters (44 x 44) Place videos last Avoid Flash Beware of the Fold Line Font size or 2 columns of content/page
36 Screen Furniture Ensure your form buttons and other navigation controls (a/k/a screen furniture ) work with low screen resolutions Slide 36
37 Images Optimise size and compression of larger image files to minimise bandwidth requirements Detail on images should be kept to a minimum to ensure readability on small screens
38 Be cautious in use of Flash Be aware of what technologies your participants devices support Slide 38
39 Be cautious in use of Flash Helps minimise bandwidth requirements Strengthens cross-device compatibility Flash will not work on Apple iphones, ipads or ipod touch devices Flash is compatible with some mobile platforms such as Android phones (and tablets) and Windows Mobile Slide 39
40 When is feedback useful? Correct faulty recollection Helps participant with faulty recall Correcting misconceptions Provide guidance when evidence of fundamental misunderstanding of a topic Feedback only useful if it is read keep short Slide 40
41 Try before you deliver! Slide 41
42 Test your content! Test your assessment content With different browsers On as many different devices as practical Emulators can help understand how content will appear on the small screen -- but don t always give a true user experience Setting up a mobile test centre? Test delivery environments when possible particularly for signal/wifi strength Many free online bandwidth tests are available
43 Questionmark s support for Mobile Delivery Slide 43
44 Levels of Monitoring Blended Delivery Diagnostic Tests Low Stakes Tests Medium Stakes Exams High Stakes Exams Formative Quizzes Course Evaluations Stakes of Assessment
45 Access to your Assessments Mobile delivery makes it easier for participants to access assessments: Use mobile Apps Place links in content (PDFs, HTML Web Pages, etc) Embed within a Portal For employees, partners and customers
46 Android Questionmark Mobile Apps iphone, ipad and ipod touch
47 Participant Devices Responsive Design 4. On-the-fly auto-sizing of content and controls 1. Senses device/browser 3. Sends assessment to browser 2. Device drivers used to format assessment for device/browser Slide 47
48 Responsive Design Will resize the assessment tools/content for optimum fit Consider if your assessment content will be affective on smaller screens
49 Benefits Author once Deliver to any device or context Schedule once Single results set Slide 49
50 Case study Antonio Herrera, Inlea
51 Mobile Delivery Real Case Test of Entrepreneurial Profile Belongs to Inlea s CSR activity to help Startup Entrepreneurs to design and launch their business projects (Fundación Inlea, linktostart)
52 Mobile Delivery Real Case Context, about Inlea: Inlea is an international group of companies dedicated to transfer knowledge between Industry and the Education Sector. We support education programs for companies such as Cisco, Oracle, Corning, and Televes Inlea is Questionmark s distributor for Spain
53 Mobile Delivery Real Case entrepreneur, i.e. one who "undertakes an enterprise". The term puts emphasis on the risk and effort of individuals who own and manage a business, and on the innovations that result from their pursuit of economic success
54 Mobile Delivery Real Case
55 Mobile Delivery Real Case
56 Mobile Delivery Real Case Why Mobile? This Self-Test will be delivered to large communities of Startup Entrepreneurs, intra-entrepreneurs, and University students. Many of them will be able to take the test in mobile devices and will prefer such option. Mobile delivery will allow a wider deployment to service more users with their device of choice.
57 Mobile Delivery Real Case Issues? Is a mobile device the best tool for an entrepreneurial profile self-test? What size of mobile device is sufficient? What happens on a crowded context? Is it possible to brand and customize the mobile template?
58 Screen shot: Laptop Mobile Delivery Real Case
59 Screen shot: Samsung Galaxy S4 Mobile Delivery Real Case
61 Thank you for attending! Ivan Forward Antonio Herrera Copyright Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark
511 Merging Assessments with Learning via Web Sites, Blogs, Wikis, Mashups, and Mobile Devices Jeff Place, Questionmark Jeff Place Questionmark email@example.com Copyright 1995-2010 Questionmark and/or
Authoring and Presenting Section 1: Introduction to RSNA Diagnosis Live Respond to an Institution Invitation Login to Diagnosis Live Player Portal Select the Admin Portal Diagnosis Live Requirements Player/Student
Last Updated: 5/31/2013 MH Student Guide to Blackboard & Mobile Access Students interested in accessing components of their Blackboard courses on mobile devices may download the MATC 2 Go or Blackboard
RMU User Guide RISK MANAGEMENT UNIVERSITY User Guide January 2014, Version 1.1 Risk Management University EIIA, Inc. Email: RMU@EIIA.org Web: www.eiiarmu.org Contents CONTENTS... 2 GETTING STARTED... 4
Illinois Longitudinal Data System Ed360 Teacher Classroom Assessment User Guide Table of Contents Background 2 What is Ed360? 2 A Brief History of Ed360 2 Ed360 and Plickers Compatibility Supports Classroom
Top Trends in elearning September 15 & 16, 2011 401 Leveraging the Latest Technologies for elearning Video, 3D Visualization, and Mobile Edward Prentice III, Centrax Corporation Leveraging the Latest Technologies
Slide 1 A Guide to Getting Started Edmodo Training Slide 2 Free social learning network for teachers, students, schools and districts Safe and easy way to connect Exchange ideas Share content Access homework,
The Math Inventory Software Manual For use with The Math Inventory version 2.5 or later and Student Achievement Manager version 2.5 or later PDF0953 (PDF) Houghton Mifflin Harcourt Publishing Company ipad
English 3D Technology User s Guide For use with the English 3D Issues Book Digital Edition, Issue Test Application, HMH Student Central, and HMH Teacher Central. Table of Contents Overview... 4 English
hmhco.com HMH Player is a revolutionary new learning app that FITS how you teach and how your students learn, for real-time collaboration! FFlexible I Intuitive T Transformative SStreamlined content that
hmhco.com Version 1.3 FAQ HMH Player is a revolutionary new learning app that FITS how you teach and how your students learn, for real-time collaboration! FFlexible I Intuitive T Transformative SStreamlined
Quick Reference Card Student Online Registration WCU students will be able to register their courses for the upcoming term via an Online Registration application. Students can use any internet connected
Wiley Digital Textbooks & WileyPLUS Digital Resources USER GUIDE Page 1 CONTENT 1 System Requirements.. 3 2 Benefits of Digtial Textbooks.....4 3 Benefits of WileyPLUS, WileyPLUS with Orion & WileyPLUS
Online Testing Highlights and Script for Spring 2018 Ohio s State Tests Administrations Test administrators must use this document when administering Ohio s State Tests online. It includes step-by-step
ipads, iclickers, and Apps Session Clark Shah-Nelson JHSPH Center for Teaching & Learning David Schwartz Clinical Information Systems Education Center Emily L. Jones JHUSON Office for Teaching Excellence
Plickers Student Response System Tutorial To use Plickers, you need one computer (laptop or desktop) and one mobile device (smartphone, ipad or tablet) First, visit the Plickers website at http://www.plickers.com.
Online Testing Highlights and Script for Fall 2017 Ohio s State Tests Administrations Test administrators must use this document when administering Ohio s State Tests online. It includes step-by-step directions,
LONDON S GLOBAL UNIVERSITY 1 UCL E-Learning Baseline: enhancing e-learning provision Baseline and Baseline+ UCL E-Learning Baseline: enhancing e-learning provision Students appreciate, and increasingly
Tablets for Learning Learning Context The increasing availability, adoption and use of tablets in many aspects of life outside school demands that we reflect on whether they can be purposefully used for
Go Math! Daily Assessment App Journeys Common Core Reading Practice and Assessment App Teacher Resource Center Version 2.0 User Guide Houghton Mifflin Harcourt 2013 Copyright by Houghton Mifflin Harcourt
Teacher Sign Up Need an account? Follow these steps: Step 1: On the www.wilsoncounty.edmodo.com start page, click the button I m a Teacher to sign up for a free account. Get your code from your technology
Using Scholastic Central With Scholastic Math Inventory College & Career For use with SMI College & Career version 2.3.2 or later, Scholastic Central, and Scholastic Achievement Manager version 2.3.2 or
Digital Textbook & WileyPLUS Digital Resources CONTENT 1 System Requirements 3 2 Benefits of Digtial Textbook. 4 3 Benefits of WileyPLUS, WileyPLUS with Orion & WileyPLUS Learning Space.. 5 4 How to Access
Using Vision for Windows in mobile labs and BYOD environments Change is inevitable Classrooms around the world are evolving and changing. Schools are looking for ways to successfully integrate technology
PLATO Learning Environment System and Configuration Requirements Version 1.1 (for use with Academic Systems Algebra only) for workstations April 27, 2007 Windows 2000 Professional with SP4 Windows XP Professional
CAMS Enterprise Student Mobility Portal Unit4 Education Solutions, Inc. Published: 29 January 2016 Abstract This document is designed to provide information necessary to use the Student Mobility Portal.
Augmentative and alternative communication (AAC) includes all forms of communication (other than oral speech) that is used to express thoughts, needs, wants, and ideas. People with severe speech or language
elearning Learning Management System (LMS) Overview Table of Contents LOGGING IN TO THE LEARNING MANAGEMENT SYSTEM (LMS) 3 THE MY DASHBOARD PAGE 4 ENROLLMENTS 4 WIDGETS 5 ENROLL IN A COURSE 7 LAUNCH AN
The British Army compliance training goes mobile The British Army recognised the opportunity of leveraging the power and accessibility of mobile devices for its compliance training deployment. As the millennium
WEST: Tutor Quick Start Guide v1.3.2 1 Screener A learner can take a screener before they have an account on WEST as a registered learner. If you want your learner to do this, direct them to click on the
User guide for mobility participants Learn languages with Erasmus+ OLS German - English - Spanish French - Italian - Dutch Copyright 2014 ALTISSIA International S.A. All rights reserved. Contents 1. Introduction...
Guidelines for using SDU s e-learning platform - Checklist for setting up your course site on the e-learning platform Contents The course menu... 2 Announcements... 4 Course Information... 4 Course Materials...
Updated: 21 June 2017 epath User Guide Page 1 Introduction... 3 USAS Coach Academy Catalog web site... 3 Selecting a course from the Coach Academy Catalog web site... 4 epath Logon... 7 Your Home Page...
Plickers Tutorial 1. Create an account. Go to https://plickers.com/. Click Sign Up in the upper right corner. Enter your information and click Sign Up. 2. Add your classes. Go to the Plickers website to
The Electronic Journal for English as a Second Language February 2017 Volume 20, Number 4 Nearpod Title Platform Minimum Hardware Requirements Producer/strong> Support Offered Target Language Target Audience
Fast ForWord Programs on ipad User Guide For educators and providers using MySciLEARN November 2017 Copyright 1996 through 2017 Scientific Learning Corporation. All rights reserved. This document is supplied
Etudes Instructions for Oceanography 10 page 1 Etudes: Labs, Homework, Practice Quizzes, & Online Lectures Task 1: Logging in to Etudes In the class, we will use the Etudes course management system. Enter
Music Teacher Grade Book Welcome to the revised teacher grade book. The new functionality streamlines common teacher tasks such as Attendance and Scoring assignments. In the following pages we will review
Scholastic Reading Inventory Software Manual For use with SRI v1.9, SAM v1.9 or later, and Expert 21 Copyright 2009, 2005 by Scholastic Inc. All rights reserved. Published by Scholastic Inc. SCHOLASTIC,
Cloud QUICK GUIDE 1 Getting Started Imagine Learning is an award-winning language and literacy software program that features interactive activities, videos, and games. It s research-based, instructionally
Accessing the Portal The Portal can be accessed by parents of enrolled students. Parents will see all children in their household, or students that are related through the Guardian checkbox of the Relationships
On-line Graduate Certificate in Interdisciplinary Qualitative Studies Graduate Handbook Department of Lifelong Education, Administration, and Policy College of Education Last updated January 9, 2018 University
Blackboard Mobile Learn Installation/Configuration Guide INSTALLING THE BLACKBOARD MOBILE WEB SERVICES BUILDING BLOCK FOR BLACKBOARD LEARN, RELEASE 9.1 These instructions are for installing and configuring
2017 Science SBA Fall Retest CBT Training itester William Kinnison System Overview 2017 emetric LLC Do Not Distribute Science SBA Portal: Test Administration System Science SBA Kiosk: Student Test Delivery
Through Test Manager Creating Online Quizzes through Test Manager Adding a Test 1. Go to Control Panel, then Test Manager under Assessment area. 2. Click Add Test. 3. Fill in the appropriate information
PARCC: An Educator s Assessment December 2013 1 By Educators for Students Thousands of K-12 educators are leading test development More than 1,000 educators serve as PARCC Educator Leader Cadre members,
Welcome to Compass A guide for parents and families Our school uses Compass as our Parent Portal What does Compass do for me? Using Compass allows you to access up-to-date and meaningful information about
Apptivities for Business English Pete Sharma and Barney Barrett Contents Introduction Chapter one Speaking Chapter two Writing Chapter three Listening Chapter four Reading Chapter five Language Chapter
WorkKeys Online Frequently Asked Questions The frequently asked questions below refer often to the Quick Start Guides. The Quick Start Guides are located at http://www.act.org/content/act/en/products-and-services/workkeys-for-educators/assessments/administration.html.
Worldwide Headquarters: 211 North Union Street, Suite 105, Alexandria, VA 22314, USA P.571.296.8060 F.508.988.7881 www.idc-gi.com T h e N ext-generation Classroom: Smart, I n t eractive and Connected L
GETTING STARTED Table of Contents Welcome to Utah Compose 3 Utah Compose Welcome Page 3 Utah Compose Writing Site 6 Changing your Password 7 Accessibility Options 8 Accessing your Courses 9 Selecting a
PowerSchool's PowerTeacher Pro gradebook is a robust classroom management tool that includes advanced features for both standards-based and traditional grading. Teachers use the mobilefriendly gradebook
Back to School August 2011 IRM Newsletter Technology News for FAU Faculty and Students Summer at IRM Has Been Anything But Quiet! Whether you are new to FAU or returning to campus after a relaxing summer,
http://www.atrixware.com 1.866.696.8709 Request for Proposal for a Cloud Based Learning Management Solution Sample Questions for a Learning Management System (LMS) General Is your product 100% web based
Edinburgh Business School Online Revision Plan 1 REGISTRATION INFORMATION TUTOR PROFILE TIMETABLE LOGIN & ADOBE INFORMATION TROUBLE- SHOOT & FAQ ONLINE REVISION Fee: 150 Designed to support students in
International Company Directors Course Participant Assessment Information Participant Assessment Information Table of contents Introduction... 3 Assessment Top FAQs... 4 Assessment outcomes... 5 Grades...
Online and searchable training guides can be found at: www.help.craniumcafe.com for Faculty & Staff Members for Canvas LMS Integration 132 S 600 E Suite 204, SLC UT 84102 801-935-4244 Info@CraniumCafe.com
Creating Content for the Twenty-First Century Student 1 FIGURE 1. OPEN YALE COURSES, YALE.COM It is all about getting access to quality content and doing so while paying attention to your audiences learning
Promoting Your Location Platform A Change Management Kit www.esri.com/changekit Publication Date: April 3, 2017 Esri: Promoting Your Location Platform 1 What is the Change Management Kit? The launch of
Welcome to EF English Live 50 YEARS OF TEACHING EXPERIENCE Congratulations on becoming a part of the world s most innovative online English school. We re happy to welcome you as the newest member of our
PowerSchool Student Information System Document Properties Copyright Owner Copyright 2007 Pearson Education, Inc. or its affiliates. All rights reserved. This document is the property of Pearson Education,
The experts in flexible learning solutions Bespoke elearning Our approach to elearning starts with your business challenge understanding your people and what you re aiming to achieve. At a glance Our team
Introductory User Guide GIBS Blackboard LMS WELCOME Welcome to Aspire, the GIBS Blackboard Learning Management System, and to what we hope will be a productive, dynamic and interactive learning experience.
NEW! Comprehend. Create. Communicate. Achieve more. Quick Start Guide Welcome to Inspiration 9, the ultimate thinking and learning tool to comprehend, create, communicate and achieve more. Over 20 years
Houghton Mifflin Online Assessment System Walkthrough Guide Page 1 Copyright 2007 by Houghton Mifflin Company. All Rights Reserved. No part of this document may be reproduced or transmitted in any form
Ensuring Success with myhrw.com and the Personal Math Trainer Tips for Broward County Public Students and Family Members 1 Operating Systems and Browsers The website my.hrw.com and the Personal Math Trainer
2017 Manual STUDENT 0 Contents Description of roles and users... 2 REGISTERING ON THE PLATFORM... 4 STUDENT... 9 NAVIGATING THE PLATFORM... 10 User account... 13 MY E-BOOKS... 14 PROGRESS... 18 Assignments...
Blackboard Collaborate Ultra Blackboard Collaborate with the Ultra experience provides an online room for your course that stays open for the life of your course. By default, the room is given your course
SAM Settings and Reports for READ 180 Enterprise Edition For use with READ 180 Enterprise Edition v2.0.2 and SAM 2.0.2 or later Copyright 2011 by Scholastic Inc. All rights reserved. Published by Scholastic
Edinburgh Business School Online Revision Plan 1 REGISTRATION INFORMATION TUTOR PROFILE TIMETABLE LOGIN & ADOBE INFORMATION TROUBLE- SHOOT & FAQ ONLINE REVISION Fee: 150 Designed to support students in
ASKnLearn LMS Teachers User Guide 2.0 Wizlearn Technologies Pte Ltd http://lms.asknlearn.com Best view using: Mozilla Firefox, Google Chrome or Microsoft Internet Explorer version 8 or above Flash player
Reading Assistant on ipad User Guide For educators and providers using MySciLEARN November 2017 Copyright 1996 through 2017 Scientific Learning Corporation. All rights reserved. This document is supplied
+ 2017 2018 Practice Test Manual Part 1 and Part 2 Assessment: Grade 10 Copyright 2017 by State of Indiana Department of Education (IDOE). All rights reserved. No part of this publication may be reproduced
Wimba PowerLink for Blackboard LS (WebCT) Vista 4.0-8.0 / CE 6.0-8.0 Version 3.3 User Guide Wimba Powerlink User Guide 1 Getting Started 1 Introduction 1 Adding a Feature to a Section 2 Wimba Classroom
Schoolnet Instructional Management Suite Released March 4, 2013 Document Owner: Curriculum This edition applies to Release [v14.3] of the Schoolnet software and to all subsequent releases and modifications
ANALYST REPORT OF KAHOOT Caleb Poole-ETEC 522 What is? Kahoot is web-based learning platform that makes assessment engaging and efficient It is designed to work on any device with internet access and carries
Online Assignment Tutorial Completing assigments on Skyward that can make life a bit easier for both teacher and student. This tutorial will go through four things: 1. Creation of an online assignment.
K2 FAIR-FS User s Guide School Year 2014 2015 PMRN 3-12 WAM Manager Guide Version 1 1 Contents Section 1: Overview of the Assessment...2 Computer Specifications... 2 FAIR FS Assessment System Specifications...