Drop-In Demo: Open Forum Ivan Forward
Agenda Brief Overview of Questionmark Corporation Assessment Solutions enabled by Questionmark Collaborative Authoring Blended Delivery options including: Secure Browser Mobile Devices Embedding Assessments in Blogs, Wikis, Portals and more Reports and Assessment Result Analytics Observational Assessments Translation Management for Multilingual Assessments Integrating Questionmark with other systems Why Questionmark OnDemand Slide 2
Founded in 1988 About Questionmark Technologies and services that enable organizations to measure knowledge, skills, and attitudes securely for certification, regulatory compliance and improved learning outcomes Assessment Management System: On Demand On Premise More than 2,500 customers worldwide Offices in US, Canada, UK, Belgium and Germany Questionmark Perception available in English, Spanish, German, French, Dutch, Norwegian and Japanese Participant facing software in 20 languages Questionmark Live SME Authoring available in 15 languages Slide 3
Questionmark enables customers to meet key objectives Education Improve learning outcomes Increase student satisfaction Data for institutional effectiveness, accreditation Learning, Training & HR in Business and Government Regulatory Compliance Heath and Safety Sales and Technical Channel Verification Employee Selection Awarding Bodies / Certification / Test Publishers Efficiently create and maintain valid, reliable tests Generate revenue from exams and practice tests Slide 4
Assessment Solutions Enabled Course evaluation Quizzes & Knowledge Checks Summative assessment Diagnostic/ Placement tests Pre- and Postcourse tests Certification & licensing exams Observational Assessments Job Task Analysis
Questionmark and Kirkpatrick s Levels of Evaluation Was it worth it? Level 4 Did they get it Level 3 Did they learn it? Level 2 Did they like it? Level 1 Observational Assessments Tests/Quizzes/ Exams Survey/course evaluations
Create Collaborative, secure authoring of surveys, quizzes, tests and exams Software-as-a- Service Deliver Blended delivery to support a broad range of devices and security needs For OnPremise Deployment Analyze Evaluate results and inform stakeholders with timely, meaningful reports
Author, Deliver and Analyze via the Cloud Internet
Questionmark Live: Ideal for rapid item and assessment writing Authors, Admins and SMEs: Create Items & Assessments Items Assessments Content Questionmark Repository
Wizards to create 21 item types Drag and Drop *Essay *Explanation Fill in Blanks *Hotspot *Likert Adobe Flash Adobe Captivate *Matching Knowledge Matrix Survey Matrix *Multiple Choice *Multiple Response *Numeric File Upload *Pull-down List Ranking Select a Blank *Text Match *True/False *Yes/No Enable authors to create more interesting and probing questions Reveals more information during an assessment in a shorter time Not offered by simpler assessment tools in LMS s Slide 10
Link. Launch. Embed. Social Networking Platforms Embedded in Wikis, Blogs, and Web pages Printing and Scanning Secure Browser Web Browser Questionmark to Go LMS Integration Test Centers Windows / CD Mobile Devices Slide 11
Responsive Design 2. Device drivers used to format assessment for Device/Browser/iFrame 1. Senses Device/Browser 3. Sends assessment to browser 4. On-the-fly auto-sizing of skin and controls
Levels of Monitoring Delivery Stakes and Devices Diagnostic Tests Low Stakes Tests Medium Stakes Exams High Stakes Exams Formative Quizzes Course Evaluations Stakes of Assessment
Questionmark Secure One Setting Multiple Platforms Prevents. Printing Screen capture Task switching Control/system keys Right-click / context menu options View source Accidentally exiting exam Questionmark Secure for Windows Questionmark Secure for Mac Questionmark Secure for ipad Slide 14
Options for Monitored Delivery Traditional Test Centers Live Monitoring/ Standard Webcams Recorded Monitoring/ Custom Hardware Live Monitoring/ Custom kiosk Slide 15
Analyze and report on results Did the learning investment impact performance? How did one group of test takers compare to another? Where are the skills and knowledge gaps in my organization? How do I coach participants to improve performance? Are my questions and tests valid and reliable? What did participants learn from the training or course? What did participants think of the learning experience?
Demonstration
Slide 18 What are some of the other solutions available from Questionmark?
Potential Applications for Mobile Delivery Deliver to the device in your hand Observational assessments Mobile test centers
Android Mobile Apps iphone, ipad and ipod touch
Scan a QR Code With Your Mobile Device to Start an Assessment! Benefits Ease of access for increased response rates Demographic data easily captured Better data accuracy Easier analysis of survey results by demographic Slide 21
Observational Assessment Traditional assessment Participant is presented with questions for direct response Observational assessment Observer is presented with questions to rate participant to measure behaviors, skills and abilities Example Applications Certification Process Observational assessments can be used as critical components of the certification process in some cases are required by regulatory authorities. Medical and Dental School exams: Medical and dental schools make extensive use of observational assessments such as the Objective Structured Clinical Examination (OSCE). Equipment operation: Observational assessment can be used to record and rate operators' skills, abilities, safety practices and adherence to required procedures
Launch and Track Integration with LMS Questionmark LMS/VLE Create Assessment Publish to LMS Set up learner to access assessment Make assessment available to learner Deliver Assessment Completes Assessment Learner Launches Assessment Results returned to LMS Deep Analysis of Results Slide 23
Embedding Assessments in Wikis, blogs, portals
Benefits of Embedding in Blogs, Portals, Wiki s For Learners For Organizations Focus the learners attention Practice memory recall Identify what was learned Provide feedback to assist the learner to: Correct misconceptions Instill confidence Point to relevant material Embrace 70+20+10 with confidence Easily use assessments throughout the learning process Provide seamless user experience Centralized management of assessment content and results Slide 25
Translation Management System Translation methods Interactive Translations Using Questionmark TMS Translations using 3 rd Party Tools Export to XLIFF (XML) On-The-Fly Translation Management System Set Up Project using TMS Translate using 3 rd Party Tools Manages translation process.does not do translation Import from XLIFF (XML) Slide 26
Consulting Services Deployment Planning Installation Integration Authoring Assessments Importing items Templates / Look & feel Reporting Item reports Other custom reports Solutions & Integration Testing and Assessment Portals People Data syncing Results Data syncing Self Registration Auto Scheduling Assessment Clustering Certificate Generation Distributed Administration Assessment Catalogs Slide 27
Candidate Portals
Can I integrate Questionmark with various other Enterprise Systems? Launch and Track API / Data Integration Connectors for Embedded / iframe / Portals AICC SCORM QMWISe OData Next-gen SCORM LTI HR-XML SAP Blackboard Moodle SharePoint Wikis Blogs Portals SharePoint Slide 29
Integrating with SharePoint Embedding assessment lists and assessments using Windows Authentication Embedding assessment lists using SharePoint Connector for OnDemand Slide 30
SAP Connector Slide 31
Blackboard Connector (v8 and 9) Slide 32
Ways to Evaluate Try Questionmark OnDemand 30 Day Trial Software as a Service https://www.questionmark.com/go/try430days Try Questionmark Perception Download 30 day trial https://www.questionmark.com/download Slide 33
Questionmark OnDemand Scalable, SaaS-based Testing and Assessment Solution SSAE 16 Audited Data Center State-of-the-art data centers SaaS / Rapid Deployment 24/7 Monitoring Global 24/7 support available 99.9+% Uptime Scalable to meet highvolume, peak delivery needs Always have the latest version Turnkey service - no hardware to buy and maintain
Ways to Learn More Questionmark Blog! http://blog.questionmark.com Questionmark Training Course http://www.questionmark.com/training White Papers http://www.questionmark.com/whitepapers Manuals, Knowledge Base and Best Practices Guides http://www.questionmark.com/perception/help Web Seminars www.questionmark.com/seminars Slide 35
Recommended White Papers Assessments through the Learning Process Security of Questionmark s OnDemand Service Alignment, Impact and Measurement with the A-model Embedded Assessments: Building Knowledge Checks, Surveys and Other Assessments into Learning Materials How Questionmark Aids ISO 10667 Compliance https://www.questionmark.com/whitepapers Slide 36
Keep in Touch blog.questionmark.com www.questionmark.com/newsletter twitter.com/questionmark linkedin.com Look for Questionmark under Groups and join youtube.com/questionmarkvideo flickr.com/questionmarkpictures facebook.com Become a fan for news, updates and more Slide 37
Why Questionmark? Secure Scalable Agile Trustable Content Delivery Results Millions of tests delivered 99.99% Uptime Tests available globally Author in Browser Multilingual Mobile, Blended Delivery Accessible Reliable 24/7 Support
Thank you for attending! Ivan Forward