Metrics that Matter Cisco Channel Partner MTM Training
Purpose Your organization is using Metrics that Matter (MTM) to: Collect evaluations for training Improve learning effectiveness and impact Communicate results Today s session MTM Overview Key Reports Additional Resources 2012, KnowledgeAdvisors 2
Expectations for Training Interactive Ask questions Participate in hands-on exercises Close email and other applications Focused 60 minutes Off-topic questions may need to wait 2012, KnowledgeAdvisors 3
Agenda MTM Overview Getting Started with MTM Cisco Sponsored Reports Subscription Based Reports Additional Resources Wrap - Up 2012, KnowledgeAdvisors 4
Logging into MTM www.metricsthatmatter.com/mtm View announcements Register for workshops, events, and MTM training sessions
Hands-On: Log into MTM 1. Open your web browser 2. Go to www.metricsthatmatter.com/mtm 3. Bookmark this page 4. Login 2012, KnowledgeAdvisors 6
Admin Menu FAQ Site Help Admin Favorites
MTM Admin Schedule Training Tools Covered Today Tools for Scheduling Classes Tools for Collecting Evaluations
MTM Admin Manage Evaluations Tools Covered Today Tools for Scheduling Classes Tools for Collecting Evaluations
MTM Evaluation Process Purpose of administration Collect evaluations Tag evaluations with class information (instructor, date, learning methodology) Populate reports LMS integration can eliminate administration Schedule Classes Collect Evaluations View Reports 2012, KnowledgeAdvisors 10
MTM Evaluation Process Add Courses Add Locations Add Instructors Schedule Classes Collect Evaluations View Reports 2012, KnowledgeAdvisors 11
MTM Evaluation Process Schedule Classes Collect Evaluations View Reports 2012, KnowledgeAdvisors 12
MTM Evaluation Process Schedule Classes Collect Evaluations View Reports 2012, KnowledgeAdvisors 13
Getting Started Resources 1. Cisco Quick Start Guide 2. Cisco Welcome Kit 3. Cisco BLP Welcome Kit 2012, KnowledgeAdvisors 14
Reporting tab Help FAQ Site Report Favorites
Additional reports Recent reports Manage reports Recommended reports
Benchmark preferences My Settings Configure reports Set reporting scale
Cisco Sponsored Reports Objectives Identify reports Manually run reports Select optimal report 2012, KnowledgeAdvisors 18
Cisco Sponsored Reports 1. Class Analysis Report 2. Quick Question 3. Data Download 2012, KnowledgeAdvisors 19
Run Class Analysis Report Query Type Date Range Class Search Select Class
Select Question Categories Select Question Categories Set Benchmark Click Next
Additional Report Options Select Language Report Sections Click Next
Generate Report Select Format Generate Report
Run a Summary Report for a Class Narrative Report available in Word or PDF Comprehensive, client-ready view into one class Summary Evaluation Ratings Questions by Category Qualitative Feedback Demographics Learner Responses Next Steps Facilitates analysis and comparison Compare performance against a benchmark 2012, KnowledgeAdvisors 24
Class Analysis Report 2012, KnowledgeAdvisors 25
Class Analysis Report 2012, KnowledgeAdvisors 26
Class Analysis Report 2012, KnowledgeAdvisors 27
Class Analysis Report 2012, KnowledgeAdvisors 28
Class Analysis Report Demographics Additional Recommendations 2012, KnowledgeAdvisors 29
Quick Question Report Summary Question Categories Average Scores 2012, KnowledgeAdvisors 30
Hands-On: Run a Class Based Report 1. Click Reporting 2. Click Class Analysis or Quick Question 3. Select Date Range 4. Search for Class and click link 5. Click Next 6. Make any report selections, then click Next 7. Click Generate Report 2012, KnowledgeAdvisors 31
Additional MTM Reports Objectives Rank instructors Review an instructor s performance 2012, KnowledgeAdvisors 32
Rank Instructors Recognize top instructors Leverage top instructors for train-the-trainer Drill into bottom instructors Comparative Performance 2012, KnowledgeAdvisors 33
Rank Courses Expand design approach of top courses Revise or retire bottom courses Incorporate into performance ratings Comparative Performance 2012, KnowledgeAdvisors 34
Review an Instructor s Performance Discuss in performance review Recognize strengths Identify skills and courses to improve on Establish development plan and goals Instructor Performance Summary 2012, KnowledgeAdvisors 35
Instructor Performance Summary 2012, KnowledgeAdvisors 36
Instructor Performance Summary Top and bottom three classes Evaluations collected by learning methodology 2012, KnowledgeAdvisors 37
Instructor Performance Summary Ratings by question category Learner comments by class 2012, KnowledgeAdvisors 38
Crosstab Report View intersection of 2 attributes to pinpoint opportunities for improvement Course x Question Category Course x Instructor Demographic x Learning Methodology 29 April 2013 2008, KnowledgeAdvisors 39
Analyze Qualitative Feedback Text Analytics Learner Comments Report Provide aggregated view of qualitative data Easier access to actionable and informative feedback Determine learner sentiment: Sentiment Score (overall Satisfaction Score) Relative to Benchmark Word count 2012, KnowledgeAdvisors 40
Use Benchmarks Compare performance against internal or external reference Context for quantitative metrics Insight into above and below average areas Report Card 2012, KnowledgeAdvisors 41
Identify Sales Leads Flexible Report output/structure Identify sales leads Include qualitative data Report by question Multi-Level Analysis 2012, KnowledgeAdvisors 42
Q&A and Next Steps Objectives Summary Q&A Additional Resources 2012, KnowledgeAdvisors 43
Summary Objectives Overview of MTM Cisco Sponsored Reports Key MTM Reports Additional Resources Tools Class Analysis Report Quick Question Report Data Download Comparative Performance Report Card Learner Sentiment Multi-Level Analysis 2012, KnowledgeAdvisors 44
Additional Resources MTM Help documentation on Reporting Best Practices: http://www.mtmlearning.com/lghelp/start/default.htm?_search=%20data download FAQ site: http://knowledgeadvisors.force.com/knowledgehome Cisco Quick Start Guide Cisco Welcome Kit Cisco BLP Welcome Kit 2012, KnowledgeAdvisors 45
Thank you! For on-going support and questions, please contact your Services Team at KnowledgeAdvisors or email Customer Support: solutions@knowledgeadvisors.com 2012, KnowledgeAdvisors 46