Forget catastrophic forgetting: AI that learns after deployment

Size: px
Start display at page:

Download "Forget catastrophic forgetting: AI that learns after deployment"

Transcription

1 Forget catastrophic forgetting: AI that learns after deployment Anatoly Gorshechnikov CTO, Neurala 1

2 Neurala at a glance Programming neural networks on GPUs since circa 2 B.C. Founded in 2006 expecting that there will be a programmable GPU in every cell phone Concentrating on the edgebased cloud indifferent AI Actively growing Experience in building and commercializing AI 2

3 Built with Brains For Bots SDK Example: inspections with drones Use case: inspection of telecommunication towers, solar panels, roofs, power lines Problem: what if tomorrow we need to add new data to the set? 3

4 Theory of Catastrophic Forgetting at a glance Distributed representation: very many neurons are involved in correct classification of every object Very many weights are important for each classification Learning of new objects perturbs all weights, hence forgetting 4

5 Brute Force Solution Combine the old and the new datasets and retrain the network General issues: Requires powerful server + Takes a lot of time 5

6 Many More Practical Client-Specific Issues Clients don t like to share their data Clients definitely do not want us to keep their data after training is done How can we combine old and new data sets in these conditions? Client wants their toy to recognize their other toys: easy factory pretraining Client also wants their toy to recognize its owner: need to train after deployment Privacy laws do not allow uploading of kid s images to the cloud 6

7 How can we Add new data to existing DNN knowledge without forgetting the old data? Do this without powerful servers and cloud access? Do this within seconds rather than hours? 7

8 Ignorance Is Bliss We age, advance in our career paths, and quit reviewing papers New generation does not pay attention to papers from 20 years ago A lot of ways to alleviate catastrophic forgetting we discussed in mid-90es 8

9 How Psych Took Insight from Computer Science Brain has multiple neural networks with different properties and functions Need an interacting system of short and long term memory 9

10 Deeper in Neurobiology Hasselmo (1999) Neuromodulation: Acetylcholine and memory consolidastion Brain switches between learning and recall modes by regulating ACh levels High levels of ACh suppress feedback and enhance feedforward processing Low levels do the opposite 10

11 One of Most Recent Solutions Kirkpatrick et al (2017) Overcoming catastrophic forgetting in neural networks Protects individual network parameters such as synaptic weights by evaluating their importance for prior learning Supported by neurophysiology (see Hasselmo, 2017 for references) Can be complimentary to our solution 11

12 Flashback from GTC Computational complexity of neurons on GPU for different network sizes Amount of communication between neurons on GPU 12

13 No Need to Restrict Ourselves to Simple Models Design a fast learning system based on what we know about the hippocampus: High degree of recurrent projections (auto or heteroassociative NN) Hebbian-like learning Alteration between learning and recall modes High learning rates for learning mode Local inhibition in learning mode is removed during recall mode 13

14 Neurala s Solution for Fast Learning (Recognition) For recognition learning we had a solution for some time Take the existing recognition network (AlexNet trained on ImageNet) Surgically insert our hippocampus : fast learning associative NN The resulting architecture learns fast and can run even without GPUs 14

15 Neurala s Solution for Fast Learning (Detection) For detection we show our solution here for the first time Take the existing detection network (YOLO) Surgically insert an extended version of the hippocampus : need to detect location, not just class Needs GPU to run smoothly (dev code on TX1 ~5fps) Needs about 10-20s of training per new object Currently is distance sensitive Shown in booth 522 Add tracker for the learning process 15

16 Future Steps Integrate with Kirkpatrick et al (2017) solution for sleep consolidation Switch to segmentation from bounding boxes Add the ability to selectively forget bad data Add the ability to share new knowledge between agents directly 16

17 Ultimate Goal 17

18 Questions? Neurala Inc. 8 St. Mary s Street, Suite 613 Boston, MA info@neurala.com sales@neurala.com tel

OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS

OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,

More information

Blended E-learning in the Architectural Design Studio

Blended E-learning in the Architectural Design Studio Blended E-learning in the Architectural Design Studio An Experimental Model Mohammed F. M. Mohammed Associate Professor, Architecture Department, Cairo University, Cairo, Egypt (Associate Professor, Architecture

More information

Python Machine Learning

Python Machine Learning Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled

More information

Course Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE

Course Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE EE-589 Introduction to Neural Assistant Prof. Dr. Turgay IBRIKCI Room # 305 (322) 338 6868 / 139 Wensdays 9:00-12:00 Course Outline The course is divided in two parts: theory and practice. 1. Theory covers

More information

TRANSFER LEARNING OF WEAKLY LABELLED AUDIO. Aleksandr Diment, Tuomas Virtanen

TRANSFER LEARNING OF WEAKLY LABELLED AUDIO. Aleksandr Diment, Tuomas Virtanen TRANSFER LEARNING OF WEAKLY LABELLED AUDIO Aleksandr Diment, Tuomas Virtanen Tampere University of Technology Laboratory of Signal Processing Korkeakoulunkatu 1, 33720, Tampere, Finland firstname.lastname@tut.fi

More information

arxiv: v1 [cs.lg] 15 Jun 2015

arxiv: v1 [cs.lg] 15 Jun 2015 Dual Memory Architectures for Fast Deep Learning of Stream Data via an Online-Incremental-Transfer Strategy arxiv:1506.04477v1 [cs.lg] 15 Jun 2015 Sang-Woo Lee Min-Oh Heo School of Computer Science and

More information

File # for photo

File # for photo File #6883458 for photo -------- I got interested in Neuroscience and its applications to learning when I read Norman Doidge s book The Brain that Changes itself. I was reading the book on our family vacation

More information

Breaking the Habit of Being Yourself Workshop for Quantum University

Breaking the Habit of Being Yourself Workshop for Quantum University Breaking the Habit of Being Yourself Workshop for Quantum University 2 Copyright Dr Joe Dispenza. June 2013. All rights reserved. 3 Copyright Dr Joe Dispenza. June 2013. All rights reserved. 4 Copyright

More information

Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science

Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science Gilberto de Paiva Sao Paulo Brazil (May 2011) gilbertodpaiva@gmail.com Abstract. Despite the prevalence of the

More information

Computerized Adaptive Psychological Testing A Personalisation Perspective

Computerized Adaptive Psychological Testing A Personalisation Perspective Psychology and the internet: An European Perspective Computerized Adaptive Psychological Testing A Personalisation Perspective Mykola Pechenizkiy mpechen@cc.jyu.fi Introduction Mixed Model of IRT and ES

More information

Customised Software Tools for Quality Measurement Application of Open Source Software in Education

Customised Software Tools for Quality Measurement Application of Open Source Software in Education Customised Software Tools for Quality Measurement Application of Open Source Software in Education Stefan Waßmuth Martin Dambon, Gerhard Linß Technische Universität Ilmenau (Germany) Faculty of Mechanical

More information

Lecture 1: Machine Learning Basics

Lecture 1: Machine Learning Basics 1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

Laboratorio di Intelligenza Artificiale e Robotica

Laboratorio di Intelligenza Artificiale e Robotica Laboratorio di Intelligenza Artificiale e Robotica A.A. 2008-2009 Outline 2 Machine Learning Unsupervised Learning Supervised Learning Reinforcement Learning Genetic Algorithms Genetics-Based Machine Learning

More information

ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY DOWNLOAD EBOOK : ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY PDF

ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY DOWNLOAD EBOOK : ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY PDF Read Online and Download Ebook ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY DOWNLOAD EBOOK : ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY PDF Click link bellow and free register to download

More information

How People Learn Physics

How People Learn Physics How People Learn Physics Edward F. (Joe) Redish Dept. Of Physics University Of Maryland AAPM, Houston TX, Work supported in part by NSF grants DUE #04-4-0113 and #05-2-4987 Teaching complex subjects 2

More information

Accelerated Learning Course Outline

Accelerated Learning Course Outline Accelerated Learning Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies of Accelerated

More information

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering

More information

TotalLMS. Getting Started with SumTotal: Learner Mode

TotalLMS. Getting Started with SumTotal: Learner Mode TotalLMS Getting Started with SumTotal: Learner Mode Contents Learner Mode... 1 TotalLMS... 1 Introduction... 3 Objectives of this Guide... 3 TotalLMS Overview... 3 Logging on to SumTotal... 3 Exploring

More information

Accelerated Learning Online. Course Outline

Accelerated Learning Online. Course Outline Accelerated Learning Online Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies

More information

OCR for Arabic using SIFT Descriptors With Online Failure Prediction

OCR for Arabic using SIFT Descriptors With Online Failure Prediction OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,

More information

A GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING

A GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING A GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING Yong Sun, a * Colin Fidge b and Lin Ma a a CRC for Integrated Engineering Asset Management, School of Engineering Systems, Queensland

More information

Axiom 2013 Team Description Paper

Axiom 2013 Team Description Paper Axiom 2013 Team Description Paper Mohammad Ghazanfari, S Omid Shirkhorshidi, Farbod Samsamipour, Hossein Rahmatizadeh Zagheli, Mohammad Mahdavi, Payam Mohajeri, S Abbas Alamolhoda Robotics Scientific Association

More information

(Sub)Gradient Descent

(Sub)Gradient Descent (Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include

More information

Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models

Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Navdeep Jaitly 1, Vincent Vanhoucke 2, Geoffrey Hinton 1,2 1 University of Toronto 2 Google Inc. ndjaitly@cs.toronto.edu,

More information

ED 294 EDUCATIONAL PSYCHOLOGY

ED 294 EDUCATIONAL PSYCHOLOGY ED 294 EDUCATIONAL PSYCHOLOGY Readings and Website Information Required Text: Moreno, R. (2010). Educational Psychology. Hoboken, NJ: John Wiley & Sons Inc. Course Materials/Grades: Syllabus, Daily Outlines,

More information

A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation

A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation SLSP-2016 October 11-12 Natalia Tomashenko 1,2,3 natalia.tomashenko@univ-lemans.fr Yuri Khokhlov 3 khokhlov@speechpro.com Yannick

More information

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng Microsoft Research, One Microsoft Way, Redmond, WA 98052, U.S.A.

More information

INPE São José dos Campos

INPE São José dos Campos INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA

More information

HIERARCHICAL DEEP LEARNING ARCHITECTURE FOR 10K OBJECTS CLASSIFICATION

HIERARCHICAL DEEP LEARNING ARCHITECTURE FOR 10K OBJECTS CLASSIFICATION HIERARCHICAL DEEP LEARNING ARCHITECTURE FOR 10K OBJECTS CLASSIFICATION Atul Laxman Katole 1, Krishna Prasad Yellapragada 1, Amish Kumar Bedi 1, Sehaj Singh Kalra 1 and Mynepalli Siva Chaitanya 1 1 Samsung

More information

Human Emotion Recognition From Speech

Human Emotion Recognition From Speech RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati

More information

Smiley Face Feedback Form

Smiley Face Feedback Form Smiley Face Free PDF ebook Download: Smiley Face Download or Read Online ebook smiley face feedback form in PDF Format From The Best User Guide Database Monitoring the young persons and carers feedback

More information

Cognitive Self- Regulation

Cognitive Self- Regulation Cognitive Self- Regulation Cognitive Domain Set learning goals Plan and execute several steps Focus, and switch focus Monitor and assess performance Manage time effectively Use learning aids Understand

More information

Preprint.

Preprint. http://www.diva-portal.org Preprint This is the submitted version of a paper presented at Privacy in Statistical Databases'2006 (PSD'2006), Rome, Italy, 13-15 December, 2006. Citation for the original

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

Knowledge Transfer in Deep Convolutional Neural Nets

Knowledge Transfer in Deep Convolutional Neural Nets Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract

More information

A Neural Network GUI Tested on Text-To-Phoneme Mapping

A Neural Network GUI Tested on Text-To-Phoneme Mapping A Neural Network GUI Tested on Text-To-Phoneme Mapping MAARTEN TROMPPER Universiteit Utrecht m.f.a.trompper@students.uu.nl Abstract Text-to-phoneme (T2P) mapping is a necessary step in any speech synthesis

More information

Nothing is constant, except change - about the hard job of East German SMEs to move towards new markets

Nothing is constant, except change - about the hard job of East German SMEs to move towards new markets INNOCASE, 2013-1-TR1-LEO05-47533 Gerd Zimmer Nothing is constant, except change - about the hard job of East German SMEs to move towards new markets -Teaching Note- The information and views set out in

More information

New Paths to Learning with Chromebooks

New Paths to Learning with Chromebooks Thought Leadership Paper Samsung New Paths to Learning with Chromebooks Economical, cloud-connected computer alternatives open new opportunities for every student Research provided by As Computers Play

More information

Evolutive Neural Net Fuzzy Filtering: Basic Description

Evolutive Neural Net Fuzzy Filtering: Basic Description Journal of Intelligent Learning Systems and Applications, 2010, 2: 12-18 doi:10.4236/jilsa.2010.21002 Published Online February 2010 (http://www.scirp.org/journal/jilsa) Evolutive Neural Net Fuzzy Filtering:

More information

Artificial Neural Networks written examination

Artificial Neural Networks written examination 1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14

More information

No Parent Left Behind

No Parent Left Behind No Parent Left Behind Navigating the Special Education Universe SUSAN M. BREFACH, Ed.D. Page i Introduction How To Know If This Book Is For You Parents have become so convinced that educators know what

More information

Your School and You. Guide for Administrators

Your School and You. Guide for Administrators Your School and You Guide for Administrators Table of Content SCHOOLSPEAK CONCEPTS AND BUILDING BLOCKS... 1 SchoolSpeak Building Blocks... 3 ACCOUNT... 4 ADMIN... 5 MANAGING SCHOOLSPEAK ACCOUNT ADMINISTRATORS...

More information

Artificial Neural Networks

Artificial Neural Networks Artificial Neural Networks Andres Chavez Math 382/L T/Th 2:00-3:40 April 13, 2010 Chavez2 Abstract The main interest of this paper is Artificial Neural Networks (ANNs). A brief history of the development

More information

Lucy Calkins Units of Study 3-5 Heinemann Books Support Document. Designed to support the implementation of the Lucy Calkins Curriculum

Lucy Calkins Units of Study 3-5 Heinemann Books Support Document. Designed to support the implementation of the Lucy Calkins Curriculum Lucy Calkins Units of Study 3-5 Heinemann Books 2006 Support Document Designed to support the implementation of the Lucy Calkins Curriculum Lesson Plans Written by Browand, Gallagher, Shipman and Shultz-Bartlett

More information

Competent Mortgage Adviser Certificate (CMAcert ) Study Guide

Competent Mortgage Adviser Certificate (CMAcert ) Study Guide Competent Mortgage Adviser Certificate (CMAcert ) Study Guide WELCOME Thank you for choosing Simply Academy to support you with your studies. Our mission is to help you achieve your educational goals by

More information

M55205-Mastering Microsoft Project 2016

M55205-Mastering Microsoft Project 2016 M55205-Mastering Microsoft Project 2016 Course Number: M55205 Category: Desktop Applications Duration: 3 days Certification: Exam 70-343 Overview This three-day, instructor-led course is intended for individuals

More information

Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski

Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Problem Statement and Background Given a collection of 8th grade science questions, possible answer

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

Australian Journal of Basic and Applied Sciences

Australian Journal of Basic and Applied Sciences AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean

More information

FUZZY EXPERT. Dr. Kasim M. Al-Aubidy. Philadelphia University. Computer Eng. Dept February 2002 University of Damascus-Syria

FUZZY EXPERT. Dr. Kasim M. Al-Aubidy. Philadelphia University. Computer Eng. Dept February 2002 University of Damascus-Syria FUZZY EXPERT SYSTEMS 16-18 18 February 2002 University of Damascus-Syria Dr. Kasim M. Al-Aubidy Computer Eng. Dept. Philadelphia University What is Expert Systems? ES are computer programs that emulate

More information

PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES

PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES Po-Sen Huang, Kshitiz Kumar, Chaojun Liu, Yifan Gong, Li Deng Department of Electrical and Computer Engineering,

More information

MULTIMEDIA Motion Graphics for Multimedia

MULTIMEDIA Motion Graphics for Multimedia MULTIMEDIA 210 - Motion Graphics for Multimedia INTRODUCTION Welcome to Digital Editing! The main purpose of this course is to introduce you to the basic principles of motion graphics editing for multimedia

More information

Emergent Narrative As A Novel Framework For Massively Collaborative Authoring

Emergent Narrative As A Novel Framework For Massively Collaborative Authoring Emergent Narrative As A Novel Framework For Massively Collaborative Authoring Michael Kriegel and Ruth Aylett School of Mathematical and Computer Sciences, Heriot Watt University, Edinburgh, EH14 4AS,

More information

Deep Neural Network Language Models

Deep Neural Network Language Models Deep Neural Network Language Models Ebru Arısoy, Tara N. Sainath, Brian Kingsbury, Bhuvana Ramabhadran IBM T.J. Watson Research Center Yorktown Heights, NY, 10598, USA {earisoy, tsainath, bedk, bhuvana}@us.ibm.com

More information

Critical Thinking in the Workplace. for City of Tallahassee Gabrielle K. Gabrielli, Ph.D.

Critical Thinking in the Workplace. for City of Tallahassee Gabrielle K. Gabrielli, Ph.D. Critical Thinking in the Workplace for City of Tallahassee Gabrielle K. Gabrielli, Ph.D. Purpose The purpose of this training is to provide: Tools and information to help you become better critical thinkers

More information

Spinal Cord. Student Pages. Classroom Ac tivities

Spinal Cord. Student Pages. Classroom Ac tivities Classroom Ac tivities Spinal Cord Student Pages Produced by Regenerative Medicine Partnership in Education Duquesne University Director john A. Pollock (pollock@duq.edu) The spinal column protects the

More information

MyUni - Turnitin Assignments

MyUni - Turnitin Assignments - Turnitin Assignments Originality, Grading & Rubrics Turnitin Assignments... 2 Create Turnitin assignment... 2 View Originality Report and grade a Turnitin Assignment... 4 Originality Report... 6 GradeMark...

More information

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents

More information

Beyond Classroom Solutions: New Design Perspectives for Online Learning Excellence

Beyond Classroom Solutions: New Design Perspectives for Online Learning Excellence Educational Technology & Society 5(2) 2002 ISSN 1436-4522 Beyond Classroom Solutions: New Design Perspectives for Online Learning Excellence Moderator & Sumamrizer: Maggie Martinez CEO, The Training Place,

More information

INDIVIDUALIZED STUDY, BIS

INDIVIDUALIZED STUDY, BIS Individualized Study, BIS INDIVIDUALIZED STUDY, BIS Banner Code: LA-BIS-INDV A25 Robinson Hall Fairfax Campus Website: bis.gmu.edu/programs/la-bis-indv The Bachelor of Individualized Study (BIS) Program

More information

Semantic Segmentation with Histological Image Data: Cancer Cell vs. Stroma

Semantic Segmentation with Histological Image Data: Cancer Cell vs. Stroma Semantic Segmentation with Histological Image Data: Cancer Cell vs. Stroma Adam Abdulhamid Stanford University 450 Serra Mall, Stanford, CA 94305 adama94@cs.stanford.edu Abstract With the introduction

More information

Speech Emotion Recognition Using Support Vector Machine

Speech Emotion Recognition Using Support Vector Machine Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,

More information

SARDNET: A Self-Organizing Feature Map for Sequences

SARDNET: A Self-Organizing Feature Map for Sequences SARDNET: A Self-Organizing Feature Map for Sequences Daniel L. James and Risto Miikkulainen Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 dljames,risto~cs.utexas.edu

More information

Steve Miller UNC Wilmington w/assistance from Outlines by Eileen Goldgeier and Jen Palencia Shipp April 20, 2010

Steve Miller UNC Wilmington w/assistance from Outlines by Eileen Goldgeier and Jen Palencia Shipp April 20, 2010 Steve Miller UNC Wilmington w/assistance from Outlines by Eileen Goldgeier and Jen Palencia Shipp April 20, 2010 Find this ppt, Info and Forms at: http://uncw.edu/generalcounsel/ltferpa.htm Family Educational

More information

Citrine Informatics. The Latest from Citrine. Citrine Informatics. The data analytics platform for the physical world

Citrine Informatics. The Latest from Citrine. Citrine Informatics. The data analytics platform for the physical world Citrine Informatics The data analytics platform for the physical world The Latest from Citrine Summit on Data and Analytics for Materials Research 31 October 2016 Our Mission is Simple Add as much value

More information

STUDENT MOODLE ORIENTATION

STUDENT MOODLE ORIENTATION BAKER UNIVERSITY SCHOOL OF PROFESSIONAL AND GRADUATE STUDIES STUDENT MOODLE ORIENTATION TABLE OF CONTENTS Introduction to Moodle... 2 Online Aptitude Assessment... 2 Moodle Icons... 6 Logging In... 8 Page

More information

Alyson D. Stover, MOT, JD, OTR/L, BCP

Alyson D. Stover, MOT, JD, OTR/L, BCP Alyson D. Stover, MOT, JD, OTR/L, BCP Curriculum Vitae BIOGRAPHICAL INFORMATION Business Address: Department of Occupational Therapy School of Health & Rehabilitation Sciences University of Pittsburgh

More information

Deep search. Enhancing a search bar using machine learning. Ilgün Ilgün & Cedric Reichenbach

Deep search. Enhancing a search bar using machine learning. Ilgün Ilgün & Cedric Reichenbach #BaselOne7 Deep search Enhancing a search bar using machine learning Ilgün Ilgün & Cedric Reichenbach We are not researchers Outline I. Periscope: A search tool II. Goals III. Deep learning IV. Applying

More information

Top US Tech Talent for the Top China Tech Company

Top US Tech Talent for the Top China Tech Company THE FALL 2017 US RECRUITING TOUR Top US Tech Talent for the Top China Tech Company INTERVIEWS IN 7 CITIES Tour Schedule CITY Boston, MA New York, NY Pittsburgh, PA Urbana-Champaign, IL Ann Arbor, MI Los

More information

Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures

Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures Alex Graves and Jürgen Schmidhuber IDSIA, Galleria 2, 6928 Manno-Lugano, Switzerland TU Munich, Boltzmannstr.

More information

The University of Amsterdam s Concept Detection System at ImageCLEF 2011

The University of Amsterdam s Concept Detection System at ImageCLEF 2011 The University of Amsterdam s Concept Detection System at ImageCLEF 2011 Koen E. A. van de Sande and Cees G. M. Snoek Intelligent Systems Lab Amsterdam, University of Amsterdam Software available from:

More information

A Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation

A Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation A Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation Chunpeng Wu 1, Wei Wen 1, Tariq Afzal 2, Yongmei Zhang 2, Yiran Chen 3, and Hai (Helen) Li 3 1 Electrical and

More information

DYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING

DYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING University of Craiova, Romania Université de Technologie de Compiègne, France Ph.D. Thesis - Abstract - DYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING Elvira POPESCU Advisors: Prof. Vladimir RĂSVAN

More information

Ericsson Wallet Platform (EWP) 3.0 Training Programs. Catalog of Course Descriptions

Ericsson Wallet Platform (EWP) 3.0 Training Programs. Catalog of Course Descriptions Ericsson Wallet Platform (EWP) 3.0 Training Programs Catalog of Course Descriptions Catalog of Course Descriptions INTRODUCTION... 3 ERICSSON CONVERGED WALLET (ECW) 3.0 RATING MANAGEMENT... 4 ERICSSON

More information

The Good Judgment Project: A large scale test of different methods of combining expert predictions

The Good Judgment Project: A large scale test of different methods of combining expert predictions The Good Judgment Project: A large scale test of different methods of combining expert predictions Lyle Ungar, Barb Mellors, Jon Baron, Phil Tetlock, Jaime Ramos, Sam Swift The University of Pennsylvania

More information

SELF-STUDY QUESTIONNAIRE FOR REVIEW of the COMPUTER SCIENCE PROGRAM

SELF-STUDY QUESTIONNAIRE FOR REVIEW of the COMPUTER SCIENCE PROGRAM Disclaimer: This Self Study was developed to meet the goals of the CAC Session at the 2006 Summit. It should not be considered as a model or a template. ABET Computing Accreditation Commission SELF-STUDY

More information

Council of Educational Facilities Planners, International

Council of Educational Facilities Planners, International Council of Educational Facilities Planners, International Case Study: Design of Hudson Bend Middle School, Lake Travis ISD How to Transform Cells and Bells into 21 st Century Learning CEFPI is a Registered

More information

Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach.

Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach. Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach. Nikolaos Avouris, Meletis Margaritis, Vassilis Komis University of Patras, Patras, Greece { N.Avouris,

More information

Monitoring Metacognitive abilities in children: A comparison of children between the ages of 5 to 7 years and 8 to 11 years

Monitoring Metacognitive abilities in children: A comparison of children between the ages of 5 to 7 years and 8 to 11 years Monitoring Metacognitive abilities in children: A comparison of children between the ages of 5 to 7 years and 8 to 11 years Abstract Takang K. Tabe Department of Educational Psychology, University of Buea

More information

UTILITY POLE ATTACHMENTS Understanding New FCC Regulations and Industry Trends

UTILITY POLE ATTACHMENTS Understanding New FCC Regulations and Industry Trends COURSE UTILITY POLE ATTACHMENTS Understanding New FCC Regulations and Industry Trends May 1-2, 2017 Atlanta Marriott Suites Midtown Atlanta, GA EUCI is authorized by IACET to offer 1.0 CEUs for this course

More information

Ecosystem: Description of the modules:

Ecosystem: Description of the modules: Nanotechnology Solutions to Engineering Grand Challenges Edward W. Davis Auburn University Polapradada Raju Auburn University Virginia Davis Auburn University Abstract: Nanotechnology is becoming, and

More information

Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining

Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl

More information

Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining

Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl

More information

XXII BrainStorming Day

XXII BrainStorming Day UNIVERSITA DEGLI STUDI DI CATANIA FACOLTA DI INGEGNERIA PhD course in Electronics, Automation and Control of Complex Systems - XXV Cycle DIPARTIMENTO DI INGEGNERIA ELETTRICA ELETTRONICA E INFORMATICA XXII

More information

From Self Hosted to SaaS Our Journey (LEC107648)

From Self Hosted to SaaS Our Journey (LEC107648) From Self Hosted to SaaS Our Journey (LEC107648) Kathy Saville Director of Instructional Technology Saint Mary s College, Notre Dame Saint Mary s College, Notre Dame, Indiana Founded 1844 Premier Women

More information

Storytelling Made Simple

Storytelling Made Simple Storytelling Made Simple Storybird is a Web tool that allows adults and children to create stories online (independently or collaboratively) then share them with the world or select individuals. Teacher

More information

Using EEG to Improve Massive Open Online Courses Feedback Interaction

Using EEG to Improve Massive Open Online Courses Feedback Interaction Using EEG to Improve Massive Open Online Courses Feedback Interaction Haohan Wang, Yiwei Li, Xiaobo Hu, Yucong Yang, Zhu Meng, Kai-min Chang Language Technologies Institute School of Computer Science Carnegie

More information

Outreach Connect User Manual

Outreach Connect User Manual Outreach Connect A Product of CAA Software, Inc. Outreach Connect User Manual Church Growth Strategies Through Sunday School, Care Groups, & Outreach Involving Members, Guests, & Prospects PREPARED FOR:

More information

Master s Programme in Computer, Communication and Information Sciences, Study guide , ELEC Majors

Master s Programme in Computer, Communication and Information Sciences, Study guide , ELEC Majors Master s Programme in Computer, Communication and Information Sciences, Study guide 2015-2016, ELEC Majors Sisällysluettelo PS=pääsivu, AS=alasivu PS: 1 Acoustics and Audio Technology... 4 Objectives...

More information

The Foundations of Interpersonal Communication

The Foundations of Interpersonal Communication L I B R A R Y A R T I C L E The Foundations of Interpersonal Communication By Dennis Emberling, President of Developmental Consulting, Inc. Introduction Mark Twain famously said, Everybody talks about

More information

arxiv: v1 [cs.lg] 7 Apr 2015

arxiv: v1 [cs.lg] 7 Apr 2015 Transferring Knowledge from a RNN to a DNN William Chan 1, Nan Rosemary Ke 1, Ian Lane 1,2 Carnegie Mellon University 1 Electrical and Computer Engineering, 2 Language Technologies Institute Equal contribution

More information

arxiv: v1 [cs.cl] 27 Apr 2016

arxiv: v1 [cs.cl] 27 Apr 2016 The IBM 2016 English Conversational Telephone Speech Recognition System George Saon, Tom Sercu, Steven Rennie and Hong-Kwang J. Kuo IBM T. J. Watson Research Center, Yorktown Heights, NY, 10598 gsaon@us.ibm.com

More information

Generative models and adversarial training

Generative models and adversarial training Day 4 Lecture 1 Generative models and adversarial training Kevin McGuinness kevin.mcguinness@dcu.ie Research Fellow Insight Centre for Data Analytics Dublin City University What is a generative model?

More information

PRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN PROGRAM AT THE UNIVERSITY OF TWENTE

PRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN PROGRAM AT THE UNIVERSITY OF TWENTE INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 6 & 7 SEPTEMBER 2012, ARTESIS UNIVERSITY COLLEGE, ANTWERP, BELGIUM PRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN

More information

Introduction to Mobile Learning Systems and Usability Factors

Introduction to Mobile Learning Systems and Usability Factors Introduction to Mobile Learning Systems and Usability Factors K.B.Lee Computer Science University of Northern Virginia Annandale, VA Kwang.lee@unva.edu Abstract - Number of people using mobile phones has

More information

Learning From the Past with Experiment Databases

Learning From the Past with Experiment Databases Learning From the Past with Experiment Databases Joaquin Vanschoren 1, Bernhard Pfahringer 2, and Geoff Holmes 2 1 Computer Science Dept., K.U.Leuven, Leuven, Belgium 2 Computer Science Dept., University

More information

PREP S SPEAKER LISTENER TECHNIQUE COACHING MANUAL

PREP S SPEAKER LISTENER TECHNIQUE COACHING MANUAL 1 PREP S SPEAKER LISTENER TECHNIQUE COACHING MANUAL IMPORTANCE OF THE SPEAKER LISTENER TECHNIQUE The Speaker Listener Technique (SLT) is a structured communication strategy that promotes clarity, understanding,

More information

Taxonomy of the cognitive domain: An example of architectural education program

Taxonomy of the cognitive domain: An example of architectural education program Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 174 ( 2015 ) 3272 3277 INTE 2014 Taxonomy of the cognitive domain: An example of architectural education

More information

WHY GO TO GRADUATE SCHOOL?

WHY GO TO GRADUATE SCHOOL? WHY GO TO GRADUATE SCHOOL? 1 GRADUATE EDUCATION: WHAT ARE THE QUESTIONS? Why go to graduate school? What degree? Masters of Doctorate? Where should you go? And how to choose? When is the right time for

More information