Forget catastrophic forgetting: AI that learns after deployment
|
|
- Madlyn Martin
- 6 years ago
- Views:
Transcription
1 Forget catastrophic forgetting: AI that learns after deployment Anatoly Gorshechnikov CTO, Neurala 1
2 Neurala at a glance Programming neural networks on GPUs since circa 2 B.C. Founded in 2006 expecting that there will be a programmable GPU in every cell phone Concentrating on the edgebased cloud indifferent AI Actively growing Experience in building and commercializing AI 2
3 Built with Brains For Bots SDK Example: inspections with drones Use case: inspection of telecommunication towers, solar panels, roofs, power lines Problem: what if tomorrow we need to add new data to the set? 3
4 Theory of Catastrophic Forgetting at a glance Distributed representation: very many neurons are involved in correct classification of every object Very many weights are important for each classification Learning of new objects perturbs all weights, hence forgetting 4
5 Brute Force Solution Combine the old and the new datasets and retrain the network General issues: Requires powerful server + Takes a lot of time 5
6 Many More Practical Client-Specific Issues Clients don t like to share their data Clients definitely do not want us to keep their data after training is done How can we combine old and new data sets in these conditions? Client wants their toy to recognize their other toys: easy factory pretraining Client also wants their toy to recognize its owner: need to train after deployment Privacy laws do not allow uploading of kid s images to the cloud 6
7 How can we Add new data to existing DNN knowledge without forgetting the old data? Do this without powerful servers and cloud access? Do this within seconds rather than hours? 7
8 Ignorance Is Bliss We age, advance in our career paths, and quit reviewing papers New generation does not pay attention to papers from 20 years ago A lot of ways to alleviate catastrophic forgetting we discussed in mid-90es 8
9 How Psych Took Insight from Computer Science Brain has multiple neural networks with different properties and functions Need an interacting system of short and long term memory 9
10 Deeper in Neurobiology Hasselmo (1999) Neuromodulation: Acetylcholine and memory consolidastion Brain switches between learning and recall modes by regulating ACh levels High levels of ACh suppress feedback and enhance feedforward processing Low levels do the opposite 10
11 One of Most Recent Solutions Kirkpatrick et al (2017) Overcoming catastrophic forgetting in neural networks Protects individual network parameters such as synaptic weights by evaluating their importance for prior learning Supported by neurophysiology (see Hasselmo, 2017 for references) Can be complimentary to our solution 11
12 Flashback from GTC Computational complexity of neurons on GPU for different network sizes Amount of communication between neurons on GPU 12
13 No Need to Restrict Ourselves to Simple Models Design a fast learning system based on what we know about the hippocampus: High degree of recurrent projections (auto or heteroassociative NN) Hebbian-like learning Alteration between learning and recall modes High learning rates for learning mode Local inhibition in learning mode is removed during recall mode 13
14 Neurala s Solution for Fast Learning (Recognition) For recognition learning we had a solution for some time Take the existing recognition network (AlexNet trained on ImageNet) Surgically insert our hippocampus : fast learning associative NN The resulting architecture learns fast and can run even without GPUs 14
15 Neurala s Solution for Fast Learning (Detection) For detection we show our solution here for the first time Take the existing detection network (YOLO) Surgically insert an extended version of the hippocampus : need to detect location, not just class Needs GPU to run smoothly (dev code on TX1 ~5fps) Needs about 10-20s of training per new object Currently is distance sensitive Shown in booth 522 Add tracker for the learning process 15
16 Future Steps Integrate with Kirkpatrick et al (2017) solution for sleep consolidation Switch to segmentation from bounding boxes Add the ability to selectively forget bad data Add the ability to share new knowledge between agents directly 16
17 Ultimate Goal 17
18 Questions? Neurala Inc. 8 St. Mary s Street, Suite 613 Boston, MA info@neurala.com sales@neurala.com tel
OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS
OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,
More informationBlended E-learning in the Architectural Design Studio
Blended E-learning in the Architectural Design Studio An Experimental Model Mohammed F. M. Mohammed Associate Professor, Architecture Department, Cairo University, Cairo, Egypt (Associate Professor, Architecture
More informationPython Machine Learning
Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled
More informationCourse Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE
EE-589 Introduction to Neural Assistant Prof. Dr. Turgay IBRIKCI Room # 305 (322) 338 6868 / 139 Wensdays 9:00-12:00 Course Outline The course is divided in two parts: theory and practice. 1. Theory covers
More informationTRANSFER LEARNING OF WEAKLY LABELLED AUDIO. Aleksandr Diment, Tuomas Virtanen
TRANSFER LEARNING OF WEAKLY LABELLED AUDIO Aleksandr Diment, Tuomas Virtanen Tampere University of Technology Laboratory of Signal Processing Korkeakoulunkatu 1, 33720, Tampere, Finland firstname.lastname@tut.fi
More informationarxiv: v1 [cs.lg] 15 Jun 2015
Dual Memory Architectures for Fast Deep Learning of Stream Data via an Online-Incremental-Transfer Strategy arxiv:1506.04477v1 [cs.lg] 15 Jun 2015 Sang-Woo Lee Min-Oh Heo School of Computer Science and
More informationFile # for photo
File #6883458 for photo -------- I got interested in Neuroscience and its applications to learning when I read Norman Doidge s book The Brain that Changes itself. I was reading the book on our family vacation
More informationBreaking the Habit of Being Yourself Workshop for Quantum University
Breaking the Habit of Being Yourself Workshop for Quantum University 2 Copyright Dr Joe Dispenza. June 2013. All rights reserved. 3 Copyright Dr Joe Dispenza. June 2013. All rights reserved. 4 Copyright
More informationProposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science
Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science Gilberto de Paiva Sao Paulo Brazil (May 2011) gilbertodpaiva@gmail.com Abstract. Despite the prevalence of the
More informationComputerized Adaptive Psychological Testing A Personalisation Perspective
Psychology and the internet: An European Perspective Computerized Adaptive Psychological Testing A Personalisation Perspective Mykola Pechenizkiy mpechen@cc.jyu.fi Introduction Mixed Model of IRT and ES
More informationCustomised Software Tools for Quality Measurement Application of Open Source Software in Education
Customised Software Tools for Quality Measurement Application of Open Source Software in Education Stefan Waßmuth Martin Dambon, Gerhard Linß Technische Universität Ilmenau (Germany) Faculty of Mechanical
More informationLecture 1: Machine Learning Basics
1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationLaboratorio di Intelligenza Artificiale e Robotica
Laboratorio di Intelligenza Artificiale e Robotica A.A. 2008-2009 Outline 2 Machine Learning Unsupervised Learning Supervised Learning Reinforcement Learning Genetic Algorithms Genetics-Based Machine Learning
More informationADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY DOWNLOAD EBOOK : ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY PDF
Read Online and Download Ebook ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY DOWNLOAD EBOOK : ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY PDF Click link bellow and free register to download
More informationHow People Learn Physics
How People Learn Physics Edward F. (Joe) Redish Dept. Of Physics University Of Maryland AAPM, Houston TX, Work supported in part by NSF grants DUE #04-4-0113 and #05-2-4987 Teaching complex subjects 2
More informationAccelerated Learning Course Outline
Accelerated Learning Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies of Accelerated
More informationSystem Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks
System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering
More informationTotalLMS. Getting Started with SumTotal: Learner Mode
TotalLMS Getting Started with SumTotal: Learner Mode Contents Learner Mode... 1 TotalLMS... 1 Introduction... 3 Objectives of this Guide... 3 TotalLMS Overview... 3 Logging on to SumTotal... 3 Exploring
More informationAccelerated Learning Online. Course Outline
Accelerated Learning Online Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies
More informationOCR for Arabic using SIFT Descriptors With Online Failure Prediction
OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,
More informationA GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING
A GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING Yong Sun, a * Colin Fidge b and Lin Ma a a CRC for Integrated Engineering Asset Management, School of Engineering Systems, Queensland
More informationAxiom 2013 Team Description Paper
Axiom 2013 Team Description Paper Mohammad Ghazanfari, S Omid Shirkhorshidi, Farbod Samsamipour, Hossein Rahmatizadeh Zagheli, Mohammad Mahdavi, Payam Mohajeri, S Abbas Alamolhoda Robotics Scientific Association
More information(Sub)Gradient Descent
(Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include
More informationAutoregressive product of multi-frame predictions can improve the accuracy of hybrid models
Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Navdeep Jaitly 1, Vincent Vanhoucke 2, Geoffrey Hinton 1,2 1 University of Toronto 2 Google Inc. ndjaitly@cs.toronto.edu,
More informationED 294 EDUCATIONAL PSYCHOLOGY
ED 294 EDUCATIONAL PSYCHOLOGY Readings and Website Information Required Text: Moreno, R. (2010). Educational Psychology. Hoboken, NJ: John Wiley & Sons Inc. Course Materials/Grades: Syllabus, Daily Outlines,
More informationA New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation
A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation SLSP-2016 October 11-12 Natalia Tomashenko 1,2,3 natalia.tomashenko@univ-lemans.fr Yuri Khokhlov 3 khokhlov@speechpro.com Yannick
More informationUnsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng Microsoft Research, One Microsoft Way, Redmond, WA 98052, U.S.A.
More informationINPE São José dos Campos
INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA
More informationHIERARCHICAL DEEP LEARNING ARCHITECTURE FOR 10K OBJECTS CLASSIFICATION
HIERARCHICAL DEEP LEARNING ARCHITECTURE FOR 10K OBJECTS CLASSIFICATION Atul Laxman Katole 1, Krishna Prasad Yellapragada 1, Amish Kumar Bedi 1, Sehaj Singh Kalra 1 and Mynepalli Siva Chaitanya 1 1 Samsung
More informationHuman Emotion Recognition From Speech
RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati
More informationSmiley Face Feedback Form
Smiley Face Free PDF ebook Download: Smiley Face Download or Read Online ebook smiley face feedback form in PDF Format From The Best User Guide Database Monitoring the young persons and carers feedback
More informationCognitive Self- Regulation
Cognitive Self- Regulation Cognitive Domain Set learning goals Plan and execute several steps Focus, and switch focus Monitor and assess performance Manage time effectively Use learning aids Understand
More informationPreprint.
http://www.diva-portal.org Preprint This is the submitted version of a paper presented at Privacy in Statistical Databases'2006 (PSD'2006), Rome, Italy, 13-15 December, 2006. Citation for the original
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More informationKnowledge Transfer in Deep Convolutional Neural Nets
Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract
More informationA Neural Network GUI Tested on Text-To-Phoneme Mapping
A Neural Network GUI Tested on Text-To-Phoneme Mapping MAARTEN TROMPPER Universiteit Utrecht m.f.a.trompper@students.uu.nl Abstract Text-to-phoneme (T2P) mapping is a necessary step in any speech synthesis
More informationNothing is constant, except change - about the hard job of East German SMEs to move towards new markets
INNOCASE, 2013-1-TR1-LEO05-47533 Gerd Zimmer Nothing is constant, except change - about the hard job of East German SMEs to move towards new markets -Teaching Note- The information and views set out in
More informationNew Paths to Learning with Chromebooks
Thought Leadership Paper Samsung New Paths to Learning with Chromebooks Economical, cloud-connected computer alternatives open new opportunities for every student Research provided by As Computers Play
More informationEvolutive Neural Net Fuzzy Filtering: Basic Description
Journal of Intelligent Learning Systems and Applications, 2010, 2: 12-18 doi:10.4236/jilsa.2010.21002 Published Online February 2010 (http://www.scirp.org/journal/jilsa) Evolutive Neural Net Fuzzy Filtering:
More informationArtificial Neural Networks written examination
1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14
More informationNo Parent Left Behind
No Parent Left Behind Navigating the Special Education Universe SUSAN M. BREFACH, Ed.D. Page i Introduction How To Know If This Book Is For You Parents have become so convinced that educators know what
More informationYour School and You. Guide for Administrators
Your School and You Guide for Administrators Table of Content SCHOOLSPEAK CONCEPTS AND BUILDING BLOCKS... 1 SchoolSpeak Building Blocks... 3 ACCOUNT... 4 ADMIN... 5 MANAGING SCHOOLSPEAK ACCOUNT ADMINISTRATORS...
More informationArtificial Neural Networks
Artificial Neural Networks Andres Chavez Math 382/L T/Th 2:00-3:40 April 13, 2010 Chavez2 Abstract The main interest of this paper is Artificial Neural Networks (ANNs). A brief history of the development
More informationLucy Calkins Units of Study 3-5 Heinemann Books Support Document. Designed to support the implementation of the Lucy Calkins Curriculum
Lucy Calkins Units of Study 3-5 Heinemann Books 2006 Support Document Designed to support the implementation of the Lucy Calkins Curriculum Lesson Plans Written by Browand, Gallagher, Shipman and Shultz-Bartlett
More informationCompetent Mortgage Adviser Certificate (CMAcert ) Study Guide
Competent Mortgage Adviser Certificate (CMAcert ) Study Guide WELCOME Thank you for choosing Simply Academy to support you with your studies. Our mission is to help you achieve your educational goals by
More informationM55205-Mastering Microsoft Project 2016
M55205-Mastering Microsoft Project 2016 Course Number: M55205 Category: Desktop Applications Duration: 3 days Certification: Exam 70-343 Overview This three-day, instructor-led course is intended for individuals
More informationTraining a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski
Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Problem Statement and Background Given a collection of 8th grade science questions, possible answer
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationAustralian Journal of Basic and Applied Sciences
AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean
More informationFUZZY EXPERT. Dr. Kasim M. Al-Aubidy. Philadelphia University. Computer Eng. Dept February 2002 University of Damascus-Syria
FUZZY EXPERT SYSTEMS 16-18 18 February 2002 University of Damascus-Syria Dr. Kasim M. Al-Aubidy Computer Eng. Dept. Philadelphia University What is Expert Systems? ES are computer programs that emulate
More informationPREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES
PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES Po-Sen Huang, Kshitiz Kumar, Chaojun Liu, Yifan Gong, Li Deng Department of Electrical and Computer Engineering,
More informationMULTIMEDIA Motion Graphics for Multimedia
MULTIMEDIA 210 - Motion Graphics for Multimedia INTRODUCTION Welcome to Digital Editing! The main purpose of this course is to introduce you to the basic principles of motion graphics editing for multimedia
More informationEmergent Narrative As A Novel Framework For Massively Collaborative Authoring
Emergent Narrative As A Novel Framework For Massively Collaborative Authoring Michael Kriegel and Ruth Aylett School of Mathematical and Computer Sciences, Heriot Watt University, Edinburgh, EH14 4AS,
More informationDeep Neural Network Language Models
Deep Neural Network Language Models Ebru Arısoy, Tara N. Sainath, Brian Kingsbury, Bhuvana Ramabhadran IBM T.J. Watson Research Center Yorktown Heights, NY, 10598, USA {earisoy, tsainath, bedk, bhuvana}@us.ibm.com
More informationCritical Thinking in the Workplace. for City of Tallahassee Gabrielle K. Gabrielli, Ph.D.
Critical Thinking in the Workplace for City of Tallahassee Gabrielle K. Gabrielli, Ph.D. Purpose The purpose of this training is to provide: Tools and information to help you become better critical thinkers
More informationSpinal Cord. Student Pages. Classroom Ac tivities
Classroom Ac tivities Spinal Cord Student Pages Produced by Regenerative Medicine Partnership in Education Duquesne University Director john A. Pollock (pollock@duq.edu) The spinal column protects the
More informationMyUni - Turnitin Assignments
- Turnitin Assignments Originality, Grading & Rubrics Turnitin Assignments... 2 Create Turnitin assignment... 2 View Originality Report and grade a Turnitin Assignment... 4 Originality Report... 6 GradeMark...
More informationQuickStroke: An Incremental On-line Chinese Handwriting Recognition System
QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents
More informationBeyond Classroom Solutions: New Design Perspectives for Online Learning Excellence
Educational Technology & Society 5(2) 2002 ISSN 1436-4522 Beyond Classroom Solutions: New Design Perspectives for Online Learning Excellence Moderator & Sumamrizer: Maggie Martinez CEO, The Training Place,
More informationINDIVIDUALIZED STUDY, BIS
Individualized Study, BIS INDIVIDUALIZED STUDY, BIS Banner Code: LA-BIS-INDV A25 Robinson Hall Fairfax Campus Website: bis.gmu.edu/programs/la-bis-indv The Bachelor of Individualized Study (BIS) Program
More informationSemantic Segmentation with Histological Image Data: Cancer Cell vs. Stroma
Semantic Segmentation with Histological Image Data: Cancer Cell vs. Stroma Adam Abdulhamid Stanford University 450 Serra Mall, Stanford, CA 94305 adama94@cs.stanford.edu Abstract With the introduction
More informationSpeech Emotion Recognition Using Support Vector Machine
Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,
More informationSARDNET: A Self-Organizing Feature Map for Sequences
SARDNET: A Self-Organizing Feature Map for Sequences Daniel L. James and Risto Miikkulainen Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 dljames,risto~cs.utexas.edu
More informationSteve Miller UNC Wilmington w/assistance from Outlines by Eileen Goldgeier and Jen Palencia Shipp April 20, 2010
Steve Miller UNC Wilmington w/assistance from Outlines by Eileen Goldgeier and Jen Palencia Shipp April 20, 2010 Find this ppt, Info and Forms at: http://uncw.edu/generalcounsel/ltferpa.htm Family Educational
More informationCitrine Informatics. The Latest from Citrine. Citrine Informatics. The data analytics platform for the physical world
Citrine Informatics The data analytics platform for the physical world The Latest from Citrine Summit on Data and Analytics for Materials Research 31 October 2016 Our Mission is Simple Add as much value
More informationSTUDENT MOODLE ORIENTATION
BAKER UNIVERSITY SCHOOL OF PROFESSIONAL AND GRADUATE STUDIES STUDENT MOODLE ORIENTATION TABLE OF CONTENTS Introduction to Moodle... 2 Online Aptitude Assessment... 2 Moodle Icons... 6 Logging In... 8 Page
More informationAlyson D. Stover, MOT, JD, OTR/L, BCP
Alyson D. Stover, MOT, JD, OTR/L, BCP Curriculum Vitae BIOGRAPHICAL INFORMATION Business Address: Department of Occupational Therapy School of Health & Rehabilitation Sciences University of Pittsburgh
More informationDeep search. Enhancing a search bar using machine learning. Ilgün Ilgün & Cedric Reichenbach
#BaselOne7 Deep search Enhancing a search bar using machine learning Ilgün Ilgün & Cedric Reichenbach We are not researchers Outline I. Periscope: A search tool II. Goals III. Deep learning IV. Applying
More informationTop US Tech Talent for the Top China Tech Company
THE FALL 2017 US RECRUITING TOUR Top US Tech Talent for the Top China Tech Company INTERVIEWS IN 7 CITIES Tour Schedule CITY Boston, MA New York, NY Pittsburgh, PA Urbana-Champaign, IL Ann Arbor, MI Los
More informationFramewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures
Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures Alex Graves and Jürgen Schmidhuber IDSIA, Galleria 2, 6928 Manno-Lugano, Switzerland TU Munich, Boltzmannstr.
More informationThe University of Amsterdam s Concept Detection System at ImageCLEF 2011
The University of Amsterdam s Concept Detection System at ImageCLEF 2011 Koen E. A. van de Sande and Cees G. M. Snoek Intelligent Systems Lab Amsterdam, University of Amsterdam Software available from:
More informationA Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation
A Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation Chunpeng Wu 1, Wei Wen 1, Tariq Afzal 2, Yongmei Zhang 2, Yiran Chen 3, and Hai (Helen) Li 3 1 Electrical and
More informationDYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING
University of Craiova, Romania Université de Technologie de Compiègne, France Ph.D. Thesis - Abstract - DYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING Elvira POPESCU Advisors: Prof. Vladimir RĂSVAN
More informationEricsson Wallet Platform (EWP) 3.0 Training Programs. Catalog of Course Descriptions
Ericsson Wallet Platform (EWP) 3.0 Training Programs Catalog of Course Descriptions Catalog of Course Descriptions INTRODUCTION... 3 ERICSSON CONVERGED WALLET (ECW) 3.0 RATING MANAGEMENT... 4 ERICSSON
More informationThe Good Judgment Project: A large scale test of different methods of combining expert predictions
The Good Judgment Project: A large scale test of different methods of combining expert predictions Lyle Ungar, Barb Mellors, Jon Baron, Phil Tetlock, Jaime Ramos, Sam Swift The University of Pennsylvania
More informationSELF-STUDY QUESTIONNAIRE FOR REVIEW of the COMPUTER SCIENCE PROGRAM
Disclaimer: This Self Study was developed to meet the goals of the CAC Session at the 2006 Summit. It should not be considered as a model or a template. ABET Computing Accreditation Commission SELF-STUDY
More informationCouncil of Educational Facilities Planners, International
Council of Educational Facilities Planners, International Case Study: Design of Hudson Bend Middle School, Lake Travis ISD How to Transform Cells and Bells into 21 st Century Learning CEFPI is a Registered
More informationModelling interaction during small-group synchronous problem-solving activities: The Synergo approach.
Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach. Nikolaos Avouris, Meletis Margaritis, Vassilis Komis University of Patras, Patras, Greece { N.Avouris,
More informationMonitoring Metacognitive abilities in children: A comparison of children between the ages of 5 to 7 years and 8 to 11 years
Monitoring Metacognitive abilities in children: A comparison of children between the ages of 5 to 7 years and 8 to 11 years Abstract Takang K. Tabe Department of Educational Psychology, University of Buea
More informationUTILITY POLE ATTACHMENTS Understanding New FCC Regulations and Industry Trends
COURSE UTILITY POLE ATTACHMENTS Understanding New FCC Regulations and Industry Trends May 1-2, 2017 Atlanta Marriott Suites Midtown Atlanta, GA EUCI is authorized by IACET to offer 1.0 CEUs for this course
More informationEcosystem: Description of the modules:
Nanotechnology Solutions to Engineering Grand Challenges Edward W. Davis Auburn University Polapradada Raju Auburn University Virginia Davis Auburn University Abstract: Nanotechnology is becoming, and
More informationEvaluation of Usage Patterns for Web-based Educational Systems using Web Mining
Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl
More informationEvaluation of Usage Patterns for Web-based Educational Systems using Web Mining
Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl
More informationXXII BrainStorming Day
UNIVERSITA DEGLI STUDI DI CATANIA FACOLTA DI INGEGNERIA PhD course in Electronics, Automation and Control of Complex Systems - XXV Cycle DIPARTIMENTO DI INGEGNERIA ELETTRICA ELETTRONICA E INFORMATICA XXII
More informationFrom Self Hosted to SaaS Our Journey (LEC107648)
From Self Hosted to SaaS Our Journey (LEC107648) Kathy Saville Director of Instructional Technology Saint Mary s College, Notre Dame Saint Mary s College, Notre Dame, Indiana Founded 1844 Premier Women
More informationStorytelling Made Simple
Storytelling Made Simple Storybird is a Web tool that allows adults and children to create stories online (independently or collaboratively) then share them with the world or select individuals. Teacher
More informationUsing EEG to Improve Massive Open Online Courses Feedback Interaction
Using EEG to Improve Massive Open Online Courses Feedback Interaction Haohan Wang, Yiwei Li, Xiaobo Hu, Yucong Yang, Zhu Meng, Kai-min Chang Language Technologies Institute School of Computer Science Carnegie
More informationOutreach Connect User Manual
Outreach Connect A Product of CAA Software, Inc. Outreach Connect User Manual Church Growth Strategies Through Sunday School, Care Groups, & Outreach Involving Members, Guests, & Prospects PREPARED FOR:
More informationMaster s Programme in Computer, Communication and Information Sciences, Study guide , ELEC Majors
Master s Programme in Computer, Communication and Information Sciences, Study guide 2015-2016, ELEC Majors Sisällysluettelo PS=pääsivu, AS=alasivu PS: 1 Acoustics and Audio Technology... 4 Objectives...
More informationThe Foundations of Interpersonal Communication
L I B R A R Y A R T I C L E The Foundations of Interpersonal Communication By Dennis Emberling, President of Developmental Consulting, Inc. Introduction Mark Twain famously said, Everybody talks about
More informationarxiv: v1 [cs.lg] 7 Apr 2015
Transferring Knowledge from a RNN to a DNN William Chan 1, Nan Rosemary Ke 1, Ian Lane 1,2 Carnegie Mellon University 1 Electrical and Computer Engineering, 2 Language Technologies Institute Equal contribution
More informationarxiv: v1 [cs.cl] 27 Apr 2016
The IBM 2016 English Conversational Telephone Speech Recognition System George Saon, Tom Sercu, Steven Rennie and Hong-Kwang J. Kuo IBM T. J. Watson Research Center, Yorktown Heights, NY, 10598 gsaon@us.ibm.com
More informationGenerative models and adversarial training
Day 4 Lecture 1 Generative models and adversarial training Kevin McGuinness kevin.mcguinness@dcu.ie Research Fellow Insight Centre for Data Analytics Dublin City University What is a generative model?
More informationPRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN PROGRAM AT THE UNIVERSITY OF TWENTE
INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 6 & 7 SEPTEMBER 2012, ARTESIS UNIVERSITY COLLEGE, ANTWERP, BELGIUM PRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN
More informationIntroduction to Mobile Learning Systems and Usability Factors
Introduction to Mobile Learning Systems and Usability Factors K.B.Lee Computer Science University of Northern Virginia Annandale, VA Kwang.lee@unva.edu Abstract - Number of people using mobile phones has
More informationLearning From the Past with Experiment Databases
Learning From the Past with Experiment Databases Joaquin Vanschoren 1, Bernhard Pfahringer 2, and Geoff Holmes 2 1 Computer Science Dept., K.U.Leuven, Leuven, Belgium 2 Computer Science Dept., University
More informationPREP S SPEAKER LISTENER TECHNIQUE COACHING MANUAL
1 PREP S SPEAKER LISTENER TECHNIQUE COACHING MANUAL IMPORTANCE OF THE SPEAKER LISTENER TECHNIQUE The Speaker Listener Technique (SLT) is a structured communication strategy that promotes clarity, understanding,
More informationTaxonomy of the cognitive domain: An example of architectural education program
Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 174 ( 2015 ) 3272 3277 INTE 2014 Taxonomy of the cognitive domain: An example of architectural education
More informationWHY GO TO GRADUATE SCHOOL?
WHY GO TO GRADUATE SCHOOL? 1 GRADUATE EDUCATION: WHAT ARE THE QUESTIONS? Why go to graduate school? What degree? Masters of Doctorate? Where should you go? And how to choose? When is the right time for
More information