Phase-Change-Memory Devices for Non-von Neumann Computing in the AI Era
|
|
- James Ball
- 6 years ago
- Views:
Transcription
1 Phase-Change-Memory Devices for Non-von Neumann Computing in the AI Era Evangelos Eleftheriou IBM Fellow, IBM Research - Zurich
2 Application Trends Computational Complexity Graph Analytics HADOOP HPC O(N 3 ) O(N 2 ) O(N) MB Classical HPC Applications Uncertainty Quantification GB Deep Learning Database Queries Dimensional Reduction TB Knowledge Graph Creation Information Retrieval PB Data Volume
3 Performance and Power Efficiency Trends Performance (Petaflops/s) Power efficiency (Gigaflops/W) Increasing gap between performance and power efficiency Diminishing performance/power efficiency gains from technology scaling 0
4 AI Computational Requirements: Very Challenging à FLOPS for image classification à 10 7 hours for speech training in several languages Classical Scaling Alone: Not the Solution Key Focus: Decrease the power density and power consumption Overcome the CPU/memory bottleneck of conventional computing architectures Design new AI algorithms, accelerators, interconnect, and software technologies Merolla et al., Science, 2014
5 Improve von Neumann Computing Storage class memory Near memory computing Monolithic 3D integration MEMORY CMOS Processing Units CPU Burr et al., IBM J. Res. Dev., 2008 Vermij et al., Proc. ACM CF, 2016 Wong, Salahuddin, Nature Nanotechnology, 2015 Minimize the time and distance to memory access
6 Go beyond von Neumann Computing Neuromorphic computing Computational memory LeCun, Bengio, Hinton, Nature, 2015 Merolla et al., Science, 2014 Indiveri, Liu, Proc. IEEE, 2015 Borghetti et al., Nature, 2010 Di Ventra and Pershin, Scientific American, 2015 Hosseini et al., Electron Dev. Lett., 2015 Sebastian et al., Nature Communications, 2017
7 Neural Hardware: Digital or Analog? Fully digital Analog/hybrid Google TPU IBM Synapse Manchester Univ. Stanford UZH / ETH Heidelberg Univ. Area/power for SRAM/RRAM neurons and synapses 1 million neurons 1 million neurons Large improvements in power, area and learning performance for memristive neural HW Truly non-von Neumann computations Rajendran et al., IEEE Trans. Electron Dev., 2013 Rajendran et al., IEEE Trans. Electron Dev., 2013 Potential of a memristive neuron/synapse
8 Resistive Memory Devices Charge-based memory/storage à resistance-based memory/storage Spin-torque transfer magnetic random access memory (STT-MRAM) Metal oxide random access memory (ReRAM) Conductive bridge random access memory (CBRAM) Phase change memory (PCM) Significant impact on memory/storage hierarchy Monolithic integration of memories and computation units Sufficient richness of dynamics for non-von Neumann computing
9 Phase-Change Memory (PCM) Amorphize Crystallize High-resistance state Low-resistance state Use two distinct solid phases of a Ge-Sb-Te metal alloy to store a bit Use intermediate phases to obtain a continuum of different states or resistance levels Transition between phases by controlled heating and cooling
10 Phase-Change Devices in Spiking Neural Networks Synapse Postsynaptic potential ( input ) Neuron Ovshinsky, E\PCOS, 2004 Wright, Adv. Mater., 2011 Kuzum et al., Nano Lett., 2012 Jackson et al., ACM JETCS, 2013 Tuma et al., Nature Nanotechnology, 2016 Pantazi et al., Nanotechnology, 2016 Tuma, et al., IEEE Electron Dev. Lett., 2016 All-PCM architecture: Areal/energy efficiency Can we exploit some unique physical attributes?
11 Phase-Change Neurons Stochastic phase-change neurons T. Tuma, A. Pantazi, M. Le Gallo, A. Sebastian & E. Eleftheriou Nature Nanotechnology, Aug The internal state of the neuron is stored in the phase configuration of a PCM device Neuronal dynamics emulated using the physics of crystallization Exhibit inherent stochasticity, which is key for neuronal population coding
12 Neuronal Population Coding How does the brain store and represent complex stimuli given the slowness, unreliability and uncertainty of individual neurons? Motion Vision Sound High-speed, information-rich stimuli Slow (~10 Hz), stochastic, unreliable neurons Spiking activity of neurons As in any good democracy, individual neurons count for little; it is population activity that matters. For example, as with control of eye and arm movements, visual discrimination is much more accurate than would be predicted from the responses of single neurons. Averbeck et al., Nature Reviews, 2006 Spiking activity T. Tuma et al., Nature Nanotechnology, 2016
13 Application of an SNN: Temporal Correlation Detection Algorithmic goals Determine whether some data streams are statistically correlated Observe variations in the activity of the correlated input Quickly react to occurrence of correlated inputs Continuously and dynamically re-evaluate the learned statistics Use only unsupervised learning & consume very low power FINANCE SCIENCE MEDICINE BIG DATA and more
14 Learning Patterns with a Spiking Neural Network Neuron #1: synaptic weights Input pattern Neuron #1: output Neuron #2: synaptic weights Neuron #2: output A. Pantazi et al., Nanotechnology, 2016 Purely unsupervised neuromorphic computation: No counting, no transfers between memory and CPU!
15 Computational Memory Processing unit & Conventional memory Processing unit & Computational memory Borghetti et al., Nature, 2010 Di Ventra and Pershin, Scientific American, 2015 Hosseini et al., Elect. Dev. Lett., 2015 Sebastian et al., Nature Communications, 2017 The concept: Perform certain computational tasks without the need to transfer data back and forth in the process
16 PCM to Perform Analog Matrix-Vector Multiplications = Burr et al., Adv. Phys: X, 2017 MAP to conductance values MAP to read voltage DECIPHER from the current Matrix multiplication: Exploits multi-level storage capability and Kirchhoff and Ohm laws A crossbar array performs fast matrix-vector multiplication without data movements in O(1)
17 How Precisely is the Multiplication? Matrix multiplication: Experimental results But: owing to device variability, stochasticity etc., the matrix-vector multiplication is not highly precise
18 Application 1: Optimization Solvers Input signal Measured Compressed measurements Reconstructed signal Reconstructed Le Gallo et. El., Proc. IEDM 2017 Compressed sensing: Reconstruction of signals from a small number of measurements from a high-dimensional signal Used in various applications such as MRI, facial recognition, holography, audio restoration or in mobile phone camera sensors
19 Compressed Sensing/Recovery Using Computational Memory Complexity reduction: O(N 2 ) O(N); Potential 10 6 speed-up on 1000x1000 pixel image Le Gallo et al., Proc. IEDM, 2017
20 Image Reconstruction with Computational Memory Reconstruction Error NMSE PCM chip 4x4-bit Fixed-point Floating-point 0 10Iteration t20 30 Iterations t Experimental result: 128x128 image, 50% sampling rate, Computational memory unit with 131,072 PCM devices Le Gallo et. El., Proc. IEDM 2017 Estimated power reduction of 50x compared to using an optimized 4-bit FPGA matrix-vector multiplier that delivers same reconstruction accuracy at same speed.
21 Can We Compute with the Dynamics of PCM? A nanoscale non-volatile integrator Sebastian et al., Nature Communications, 2017 Can we exploit the crystallization dynamics for computational memory?
22 Application 2: Correlation Detection Goal: Detect temporal correlations between event-based data streams. Each process is assigned to a single PCM device. Whenever the process takes the value 1, a SET pulse is applied to the PCM device, with the amplitude or the width of the pulse being proportional to the instantaneous sum of all processes. The conductance of the memory devices deciphers the correlated groups. Sebastian et al., Nature Communications, 2017
23 Experimental Results (1 Million PCM Devices) Processes Conductances Very weak correlation of c = 0.01 No shuttling back and forth of data Massively parallel
24 Comparative Study IBM Power8+ Architecture Sebastian et al., Nature Communications, x improvement in computation time! Peak dynamic power on the order of watts compared to hundreds of Watts
25 What if Arbitrarily High-precision is Needed? Mixed-precision computing to the rescue! Bulk of computations in low-precision Computational Memory Refinement in high-precision digital processing engine
26 Application 3: Linear Equation Solver Digital processor (High precision) Computational memory (Low precision) Le Gallo et al., Mixed-Precision In-Memory Computing, ArXiv, 2017 Solution iteratively updated with low-precision error-correction term Error-correction term obtained using inexact inner solver The matrix multiplications in the inner solver are performed using a PCM array
27 Linear Equation Solver: Experimental Results Le Gallo et al., Mixed-Precision In-Memory Computing, ArXiv, 2017 Mixed-precision computing provides a pathway for arbitrarily precise computation using computational memory.
28 System-Level Performance Analysis POWER8 CPU as high-precision processing unit, simulated memory computing unit Significant improvement in the time/energy to solution metric The higher the accuracy of the computational memory, the higher the gain
29 Application 4: Mixed-Precision Deep Learning Synaptic weight Synaptic weights stored in computational memory The matrix-vector multiplications associated with forward/backward propagation performed in place with low precision The desired weight updates are accumulated in high precision Nandakumar et al., arxiv: , 2017
30 Simulation Results Nandakumar et al., Mixed-Precision Training of Deep Neural Networks Using Computational Memory ArXiv, 2017 Two PCM devices in differential configuration to represent a synapse Device-model-based network simulation achieves 97.78% test accuracy Additional drop from the read noise (0.26%) and analog-digital converters (0.12%)
A Variation-Tolerant Multi-Level Memory Architecture Encoded in Two-state Memristors
A Variation-Tolerant Multi-Level Memory Architecture Encoded in Two-state Memristors Bin Wu and Matthew R. Guthaus Department of CE, University of California Santa Cruz Santa Cruz, CA 95064 {wubin6666,mrg}@soe.ucsc.edu
More informationPROGRAM Day 1 - Thursday, May 28, 2015
MemoCIS 1 st Workshop and MC Meeting 'Memristors Devices, Models, Circuits, Systems and Applications', Lisbon, Portugal. 9.-11.5.2015 PROGRAM Day 1 - Thursday, May 28, 2015 08:30 09:00 Registration and
More informationPython Machine Learning
Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled
More informationGenerative models and adversarial training
Day 4 Lecture 1 Generative models and adversarial training Kevin McGuinness kevin.mcguinness@dcu.ie Research Fellow Insight Centre for Data Analytics Dublin City University What is a generative model?
More informationLecture 1: Machine Learning Basics
1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3
More informationQuickStroke: An Incremental On-line Chinese Handwriting Recognition System
QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents
More informationOPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS
OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,
More informationComputer Science. Embedded systems today. Microcontroller MCR
Computer Science Microcontroller Embedded systems today Prof. Dr. Siepmann Fachhochschule Aachen - Aachen University of Applied Sciences 24. März 2009-2 Minuteman missile 1962 Prof. Dr. Siepmann Fachhochschule
More informationINPE São José dos Campos
INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA
More informationKnowledge Transfer in Deep Convolutional Neural Nets
Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More informationCircuit Simulators: A Revolutionary E-Learning Platform
Circuit Simulators: A Revolutionary E-Learning Platform Mahi Itagi Padre Conceicao College of Engineering, Verna, Goa, India. itagimahi@gmail.com Akhil Deshpande Gogte Institute of Technology, Udyambag,
More informationFUZZY EXPERT. Dr. Kasim M. Al-Aubidy. Philadelphia University. Computer Eng. Dept February 2002 University of Damascus-Syria
FUZZY EXPERT SYSTEMS 16-18 18 February 2002 University of Damascus-Syria Dr. Kasim M. Al-Aubidy Computer Eng. Dept. Philadelphia University What is Expert Systems? ES are computer programs that emulate
More informationA Neural Network GUI Tested on Text-To-Phoneme Mapping
A Neural Network GUI Tested on Text-To-Phoneme Mapping MAARTEN TROMPPER Universiteit Utrecht m.f.a.trompper@students.uu.nl Abstract Text-to-phoneme (T2P) mapping is a necessary step in any speech synthesis
More informationSeminar - Organic Computing
Seminar - Organic Computing Self-Organisation of OC-Systems Markus Franke 25.01.2006 Typeset by FoilTEX Timetable 1. Overview 2. Characteristics of SO-Systems 3. Concern with Nature 4. Design-Concepts
More informationProposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science
Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science Gilberto de Paiva Sao Paulo Brazil (May 2011) gilbertodpaiva@gmail.com Abstract. Despite the prevalence of the
More informationOn Human Computer Interaction, HCI. Dr. Saif al Zahir Electrical and Computer Engineering Department UBC
On Human Computer Interaction, HCI Dr. Saif al Zahir Electrical and Computer Engineering Department UBC Human Computer Interaction HCI HCI is the study of people, computer technology, and the ways these
More informationEvolutive Neural Net Fuzzy Filtering: Basic Description
Journal of Intelligent Learning Systems and Applications, 2010, 2: 12-18 doi:10.4236/jilsa.2010.21002 Published Online February 2010 (http://www.scirp.org/journal/jilsa) Evolutive Neural Net Fuzzy Filtering:
More informationProbabilistic Latent Semantic Analysis
Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview
More informationSystem Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks
System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationArtificial Neural Networks
Artificial Neural Networks Andres Chavez Math 382/L T/Th 2:00-3:40 April 13, 2010 Chavez2 Abstract The main interest of this paper is Artificial Neural Networks (ANNs). A brief history of the development
More informationImproving Fairness in Memory Scheduling
Improving Fairness in Memory Scheduling Using a Team of Learning Automata Aditya Kajwe and Madhu Mutyam Department of Computer Science & Engineering, Indian Institute of Tehcnology - Madras June 14, 2014
More informationAxiom 2013 Team Description Paper
Axiom 2013 Team Description Paper Mohammad Ghazanfari, S Omid Shirkhorshidi, Farbod Samsamipour, Hossein Rahmatizadeh Zagheli, Mohammad Mahdavi, Payam Mohajeri, S Abbas Alamolhoda Robotics Scientific Association
More informationNSF Grantee s Meeting December 4 th, Gerhard Klimeck
nanohub.org Future Cyberinfrastructure serving over 26,000 users today Gerhard Klimeck, Mark Lundstrom, Michael McLennan, George Adams Network for Computational Nanotechnology Purdue University NSF Grantee
More informationSARDNET: A Self-Organizing Feature Map for Sequences
SARDNET: A Self-Organizing Feature Map for Sequences Daniel L. James and Risto Miikkulainen Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 dljames,risto~cs.utexas.edu
More informationBachelor of Science in Mechanical Engineering with Co-op
Bachelor of Science in Mechanical Engineering with Co-op 1 Bachelor of Science in Mechanical Engineering with Co-op Cooperative Education Program A Cooperative Education (Co-Op) is an optional program
More informationUnsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng Microsoft Research, One Microsoft Way, Redmond, WA 98052, U.S.A.
More information(Sub)Gradient Descent
(Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include
More informationAUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION
JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 11/2007, ISSN 1642-6037 Marek WIŚNIEWSKI *, Wiesława KUNISZYK-JÓŹKOWIAK *, Elżbieta SMOŁKA *, Waldemar SUSZYŃSKI * HMM, recognition, speech, disorders
More informationXXII BrainStorming Day
UNIVERSITA DEGLI STUDI DI CATANIA FACOLTA DI INGEGNERIA PhD course in Electronics, Automation and Control of Complex Systems - XXV Cycle DIPARTIMENTO DI INGEGNERIA ELETTRICA ELETTRONICA E INFORMATICA XXII
More informationTest Effort Estimation Using Neural Network
J. Software Engineering & Applications, 2010, 3: 331-340 doi:10.4236/jsea.2010.34038 Published Online April 2010 (http://www.scirp.org/journal/jsea) 331 Chintala Abhishek*, Veginati Pavan Kumar, Harish
More informationCourse Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE
EE-589 Introduction to Neural Assistant Prof. Dr. Turgay IBRIKCI Room # 305 (322) 338 6868 / 139 Wensdays 9:00-12:00 Course Outline The course is divided in two parts: theory and practice. 1. Theory covers
More informationA New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation
A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation SLSP-2016 October 11-12 Natalia Tomashenko 1,2,3 natalia.tomashenko@univ-lemans.fr Yuri Khokhlov 3 khokhlov@speechpro.com Yannick
More informationSpeech Recognition at ICSI: Broadcast News and beyond
Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI
More informationOn the Combined Behavior of Autonomous Resource Management Agents
On the Combined Behavior of Autonomous Resource Management Agents Siri Fagernes 1 and Alva L. Couch 2 1 Faculty of Engineering Oslo University College Oslo, Norway siri.fagernes@iu.hio.no 2 Computer Science
More informationAbstractions and the Brain
Abstractions and the Brain Brian D. Josephson Department of Physics, University of Cambridge Cavendish Lab. Madingley Road Cambridge, UK. CB3 OHE bdj10@cam.ac.uk http://www.tcm.phy.cam.ac.uk/~bdj10 ABSTRACT
More informationDesigning a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses
Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Thomas F.C. Woodhall Masters Candidate in Civil Engineering Queen s University at Kingston,
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationOn-Line Data Analytics
International Journal of Computer Applications in Engineering Sciences [VOL I, ISSUE III, SEPTEMBER 2011] [ISSN: 2231-4946] On-Line Data Analytics Yugandhar Vemulapalli #, Devarapalli Raghu *, Raja Jacob
More informationWord Segmentation of Off-line Handwritten Documents
Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department
More informationSuccess Factors for Creativity Workshops in RE
Success Factors for Creativity s in RE Sebastian Adam, Marcus Trapp Fraunhofer IESE Fraunhofer-Platz 1, 67663 Kaiserslautern, Germany {sebastian.adam, marcus.trapp}@iese.fraunhofer.de Abstract. In today
More informationA Reinforcement Learning Variant for Control Scheduling
A Reinforcement Learning Variant for Control Scheduling Aloke Guha Honeywell Sensor and System Development Center 3660 Technology Drive Minneapolis MN 55417 Abstract We present an algorithm based on reinforcement
More informationMASTER OF SCIENCE (M.S.) MAJOR IN COMPUTER SCIENCE
Master of Science (M.S.) Major in Computer Science 1 MASTER OF SCIENCE (M.S.) MAJOR IN COMPUTER SCIENCE Major Program The programs in computer science are designed to prepare students for doctoral research,
More informationDIGITAL GAMING & INTERACTIVE MEDIA BACHELOR S DEGREE. Junior Year. Summer (Bridge Quarter) Fall Winter Spring GAME Credits.
DIGITAL GAMING & INTERACTIVE MEDIA BACHELOR S DEGREE Sample 2-Year Academic Plan DRAFT Junior Year Summer (Bridge Quarter) Fall Winter Spring MMDP/GAME 124 GAME 310 GAME 318 GAME 330 Introduction to Maya
More information*Net Perceptions, Inc West 78th Street Suite 300 Minneapolis, MN
From: AAAI Technical Report WS-98-08. Compilation copyright 1998, AAAI (www.aaai.org). All rights reserved. Recommender Systems: A GroupLens Perspective Joseph A. Konstan *t, John Riedl *t, AI Borchers,
More informationLearning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models
Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models Stephan Gouws and GJ van Rooyen MIH Medialab, Stellenbosch University SOUTH AFRICA {stephan,gvrooyen}@ml.sun.ac.za
More informationENEE 302h: Digital Electronics, Fall 2005 Prof. Bruce Jacob
Course Syllabus ENEE 302h: Digital Electronics, Fall 2005 Prof. Bruce Jacob 1. Basic Information Time & Place Lecture: TuTh 2:00 3:15 pm, CSIC-3118 Discussion Section: Mon 12:00 12:50pm, EGR-1104 Professor
More informationAGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS
AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS 1 CALIFORNIA CONTENT STANDARDS: Chapter 1 ALGEBRA AND WHOLE NUMBERS Algebra and Functions 1.4 Students use algebraic
More informationWHEN THERE IS A mismatch between the acoustic
808 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 14, NO. 3, MAY 2006 Optimization of Temporal Filters for Constructing Robust Features in Speech Recognition Jeih-Weih Hung, Member,
More informationA Case Study: News Classification Based on Term Frequency
A Case Study: News Classification Based on Term Frequency Petr Kroha Faculty of Computer Science University of Technology 09107 Chemnitz Germany kroha@informatik.tu-chemnitz.de Ricardo Baeza-Yates Center
More informationArtificial Neural Networks written examination
1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14
More informationHow People Learn Physics
How People Learn Physics Edward F. (Joe) Redish Dept. Of Physics University Of Maryland AAPM, Houston TX, Work supported in part by NSF grants DUE #04-4-0113 and #05-2-4987 Teaching complex subjects 2
More informationRendezvous with Comet Halley Next Generation of Science Standards
Next Generation of Science Standards 5th Grade 6 th Grade 7 th Grade 8 th Grade 5-PS1-3 Make observations and measurements to identify materials based on their properties. MS-PS1-4 Develop a model that
More informationAn Introduction to Simio for Beginners
An Introduction to Simio for Beginners C. Dennis Pegden, Ph.D. This white paper is intended to introduce Simio to a user new to simulation. It is intended for the manufacturing engineer, hospital quality
More informationDesigning a Computer to Play Nim: A Mini-Capstone Project in Digital Design I
Session 1793 Designing a Computer to Play Nim: A Mini-Capstone Project in Digital Design I John Greco, Ph.D. Department of Electrical and Computer Engineering Lafayette College Easton, PA 18042 Abstract
More informationAn empirical study of learning speed in backpropagation
Carnegie Mellon University Research Showcase @ CMU Computer Science Department School of Computer Science 1988 An empirical study of learning speed in backpropagation networks Scott E. Fahlman Carnegie
More informationAC : TEACHING COLLEGE PHYSICS
AC 2012-5386: TEACHING COLLEGE PHYSICS Dr. Bert Pariser, Technical Career Institutes Bert Pariser is a faculty member in the Electronic Engineering Technology and the Computer Science Technology departments
More informationLearning Methods for Fuzzy Systems
Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8
More informationMathematics subject curriculum
Mathematics subject curriculum Dette er ei omsetjing av den fastsette læreplanteksten. Læreplanen er fastsett på Nynorsk Established as a Regulation by the Ministry of Education and Research on 24 June
More informationValue Creation Through! Integration Workshop! Value Stream Analysis and Mapping for PD! January 31, 2002!
Presented by:! Hugh McManus for Rich Millard! MIT! Value Creation Through! Integration Workshop! Value Stream Analysis and Mapping for PD!!!! January 31, 2002! Steps in Lean Thinking (Womack and Jones)!
More informationDeep search. Enhancing a search bar using machine learning. Ilgün Ilgün & Cedric Reichenbach
#BaselOne7 Deep search Enhancing a search bar using machine learning Ilgün Ilgün & Cedric Reichenbach We are not researchers Outline I. Periscope: A search tool II. Goals III. Deep learning IV. Applying
More informationData Fusion Models in WSNs: Comparison and Analysis
Proceedings of 2014 Zone 1 Conference of the American Society for Engineering Education (ASEE Zone 1) Data Fusion s in WSNs: Comparison and Analysis Marwah M Almasri, and Khaled M Elleithy, Senior Member,
More informationRule Learning With Negation: Issues Regarding Effectiveness
Rule Learning With Negation: Issues Regarding Effectiveness S. Chua, F. Coenen, G. Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX Liverpool, United
More informationLearning to Schedule Straight-Line Code
Learning to Schedule Straight-Line Code Eliot Moss, Paul Utgoff, John Cavazos Doina Precup, Darko Stefanović Dept. of Comp. Sci., Univ. of Mass. Amherst, MA 01003 Carla Brodley, David Scheeff Sch. of Elec.
More informationRobust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction
INTERSPEECH 2015 Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction Akihiro Abe, Kazumasa Yamamoto, Seiichi Nakagawa Department of Computer
More informationClass-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification
Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification Tomi Kinnunen and Ismo Kärkkäinen University of Joensuu, Department of Computer Science, P.O. Box 111, 80101 JOENSUU,
More informationSemi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
INTERSPEECH 2013 Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration Yan Huang, Dong Yu, Yifan Gong, and Chaojun Liu Microsoft Corporation, One
More informationComputer Organization I (Tietokoneen toiminta)
581305-6 Computer Organization I (Tietokoneen toiminta) Teemu Kerola University of Helsinki Department of Computer Science Spring 2010 1 Computer Organization I Course area and goals Course learning methods
More informationCross Language Information Retrieval
Cross Language Information Retrieval RAFFAELLA BERNARDI UNIVERSITÀ DEGLI STUDI DI TRENTO P.ZZA VENEZIA, ROOM: 2.05, E-MAIL: BERNARDI@DISI.UNITN.IT Contents 1 Acknowledgment.............................................
More informationAccelerated Learning Online. Course Outline
Accelerated Learning Online Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies
More informationRule discovery in Web-based educational systems using Grammar-Based Genetic Programming
Data Mining VI 205 Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming C. Romero, S. Ventura, C. Hervás & P. González Universidad de Córdoba, Campus Universitario de
More informationCourses in English. Application Development Technology. Artificial Intelligence. 2017/18 Spring Semester. Database access
The courses availability depends on the minimum number of registered students (5). If the course couldn t start, students can still complete it in the form of project work and regular consultations with
More informationResearch computing Results
About Online Surveys Support Contact Us Online Surveys Develop, launch and analyse Web-based surveys My Surveys Create Survey My Details Account Details Account Users You are here: Research computing Results
More informationCROSS-LANGUAGE INFORMATION RETRIEVAL USING PARAFAC2
1 CROSS-LANGUAGE INFORMATION RETRIEVAL USING PARAFAC2 Peter A. Chew, Brett W. Bader, Ahmed Abdelali Proceedings of the 13 th SIGKDD, 2007 Tiago Luís Outline 2 Cross-Language IR (CLIR) Latent Semantic Analysis
More informationDevice Independence and Extensibility in Gesture Recognition
Device Independence and Extensibility in Gesture Recognition Jacob Eisenstein, Shahram Ghandeharizadeh, Leana Golubchik, Cyrus Shahabi, Donghui Yan, Roger Zimmermann Department of Computer Science University
More informationExploration. CS : Deep Reinforcement Learning Sergey Levine
Exploration CS 294-112: Deep Reinforcement Learning Sergey Levine Class Notes 1. Homework 4 due on Wednesday 2. Project proposal feedback sent Today s Lecture 1. What is exploration? Why is it a problem?
More informationA Pipelined Approach for Iterative Software Process Model
A Pipelined Approach for Iterative Software Process Model Ms.Prasanthi E R, Ms.Aparna Rathi, Ms.Vardhani J P, Mr.Vivek Krishna Electronics and Radar Development Establishment C V Raman Nagar, Bangalore-560093,
More informationSpeaker Identification by Comparison of Smart Methods. Abstract
Journal of mathematics and computer science 10 (2014), 61-71 Speaker Identification by Comparison of Smart Methods Ali Mahdavi Meimand Amin Asadi Majid Mohamadi Department of Electrical Department of Computer
More informationEvolving Spiking Networks with Variable Resistive Memories
Evolving Spiking Networks with Variable Resistive Memories Gerard Howard david4.howard@uwe.ac.uk Department of Computer Science, University of the West of England, Bristol, BS16 1QY, UK Larry Bull larry.bull@uwe.ac.uk
More informationTraining Memristors for Reliable Computing
Training Memristors for Reliable Computing by Idongesit Effiong Ebong A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy (Electrical Engineering)
More informationGrade 6: Correlated to AGS Basic Math Skills
Grade 6: Correlated to AGS Basic Math Skills Grade 6: Standard 1 Number Sense Students compare and order positive and negative integers, decimals, fractions, and mixed numbers. They find multiples and
More informationAGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016
AGENDA Advanced Learning Theories Alejandra J. Magana, Ph.D. admagana@purdue.edu Introduction to Learning Theories Role of Learning Theories and Frameworks Learning Design Research Design Dual Coding Theory
More informationA study of speaker adaptation for DNN-based speech synthesis
A study of speaker adaptation for DNN-based speech synthesis Zhizheng Wu, Pawel Swietojanski, Christophe Veaux, Steve Renals, Simon King The Centre for Speech Technology Research (CSTR) University of Edinburgh,
More informationBayllocator: A proactive system to predict server utilization and dynamically allocate memory resources using Bayesian networks and ballooning
Bayllocator: A proactive system to predict server utilization and dynamically allocate memory resources using Bayesian networks and ballooning Evangelos Tasoulas - University of Oslo Hårek Haugerud - Oslo
More informationUSER ADAPTATION IN E-LEARNING ENVIRONMENTS
USER ADAPTATION IN E-LEARNING ENVIRONMENTS Paraskevi Tzouveli Image, Video and Multimedia Systems Laboratory School of Electrical and Computer Engineering National Technical University of Athens tpar@image.
More informationAccelerated Learning Course Outline
Accelerated Learning Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies of Accelerated
More informationReducing Features to Improve Bug Prediction
Reducing Features to Improve Bug Prediction Shivkumar Shivaji, E. James Whitehead, Jr., Ram Akella University of California Santa Cruz {shiv,ejw,ram}@soe.ucsc.edu Sunghun Kim Hong Kong University of Science
More informationQuantitative Evaluation of an Intuitive Teaching Method for Industrial Robot Using a Force / Moment Direction Sensor
International Journal of Control, Automation, and Systems Vol. 1, No. 3, September 2003 395 Quantitative Evaluation of an Intuitive Teaching Method for Industrial Robot Using a Force / Moment Direction
More information*** * * * COUNCIL * * CONSEIL OFEUROPE * * * DE L'EUROPE. Proceedings of the 9th Symposium on Legal Data Processing in Europe
*** * * * COUNCIL * * CONSEIL OFEUROPE * * * DE L'EUROPE Proceedings of the 9th Symposium on Legal Data Processing in Europe Bonn, 10-12 October 1989 Systems based on artificial intelligence in the legal
More informationHuman Emotion Recognition From Speech
RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati
More informationSoftware Maintenance
1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories
More informationUsing EEG to Improve Massive Open Online Courses Feedback Interaction
Using EEG to Improve Massive Open Online Courses Feedback Interaction Haohan Wang, Yiwei Li, Xiaobo Hu, Yucong Yang, Zhu Meng, Kai-min Chang Language Technologies Institute School of Computer Science Carnegie
More informationK.L.N. COLLEGE OF ENGINEERING, POTTAPALAYAM. Department of Computer Science and Engineering. Academic Year:
K.L.N. COLLEGE OF ENGINEERING, POTTAPALAYAM Department of Computer Science and Details of Faculty Development/ Training / Seminar / Workshop attended by Faculty members Academic Year: 2014-2015 S.No. Name
More informationD Road Maps 6. A Guide to Learning System Dynamics. System Dynamics in Education Project
D-4506-5 1 Road Maps 6 A Guide to Learning System Dynamics System Dynamics in Education Project 2 A Guide to Learning System Dynamics D-4506-5 Road Maps 6 System Dynamics in Education Project System Dynamics
More informationEECS 571 PRINCIPLES OF REAL-TIME COMPUTING Fall 10. Instructor: Kang G. Shin, 4605 CSE, ;
EECS 571 PRINCIPLES OF REAL-TIME COMPUTING Fall 10 Instructor: Kang G. Shin, 4605 CSE, 763-0391; kgshin@umich.edu Number of credit hours: 4 Class meeting time and room: Regular classes: MW 10:30am noon
More informationAustralian Journal of Basic and Applied Sciences
AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean
More informationLEGO MINDSTORMS Education EV3 Coding Activities
LEGO MINDSTORMS Education EV3 Coding Activities s t e e h s k r o W t n e d Stu LEGOeducation.com/MINDSTORMS Contents ACTIVITY 1 Performing a Three Point Turn 3-6 ACTIVITY 2 Written Instructions for a
More informationMYCIN. The MYCIN Task
MYCIN Developed at Stanford University in 1972 Regarded as the first true expert system Assists physicians in the treatment of blood infections Many revisions and extensions over the years The MYCIN Task
More informationHigh School Digital Electronics Curriculum Essentials Document
High School Digital Electronics Curriculum Essentials Document Boulder Valley School District Department of CTEC May 2012 Introduction Digital Electronics Course This file is intended to be a complete
More information