Programming Social Robots for Human Interaction. Lecture 4: Machine Learning and Pattern Recognition

 Isabel Foster
 6 months ago
 Views:
Transcription
1 Programming Social Robots for Human Interaction Lecture 4: Machine Learning and Pattern Recognition ZhengHua Tan Dept. of Electronic Systems, Aalborg Univ., Denmark Many of the figures are provided by Chris Bishop. Programming Social Robots 4, ZhengHua Tan 1 Course outline 1. Introduction to Robot Operating System (ROS) 2. Introduction to isociobot and NAO robot, and demos 3. Social Robots and Applications 4. Machine Learning and Pattern Recognition 5. Speech Processing I: Acquisition of Speech, Feature Extraction and Speaker Localization 6. Speech Processing II: Speaker Identification and Speech Recognition 7. Image Processing I: Image Acquisition, Preprocessing and Feature Extraction 8. Image Processing II: Face Detection and Face Recognition 9. User Modelling 10. Multimodal HumanRobot Interaction Programming Social Robots 4, ZhengHua Tan 2
2 Classification examples Handwritten Digit Recognition It s not easy to recognize speech. It s not easy to wreck a nice beach. Programming Social Robots 4, ZhengHua Tan 3 Regression example Polynomial Curve Fitting from Bishop Programming Social Robots 4, ZhengHua Tan 4
3 Density estimation examples from Bishop Programming Social Robots 4, ZhengHua Tan 5 General information References Pattern Recognition and Machine Learning by Bishop Introduction to Machine Learning by Alpaydin For more resources, refer to Machine_learning_resources.htm Programming Social Robots 4, ZhengHua Tan 6
4 Lecture outline Introduction Machine learning Concepts, supervised learning, unsupervised learning Memorybased learning Modelbased learning Programming Social Robots 4, ZhengHua Tan 7 What is machine learning? Machine: computing device. Learning is acquiring and improving performance through experience. is the acquisition and development of memories and behaviors, including skills, knowledge, understanding, values, and wisdom. Machine learning is programming computers to optimize a performance criterion using example data or past experience. is concerned with the design and development of algorithms and techniques that allow computers to learn from examples or experiences. Programming Social Robots 4, ZhengHua Tan 8
5 Machine learning s WHs When: We want computers to learn when it is too difficult or too expensive to program them directly to perform a task (e.g., spam filtering). human expertise does not exist (e.g., navigating on Mars), humans are unable to explain their expertise (e.g., speech recognition) Solution changes in time (routing on a computer network) What: Get the computer to learn density, discriminant or regression functions by showing examples of inputs (and outputs). How: We write a parameterized program, and let the learning algorithm find the set of parameters that best approximates the desired function or behavior. Programming Social Robots 4, ZhengHua Tan 9 Why study machine learning? Build intelligent computer systems that acquire or improve knowledge from examples adapt to users, customize and be contextaware discover patterns in large databases (data mining) Timing is good ubiquitous computing: computers are cheap, powerful and everywhere progresses in algorithm and theory development abundant data Study is needed develop new algorithms, and understand which algorithms should be applied in which circumstances, primarily aiming at good generalization performance on unseen test data Programming Social Robots 4, ZhengHua Tan 10
6 Related subjects and applications Statistics: statistical estimation targets the same problem as machine learning and most learning algorithms are statistical in nature. Pattern Recognition is when the output of the learning machine is a set of discrete categories. Data Mining is when machine learning is applied to a large database. Applications: speech recognition, handwriting recognition, bioinformatics, adaptive control, natural language processing, web search and text classification, fraud detection, timeseries prediction, etc. Programming Social Robots 4, ZhengHua Tan 11 Types of machine learning Supervised learning: given inputs along with corresponding outputs, find the correct outputs for test inputs Classification: 1ofN discrete output (pattern recognition) Regression: realvalued output (prediction) Unsupervised learning: given only inputs without outputs as training, find structure in the space density estimation clustering dimensionality reduction Reinforcement learning: given inputs from the environment, take actions that affect the environment and produce action sequences that maximize the expected scalar reward or punishment. This is similar to animal learning. Programming Social Robots 4, ZhengHua Tan 12
7 Supervised learning {input, output} Classification: assign each input to one of a finite number of discrete categories. Learn a decision boundary that separates one class from the other. Two separate stages: Inference stage: use a training data to learn a model for p(c k x), being either probabilistic generative or discriminative model. Decision stage: use these posterior probabilities to make optimal class assignments. Alternatively, we can solve both problems together and simply learn a discriminant function that maps inputs x directly into decisions. Regression: the desired output consists of one or more continuous variables. Learn a continuous inputoutput mapping from a limited number of examples. Regression is also known as curve fitting or function approximation. Programming Social Robots 4, ZhengHua Tan 13 Supervised learning {input, output} How to represent the inputs and outputs How to select a both powerful and searchable hypothesis space to represent the relationship between inputs and outputs Programming Social Robots 4, ZhengHua Tan 14
8 Unsupervised learning {input} Discover the unknown structure of the inputs. density estimation: determine the probability density distribution of data within the input space, e.g. knn, histogram, kernel. clustering: discover groups of similar examples (clumps) within the data, e.g., kmeans, EM. Dimensionality reduction: project the data from a highdimensional space down to low dimensions. Compression/quantization: discover a function that for each input computes a compact code from which the input can be reconstructed (clustering). Association E.g., in retail, from customer transactions to consumer behavior: people who bought A also bought B. Programming Social Robots 4, ZhengHua Tan 15 Introduction Machine learning Memorybased learning Modelbased learning Lecture outline Programming Social Robots 4, ZhengHua Tan 16
9 Learning is more than memorization Constructing a lookup table is easy Simply store all the inputs and their corresponding outputs in the training data. For a new input, compare it to all the samples and produce the output associated with the matching prototype. Problem In general, new inputs are different from training prototypes. The key of learning is generalization: the ability to produce correct outputs or behavior on previously unseen inputs. Programming Social Robots 4, ZhengHua Tan 17 Memory based learning: a simple trick Compute the distances between the input and all the stored prototypes, instead of identity requirement. 1nearest neighbor search: choose the class of the nearest prototype. Knearest neighbor search: choose the class that has the majority among the K nearest prototypes. so called lazy learning, memory based learning, or instancebased learning ; similar to case based reasoning. Challenges What is the right similarity measure? High computational intensity for large number of prototypes The curse of dimensionality and data sparsity. Programming Social Robots 4, ZhengHua Tan 18
10 Lecture outline Introduction Machine learning Memorybased learning Modelbased learning Overfitting, biasvariance tradeoff Programming Social Robots 4, ZhengHua Tan 19 Model based learning Build a model that is a good, useful approximation to the data, or construct a general, explicit description of the target function linear vs nonlinear parametric vs nonparametric Discard learning examples when they are processed efficient computationally efficient in memory use. It is limited by the used learning bias  a coarse approximation of the target function. Programming Social Robots 4, ZhengHua Tan 20
11 Linear classifier  two classes g T ( x) = w x + w0 ( x) C1 if g > 0 choose C2 otherwise from Alpaydin Programming Social Robots 4, ZhengHua Tan 21 Regression  polynomial curve fitting, again! from Bishop Programming Social Robots 4, ZhengHua Tan 22
12 Sumofsquares error function from Bishop Programming Social Robots 4, ZhengHua Tan 23 Polynomials model selection excessively tuned to the random noise! Programming Social Robots 4, ZhengHua Tan 24
13 Overfitting from Bishop The need for a separate validation (or holdout) set for model selection. RootMeanSquare (RMS) Error: Programming Social Robots 4, ZhengHua Tan 25 Polynomial coefficients various order Programming Social Robots 4, ZhengHua Tan 26
14 Regularization Penalize large coefficient values from Bishop Programming Social Robots 4, ZhengHua Tan 27 Regularization: vs. from Bishop Programming Social Robots 4, ZhengHua Tan 28
15 Polynomial coefficients various λ 9 th Order Polynomial Programming Social Robots 4, ZhengHua Tan 29 Data set size 9 th Order Polynomial N = 10 For a given model complexity, the overfitting problem become less severe as the size of the data set increases. Programming Social Robots 4, ZhengHua Tan 30
16 Number of data sets 100 data sets; training multiple polynomials and then averaging them, the contribution from the variance term tended to cancel, leading to improved predictions. The dependence of bias and variance on model complexity variance bias Programming Social Robots 4, ZhengHua Tan 31 Biasvariance tradeoff There is a tradeoff between bias and variance, with very flexible models having low bias and high variance, and relatively rigid models having high bias and low variance. Mean square error of the estimator d for unknown parameter θ : r (d,θ) = E [(d θ) 2 ] = (E [d] θ) 2 + E [(d E [d]) 2 ] = Bias 2 + Variance Programming Social Robots 4, ZhengHua Tan 32
17 Beating the biasvariance tradeoff We can reduce the variance by averaging lots of models trained on different datasets. This seems silly. If we had lots of different datasets it would be better to combine them into one big training set. (With more training data there will be much less variance.) Weird idea: We can create different datasets by bootstrap sampling of our single training dataset. This is called bagging and it works surprisingly well. But if we have enough computation its better to do the right Bayesian thing: Combine the predictions of many models using the posterior probability of each parameter vector as the combination weight. Programming Social Robots 4, ZhengHua Tan 33 Overfitting a still unsolved problem! from Bishop The least squares approach to finding the model parameters resorts to intuition and represents a specific case of maximum likelihood, and that the overfitting problem can be understood as a general property of ML. More principled approach  probability theory, foundation for machine learning. Programming Social Robots 4, ZhengHua Tan 34
18 Lecture outline Introduction Machine learning Concepts, supervised learning, unsupervised learning Memorybased learning Modelbased learning Overfitting, biasvariance tradeoff Programming Social Robots 4, ZhengHua Tan 35 Course outline 1. Introduction to Robot Operating System (ROS) 2. Introduction to isociobot and NAO robot, and demos 3. Social Robots and Applications 4. Machine Learning and Pattern Recognition 5. Speech Processing I: Acquisition of Speech, Feature Extraction and Speaker Localization 6. Speech Processing II: Speaker Identification and Speech Recognition 7. Image Processing I: Image Acquisition, Preprocessing and Feature Extraction 8. Image Processing II: Face Detection and Face Recognition 9. User Modelling 10. Multimodal HumanRobot Interaction Programming Social Robots 4, ZhengHua Tan 36
M. R. Ahmadzadeh Isfahan University of Technology. M. R. Ahmadzadeh Isfahan University of Technology
1 2 M. R. Ahmadzadeh Isfahan University of Technology Ahmadzadeh@cc.iut.ac.ir M. R. Ahmadzadeh Isfahan University of Technology Textbooks 3 Introduction to Machine Learning  Ethem Alpaydin Pattern Recognition
More informationCS545 Machine Learning
Machine learning and related fields CS545 Machine Learning Course Introduction Machine learning: the construction and study of systems that learn from data. Pattern recognition: the same field, different
More informationPattern Classification and Clustering Spring 2006
Pattern Classification and Clustering Time: Spring 2006 Room: Instructor: Yingen Xiong Office: 621 McBryde Office Hours: Phone: 2314212 Email: yxiong@cs.vt.edu URL: http://www.cs.vt.edu/~yxiong/pcc/ Detailed
More informationECE271A Statistical Learning I
ECE271A Statistical Learning I Nuno Vasconcelos ECE Department, UCSD The course the course is an introductory level course in statistical learning by introductory I mean that you will not need any previous
More informationLecture 1: Machine Learning Basics
1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3
More informationPython Machine Learning
Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled
More informationLecture 1. Introduction Bastian Leibe Visual Computing Institute RWTH Aachen University
Advanced Machine Learning Lecture 1 Introduction 20.10.2015 Bastian Leibe Visual Computing Institute RWTH Aachen University http://www.vision.rwthaachen.de/ leibe@vision.rwthaachen.de Organization Lecturer
More informationLecture 1: Introduc4on
CSC2515 Spring 2014 Introduc4on to Machine Learning Lecture 1: Introduc4on All lecture slides will be available as.pdf on the course website: http://www.cs.toronto.edu/~urtasun/courses/csc2515/csc2515_winter15.html
More information36350: Data Mining. Fall Lectures: Monday, Wednesday and Friday, 10:30 11:20, Porter Hall 226B
36350: Data Mining Fall 2009 Instructor: Cosma Shalizi, Statistics Dept., Baker Hall 229C, cshalizi@stat.cmu.edu Teaching Assistant: Joseph Richards, jwrichar@stat.cmu.edu Lectures: Monday, Wednesday
More informationIntroduction to Pattern Recognition
Introduction to Pattern Recognition Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2017 CS 551, Fall 2017 c 2017, Selim Aksoy (Bilkent University)
More information10702: Statistical Machine Learning
10702: Statistical Machine Learning Syllabus, Spring 2010 http://www.cs.cmu.edu/~10702 Statistical Machine Learning is a second graduate level course in machine learning, assuming students have taken
More informationMachine Learning. Nate Derbinsky Assistant Professor Computer Science and Networking
Nate Derbinsky Assistant Professor Computer Science and Networking 1 Founded a computer consulting business in high school About Me PhD from University of Michigan (Go Blue!) Imagineer with Disney Research,
More informationCSC 411 MACHINE LEARNING and DATA MINING
CSC 411 MACHINE LEARNING and DATA MINING Lectures: Monday, Wednesday 121 (section 1), 34 (section 2) Lecture Room: MP 134 (section 1); Bahen 1200 (section 2) Instructor (section 1): Richard Zemel Instructor
More informationINTRODUCTION TO DATA SCIENCE
DATA11001 INTRODUCTION TO DATA SCIENCE EPISODE 6: MACHINE LEARNING TODAY S MENU 1. WHAT IS ML? 2. CLASSIFICATION AND REGRESSSION 3. EVALUATING PERFORMANCE & OVERFITTING WHAT IS MACHINE LEARNING? Definition:
More informationIndepth: Deep learning (one lecture) Applied to both SL and RL above Code examples
Introduction to machine learning (two lectures) Supervised learning Reinforcement learning (lab) Indepth: Deep learning (one lecture) Applied to both SL and RL above Code examples 20170930 2 1 To enable
More informationCS540 Machine learning Lecture 1 Introduction
CS540 Machine learning Lecture 1 Introduction Administrivia Overview Supervised learning Unsupervised learning Other kinds of learning Outline Administrivia Class web page www.cs.ubc.ca/~murphyk/teaching/cs540fall08
More informationCPSC 340: Machine Learning and Data Mining. Course Review/Preview Fall 2015
CPSC 340: Machine Learning and Data Mining Course Review/Preview Fall 2015 Admin Assignment 6 due now. We will have office hours as usual next week. Final exam details: December 15: 8:3011 (WESB 100).
More informationSession 1: Gesture Recognition & Machine Learning Fundamentals
IAP Gesture Recognition Workshop Session 1: Gesture Recognition & Machine Learning Fundamentals Nicholas Gillian Responsive Environments, MIT Media Lab Tuesday 8th January, 2013 My Research My Research
More informationA Few Useful Things to Know about Machine Learning. Pedro Domingos Department of Computer Science and Engineering University of Washington" 2012"
A Few Useful Things to Know about Machine Learning Pedro Domingos Department of Computer Science and Engineering University of Washington 2012 A Few Useful Things to Know about Machine Learning Machine
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More informationSession 4: Regularization (Chapter 7)
Session 4: Regularization (Chapter 7) Tapani Raiko Aalto University 30 September 2015 Tapani Raiko (Aalto University) Session 4: Regularization (Chapter 7) 30 September 2015 1 / 27 Table of Contents Background
More informationWord Sense Determination from Wikipedia. Data Using a Neural Net
1 Word Sense Determination from Wikipedia Data Using a Neural Net CS 297 Report Presented to Dr. Chris Pollett Department of Computer Science San Jose State University By Qiao Liu May 2017 Word Sense Determination
More informationOverview COEN 296 Topics in Computer Engineering Introduction to Pattern Recognition and Data Mining Course Goals Syllabus
Overview COEN 296 Topics in Computer Engineering to Pattern Recognition and Data Mining Instructor: Dr. Giovanni Seni G.Seni@ieee.org Department of Computer Engineering Santa Clara University Course Goals
More informationDudon Wai Georgia Institute of Technology CS 7641: Machine Learning Atlanta, GA
Adult Income and Letter Recognition  Supervised Learning Report An objective look at classifier performance for predicting adult income and Letter Recognition Dudon Wai Georgia Institute of Technology
More informationMachine Learning and Applications in Finance
Machine Learning and Applications in Finance Christian Hesse 1,2,* 1 Autobahn Equity Europe, Global Markets Equity, Deutsche Bank AG, London, UK christiana.hesse@db.com 2 Department of Computer Science,
More informationT Machine Learning: Advanced Probablistic Methods
T61.5140 Machine Learning: Advanced Probablistic Methods Jaakko Hollmén Department of Information and Computer Science Helsinki University of Technology, Finland email: Jaakko.Hollmen@tkk.fi Web: http://www.cis.hut.fi/opinnot/t61.5140/
More informationCSE 546 Machine Learning
CSE 546 Machine Learning Instructor: Luke Zettlemoyer TA: Lydia Chilton Slides adapted from Pedro Domingos and Carlos Guestrin Logistics Instructor: Luke Zettlemoyer Email: lsz@cs Office: CSE 658 Office
More information10701: Intro to Machine Learning. Instructors: Pradeep Ravikumar, Manuela Veloso, Teaching Assistants:
10701: Intro to Machine Instructors: Pradeep Ravikumar, pradeepr@cs.cmu.edu Manuela Veloso, mmv@cs.cmu.edu Teaching Assistants: Shaojie Bai shaojieb@andrew.cmu.edu Adarsh Prasad adarshp@andrew.cmu.edu
More informationMachine Learning Tom M. Mitchell Machine Learning Department Carnegie Mellon University. January 11, 2011
Machine Learning 10701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 11, 2011 Today: What is machine learning? Decision tree learning Course logistics Readings: The Discipline
More informationCSC 411: Lecture 01: Introduction
CSC 411: Lecture 01: Introduction Richard Zemel, Raquel Urtasun and Sanja Fidler University of Toronto Zemel, Urtasun, Fidler (UofT) CSC 411: 01Introduction 1 / 44 Today Administration details Why is
More informationMachine Learning 2nd Edition
INTRODUCTION TO Lecture Slides for Machine Learning 2nd Edition ETHEM ALPAYDIN, modified by Leonardo Bobadilla and some parts from http://www.cs.tau.ac.il/~apartzin/machinelearning/ The MIT Press, 2010
More informationCrossDomain Video Concept Detection Using Adaptive SVMs
CrossDomain Video Concept Detection Using Adaptive SVMs AUTHORS: JUN YANG, RONG YAN, ALEXANDER G. HAUPTMANN PRESENTATION: JESSE DAVIS CS 3710 VISUAL RECOGNITION ProblemIdeaChallenges Address accuracy
More informationCOMP 551 Applied Machine Learning Lecture 6: Performance evaluation. Model assessment and selection.
COMP 551 Applied Machine Learning Lecture 6: Performance evaluation. Model assessment and selection. Instructor: Herke van Hoof (herke.vanhoof@mail.mcgill.ca) Slides mostly by: Class web page: www.cs.mcgill.ca/~hvanho2/comp551
More informationP(A, B) = P(A B) = P(A) + P(B)  P(A B)
AND Probability P(A, B) = P(A B) = P(A) + P(B)  P(A B) P(A B) = P(A) + P(B)  P(A B) Area = Probability of Event AND Probability P(A, B) = P(A B) = P(A) + P(B)  P(A B) If, and only if, A and B are independent,
More informationBig Data Analytics Clustering and Classification
E6893 Big Data Analytics Lecture 4: Big Data Analytics Clustering and Classification ChingYung Lin, Ph.D. Adjunct Professor, Dept. of Electrical Engineering and Computer Science September 28th, 2017 1
More informationL16: Speaker recognition
L16: Speaker recognition Introduction Measurement of speaker characteristics Construction of speaker models Decision and performance Applications [This lecture is based on Rosenberg et al., 2008, in Benesty
More informationPerformance Analysis of Various Data Mining Techniques on Banknote Authentication
International Journal of Engineering Science Invention ISSN (Online): 2319 6734, ISSN (Print): 2319 6726 Volume 5 Issue 2 February 2016 PP.6271 Performance Analysis of Various Data Mining Techniques on
More informationCOMP 551 Applied Machine Learning Lecture 6: Performance evaluation. Model assessment and selection.
COMP 551 Applied Machine Learning Lecture 6: Performance evaluation. Model assessment and selection. Instructor: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/comp551 Unless otherwise
More informationIntroduction to Classification
Introduction to Classification Classification: Definition Given a collection of examples (training set ) Each example is represented by a set of features, sometimes called attributes Each example is to
More informationPredicting Student Performance by Using Data Mining Methods for Classification
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 13, No 1 Sofia 2013 Print ISSN: 13119702; Online ISSN: 13144081 DOI: 10.2478/cait20130006 Predicting Student Performance
More informationMachine Learning for NLP
Natural Language Processing SoSe 2014 Machine Learning for NLP Dr. Mariana Neves April 30th, 2014 (based on the slides of Dr. Saeedeh Momtazi) Introduction Field of study that gives computers the ability
More informationAssignment 1: Predicting Amazon Review Ratings
Assignment 1: Predicting Amazon Review Ratings 1 Dataset Analysis Richard Park r2park@acsmail.ucsd.edu February 23, 2015 The dataset selected for this assignment comes from the set of Amazon reviews for
More information18 LEARNING FROM EXAMPLES
18 LEARNING FROM EXAMPLES An intelligent agent may have to learn, for instance, the following components: A direct mapping from conditions on the current state to actions A means to infer relevant properties
More informationAdvanced Probabilistic Binary Decision Tree Using SVM for large class problem
Advanced Probabilistic Binary Decision Tree Using for large class problem Anita Meshram 1 Roopam Gupta 2 and Sanjeev Sharma 3 1 School of Information Technology, UTD, RGPV, Bhopal, M.P., India. 2 Information
More informationStatistics and Machine Learning, Master s Programme
DNR LIU201702005 1(9) Statistics and Machine Learning, Master s Programme 120 credits Statistics and Machine Learning, Master s Programme F7MSL Valid from: 2018 Autumn semester Determined by Board of
More informationUnsupervised Learning
17s1: COMP9417 Machine Learning and Data Mining Unsupervised Learning May 2, 2017 Acknowledgement: Material derived from slides for the book Machine Learning, Tom M. Mitchell, McGrawHill, 1997 http://www2.cs.cmu.edu/~tom/mlbook.html
More informationClassification with Deep Belief Networks. HussamHebbo Jae Won Kim
Classification with Deep Belief Networks HussamHebbo Jae Won Kim Table of Contents Introduction... 3 Neural Networks... 3 Perceptron... 3 Backpropagation... 4 Deep Belief Networks (RBM, Sigmoid Belief
More informationLinear Regression. Chapter Introduction
Chapter 9 Linear Regression 9.1 Introduction In this class, we have looked at a variety of di erent models and learning methods, such as finite state machines, sequence models, and classification methods.
More informationOnline recognition of handwritten characters
Chapter 8 Online recognition of handwritten characters Vuokko Vuori, Matti Aksela, Ramūnas Girdziušas, Jorma Laaksonen, Erkki Oja 105 106 Online recognition of handwritten characters 8.1 Introduction
More informationMachine Learning and Pattern Recognition Introduction
Machine Learning and Pattern Recognition Introduction Giovanni Maria Farinella gfarinella@dmi.unict.it www.dmi.unict.it/farinella What is ML & PR? Interdisciplinary field focusing on both the mathematical
More informationMachine Learning in Patent Analytics:: Binary Classification for Prioritizing Search Results
Machine Learning in Patent Analytics:: Binary Classification for Prioritizing Search Results Anthony Trippe Managing Director, Patinformatics, LLC Patent Information Fair & Conference November 10, 2017
More information(Sub)Gradient Descent
(Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include
More informationIt s a Machine World. Predictive Analytics with Machine Learning
It s a Machine World Predictive Analytics with Machine Learning Greg Deckler gdeckler@fusionalliance.com @GregDeckler It s a Machine World Predictive Analytics with Machine Learning Greg Deckler gdeckler@fusionalliance.com
More informationCOLLEGE OF SCIENCE. School of Mathematical Sciences. NEW (or REVISED) COURSE: COSSTAT747 Principles of Statistical Data Mining.
ROCHESTER INSTITUTE OF TECHNOLOGY COURSE OUTLINE FORM COLLEGE OF SCIENCE School of Mathematical Sciences NEW (or REVISED) COURSE: COSSTAT747 Principles of Statistical Data Mining 1.0 Course Designations
More informationA survey of robot learning from demonstration
A survey of robot learning from demonstration Brenna D. Argall, Sonia Chernova, Manuela Veloso, Brett Browning Presented by Aalhad Patankar Overview of learning from demonstration (LfD) Learning from Demonstration:
More informationIntroduction to Machine Learning for NLP I
Introduction to Machine Learning for NLP I Benjamin Roth CIS LMU München Benjamin Roth (CIS LMU München) Introduction to Machine Learning for NLP I 1 / 49 Outline 1 This Course 2 Overview 3 Machine Learning
More informationA study of the NIPS feature selection challenge
A study of the NIPS feature selection challenge Nicholas Johnson November 29, 2009 Abstract The 2003 Nips Feature extraction challenge was dominated by Bayesian approaches developed by the team of Radford
More informationLecture 5: 21 September 2016 Intro to machine learning and singlelayer neural networks. Jim Tørresen This Lecture
This Lecture INF3490  Biologically inspired computing Lecture 5: 21 September 2016 Intro to machine learning and singlelayer neural networks Jim Tørresen 1. Introduction to learning/classification 2.
More informationIntroduction to Machine Learning
1, DATA11002 Introduction to Machine Learning Lecturer: Teemu Roos TAs: Ville Hyvönen and Janne Leppäaho Department of Computer Science University of Helsinki (based in part on material by Patrik Hoyer
More informationAbout This Specialization
About This Specialization The 5 courses in this University of Michigan specialization introduce learners to data science through the python programming language. This skillsbased specialization is intended
More informationWhen Dictionary Learning Meets Classification
When Dictionary Learning Meets Classification Bufford, Teresa Chen, Yuxin Horning, Mitchell Shee, Liberty Supervised by: Prof. Yohann Tero August 9, 213 Abstract This report details and exts the implementation
More informationFILTER BANK FEATURE EXTRACTION FOR GAUSSIAN MIXTURE MODEL SPEAKER RECOGNITION
FILTER BANK FEATURE EXTRACTION FOR GAUSSIAN MIXTURE MODEL SPEAKER RECOGNITION James H. Nealand, Alan B. Bradley, & Margaret Lech School of Electrical and Computer Systems Engineering, RMIT University,
More information10701/15781 Machine Learning, Spring 2005: Homework 1
10701/15781 Machine Learning, Spring 2005: Homework 1 Due: Monday, February 6, beginning of the class 1 [15 Points] Probability and Regression [Stano] 1 1.1 [10 Points] The Matrix Strikes Back The Matrix
More informationBGS Training Requirement in Statistics
BGS Training Requirement in Statistics All BGS students are required to have an understanding of statistical methods and their application to biomedical research. Most students take BIOM611, Statistical
More informationCSL465/603  Machine Learning
CSL465/603  Machine Learning Fall 2016 Narayanan C Krishnan ckn@iitrpr.ac.in Introduction CSL465/603  Machine Learning 1 Administrative Trivia Course Structure 302 Lecture Timings Monday 9.5510.45am
More informationMachine Learning. Basic Concepts. Joakim Nivre. Machine Learning 1(24)
Machine Learning Basic Concepts Joakim Nivre Uppsala University and Växjö University, Sweden Email: nivre@msi.vxu.se Machine Learning 1(24) Machine Learning Idea: Synthesize computer programs by learning
More informationProbabilistic Latent Semantic Analysis
Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview
More informationExploration vs. Exploitation. CS 473: Artificial Intelligence Reinforcement Learning II. How to Explore? Exploration Functions
CS 473: Artificial Intelligence Reinforcement Learning II Exploration vs. Exploitation Dieter Fox / University of Washington [Most slides were taken from Dan Klein and Pieter Abbeel / CS188 Intro to AI
More informationIntroduction to Classification, aka Machine Learning
Introduction to Classification, aka Machine Learning Classification: Definition Given a collection of examples (training set ) Each example is represented by a set of features, sometimes called attributes
More informationHAMLET JERRY ZHU UNIVERSITY OF WISCONSIN
HAMLET JERRY ZHU UNIVERSITY OF WISCONSIN Collaborators: Rui Castro, Michael Coen, Ricki Colman, Charles Kalish, Joseph Kemnitz, Robert Nowak, Ruichen Qian, Shelley Prudom, Timothy Rogers Somewhere, something
More informationThe Health Economics and Outcomes Research Applications and Valuation of Digital Health Technologies and Machine Learning
The Health Economics and Outcomes Research Applications and Valuation of Digital Health Technologies and Machine Learning Workshop W29  Session V 3:00 4:00pm May 25, 2016 ISPOR 21 st Annual International
More informationLECTURE #1 SEPTEMBER 25, 2015
RATIONALITY, HEURISTICS, AND THE COST OF COMPUTATION CSML Talks LECTURE #1 SEPTEMBER 25, 2015 LECTURER: TOM GRIFFITHS (PSYCHOLOGY DEPT., U.C. BERKELEY) SCRIBE: KIRAN VODRAHALLI Contents 1 Introduction
More informationSyllabus Data Mining for Business Analytics  Managerial INFOGB.3336, Spring 2018
Syllabus Data Mining for Business Analytics  Managerial INFOGB.3336, Spring 2018 Course information When: Mondays and Wednesdays 34:20pm Where: KMEC 365 Professor Manuel Arriaga Email: marriaga@stern.nyu.edu
More informationMusic Genre Classification Using MFCC, KNN and SVM Classifier
Volume 4, Issue 2, February2017, pp. 4347 ISSN (O): 23497084 International Journal of Computer Engineering In Research Trends Available online at: www.ijcert.org Music Genre Classification Using MFCC,
More informationLearning Agents: Introduction
Learning Agents: Introduction S Luz luzs@cs.tcd.ie October 28, 2014 Learning in agent architectures Agent Learning in agent architectures Agent Learning in agent architectures Agent perception Learning
More informationCS Machine Learning
CS 478  Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing
More informationTowards ParameterFree Classification of Sound Effects in Movies
Towards ParameterFree Classification of Sound Effects in Movies Selina Chu, Shrikanth Narayanan *, C.C Jay Kuo * Department of Computer Science * Department of Electrical Engineering University of Southern
More informationClassification of Arrhythmia Using Machine Learning Techniques
Classification of Arrhythmia Using Machine Learning Techniques THARA SOMAN PATRICK O. BOBBIE School of Computing and Software Engineering Southern Polytechnic State University (SPSU) 1 S. Marietta Parkway,
More informationECE 5424: Introduction to Machine Learning
ECE 5424: Introduction to Machine Learning Topics: Classification: Naïve Bayes Readings: Barber 10.110.3 Stefan Lee Virginia Tech Administrativia HW2 Due: Friday 09/28, 10/3, 11:55pm Implement linear
More informationFeature extraction using Latent Dirichlet Allocation and Neural Networks: A case study on movie synopses
Feature extraction using Latent Dirichlet Allocation and Neural Networks: A case study on movie synopses Despoina I. Christou Department of Applied Informatics University of Macedonia Dissertation submitted
More informationLinear Models Continued: Perceptron & Logistic Regression
Linear Models Continued: Perceptron & Logistic Regression CMSC 723 / LING 723 / INST 725 Marine Carpuat Slides credit: Graham Neubig, Jacob Eisenstein Linear Models for Classification Feature function
More informationMachine Learning for SAS Programmers
Machine Learning for SAS Programmers The Agenda Introduction of Machine Learning Supervised and Unsupervised Machine Learning Deep Neural Network Machine Learning implementation Questions and Discussion
More informationArtificial Neural Networks in Data Mining
IOSR Journal of Computer Engineering (IOSRJCE) eissn: 22780661,pISSN: 22788727, Volume 18, Issue 6, Ver. III (Nov.Dec. 2016), PP 5559 www.iosrjournals.org Artificial Neural Networks in Data Mining
More informationA Combination of Decision Trees and InstanceBased Learning Master s Scholarly Paper Peter Fontana,
A Combination of Decision s and InstanceBased Learning Master s Scholarly Paper Peter Fontana, pfontana@cs.umd.edu March 21, 2008 Abstract People are interested in developing a machine learning algorithm
More informationStudies in Deep Belief Networks
Studies in Deep Belief Networks Jiquan Ngiam jngiam@cs.stanford.edu Chris Baldassano chrisb33@cs.stanford.edu Abstract Deep networks are able to learn good representations of unlabelled data via a greedy
More informationSTID Statistics and Business Intelligence
STID Statistics and Business Intelligence IUT Roubaix Lille 2 University France Sylvia CANONNE Description of teaching modules. September 2014 3 Course descriptions subject to change Term 1 M1101A Mathematics
More informationLearning. Part 6 in Russell / Norvig Book
Wisdom is not the product of schooling but the lifelong attempt to acquire it.  Albert Einstein Learning Part 6 in Russell / Norvig Book Gerhard Fischer AI Course, Fall 1996, Lecture October 14 1 Overview
More informationLearning From the Past with Experiment Databases
Learning From the Past with Experiment Databases Joaquin Vanschoren 1, Bernhard Pfahringer 2, and Geoff Holmes 2 1 Computer Science Dept., K.U.Leuven, Leuven, Belgium 2 Computer Science Dept., University
More informationReinforcement Learning
Reinforcement Learning based Dialog Manager Speech Group Department of Signal Processing and Acoustics Katri Leino User Interface Group Department of Communications and Networking Aalto University, School
More informationAn Educational Data Mining System for Advising Higher Education Students
An Educational Data Mining System for Advising Higher Education Students Heba Mohammed Nagy, Walid Mohamed Aly, Osama Fathy Hegazy Abstract Educational data mining is a specific data mining field applied
More informationA Characterization of Prediction Errors
A Characterization of Prediction Errors Christopher Meek Microsoft Research One Microsoft Way Redmond, WA 98052 Abstract Understanding prediction errors and determining how to fix them is critical to building
More informationMD  Data Mining
Coordinating unit: Teaching unit: Academic year: Degree: ECTS credits: 017 70  FIB  Barcelona School of Informatics 715  EIO  Department of Statistics and Operations Research 73  CS  Department of
More informationMachine Learning with MATLAB Antti Löytynoja Application Engineer
Machine Learning with MATLAB Antti Löytynoja Application Engineer 2014 The MathWorks, Inc. 1 Goals Overview of machine learning Machine learning models & techniques available in MATLAB MATLAB as an interactive
More information Introduzione al Corso  (a.a )
Short Course on Machine Learning for Web Mining  Introduzione al Corso  (a.a. 20092010) Roberto Basili (University of Roma, Tor Vergata) 1 Overview MLxWM: Motivations and perspectives A temptative syllabus
More informationMachine Learning with Weka
Machine Learning with Weka SLIDES BY (TOTAL 5 Session of 1.5 Hours Each) ANJALI GOYAL & ASHISH SUREKA (www.ashishsureka.in) CS 309 INFORMATION RETRIEVAL COURSE ASHOKA UNIVERSITY NOTE: Slides created and
More informationAzure Machine Learning. Designing Iris MultiClass Classifier
Media Partners Azure Machine Learning Designing Iris MultiClass Classifier Marcin Szeliga 20 years of experience with SQL Server Trainer & data platform architect Books & articles writer Speaker at numerous
More informationCS 445/545 Machine Learning Winter, 2017
CS 445/545 Machine Learning Winter, 2017 See syllabus at http://web.cecs.pdx.edu/~mm/machinelearningwinter2017/ Lecture slides will be posted on this website before each class. What is machine learning?
More informationDATA SCIENCE CURRICULUM
DATA SCIENCE CURRICULUM Immersive program covers all the necessary tools and concepts used by data scientists in the industry, including machine learning, statistical inference, and working with data at
More informationLecture 1: Basic Concepts of Machine Learning
Lecture 1: Basic Concepts of Machine Learning Cognitive Systems  Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010
More information