Artificial Intelligence Introduction to Machine Learning

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Artificial Intelligence Introduction to Machine Learning"

Transcription

1 Artificial Intelligence Introduction to Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee

2 Introduction Applications which Machine Learning techniques play an important role: Face Recognition Dimensionality Reduction is additionally used for finding important features Face Detection Facial Age Estimation Face recognition Facial age estimation Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 2

3 Introduction Adaboost structure One of the most popular Machine Learning algorithm for applications with high-variety Good for reducing Detection Time while maintaining Detection Accuracy Often used for Automatic face focusing in Digital Cameras Automatic face focusing Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 3

4 Introduction Adaboost structure (Facial Age Estimation) Extracting important features those are difficult to be found by Human Building a Model or Property to be learned that maps the facial features to Predicted age Providing theoretical analysis and practical guidelines Extracted features A Model built by Adaboost Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 4

5 Introduction This is Bigdata era Fast development of technology Burst usage of Internet Lots of Image Sources (Examples) User-created Contents Flickr, Facebook, and YouTube Online source of Images and Texts Explosion of User-created content Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 5

6 Introduction Power of Machine Learning will be increased because Large amount of accessible data means Large amount of examples for training Large amount of examples for training means Higher chance of accurate learning Higher chance of accurate learning means Valuable but undiscovered knowledge is found Improving utility of Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 6

7 What is Machine Learning? What is Machine Learning? Difficult to define precisely because it covers a broad range of processes Modification of a behavioral tendency by experience Modification of Behavior by Experience (Data) Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 7

8 What is Machine Learning? What is Machine Learning? Difficult to define precisely because it covers a broad range of processes Modification of a behavioral tendency by experience Optimizing a performance criterion using example data and past experience Optimizing a performance with regard to a criterion Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 8

9 What is Machine Learning? Machine Learning Changes in systems for AI tasks: Recognition Diagnosis Planning Robot control Prediction A constant program can never be changed with regard to its environment! Relation to AI Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 9

10 What is Machine Learning? AI agent Perceives and models its environment Computes proper Actions considering consequences Agent may change its internal process or component according to Perceives and Actions It is regard as a sort of Learning AI agent Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 10

11 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Programming (Designing) versus Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 11

12 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule What is the underlying rule? Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 12

13 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Guessing the rule based on a large number of examples Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 13

14 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Extracting hidden relationship Extracting underlying mapping relationship Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 14

15 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Extracting hidden relationship Adapting unknown environment Navigation in unknown environment Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 15

16 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Extracting hidden relationship Adapting unknown environment Too many examples are given Big Data Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 16

17 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Extracting hidden relationship Adapting unknown environment Too many examples are given Dynamic environment Dynamic environment: Weather forecasting Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 17

18 Relationships with Other Disciplines Machine Learning unifies several disciplines Relation to other disciplines Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 18

19 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Guessing unknown probability distribution Making decisions based on estimated new samples Machine Learning versus Statistics Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 19

20 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Simplified models of biological neurons Approximating the learning phenomena Popular example: Artificial Neural Network Brain modeling Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 20

21 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Controlling a processing having parameters that must be estimated during operation Popular example: Robot Task-adaptive Robotic Arm Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 21

22 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Studying the performance of living organism in various learning tasks Popular example: Reinforcement Learning Reinforcement Learning Procedure Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 22

23 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Evolutionary Models Mimic the evolution of species Adaptation of Finch w.r.t. its environment or behavior Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 23

24 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Evolutionary Models Mimic the evolution of species Popular example: Genetic Algorithm Genetic Algorithm Procedure Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 24

25 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Evolutionary Models Modeling and Optimization How to model the separating boundary and optimize the performance Class separation Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 25

26 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Evolutionary Models Modeling and Optimization Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 26

27 Universal Dataset Universal set Containing all the possible data pairs There is a unknown probability distribution Universal set Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 27

28 Universal Dataset Universal set Containing all the possible data pairs There is a unknown probability distribution Training set Only a subset of universal set is possibly considered due to limited memory or time This subset is known as Training set Universal set Training set Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 28

29 Universal Dataset Training set Only a subset of universal set is possibly considered due to limited memory or time This subset is known as Training set Independently and Identically Distributed (i.i.d.) Validation set A subset of training set for monitoring the training process of Machine Learning algorithm Dataset Preparation Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 29

30 What Are We Looking For? Possible learned properties A line separating boundary between two groups A relation among examples Test set Unseen samples or future events A disjoint set of Training set and Validation set Used for examining performance evaluation Dataset Preparation Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 30

31 What Are We Looking For? Universal set Assumed to exist but unknown Training set A subset of Universal set that is obtained from Data acquisition stage Example of three labeled datasets: Universal, Training, and Test Set Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 31

32 What Are We Looking For? Universal set Assumed to exist but unknown Training set A subset of Universal set that is obtained from Data acquisition stage Test set A set used for examining the performance Training set Test set Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 32

33 No Free Lunch Rule Possible learned properties (Revisited) A line separating boundary between two groups A relation among examples No Free Lunch Rules Assumptions that making Machine Learning feasible Assumptions needed for both Dataset and Properties Can we expect any classification method to be superior or inferior overall? The answer is NO Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 33

34 No Free Lunch Rule Assumptions needed for Dataset Training set and Test set are come from the same distribution Assumptions needed for Properties Making assumptions on what kind of function to learn How to model the property Can we expect any classification method to be superior or inferior overall? The answer is NO Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 34

35 No Free Lunch Rule Assumptions needed for Dataset Training set and Test set are come from the same distribution Assumptions needed for Properties Making assumptions on what kind of function to learn Straight line vs. Curved line How to model the property Gaussian distribution vs. Poisson distribution Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 35

36 Learning Input-Output Functions = ( ): A short summarization of Machine Learning : Vector-valued input or Training set Ξ or h( ): Predicted output : hypothesis function between and Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 36

37 Learning Input-Output Functions = ( ): A short summarization of Machine Learning : Vector-valued input or Training set Ξ or h( ): Predicted output : hypothesis function between and H: Set of all possible hypothesis functions Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 37

38 Types of Learning Types of Machine Learning Supervised Learning Unsupervised Learning Semi-supervised Learning Reinforcement Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 38

39 Types of Learning: Supervised Learning Types of Machine Learning Supervised Learning Learning from labeled dataset Find the relationships between the Feature set and the Label set Find a hypothesis h that is mostly-agreed by members of Training set Ξ Hypothesis If it Walks/Swims/Quacks like a Duck Then It must be a Duck Features: Walks, Swims, Quacks Label: Ducks, Not ducks Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 39

40 Types of Learning: Supervised Learning Types of Machine Learning Supervised Learning Learning from labeled dataset Find the relationships between the Feature set and the Label set Find a hypothesis h that is mostly-agreed by members of Training set Ξ Regression: finding a curve that fits points Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 40

41 Types of Learning: Supervised Learning Types of Machine Learning Supervised Learning Learning from labeled dataset Find the relationships between the Feature set and the Label set Find a hypothesis h that is mostly-agreed by members of Training set Ξ Regression: finding a curve that fits points Classification: finding a discriminating vector(s) Figure (a) Figure (b) Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 41

42 Types of Learning: Unsupervised Learning Types of Machine Learning Supervised Learning Unsupervised Learning Learning from characteristics of dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 42

43 Types of Learning: Unsupervised Learning Types of Machine Learning Supervised Learning Unsupervised Learning Learning from intrinsic characteristics of dataset Popular purposes Clustering, Probability density estimation, Finding association among features, Dimensionality reduction Output can be used for other learning paradigms Figure (a) Figure (b) Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 43

44 Types of Learning: Semi-supervised Learning Types of Machine Learning Supervised Learning Unsupervised Learning Semi-supervised Learning Learning with the dataset containing both labeled and unlabeled data Figure (a) Figure (b) Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 44

45 Types of Learning: Reinforcement Learning Types of Machine Learning Supervised Learning Unsupervised Learning Semi-supervised Learning Reinforcement Learning Learning from rewards or mistakes Agent acts in an Environment Reinforcement Learning procedure Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 45

46 Input Vectors Input vectors Pattern/feature vectors, samples, examples, instances An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 46

47 Input Vectors Input vectors Pattern/feature vectors, samples, examples, instances Features: the components of the input vector Attributes, input variables, components An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 47

48 Input Vectors Input vectors Pattern/feature vectors, samples, examples, instances Features: the components of the input vector Attributes, input variables, components An instance of (class, major, sex, advisor) can be (sophomore, history, male, Higgins) An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 48

49 Input Vectors Input vectors Pattern/feature vectors, samples, examples, instances Features: the components of the input vector Attributes, input variables, components An instance of (class, major, sex, advisor) can be (sophomore, history, male, Higgins) Boolean valued-features Boolean feature (High, Normal) An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 49

50 Outputs Outputs Output value, label, class, category, decision Function estimator if output is a real number Classifier if output is a categorical value Application: hand-written character recognition Input: printed character Output: categories of hand-written character An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 50

51 Outputs Outputs Output value, label, class, category, decision Function estimator if output is a real number Classifier if output is a categorical value Vector-valued outputs If mutually exclusive then Multi-class problem If not then Multi-label problem An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 51

52 Outputs Outputs Output value, label, class, category, decision Function estimator if output is a real number Classifier if output is a categorical value Vector-valued outputs Boolean outputs True: positive instance False: negative instance An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 52

53 Outputs Outputs Output value, label, class, category, decision Function estimator if output is a real number Classifier if output is a categorical value Vector-valued outputs Boolean outputs Concept learning: Boolean input-output An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 53

54 Preprocessing Preprocessing steps for a desired Machine Learning Standard Machine Learning Procedure Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 54

55 Noise and Outliers Preprocessing steps for a desired Machine Learning Noise and Outliers Corrupted values leading to Outliers An example of outlier Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 55

56 Noise and Outliers Preprocessing steps for a desired Machine Learning Noise and Outliers Corrupted values leading to Outliers Class noise and Attribute noise Class noise vs. Attribute noise Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 56

57 Missing Value Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Adding median/mean values Deleting corresponding row Using the value from the previous row Example of missing value Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 57

58 Scaling Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Scaling Reducing values in columns into a common scale Normalization or Standardization Normalization Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 58

59 Natural Language Processing for Texts Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Scaling Natural Language Processing for Texts Encoding free texts to vectors Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 59

60 Imbalanced Datasets Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Scaling Natural Language Processing for Texts Imbalanced datasets Class distribution is skewed Scatter plot of Imbalanced dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 60

61 Imbalanced Datasets Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Scaling Natural Language Processing for Texts Imbalanced datasets Class distribution is skewed Over-/Under-sampling Synthesizing examples Over-/Under-sampling Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 61

62 Training Main step of Machine Learning Machine Learning procedures Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 62

63 Policy Main step of Machine Learning Training policy Batch method Entire Training set is available Use all at once to compute the function Batch Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 63

64 Policy Main step of Machine Learning Training policy Batch method Online method Arriving one member of Training set at a time Optimizing the function incrementally Deciding a next action based on current action Online Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 64

65 Feature Selection Main step of Machine Learning Training policy Feature selection Not all features contribute to the learning! One of Model Selection Approaches Can be used for improve the performance Curse of dimensionality Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 65

66 Evaluation Main step of Machine Learning Training policy Feature selection Evaluation Evaluating learning performance Usage of evaluation metrics Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 66

67 Evaluation Main step of Machine Learning Training policy Feature selection Evaluation Evaluating learning performance Population evaluation metric Mean-squared-error for Regression task Accuracy: the total number of errors Confusion matrix for calculating Accuracy Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 67

68 Parameter Tuning Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Controlling learning model Popular approach: Trial-and-error basis Parameter tuning based on Trial-and-error strategy Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 68

69 Overfitting (Bias) Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Overfitting Good on Training set, but poor on Test set Overfit vs. Underfit Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 69

70 Underfitting (Variance) Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Overfitting Underfitting Low performance on both sets Overfit vs. Underfit Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 70

71 Bias and Variance Trade-off Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Overfitting Underfitting Low performance on both sets Overfit vs. Underfit Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 71

72 Model Stacking Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Overfitting Underfitting Model stacking Combining multiple algorithms Example of model stacking Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 72

73 Sample Applications Sample applications based on Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 73

74 Sample Applications Sample applications based on Machine Learning Rule discovery for printing industry problem Electric power load forecasting Automatic help desk assistant 3D printing rule discovery Electric power load forecasting Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 74

75 Sample Applications Sample applications based on Machine Learning Rule discovery for printing industry problem Electric power load forecasting Automatic help desk assistant Planning and scheduling for a steel mill Stars and galaxies classification Stars and galaxies Classification Steel mill planning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 75

76 Sample Applications Successes of Machine Learning in real world Sharp s Japanese Kanji character recognition system 200 characters per second with 99% accuracy Fujitsu s continuous steel casting monitoring system Kanji character recognition Steel casting monitoring Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 76

77 Sample Applications Successes of Machine Learning in real world Sharp s Japanese Kanji character recognition system 200 characters per second with 99% accuracy Fujitsu s continuous steel casting monitoring system Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 77

Machine Learning: Preliminaries & Overview

Machine Learning: Preliminaries & Overview Machine Learning: Preliminaries & Overview Winter 2018 LOL What is machine learning? Textbook definitions of machine learning : Detecting patterns and regularities with a good and generalizable approximation

More information

The Fundamentals of Machine Learning

The Fundamentals of Machine Learning The Fundamentals of Machine Learning Willie Brink 1, Nyalleng Moorosi 2 1 Stellenbosch University, South Africa 2 Council for Scientific and Industrial Research, South Africa Deep Learning Indaba 2017

More information

Class Overview and General Introduction to Machine Learning

Class Overview and General Introduction to Machine Learning Class Overview and General Introduction to Machine Learning Piyush Rai www.cs.utah.edu/~piyush CS5350/6350: Machine Learning August 23, 2011 (CS5350/6350) Intro to ML August 23, 2011 1 / 25 What is Machine

More information

Lecture 1: Introduction to Machine Learning

Lecture 1: Introduction to Machine Learning Statistical Methods for Intelligent Information Processing (SMIIP) Lecture 1: Introduction to Machine Learning Shuigeng Zhou School of Computer Science September 13, 2017 What is machine learning? Machine

More information

CS340 Machine learning Lecture 2

CS340 Machine learning Lecture 2 CS340 Machine learning Lecture 2 What is machine learning? ``Learning denotes changes in the system that are adaptive in the sense that they enable the system to do the task or tasks drawn from the same

More information

Practical Advice for Building Machine Learning Applications

Practical Advice for Building Machine Learning Applications Practical Advice for Building Machine Learning Applications Machine Learning Fall 2017 Based on lectures and papers by Andrew Ng, Pedro Domingos, Tom Mitchell and others 1 This lecture: ML and the world

More information

Session 1: Gesture Recognition & Machine Learning Fundamentals

Session 1: Gesture Recognition & Machine Learning Fundamentals IAP Gesture Recognition Workshop Session 1: Gesture Recognition & Machine Learning Fundamentals Nicholas Gillian Responsive Environments, MIT Media Lab Tuesday 8th January, 2013 My Research My Research

More information

Introduction to Computational Linguistics

Introduction to Computational Linguistics Introduction to Computational Linguistics Olga Zamaraeva (2018) Based on Guestrin (2013) University of Washington April 10, 2018 1 / 30 This and last lecture: bird s eye view Next lecture: understand precision

More information

Programming Social Robots for Human Interaction. Lecture 4: Machine Learning and Pattern Recognition

Programming Social Robots for Human Interaction. Lecture 4: Machine Learning and Pattern Recognition Programming Social Robots for Human Interaction Lecture 4: Machine Learning and Pattern Recognition Zheng-Hua Tan Dept. of Electronic Systems, Aalborg Univ., Denmark zt@es.aau.dk, http://kom.aau.dk/~zt

More information

Statistical Pattern Recognition

Statistical Pattern Recognition Statistical Pattern Recognition A Brief Overview of the course Hamid R. Rabiee Jafar Muhammadi, Nima Pourdamghani Spring 2012 http://ce.sharif.edu/courses/90-91/2/ce725-1/ Agenda What is a Pattern? What

More information

CS534 Machine Learning

CS534 Machine Learning CS534 Machine Learning Spring 2013 Lecture 1: Introduction to ML Course logistics Reading: The discipline of Machine learning by Tom Mitchell Course Information Instructor: Dr. Xiaoli Fern Kec 3073, xfern@eecs.oregonstate.edu

More information

STA 414/2104 Statistical Methods for Machine Learning and Data Mining

STA 414/2104 Statistical Methods for Machine Learning and Data Mining STA 414/2104 Statistical Methods for Machine Learning and Data Mining Radford M. Neal, University of Toronto, 2014 Week 1 What are Machine Learning and Data Mining? Typical Machine Learning and Data Mining

More information

Machine Learning. Lecture 1: Introduction to Machine Learning. Nevin L. Zhang

Machine Learning. Lecture 1: Introduction to Machine Learning. Nevin L. Zhang Machine Learning Lecture 1: Introduction to Machine Learning Nevin L. Zhang lzhang@cse.ust.hk Department of Computer Science and Engineering The Hong Kong University of Science and Technology This set

More information

What is Machine Learning?

What is Machine Learning? What is Machine Learning? INFO-4604, Applied Machine Learning University of Colorado Boulder August 29-31, 2017 Prof. Michael Paul Definition Murphy: a set of methods that can automatically detect patterns

More information

Python Machine Learning

Python Machine Learning Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled

More information

Machine Learning - Introduction

Machine Learning - Introduction Machine Learning - Introduction CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 What is Machine Learning Quote by Tom M. Mitchell:

More information

Welcome to CMPS 142 and 242: Machine Learning

Welcome to CMPS 142 and 242: Machine Learning Welcome to CMPS 142 and 242: Machine Learning Instructor: David Helmbold, dph@soe.ucsc.edu Office hours: Monday 1:30-2:30, Thursday 4:15-5:00 TA: Aaron Michelony, amichelo@soe.ucsc.edu Web page: www.soe.ucsc.edu/classes/cmps242/fall13/01

More information

Pattern Recognition Systems

Pattern Recognition Systems Pattern Recognition Systems Dr. Shuang LIANG School of Software Engineering TongJi University Fall, 2012 Today s Topics An example Pattern recognition systems The design cycle Introduction Pattern Recognition,

More information

Machine Learning Lecture 1: Introduction

Machine Learning Lecture 1: Introduction What is? Building machines that automatically learn from experience Sub-area of artificial intelligence (Very) small sampling of applications: Lecture 1: Introduction Detection of fraudulent credit card

More information

Welcome to CMPS 142 Machine Learning

Welcome to CMPS 142 Machine Learning Welcome to CMPS 142 Machine Learning Instructor: David Helmbold, dph@soe.ucsc.edu Office hours: Tentatively after class Tu-Th 12-1:30. TA: Keshav Mathur, kemathur@ucsc.edu Web page: https://courses.soe.ucsc.edu/courses/cmps142/spring15/01

More information

Introduction. Binary Classification and Bayes Error.

Introduction. Binary Classification and Bayes Error. CIS 520: Machine Learning Spring 2018: Lecture 1 Introduction Binary Classification and Bayes Error Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture They

More information

Machine Learning Opportunities and Limitations

Machine Learning Opportunities and Limitations Machine Learning Opportunities and Limitations Holger H. Hoos LIACS Universiteit Leiden The Netherlands LCDS Conference 2017/11/28 The age of computation Clear, precise instructions flawlessly executed

More information

L1: Course introduction

L1: Course introduction Introduction Course organization Grading policy Outline What is pattern recognition? Definitions from the literature Related fields and applications L1: Course introduction Components of a pattern recognition

More information

May Masoud SAS Canada

May Masoud SAS Canada May Masoud SAS Canada #ROAD2AI #ROAD2AI Artificial Intelligence is the science of training systems to emulate human tasks through learning and automation. General Intelligence Robotics Advanced Automation

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

Applied Machine Learning

Applied Machine Learning Applied Spring 2018, CS 519 Prof. Liang Huang School of EECS Oregon State University liang.huang@oregonstate.edu is Everywhere A breakthrough in machine learning would be worth ten Microsofts (Bill Gates)

More information

Prediction of Earnings Based on Demographic and Employment Data

Prediction of Earnings Based on Demographic and Employment Data 1 Prediction of Earnings Based on Demographic and Employment Data Background I. INTRODUCTION The U.S. Department of Commerce launched Census Bureau to gather data on the country s earnings, employment

More information

Introduction to Machine Learning Prof. Sudeshna Sarkar Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur

Introduction to Machine Learning Prof. Sudeshna Sarkar Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Introduction to Machine Learning Prof. Sudeshna Sarkar Department of Computer Science and Engineering Indian Institute of Technology, Kharagpur Module - 1 Lecture - 03 Hypothesis Space and Inductive Bias

More information

18 LEARNING FROM EXAMPLES

18 LEARNING FROM EXAMPLES 18 LEARNING FROM EXAMPLES An intelligent agent may have to learn, for instance, the following components: A direct mapping from conditions on the current state to actions A means to infer relevant properties

More information

ECS171: Machine Learning

ECS171: Machine Learning ECS171: Machine Learning Lecture 1: Overview of class, LFD 1.1, 1.2 Cho-Jui Hsieh UC Davis Jan 8, 2018 Course Information Website: http://www.stat.ucdavis.edu/~chohsieh/teaching/ ECS171_Winter2018/main.html

More information

PAC Learning Introduction to Machine Learning. Matt Gormley Lecture 14 March 5, 2018

PAC Learning Introduction to Machine Learning. Matt Gormley Lecture 14 March 5, 2018 10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University PAC Learning Matt Gormley Lecture 14 March 5, 2018 1 ML Big Picture Learning Paradigms:

More information

Overview COEN 296 Topics in Computer Engineering Introduction to Pattern Recognition and Data Mining Course Goals Syllabus

Overview COEN 296 Topics in Computer Engineering Introduction to Pattern Recognition and Data Mining Course Goals Syllabus Overview COEN 296 Topics in Computer Engineering to Pattern Recognition and Data Mining Instructor: Dr. Giovanni Seni G.Seni@ieee.org Department of Computer Engineering Santa Clara University Course Goals

More information

Foundations of Machine Learning and Data Mining Rainer Marrone, Ralf Möller. Today s slides taken partly from E. ALPAYDIN

Foundations of Machine Learning and Data Mining Rainer Marrone, Ralf Möller. Today s slides taken partly from E. ALPAYDIN Foundations of Machine Learning and Data Mining Rainer Marrone, Ralf Möller Today s slides taken partly from E. ALPAYDIN 1 Lab Class and literature Thursday, 13:15 14:45, ES42 2589 Lab Class Fr 9:45-10:30,

More information

n Learning is useful as a system construction method n Examples of systems that employ ML? q Supervised learning: correct answers for each example

n Learning is useful as a system construction method n Examples of systems that employ ML? q Supervised learning: correct answers for each example Learning Learning from Data Russell and Norvig Chapter 18 Essential for agents working in unknown environments Learning is useful as a system construction method q Expose the agent to reality rather than

More information

Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology. M. Soleymani Fall 2016

Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology. M. Soleymani Fall 2016 Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2016 Course Info Instructor: Mahdieh Soleymani Email: soleymani@sharif.edu Lectures: Sun-Tue

More information

Data Mining: Practical Machine Learning Techniques

Data Mining: Practical Machine Learning Techniques Artificial Intelligence Data Mining: Practical Machine Learning Techniques Dae-Won Kim School of Computer Science & Engineering Chung-Ang University AI Scope 1. Search-based optimization techniques for

More information

Machine Learning 101a. Jan Peters Gerhard Neumann

Machine Learning 101a. Jan Peters Gerhard Neumann Machine Learning 101a Jan Peters Gerhard Neumann 1 Purpose of this Lecture Statistics and Math Refresher Foundations of machine learning tools for robotics We focus on regression methods and general principles

More information

Course 395: Machine Learning - Lectures

Course 395: Machine Learning - Lectures Course 395: Machine Learning - Lectures Lecture 1-2: Concept Learning (M. Pantic) Lecture 3-4: Decision Trees & CBC Intro (M. Pantic & S. Petridis) Lecture 5-6: Evaluating Hypotheses (S. Petridis) Lecture

More information

Overview of Machine Learning and H2O.ai

Overview of Machine Learning and H2O.ai Overview of Machine Learning and H2O.ai Machine Learning Overview What is machine learning? -- Arthur Samuel, 1959 Why now? Data, computers, and algorithms are commodities Unstructured data Increasing

More information

Machine Learning ICS 273A. Instructor: Max Welling

Machine Learning ICS 273A. Instructor: Max Welling Machine Learning ICS 273A Instructor: Max Welling Class Homework What is Expected? Required, (answers will be provided) A Project See webpage Quizzes A quiz every Friday Bring scantron form (buy in UCI

More information

Modeling with Keras. Open Discussion Machine Learning Christian Contreras, PhD

Modeling with Keras. Open Discussion Machine Learning Christian Contreras, PhD Modeling with Keras Open Discussion Machine Learning Christian Contreras, PhD Overview - As practitioners in deep networks, we often want to understand areas of prototyping and modeling. While there are

More information

Dudon Wai Georgia Institute of Technology CS 7641: Machine Learning Atlanta, GA

Dudon Wai Georgia Institute of Technology CS 7641: Machine Learning Atlanta, GA Adult Income and Letter Recognition - Supervised Learning Report An objective look at classifier performance for predicting adult income and Letter Recognition Dudon Wai Georgia Institute of Technology

More information

Machine Learning and Applications in Finance

Machine Learning and Applications in Finance Machine Learning and Applications in Finance Christian Hesse 1,2,* 1 Autobahn Equity Europe, Global Markets Equity, Deutsche Bank AG, London, UK christian-a.hesse@db.com 2 Department of Computer Science,

More information

Introduction. Notices. A Learning Agent 22/11/2012. COMP219: Artificial Intelligence. COMP219: Artificial Intelligence

Introduction. Notices. A Learning Agent 22/11/2012. COMP219: Artificial Intelligence. COMP219: Artificial Intelligence COMP219: Artificial Intelligence COMP219: Artificial Intelligence Dr. Annabel Latham Room 2.05 Ashton Building Department of Computer Science University of Liverpool Lecture 27: Introduction to Learning,

More information

State of Machine Learning and Future of Machine Learning

State of Machine Learning and Future of Machine Learning State of Machine Learning and Future of Machine Learning (based on the vision of T.M. Mitchell) Rémi Gilleron Mostrare project Lille university and INRIA Futurs www.grappa.univ-lille3.fr/mostrare Collège

More information

Optical character recognition (ICDAR - International Conference on Document Analysis and Recognition)

Optical character recognition (ICDAR - International Conference on Document Analysis and Recognition) What is Machine Learning A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves

More information

Lecture 1. Introduction - Part 1. Luigi Freda. ALCOR Lab DIAG University of Rome La Sapienza. October 6, 2016

Lecture 1. Introduction - Part 1. Luigi Freda. ALCOR Lab DIAG University of Rome La Sapienza. October 6, 2016 Lecture 1 Introduction - Part 1 Luigi Freda ALCOR Lab DIAG University of Rome La Sapienza October 6, 2016 Luigi Freda (University of Rome La Sapienza ) Lecture 1 October 6, 2016 1 / 39 Outline 1 General

More information

Machine Learning Lecture 1: Introduction

Machine Learning Lecture 1: Introduction Welcome to CSCE 478/878! Please check off your name on the roster, or write your name if you're not listed Indicate if you wish to register or sit in Policy on sit-ins: You may sit in on the course without

More information

Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology. M. Soleymani Fall 2012

Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology. M. Soleymani Fall 2012 Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2012 Course Info Instructor: Mahdieh Soleymani Email: soleyman@ce.sharif.edu Lectures: Sun-Tue

More information

Data Classification: Advanced Concepts. Lijun Zhang

Data Classification: Advanced Concepts. Lijun Zhang Data Classification: Advanced Concepts Lijun Zhang zlj@nju.edu.cn http://cs.nju.edu.cn/zlj Outline Introduction Multiclass Learning Rare Class Learning Scalable Classification Semisupervised Learning Active

More information

Lecture 1: Machine Learning Basics

Lecture 1: Machine Learning Basics 1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3

More information

Introduction to Pattern Recognition

Introduction to Pattern Recognition Introduction to Pattern Recognition Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr CS 551, Fall 2017 CS 551, Fall 2017 c 2017, Selim Aksoy (Bilkent University)

More information

Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology. M. Soleymani Fall 2014

Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology. M. Soleymani Fall 2014 Course Overview and Introduction CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2014 Course Info Instructor: Mahdieh Soleymani Email: soleymani@sharif.edu Lectures: Sun-Tue

More information

CHAPTER 1: INTRODUCTION

CHAPTER 1: INTRODUCTION CHAPTER 1: INTRODUCTION Big Data 3 Widespread use of personal computers and wireless communication leads to big data We are both producers and consumers of data Producer: when buy a product, rent a movie,

More information

Introduction to Classification

Introduction to Classification Introduction to Classification Classification: Definition Given a collection of examples (training set ) Each example is represented by a set of features, sometimes called attributes Each example is to

More information

Introduction to Machine Learning 1. Nov., 2018 D. Ratner SLAC National Accelerator Laboratory

Introduction to Machine Learning 1. Nov., 2018 D. Ratner SLAC National Accelerator Laboratory Introduction to Machine Learning 1 Nov., 2018 D. Ratner SLAC National Accelerator Laboratory Introduction What is machine learning? Arthur Samuel (1959): Ability to learn without being explicitly programmed

More information

Harivinod N Dept of CSE Vivekananda College of Engineering Technology, Puttur

Harivinod N Dept of CSE Vivekananda College of Engineering Technology, Puttur 15CS73, VTU CBCS Scheme By Dept of CSE Vivekananda College of Engineering Technology, Puttur What is Learning? Learning - improve automatically with experience Using past experiences to improve future

More information

Introduction to Classification, aka Machine Learning

Introduction to Classification, aka Machine Learning Introduction to Classification, aka Machine Learning Classification: Definition Given a collection of examples (training set ) Each example is represented by a set of features, sometimes called attributes

More information

Introduction to Machine Learning

Introduction to Machine Learning Andrea Passerini passerini@disi.unitn.it Machine Learning What is Machine Learning A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P,

More information

Machine Learning. Basic Concepts. Joakim Nivre. Machine Learning 1(24)

Machine Learning. Basic Concepts. Joakim Nivre. Machine Learning 1(24) Machine Learning Basic Concepts Joakim Nivre Uppsala University and Växjö University, Sweden E-mail: nivre@msi.vxu.se Machine Learning 1(24) Machine Learning Idea: Synthesize computer programs by learning

More information

Tapas Joshi Atefeh Mahdavi Chandan Patil. Semi-Supervised Learning with Ladder Networks CSE 5290 Artificial Intelligence

Tapas Joshi Atefeh Mahdavi Chandan Patil. Semi-Supervised Learning with Ladder Networks CSE 5290 Artificial Intelligence 1. Introduction Semi-Supervised Learning with Ladder Networks CSE 5290 Artificial Intelligence Group 2 In this modern era of autonomous cars and deep learning, pure supervised learning is widely popular

More information

COM3250 / COM6170 Introduction to Machine Learning

COM3250 / COM6170 Introduction to Machine Learning COM3250 / COM6170 Introduction to Machine Learning Instructor Prof. Rob Gaizauskas Email: r.gaizauskas@dcs.shef.ac.uk Office: Room G28b @ Computer Science Classes Lecture 1: Monday 11:10 am, SG LT05 (LT05,

More information

Machine Learning Basics

Machine Learning Basics Deep Learning Theory and Applications Machine Learning Basics Kevin Moon (kevin.moon@yale.edu) Guy Wolf (guy.wolf@yale.edu) CPSC/AMTH 663 Outline 1. What is machine learning? 2. Supervised Learning Regression

More information

Introduction to Machine Learning & Its Application in Healthcare Lecture 4 Oct 3, 2018 Presentation by: Leila Karimi

Introduction to Machine Learning & Its Application in Healthcare Lecture 4 Oct 3, 2018 Presentation by: Leila Karimi Introduction to Machine Learning & Its Application in Healthcare Lecture 4 Oct 3, 2018 Presentation by: Leila Karimi 1 What Is Machine Learning? A branch of artificial intelligence, concerned with the

More information

Educational Data Mining for Teaching and Learning. Zhi-Jun PEI 1,a

Educational Data Mining for Teaching and Learning. Zhi-Jun PEI 1,a 2017 2nd International Conference on Education and Development (ICED 2017) ISBN: 978-1-60595-487-5 Educational Data Mining for Teaching and Learning Zhi-Jun PEI 1,a 1 School of Electronic Engineering,

More information

CS798: Selected topics in Machine Learning

CS798: Selected topics in Machine Learning CS798: Selected topics in Machine Learning Introduction Jakramate Bootkrajang Department of Computer Science Chiang Mai University Jakramate Bootkrajang CS798: Selected topics in Machine Learning 1 / 22

More information

Lecture 10 Summary and reflections

Lecture 10 Summary and reflections Lecture 10 Summary and reflections Niklas Wahlström Division of Systems and Control Department of Information Technology Uppsala University. Email: niklas.wahlstrom@it.uu.se SML - Lecture 10 Contents Lecture

More information

Introduction to Machine Learning Stephen Scott, Dept of CSE

Introduction to Machine Learning Stephen Scott, Dept of CSE Introduction to Machine Learning Stephen Scott, Dept of CSE What is Machine Learning? Building machines that automatically learn from experience Sub-area of artificial intelligence (Very) small sampling

More information

M. R. Ahmadzadeh Isfahan University of Technology. M. R. Ahmadzadeh Isfahan University of Technology

M. R. Ahmadzadeh Isfahan University of Technology. M. R. Ahmadzadeh Isfahan University of Technology 1 2 M. R. Ahmadzadeh Isfahan University of Technology Ahmadzadeh@cc.iut.ac.ir M. R. Ahmadzadeh Isfahan University of Technology Textbooks 3 Introduction to Machine Learning - Ethem Alpaydin Pattern Recognition

More information

10. Machine Learning

10. Machine Learning Artificial Intelligence 10. Machine Learning Prof. Bojana Dalbelo Bašić Assoc. Prof. Jan Šnajder University of Zagreb Faculty of Electrical Engineering and Computing Academic Year 2016/2017 Creative Commons

More information

How well do people learn? Classifying the Quality of Learning Based on Gaze Data

How well do people learn? Classifying the Quality of Learning Based on Gaze Data How well do people learn? Classifying the Quality of Learning Based on Gaze Data Bertrand Schneider Stanford University schneibe@stanford.edu Yuanyuan Pao Stanford University ypao@stanford.edu ABSTRACT

More information

Lecture 12: Classification

Lecture 12: Classification Lecture 12: Classification 2 2009-04-29 Patrik Malm Centre for Image Analysis Swedish University of Agricultural Sciences Uppsala University 2 Reading instructions Chapters for this lecture 12.1 12.2 in

More information

Competition II: Springleaf

Competition II: Springleaf Competition II: Springleaf Sha Li (Team leader) Xiaoyan Chong, Minglu Ma, Yue Wang CAMCOS Fall 2015 San Jose State University Agenda Kaggle Competition: Springleaf dataset introduction Data Preprocessing

More information

Lecture 2 Fundamentals of machine learning

Lecture 2 Fundamentals of machine learning Lecture 2 Fundamentals of machine learning Topics of this lecture Formulation of machine learning Taxonomy of learning algorithms Supervised, semi-supervised, and unsupervised learning Parametric and non-parametric

More information

(Refer Slide Time: 0:33)

(Refer Slide Time: 0:33) Machine Learning for Engineering and Science Applications. Professor Dr. Balaji Srinivasan. Department of Mechanical Engineering. Indian Institute of Technology, Madras. Overview of Machine Learning. We

More information

Pricing illiquid assets A Deep Learning approach. Oded Luria Deep Learning Meetup Dec 2015

Pricing illiquid assets A Deep Learning approach. Oded Luria Deep Learning Meetup Dec 2015 Pricing illiquid assets A Deep Learning approach Oded Luria Deep Learning Meetup Dec 2015 Deep Learning in Nature (May 2015) Deep learning allows computational models that are composed of multiple processing

More information

INTRODUCTION TO MACHINE LEARNING

INTRODUCTION TO MACHINE LEARNING https://xkcd.com/894/ INTRODUCTION TO MACHINE LEARNING David Kauchak CS 158 Fall 2016 Why are you here? Machine Learning is What is Machine Learning? Machine learning is a subfield of computer science

More information

Machine Learning 1. week

Machine Learning 1. week Machine Learning 1. week Terminology Supervised Unsupervised Learning Data Preparation Cross Validation Overfitting 1 What is Machine Learning? Machine Learning is common name of algorithms which can model

More information

Introduction to Deep Learning

Introduction to Deep Learning Introduction to Deep Learning M S Ram Dept. of Computer Science & Engg. Indian Institute of Technology Kanpur Reading of Chap. 1 from Learning Deep Architectures for AI ; Yoshua Bengio; FTML Vol. 2, No.

More information

Welcome to CSCE 496/896: Deep Learning! Welcome to CSCE 496/896: Deep Learning! Override Policy. Override Policy. Override Policy.

Welcome to CSCE 496/896: Deep Learning! Welcome to CSCE 496/896: Deep Learning! Override Policy. Override Policy. Override Policy. Welcome to CSCE 496/896: Deep! Welcome to CSCE 496/896: Deep! Please check off your name on the roster, or write your name if you're not listed Indicate if you wish to register or sit in Policy on sit-ins:

More information

Self-Organizing Incremental Neural Network and Its Application

Self-Organizing Incremental Neural Network and Its Application Self-Organizing Incremental Neural Network and Its Application Furao Shen 1,2 and Osamu Hasegawa 3 1 National Key Laboratory for Novel Software Technology, Nanjing University, China frshen@nju.edu.cn http://cs.nju.edu.cn/rinc/

More information

INTRODUCTION TO DATA SCIENCE

INTRODUCTION TO DATA SCIENCE DATA11001 INTRODUCTION TO DATA SCIENCE EPISODE 6: MACHINE LEARNING TODAY S MENU 1. WHAT IS ML? 2. CLASSIFICATION AND REGRESSSION 3. EVALUATING PERFORMANCE & OVERFITTING WHAT IS MACHINE LEARNING? Definition:

More information

COMP 551 Applied Machine Learning Lecture 6: Performance evaluation. Model assessment and selection.

COMP 551 Applied Machine Learning Lecture 6: Performance evaluation. Model assessment and selection. COMP 551 Applied Machine Learning Lecture 6: Performance evaluation. Model assessment and selection. Instructor: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/comp551 Unless otherwise

More information

Trees: Themes and Variations

Trees: Themes and Variations Trees: Themes and Variations Prof. Mari Ostendorf Outline Preface Decision Trees Bagging Boosting BoosTexter 1 Preface: Vector Classifiers Today we again deal with vector classifiers and supervised training:

More information

Machine learning theory

Machine learning theory Machine learning theory Machine learning theory Introduction Hamid Beigy Sharif university of technology February 27, 2017 Hamid Beigy Sharif university of technology February 27, 2017 1 / 28 Machine learning

More information

CS 510: Lecture 8. Deep Learning, Fairness, and Bias

CS 510: Lecture 8. Deep Learning, Fairness, and Bias CS 510: Lecture 8 Deep Learning, Fairness, and Bias Next Week All Presentations, all the time Upload your presentation before class if using slides Sign up for a timeslot google doc, if you haven t already

More information

Introduction to Machine Learning Reykjavík University Spring Instructor: Dan Lizotte

Introduction to Machine Learning Reykjavík University Spring Instructor: Dan Lizotte Introduction to Machine Learning Reykjavík University Spring 2007 Instructor: Dan Lizotte Logistics To contact Dan: dlizotte@cs.ualberta.ca http://www.cs.ualberta.ca/~dlizotte/teaching/ Books: Introduction

More information

SUPERVISED LEARNING. We ve finished Part I: Problem Solving We ve finished Part II: Reasoning with uncertainty. Part III: (Machine) Learning

SUPERVISED LEARNING. We ve finished Part I: Problem Solving We ve finished Part II: Reasoning with uncertainty. Part III: (Machine) Learning SUPERVISED LEARNING Progress Report We ve finished Part I: Problem Solving We ve finished Part II: Reasoning with uncertainty Part III: (Machine) Learning Supervised Learning Unsupervised Learning Overlaps

More information

Machine Learning Part 2

Machine Learning Part 2 Data Science Weekend Machine Learning Part 2 KMK Online Analytic Team Fajri Koto Data Scientist fajri.koto@kmklabs.com Machine Learning Part 2 Outline 1. Handling Imbalanced Dataset 2. Understanding the

More information

Python Certification Training for Data Science

Python Certification Training for Data Science Python Certification Training for Data Science Fees 30,000 / - Course Curriculum Introduction to Python Learning Objectives: You will get a brief idea of what Python is and touch on the basics. Overview

More information

Machine Learning Algorithms: A Review

Machine Learning Algorithms: A Review Machine Learning Algorithms: A Review Ayon Dey Department of CSE, Gautam Buddha University, Greater Noida, Uttar Pradesh, India Abstract In this paper, various machine learning algorithms have been discussed.

More information

COMP 551 Applied Machine Learning Lecture 11: Ensemble learning

COMP 551 Applied Machine Learning Lecture 11: Ensemble learning COMP 551 Applied Machine Learning Lecture 11: Ensemble learning Instructor: Herke van Hoof (herke.vanhoof@mcgill.ca) Slides mostly by: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~hvanho2/comp551

More information

Inductive Learning and Decision Trees

Inductive Learning and Decision Trees Inductive Learning and Decision Trees Doug Downey EECS 349 Spring 2017 with slides from Pedro Domingos, Bryan Pardo Outline Announcements Homework #1 was assigned on Monday (due in five days!) Inductive

More information

CS 445/545 Machine Learning Winter, 2017

CS 445/545 Machine Learning Winter, 2017 CS 445/545 Machine Learning Winter, 2017 See syllabus at http://web.cecs.pdx.edu/~mm/machinelearningwinter2017/ Lecture slides will be posted on this website before each class. What is machine learning?

More information

Machine Learning Tom M. Mitchell Machine Learning Department Carnegie Mellon University. January 11, 2011

Machine Learning Tom M. Mitchell Machine Learning Department Carnegie Mellon University. January 11, 2011 Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 11, 2011 Today: What is machine learning? Decision tree learning Course logistics Readings: The Discipline

More information

ECT7110 Classification Decision Trees. Prof. Wai Lam

ECT7110 Classification Decision Trees. Prof. Wai Lam ECT7110 Classification Decision Trees Prof. Wai Lam Classification and Decision Tree What is classification? What is prediction? Issues regarding classification and prediction Classification by decision

More information

Machine Learning Nanodegree Syllabus

Machine Learning Nanodegree Syllabus Machine Learning Nanodegree Syllabus Artificial Neural Networks, TensorFlow, and Machine Learning Algorithms Before You Start Prerequisites: In order to succeed in this program, we recommend having experience

More information

CS148 - Building Intelligent Robots Lecture 6: Learning for Robotics. Instructor: Chad Jenkins (cjenkins)

CS148 - Building Intelligent Robots Lecture 6: Learning for Robotics. Instructor: Chad Jenkins (cjenkins) Lecture 6 Robot Learning Slide 1 CS148 - Building Intelligent Robots Lecture 6: Learning for Robotics Instructor: Chad Jenkins (cjenkins) Lecture 6 Robot Learning Slide 2 Administrivia: good news No class

More information

An Introduction to Deep Learning. Labeeb Khan

An Introduction to Deep Learning. Labeeb Khan An Introduction to Deep Learning Labeeb Khan Special Thanks: Lukas Masuch @lukasmasuch +lukasmasuch Lead Software Engineer: Machine Intelligence, SAP The Big Players Companies The Big Players Startups

More information

A Review on Classification Techniques in Machine Learning

A Review on Classification Techniques in Machine Learning A Review on Classification Techniques in Machine Learning R. Vijaya Kumar Reddy 1, Dr. U. Ravi Babu 2 1 Research Scholar, Dept. of. CSE, Acharya Nagarjuna University, Guntur, (India) 2 Principal, DRK College

More information