Artificial Intelligence Introduction to Machine Learning

Size: px
Start display at page:

Download "Artificial Intelligence Introduction to Machine Learning"

Transcription

1 Artificial Intelligence Introduction to Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee

2 Introduction Applications which Machine Learning techniques play an important role: Face Recognition Dimensionality Reduction is additionally used for finding important features Face Detection Facial Age Estimation Face recognition Facial age estimation Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 2

3 Introduction Adaboost structure One of the most popular Machine Learning algorithm for applications with high-variety Good for reducing Detection Time while maintaining Detection Accuracy Often used for Automatic face focusing in Digital Cameras Automatic face focusing Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 3

4 Introduction Adaboost structure (Facial Age Estimation) Extracting important features those are difficult to be found by Human Building a Model or Property to be learned that maps the facial features to Predicted age Providing theoretical analysis and practical guidelines Extracted features A Model built by Adaboost Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 4

5 Introduction This is Bigdata era Fast development of technology Burst usage of Internet Lots of Image Sources (Examples) User-created Contents Flickr, Facebook, and YouTube Online source of Images and Texts Explosion of User-created content Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 5

6 Introduction Power of Machine Learning will be increased because Large amount of accessible data means Large amount of examples for training Large amount of examples for training means Higher chance of accurate learning Higher chance of accurate learning means Valuable but undiscovered knowledge is found Improving utility of Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 6

7 What is Machine Learning? What is Machine Learning? Difficult to define precisely because it covers a broad range of processes Modification of a behavioral tendency by experience Modification of Behavior by Experience (Data) Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 7

8 What is Machine Learning? What is Machine Learning? Difficult to define precisely because it covers a broad range of processes Modification of a behavioral tendency by experience Optimizing a performance criterion using example data and past experience Optimizing a performance with regard to a criterion Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 8

9 What is Machine Learning? Machine Learning Changes in systems for AI tasks: Recognition Diagnosis Planning Robot control Prediction A constant program can never be changed with regard to its environment! Relation to AI Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 9

10 What is Machine Learning? AI agent Perceives and models its environment Computes proper Actions considering consequences Agent may change its internal process or component according to Perceives and Actions It is regard as a sort of Learning AI agent Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 10

11 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Programming (Designing) versus Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 11

12 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule What is the underlying rule? Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 12

13 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Guessing the rule based on a large number of examples Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 13

14 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Extracting hidden relationship Extracting underlying mapping relationship Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 14

15 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Extracting hidden relationship Adapting unknown environment Navigation in unknown environment Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 15

16 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Extracting hidden relationship Adapting unknown environment Too many examples are given Big Data Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 16

17 Designing versus Learning There is no need to learn to calculate minimum credit points for graduation Learning is required when: Humans are unable to explain the hidden rule Extracting hidden relationship Adapting unknown environment Too many examples are given Dynamic environment Dynamic environment: Weather forecasting Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 17

18 Relationships with Other Disciplines Machine Learning unifies several disciplines Relation to other disciplines Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 18

19 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Guessing unknown probability distribution Making decisions based on estimated new samples Machine Learning versus Statistics Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 19

20 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Simplified models of biological neurons Approximating the learning phenomena Popular example: Artificial Neural Network Brain modeling Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 20

21 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Controlling a processing having parameters that must be estimated during operation Popular example: Robot Task-adaptive Robotic Arm Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 21

22 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Studying the performance of living organism in various learning tasks Popular example: Reinforcement Learning Reinforcement Learning Procedure Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 22

23 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Evolutionary Models Mimic the evolution of species Adaptation of Finch w.r.t. its environment or behavior Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 23

24 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Evolutionary Models Mimic the evolution of species Popular example: Genetic Algorithm Genetic Algorithm Procedure Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 24

25 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Evolutionary Models Modeling and Optimization How to model the separating boundary and optimize the performance Class separation Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 25

26 Relationships with Other Disciplines Machine Learning unifies several disciplines Statistics Brain Models Adaptive Control Theory Psychological Models Evolutionary Models Modeling and Optimization Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 26

27 Universal Dataset Universal set Containing all the possible data pairs There is a unknown probability distribution Universal set Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 27

28 Universal Dataset Universal set Containing all the possible data pairs There is a unknown probability distribution Training set Only a subset of universal set is possibly considered due to limited memory or time This subset is known as Training set Universal set Training set Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 28

29 Universal Dataset Training set Only a subset of universal set is possibly considered due to limited memory or time This subset is known as Training set Independently and Identically Distributed (i.i.d.) Validation set A subset of training set for monitoring the training process of Machine Learning algorithm Dataset Preparation Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 29

30 What Are We Looking For? Possible learned properties A line separating boundary between two groups A relation among examples Test set Unseen samples or future events A disjoint set of Training set and Validation set Used for examining performance evaluation Dataset Preparation Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 30

31 What Are We Looking For? Universal set Assumed to exist but unknown Training set A subset of Universal set that is obtained from Data acquisition stage Example of three labeled datasets: Universal, Training, and Test Set Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 31

32 What Are We Looking For? Universal set Assumed to exist but unknown Training set A subset of Universal set that is obtained from Data acquisition stage Test set A set used for examining the performance Training set Test set Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 32

33 No Free Lunch Rule Possible learned properties (Revisited) A line separating boundary between two groups A relation among examples No Free Lunch Rules Assumptions that making Machine Learning feasible Assumptions needed for both Dataset and Properties Can we expect any classification method to be superior or inferior overall? The answer is NO Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 33

34 No Free Lunch Rule Assumptions needed for Dataset Training set and Test set are come from the same distribution Assumptions needed for Properties Making assumptions on what kind of function to learn How to model the property Can we expect any classification method to be superior or inferior overall? The answer is NO Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 34

35 No Free Lunch Rule Assumptions needed for Dataset Training set and Test set are come from the same distribution Assumptions needed for Properties Making assumptions on what kind of function to learn Straight line vs. Curved line How to model the property Gaussian distribution vs. Poisson distribution Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 35

36 Learning Input-Output Functions = ( ): A short summarization of Machine Learning : Vector-valued input or Training set Ξ or h( ): Predicted output : hypothesis function between and Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 36

37 Learning Input-Output Functions = ( ): A short summarization of Machine Learning : Vector-valued input or Training set Ξ or h( ): Predicted output : hypothesis function between and H: Set of all possible hypothesis functions Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 37

38 Types of Learning Types of Machine Learning Supervised Learning Unsupervised Learning Semi-supervised Learning Reinforcement Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 38

39 Types of Learning: Supervised Learning Types of Machine Learning Supervised Learning Learning from labeled dataset Find the relationships between the Feature set and the Label set Find a hypothesis h that is mostly-agreed by members of Training set Ξ Hypothesis If it Walks/Swims/Quacks like a Duck Then It must be a Duck Features: Walks, Swims, Quacks Label: Ducks, Not ducks Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 39

40 Types of Learning: Supervised Learning Types of Machine Learning Supervised Learning Learning from labeled dataset Find the relationships between the Feature set and the Label set Find a hypothesis h that is mostly-agreed by members of Training set Ξ Regression: finding a curve that fits points Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 40

41 Types of Learning: Supervised Learning Types of Machine Learning Supervised Learning Learning from labeled dataset Find the relationships between the Feature set and the Label set Find a hypothesis h that is mostly-agreed by members of Training set Ξ Regression: finding a curve that fits points Classification: finding a discriminating vector(s) Figure (a) Figure (b) Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 41

42 Types of Learning: Unsupervised Learning Types of Machine Learning Supervised Learning Unsupervised Learning Learning from characteristics of dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 42

43 Types of Learning: Unsupervised Learning Types of Machine Learning Supervised Learning Unsupervised Learning Learning from intrinsic characteristics of dataset Popular purposes Clustering, Probability density estimation, Finding association among features, Dimensionality reduction Output can be used for other learning paradigms Figure (a) Figure (b) Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 43

44 Types of Learning: Semi-supervised Learning Types of Machine Learning Supervised Learning Unsupervised Learning Semi-supervised Learning Learning with the dataset containing both labeled and unlabeled data Figure (a) Figure (b) Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 44

45 Types of Learning: Reinforcement Learning Types of Machine Learning Supervised Learning Unsupervised Learning Semi-supervised Learning Reinforcement Learning Learning from rewards or mistakes Agent acts in an Environment Reinforcement Learning procedure Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 45

46 Input Vectors Input vectors Pattern/feature vectors, samples, examples, instances An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 46

47 Input Vectors Input vectors Pattern/feature vectors, samples, examples, instances Features: the components of the input vector Attributes, input variables, components An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 47

48 Input Vectors Input vectors Pattern/feature vectors, samples, examples, instances Features: the components of the input vector Attributes, input variables, components An instance of (class, major, sex, advisor) can be (sophomore, history, male, Higgins) An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 48

49 Input Vectors Input vectors Pattern/feature vectors, samples, examples, instances Features: the components of the input vector Attributes, input variables, components An instance of (class, major, sex, advisor) can be (sophomore, history, male, Higgins) Boolean valued-features Boolean feature (High, Normal) An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 49

50 Outputs Outputs Output value, label, class, category, decision Function estimator if output is a real number Classifier if output is a categorical value Application: hand-written character recognition Input: printed character Output: categories of hand-written character An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 50

51 Outputs Outputs Output value, label, class, category, decision Function estimator if output is a real number Classifier if output is a categorical value Vector-valued outputs If mutually exclusive then Multi-class problem If not then Multi-label problem An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 51

52 Outputs Outputs Output value, label, class, category, decision Function estimator if output is a real number Classifier if output is a categorical value Vector-valued outputs Boolean outputs True: positive instance False: negative instance An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 52

53 Outputs Outputs Output value, label, class, category, decision Function estimator if output is a real number Classifier if output is a categorical value Vector-valued outputs Boolean outputs Concept learning: Boolean input-output An example dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 53

54 Preprocessing Preprocessing steps for a desired Machine Learning Standard Machine Learning Procedure Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 54

55 Noise and Outliers Preprocessing steps for a desired Machine Learning Noise and Outliers Corrupted values leading to Outliers An example of outlier Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 55

56 Noise and Outliers Preprocessing steps for a desired Machine Learning Noise and Outliers Corrupted values leading to Outliers Class noise and Attribute noise Class noise vs. Attribute noise Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 56

57 Missing Value Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Adding median/mean values Deleting corresponding row Using the value from the previous row Example of missing value Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 57

58 Scaling Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Scaling Reducing values in columns into a common scale Normalization or Standardization Normalization Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 58

59 Natural Language Processing for Texts Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Scaling Natural Language Processing for Texts Encoding free texts to vectors Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 59

60 Imbalanced Datasets Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Scaling Natural Language Processing for Texts Imbalanced datasets Class distribution is skewed Scatter plot of Imbalanced dataset Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 60

61 Imbalanced Datasets Preprocessing steps for a desired Machine Learning Noise and Outliers Missing value Scaling Natural Language Processing for Texts Imbalanced datasets Class distribution is skewed Over-/Under-sampling Synthesizing examples Over-/Under-sampling Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 61

62 Training Main step of Machine Learning Machine Learning procedures Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 62

63 Policy Main step of Machine Learning Training policy Batch method Entire Training set is available Use all at once to compute the function Batch Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 63

64 Policy Main step of Machine Learning Training policy Batch method Online method Arriving one member of Training set at a time Optimizing the function incrementally Deciding a next action based on current action Online Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 64

65 Feature Selection Main step of Machine Learning Training policy Feature selection Not all features contribute to the learning! One of Model Selection Approaches Can be used for improve the performance Curse of dimensionality Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 65

66 Evaluation Main step of Machine Learning Training policy Feature selection Evaluation Evaluating learning performance Usage of evaluation metrics Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 66

67 Evaluation Main step of Machine Learning Training policy Feature selection Evaluation Evaluating learning performance Population evaluation metric Mean-squared-error for Regression task Accuracy: the total number of errors Confusion matrix for calculating Accuracy Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 67

68 Parameter Tuning Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Controlling learning model Popular approach: Trial-and-error basis Parameter tuning based on Trial-and-error strategy Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 68

69 Overfitting (Bias) Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Overfitting Good on Training set, but poor on Test set Overfit vs. Underfit Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 69

70 Underfitting (Variance) Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Overfitting Underfitting Low performance on both sets Overfit vs. Underfit Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 70

71 Bias and Variance Trade-off Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Overfitting Underfitting Low performance on both sets Overfit vs. Underfit Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 71

72 Model Stacking Main step of Machine Learning Training policy Feature selection Evaluation Parameter tuning Overfitting Underfitting Model stacking Combining multiple algorithms Example of model stacking Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 72

73 Sample Applications Sample applications based on Machine Learning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 73

74 Sample Applications Sample applications based on Machine Learning Rule discovery for printing industry problem Electric power load forecasting Automatic help desk assistant 3D printing rule discovery Electric power load forecasting Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 74

75 Sample Applications Sample applications based on Machine Learning Rule discovery for printing industry problem Electric power load forecasting Automatic help desk assistant Planning and scheduling for a steel mill Stars and galaxies classification Stars and galaxies Classification Steel mill planning Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 75

76 Sample Applications Successes of Machine Learning in real world Sharp s Japanese Kanji character recognition system 200 characters per second with 99% accuracy Fujitsu s continuous steel casting monitoring system Kanji character recognition Steel casting monitoring Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 76

77 Sample Applications Successes of Machine Learning in real world Sharp s Japanese Kanji character recognition system 200 characters per second with 99% accuracy Fujitsu s continuous steel casting monitoring system Artificial Intelligence Chung-Ang University Narration: Prof. Jaesung Lee 77

Python Machine Learning

Python Machine Learning Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

Lecture 1: Machine Learning Basics

Lecture 1: Machine Learning Basics 1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3

More information

(Sub)Gradient Descent

(Sub)Gradient Descent (Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include

More information

CSL465/603 - Machine Learning

CSL465/603 - Machine Learning CSL465/603 - Machine Learning Fall 2016 Narayanan C Krishnan ckn@iitrpr.ac.in Introduction CSL465/603 - Machine Learning 1 Administrative Trivia Course Structure 3-0-2 Lecture Timings Monday 9.55-10.45am

More information

CS Machine Learning

CS Machine Learning CS 478 - Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing

More information

Introduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition

Introduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition Introduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition Todd Holloway Two Lecture Series for B551 November 20 & 27, 2007 Indiana University Outline Introduction Bias and

More information

OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS

OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,

More information

Assignment 1: Predicting Amazon Review Ratings

Assignment 1: Predicting Amazon Review Ratings Assignment 1: Predicting Amazon Review Ratings 1 Dataset Analysis Richard Park r2park@acsmail.ucsd.edu February 23, 2015 The dataset selected for this assignment comes from the set of Amazon reviews for

More information

Rule Learning With Negation: Issues Regarding Effectiveness

Rule Learning With Negation: Issues Regarding Effectiveness Rule Learning With Negation: Issues Regarding Effectiveness S. Chua, F. Coenen, G. Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX Liverpool, United

More information

Probability and Statistics Curriculum Pacing Guide

Probability and Statistics Curriculum Pacing Guide Unit 1 Terms PS.SPMJ.3 PS.SPMJ.5 Plan and conduct a survey to answer a statistical question. Recognize how the plan addresses sampling technique, randomization, measurement of experimental error and methods

More information

Lecture 1: Basic Concepts of Machine Learning

Lecture 1: Basic Concepts of Machine Learning Lecture 1: Basic Concepts of Machine Learning Cognitive Systems - Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010

More information

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents

More information

Algebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview

Algebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview Algebra 1, Quarter 3, Unit 3.1 Line of Best Fit Overview Number of instructional days 6 (1 day assessment) (1 day = 45 minutes) Content to be learned Analyze scatter plots and construct the line of best

More information

Twitter Sentiment Classification on Sanders Data using Hybrid Approach

Twitter Sentiment Classification on Sanders Data using Hybrid Approach IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 17, Issue 4, Ver. I (July Aug. 2015), PP 118-123 www.iosrjournals.org Twitter Sentiment Classification on Sanders

More information

The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X

The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, 2013 10.12753/2066-026X-13-154 DATA MINING SOLUTIONS FOR DETERMINING STUDENT'S PROFILE Adela BÂRA,

More information

Knowledge Transfer in Deep Convolutional Neural Nets

Knowledge Transfer in Deep Convolutional Neural Nets Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract

More information

Word Segmentation of Off-line Handwritten Documents

Word Segmentation of Off-line Handwritten Documents Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department

More information

Rule Learning with Negation: Issues Regarding Effectiveness

Rule Learning with Negation: Issues Regarding Effectiveness Rule Learning with Negation: Issues Regarding Effectiveness Stephanie Chua, Frans Coenen, and Grant Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX

More information

Artificial Neural Networks written examination

Artificial Neural Networks written examination 1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14

More information

Laboratorio di Intelligenza Artificiale e Robotica

Laboratorio di Intelligenza Artificiale e Robotica Laboratorio di Intelligenza Artificiale e Robotica A.A. 2008-2009 Outline 2 Machine Learning Unsupervised Learning Supervised Learning Reinforcement Learning Genetic Algorithms Genetics-Based Machine Learning

More information

Course Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE

Course Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE EE-589 Introduction to Neural Assistant Prof. Dr. Turgay IBRIKCI Room # 305 (322) 338 6868 / 139 Wensdays 9:00-12:00 Course Outline The course is divided in two parts: theory and practice. 1. Theory covers

More information

Language Acquisition Fall 2010/Winter Lexical Categories. Afra Alishahi, Heiner Drenhaus

Language Acquisition Fall 2010/Winter Lexical Categories. Afra Alishahi, Heiner Drenhaus Language Acquisition Fall 2010/Winter 2011 Lexical Categories Afra Alishahi, Heiner Drenhaus Computational Linguistics and Phonetics Saarland University Children s Sensitivity to Lexical Categories Look,

More information

Learning From the Past with Experiment Databases

Learning From the Past with Experiment Databases Learning From the Past with Experiment Databases Joaquin Vanschoren 1, Bernhard Pfahringer 2, and Geoff Holmes 2 1 Computer Science Dept., K.U.Leuven, Leuven, Belgium 2 Computer Science Dept., University

More information

Probabilistic Latent Semantic Analysis

Probabilistic Latent Semantic Analysis Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview

More information

Lecture 10: Reinforcement Learning

Lecture 10: Reinforcement Learning Lecture 1: Reinforcement Learning Cognitive Systems II - Machine Learning SS 25 Part III: Learning Programs and Strategies Q Learning, Dynamic Programming Lecture 1: Reinforcement Learning p. Motivation

More information

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering

More information

ScienceDirect. A Framework for Clustering Cardiac Patient s Records Using Unsupervised Learning Techniques

ScienceDirect. A Framework for Clustering Cardiac Patient s Records Using Unsupervised Learning Techniques Available online at www.sciencedirect.com ScienceDirect Procedia Computer Science 98 (2016 ) 368 373 The 6th International Conference on Current and Future Trends of Information and Communication Technologies

More information

Time series prediction

Time series prediction Chapter 13 Time series prediction Amaury Lendasse, Timo Honkela, Federico Pouzols, Antti Sorjamaa, Yoan Miche, Qi Yu, Eric Severin, Mark van Heeswijk, Erkki Oja, Francesco Corona, Elia Liitiäinen, Zhanxing

More information

Australian Journal of Basic and Applied Sciences

Australian Journal of Basic and Applied Sciences AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean

More information

The Good Judgment Project: A large scale test of different methods of combining expert predictions

The Good Judgment Project: A large scale test of different methods of combining expert predictions The Good Judgment Project: A large scale test of different methods of combining expert predictions Lyle Ungar, Barb Mellors, Jon Baron, Phil Tetlock, Jaime Ramos, Sam Swift The University of Pennsylvania

More information

Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science

Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science Gilberto de Paiva Sao Paulo Brazil (May 2011) gilbertodpaiva@gmail.com Abstract. Despite the prevalence of the

More information

Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling

Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling Notebook for PAN at CLEF 2013 Andrés Alfonso Caurcel Díaz 1 and José María Gómez Hidalgo 2 1 Universidad

More information

Generative models and adversarial training

Generative models and adversarial training Day 4 Lecture 1 Generative models and adversarial training Kevin McGuinness kevin.mcguinness@dcu.ie Research Fellow Insight Centre for Data Analytics Dublin City University What is a generative model?

More information

Applications of data mining algorithms to analysis of medical data

Applications of data mining algorithms to analysis of medical data Master Thesis Software Engineering Thesis no: MSE-2007:20 August 2007 Applications of data mining algorithms to analysis of medical data Dariusz Matyja School of Engineering Blekinge Institute of Technology

More information

Axiom 2013 Team Description Paper

Axiom 2013 Team Description Paper Axiom 2013 Team Description Paper Mohammad Ghazanfari, S Omid Shirkhorshidi, Farbod Samsamipour, Hossein Rahmatizadeh Zagheli, Mohammad Mahdavi, Payam Mohajeri, S Abbas Alamolhoda Robotics Scientific Association

More information

Evolution of Symbolisation in Chimpanzees and Neural Nets

Evolution of Symbolisation in Chimpanzees and Neural Nets Evolution of Symbolisation in Chimpanzees and Neural Nets Angelo Cangelosi Centre for Neural and Adaptive Systems University of Plymouth (UK) a.cangelosi@plymouth.ac.uk Introduction Animal communication

More information

Software Maintenance

Software Maintenance 1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories

More information

Laboratorio di Intelligenza Artificiale e Robotica

Laboratorio di Intelligenza Artificiale e Robotica Laboratorio di Intelligenza Artificiale e Robotica A.A. 2008-2009 Outline 2 Machine Learning Unsupervised Learning Supervised Learning Reinforcement Learning Genetic Algorithms Genetics-Based Machine Learning

More information

Active Learning. Yingyu Liang Computer Sciences 760 Fall

Active Learning. Yingyu Liang Computer Sciences 760 Fall Active Learning Yingyu Liang Computer Sciences 760 Fall 2017 http://pages.cs.wisc.edu/~yliang/cs760/ Some of the slides in these lectures have been adapted/borrowed from materials developed by Mark Craven,

More information

Semi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17.

Semi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17. Semi-supervised methods of text processing, and an application to medical concept extraction Yacine Jernite Text-as-Data series September 17. 2015 What do we want from text? 1. Extract information 2. Link

More information

Machine Learning and Data Mining. Ensembles of Learners. Prof. Alexander Ihler

Machine Learning and Data Mining. Ensembles of Learners. Prof. Alexander Ihler Machine Learning and Data Mining Ensembles of Learners Prof. Alexander Ihler Ensemble methods Why learn one classifier when you can learn many? Ensemble: combine many predictors (Weighted) combina

More information

School of Innovative Technologies and Engineering

School of Innovative Technologies and Engineering School of Innovative Technologies and Engineering Department of Applied Mathematical Sciences Proficiency Course in MATLAB COURSE DOCUMENT VERSION 1.0 PCMv1.0 July 2012 University of Technology, Mauritius

More information

A Case Study: News Classification Based on Term Frequency

A Case Study: News Classification Based on Term Frequency A Case Study: News Classification Based on Term Frequency Petr Kroha Faculty of Computer Science University of Technology 09107 Chemnitz Germany kroha@informatik.tu-chemnitz.de Ricardo Baeza-Yates Center

More information

A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation

A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation SLSP-2016 October 11-12 Natalia Tomashenko 1,2,3 natalia.tomashenko@univ-lemans.fr Yuri Khokhlov 3 khokhlov@speechpro.com Yannick

More information

Human Emotion Recognition From Speech

Human Emotion Recognition From Speech RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati

More information

Exploration. CS : Deep Reinforcement Learning Sergey Levine

Exploration. CS : Deep Reinforcement Learning Sergey Levine Exploration CS 294-112: Deep Reinforcement Learning Sergey Levine Class Notes 1. Homework 4 due on Wednesday 2. Project proposal feedback sent Today s Lecture 1. What is exploration? Why is it a problem?

More information

Speech Recognition at ICSI: Broadcast News and beyond

Speech Recognition at ICSI: Broadcast News and beyond Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI

More information

Calibration of Confidence Measures in Speech Recognition

Calibration of Confidence Measures in Speech Recognition Submitted to IEEE Trans on Audio, Speech, and Language, July 2010 1 Calibration of Confidence Measures in Speech Recognition Dong Yu, Senior Member, IEEE, Jinyu Li, Member, IEEE, Li Deng, Fellow, IEEE

More information

Speaker Identification by Comparison of Smart Methods. Abstract

Speaker Identification by Comparison of Smart Methods. Abstract Journal of mathematics and computer science 10 (2014), 61-71 Speaker Identification by Comparison of Smart Methods Ali Mahdavi Meimand Amin Asadi Majid Mohamadi Department of Electrical Department of Computer

More information

Machine Learning from Garden Path Sentences: The Application of Computational Linguistics

Machine Learning from Garden Path Sentences: The Application of Computational Linguistics Machine Learning from Garden Path Sentences: The Application of Computational Linguistics http://dx.doi.org/10.3991/ijet.v9i6.4109 J.L. Du 1, P.F. Yu 1 and M.L. Li 2 1 Guangdong University of Foreign Studies,

More information

Linking Task: Identifying authors and book titles in verbose queries

Linking Task: Identifying authors and book titles in verbose queries Linking Task: Identifying authors and book titles in verbose queries Anaïs Ollagnier, Sébastien Fournier, and Patrice Bellot Aix-Marseille University, CNRS, ENSAM, University of Toulon, LSIS UMR 7296,

More information

Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks

Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Devendra Singh Chaplot, Eunhee Rhim, and Jihie Kim Samsung Electronics Co., Ltd. Seoul, South Korea {dev.chaplot,eunhee.rhim,jihie.kim}@samsung.com

More information

arxiv: v2 [cs.cv] 30 Mar 2017

arxiv: v2 [cs.cv] 30 Mar 2017 Domain Adaptation for Visual Applications: A Comprehensive Survey Gabriela Csurka arxiv:1702.05374v2 [cs.cv] 30 Mar 2017 Abstract The aim of this paper 1 is to give an overview of domain adaptation and

More information

Cooperative evolutive concept learning: an empirical study

Cooperative evolutive concept learning: an empirical study Cooperative evolutive concept learning: an empirical study Filippo Neri University of Piemonte Orientale Dipartimento di Scienze e Tecnologie Avanzate Piazza Ambrosoli 5, 15100 Alessandria AL, Italy Abstract

More information

INPE São José dos Campos

INPE São José dos Campos INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA

More information

Evaluating Interactive Visualization of Multidimensional Data Projection with Feature Transformation

Evaluating Interactive Visualization of Multidimensional Data Projection with Feature Transformation Multimodal Technologies and Interaction Article Evaluating Interactive Visualization of Multidimensional Data Projection with Feature Transformation Kai Xu 1, *,, Leishi Zhang 1,, Daniel Pérez 2,, Phong

More information

A Case-Based Approach To Imitation Learning in Robotic Agents

A Case-Based Approach To Imitation Learning in Robotic Agents A Case-Based Approach To Imitation Learning in Robotic Agents Tesca Fitzgerald, Ashok Goel School of Interactive Computing Georgia Institute of Technology, Atlanta, GA 30332, USA {tesca.fitzgerald,goel}@cc.gatech.edu

More information

Knowledge-Based - Systems

Knowledge-Based - Systems Knowledge-Based - Systems ; Rajendra Arvind Akerkar Chairman, Technomathematics Research Foundation and Senior Researcher, Western Norway Research institute Priti Srinivas Sajja Sardar Patel University

More information

Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming

Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming Data Mining VI 205 Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming C. Romero, S. Ventura, C. Hervás & P. González Universidad de Córdoba, Campus Universitario de

More information

Physics 270: Experimental Physics

Physics 270: Experimental Physics 2017 edition Lab Manual Physics 270 3 Physics 270: Experimental Physics Lecture: Lab: Instructor: Office: Email: Tuesdays, 2 3:50 PM Thursdays, 2 4:50 PM Dr. Uttam Manna 313C Moulton Hall umanna@ilstu.edu

More information

Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models

Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models Stephan Gouws and GJ van Rooyen MIH Medialab, Stellenbosch University SOUTH AFRICA {stephan,gvrooyen}@ml.sun.ac.za

More information

A Neural Network GUI Tested on Text-To-Phoneme Mapping

A Neural Network GUI Tested on Text-To-Phoneme Mapping A Neural Network GUI Tested on Text-To-Phoneme Mapping MAARTEN TROMPPER Universiteit Utrecht m.f.a.trompper@students.uu.nl Abstract Text-to-phoneme (T2P) mapping is a necessary step in any speech synthesis

More information

Statewide Framework Document for:

Statewide Framework Document for: Statewide Framework Document for: 270301 Standards may be added to this document prior to submission, but may not be removed from the framework to meet state credit equivalency requirements. Performance

More information

Evolutive Neural Net Fuzzy Filtering: Basic Description

Evolutive Neural Net Fuzzy Filtering: Basic Description Journal of Intelligent Learning Systems and Applications, 2010, 2: 12-18 doi:10.4236/jilsa.2010.21002 Published Online February 2010 (http://www.scirp.org/journal/jilsa) Evolutive Neural Net Fuzzy Filtering:

More information

Mining Association Rules in Student s Assessment Data

Mining Association Rules in Student s Assessment Data www.ijcsi.org 211 Mining Association Rules in Student s Assessment Data Dr. Varun Kumar 1, Anupama Chadha 2 1 Department of Computer Science and Engineering, MVN University Palwal, Haryana, India 2 Anupama

More information

Semi-Supervised Face Detection

Semi-Supervised Face Detection Semi-Supervised Face Detection Nicu Sebe, Ira Cohen 2, Thomas S. Huang 3, Theo Gevers Faculty of Science, University of Amsterdam, The Netherlands 2 HP Research Labs, USA 3 Beckman Institute, University

More information

Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages

Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages Nuanwan Soonthornphisaj 1 and Boonserm Kijsirikul 2 Machine Intelligence and Knowledge Discovery Laboratory Department of Computer

More information

Using Web Searches on Important Words to Create Background Sets for LSI Classification

Using Web Searches on Important Words to Create Background Sets for LSI Classification Using Web Searches on Important Words to Create Background Sets for LSI Classification Sarah Zelikovitz and Marina Kogan College of Staten Island of CUNY 2800 Victory Blvd Staten Island, NY 11314 Abstract

More information

Learning Optimal Dialogue Strategies: A Case Study of a Spoken Dialogue Agent for

Learning Optimal Dialogue Strategies: A Case Study of a Spoken Dialogue Agent for Learning Optimal Dialogue Strategies: A Case Study of a Spoken Dialogue Agent for Email Marilyn A. Walker Jeanne C. Fromer Shrikanth Narayanan walker@research.att.com jeannie@ai.mit.edu shri@research.att.com

More information

Lecture 2: Quantifiers and Approximation

Lecture 2: Quantifiers and Approximation Lecture 2: Quantifiers and Approximation Case study: Most vs More than half Jakub Szymanik Outline Number Sense Approximate Number Sense Approximating most Superlative Meaning of most What About Counting?

More information

WHEN THERE IS A mismatch between the acoustic

WHEN THERE IS A mismatch between the acoustic 808 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 14, NO. 3, MAY 2006 Optimization of Temporal Filters for Constructing Robust Features in Speech Recognition Jeih-Weih Hung, Member,

More information

Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge

Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge Innov High Educ (2009) 34:93 103 DOI 10.1007/s10755-009-9095-2 Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge Phyllis Blumberg Published online: 3 February

More information

Seminar - Organic Computing

Seminar - Organic Computing Seminar - Organic Computing Self-Organisation of OC-Systems Markus Franke 25.01.2006 Typeset by FoilTEX Timetable 1. Overview 2. Characteristics of SO-Systems 3. Concern with Nature 4. Design-Concepts

More information

Switchboard Language Model Improvement with Conversational Data from Gigaword

Switchboard Language Model Improvement with Conversational Data from Gigaword Katholieke Universiteit Leuven Faculty of Engineering Master in Artificial Intelligence (MAI) Speech and Language Technology (SLT) Switchboard Language Model Improvement with Conversational Data from Gigaword

More information

Using focal point learning to improve human machine tacit coordination

Using focal point learning to improve human machine tacit coordination DOI 10.1007/s10458-010-9126-5 Using focal point learning to improve human machine tacit coordination InonZuckerman SaritKraus Jeffrey S. Rosenschein The Author(s) 2010 Abstract We consider an automated

More information

STA 225: Introductory Statistics (CT)

STA 225: Introductory Statistics (CT) Marshall University College of Science Mathematics Department STA 225: Introductory Statistics (CT) Course catalog description A critical thinking course in applied statistical reasoning covering basic

More information

Continual Curiosity-Driven Skill Acquisition from High-Dimensional Video Inputs for Humanoid Robots

Continual Curiosity-Driven Skill Acquisition from High-Dimensional Video Inputs for Humanoid Robots Continual Curiosity-Driven Skill Acquisition from High-Dimensional Video Inputs for Humanoid Robots Varun Raj Kompella, Marijn Stollenga, Matthew Luciw, Juergen Schmidhuber The Swiss AI Lab IDSIA, USI

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

Learning Methods for Fuzzy Systems

Learning Methods for Fuzzy Systems Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8

More information

Chapter 2 Rule Learning in a Nutshell

Chapter 2 Rule Learning in a Nutshell Chapter 2 Rule Learning in a Nutshell This chapter gives a brief overview of inductive rule learning and may therefore serve as a guide through the rest of the book. Later chapters will expand upon the

More information

OCR for Arabic using SIFT Descriptors With Online Failure Prediction

OCR for Arabic using SIFT Descriptors With Online Failure Prediction OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,

More information

Analysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier

Analysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 10, Issue 2, Ver.1 (Mar - Apr.2015), PP 55-61 www.iosrjournals.org Analysis of Emotion

More information

Student Perceptions of Reflective Learning Activities

Student Perceptions of Reflective Learning Activities Student Perceptions of Reflective Learning Activities Rosalind Wynne Electrical and Computer Engineering Department Villanova University, PA rosalind.wynne@villanova.edu Abstract It is widely accepted

More information

Speech Emotion Recognition Using Support Vector Machine

Speech Emotion Recognition Using Support Vector Machine Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,

More information

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng Microsoft Research, One Microsoft Way, Redmond, WA 98052, U.S.A.

More information

Online Updating of Word Representations for Part-of-Speech Tagging

Online Updating of Word Representations for Part-of-Speech Tagging Online Updating of Word Representations for Part-of-Speech Tagging Wenpeng Yin LMU Munich wenpeng@cis.lmu.de Tobias Schnabel Cornell University tbs49@cornell.edu Hinrich Schütze LMU Munich inquiries@cislmu.org

More information

Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape

Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape Koshi Odagiri 1, and Yoichi Muraoka 1 1 Graduate School of Fundamental/Computer Science and Engineering, Waseda University,

More information

Chapter 10 APPLYING TOPIC MODELING TO FORENSIC DATA. 1. Introduction. Alta de Waal, Jacobus Venter and Etienne Barnard

Chapter 10 APPLYING TOPIC MODELING TO FORENSIC DATA. 1. Introduction. Alta de Waal, Jacobus Venter and Etienne Barnard Chapter 10 APPLYING TOPIC MODELING TO FORENSIC DATA Alta de Waal, Jacobus Venter and Etienne Barnard Abstract Most actionable evidence is identified during the analysis phase of digital forensic investigations.

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

A study of speaker adaptation for DNN-based speech synthesis

A study of speaker adaptation for DNN-based speech synthesis A study of speaker adaptation for DNN-based speech synthesis Zhizheng Wu, Pawel Swietojanski, Christophe Veaux, Steve Renals, Simon King The Centre for Speech Technology Research (CSTR) University of Edinburgh,

More information

A cognitive perspective on pair programming

A cognitive perspective on pair programming Association for Information Systems AIS Electronic Library (AISeL) AMCIS 2006 Proceedings Americas Conference on Information Systems (AMCIS) December 2006 A cognitive perspective on pair programming Radhika

More information

*Net Perceptions, Inc West 78th Street Suite 300 Minneapolis, MN

*Net Perceptions, Inc West 78th Street Suite 300 Minneapolis, MN From: AAAI Technical Report WS-98-08. Compilation copyright 1998, AAAI (www.aaai.org). All rights reserved. Recommender Systems: A GroupLens Perspective Joseph A. Konstan *t, John Riedl *t, AI Borchers,

More information

Historical maintenance relevant information roadmap for a self-learning maintenance prediction procedural approach

Historical maintenance relevant information roadmap for a self-learning maintenance prediction procedural approach IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Historical maintenance relevant information roadmap for a self-learning maintenance prediction procedural approach To cite this

More information

Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski

Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Problem Statement and Background Given a collection of 8th grade science questions, possible answer

More information

Mining Student Evolution Using Associative Classification and Clustering

Mining Student Evolution Using Associative Classification and Clustering Mining Student Evolution Using Associative Classification and Clustering 19 Mining Student Evolution Using Associative Classification and Clustering Kifaya S. Qaddoum, Faculty of Information, Technology

More information

Comment-based Multi-View Clustering of Web 2.0 Items

Comment-based Multi-View Clustering of Web 2.0 Items Comment-based Multi-View Clustering of Web 2.0 Items Xiangnan He 1 Min-Yen Kan 1 Peichu Xie 2 Xiao Chen 3 1 School of Computing, National University of Singapore 2 Department of Mathematics, National University

More information

IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH

IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH 2009 423 Adaptive Multimodal Fusion by Uncertainty Compensation With Application to Audiovisual Speech Recognition George

More information

Robot Learning Simultaneously a Task and How to Interpret Human Instructions

Robot Learning Simultaneously a Task and How to Interpret Human Instructions Robot Learning Simultaneously a Task and How to Interpret Human Instructions Jonathan Grizou, Manuel Lopes, Pierre-Yves Oudeyer To cite this version: Jonathan Grizou, Manuel Lopes, Pierre-Yves Oudeyer.

More information

Instructor: Mario D. Garrett, Ph.D. Phone: Office: Hepner Hall (HH) 100

Instructor: Mario D. Garrett, Ph.D.   Phone: Office: Hepner Hall (HH) 100 San Diego State University School of Social Work 610 COMPUTER APPLICATIONS FOR SOCIAL WORK PRACTICE Statistical Package for the Social Sciences Office: Hepner Hall (HH) 100 Instructor: Mario D. Garrett,

More information