Session 1: Gesture Recognition & Machine Learning Fundamentals

Size: px
Start display at page:

Download "Session 1: Gesture Recognition & Machine Learning Fundamentals"

Transcription

1 IAP Gesture Recognition Workshop Session 1: Gesture Recognition & Machine Learning Fundamentals Nicholas Gillian Responsive Environments, MIT Media Lab Tuesday 8th January, 2013

2 My Research

3 My Research Gesture Recognition for Musician Computer Interaction

4 My Research Gesture Recognition for Musician Computer Interaction Rapid Learning

5 My Research Gesture Recognition for Musician Computer Interaction Rapid Learning Free-air Gestures & Fine-grain Control

6 My Research Gesture Recognition for Musician Computer Interaction Rapid Learning Free-air Gestures & Fine-grain Control Creating tools and software that enable a more diverse group of individuals to integrate gesture-recognition into their own interfaces, art installations, and musical instruments

7 My Research Gesture Recognition for Musician Computer Interaction Rapid Learning Free-air Gestures & Fine-grain Control Creating tools and software that enable a more diverse group of individuals to integrate gesture-recognition into their own interfaces, art installations, and musical instruments EyesWeb Gesture Recognition Toolkit

8 Schedule Machine Learning 101 Hello World Gesture Recognition Installation & Setup Introduction to the Gesture Recognition Toolkit Lunch Hands-on Coding Sessions

9 Basic Pattern Recognition Problem

10 Basic Pattern Recognition Problem

11 Basic Pattern Recognition Problem Might work for simple cases...

12 Basic Pattern Recognition Problem Can be more difficult with multidimensional data!

13 Basic Pattern Recognition Problem Event B Can be more difficult with multiple events!

14 Machine Learning Machine Learning 101

15 Machine Learning Dataset

16 Machine Learning ML can automatically infer the underlying behavior/rules of this data

17 Machine Learning These rules can then be used to make predictions about future data

18 Machine Learning

19 Machine Learning The three main phases of machine learning: Data Collection Learning Prediction

20 Machine Learning Machine Learning is commonly used to solve two main problems:

21 Machine Learning Machine Learning is commonly used to solve two main problems: CLASSIFICATION

22 Machine Learning Machine Learning is commonly used to solve two main problems: CLASSIFICATION

23 Machine Learning Machine Learning is commonly used to solve two main problems: CLASSIFICATION

24 Machine Learning Machine Learning is commonly used to solve two main problems: CLASSIFICATION

25 Machine Learning Machine Learning is commonly used to solve two main problems: CLASSIFICATION REGRESSION

26 Machine Learning Machine Learning is commonly used to solve two main problems: CLASSIFICATION REGRESSION

27 Machine Learning Machine Learning is commonly used to solve two main problems: CLASSIFICATION Discrete Output, representing the most likely class that the input x belongs to REGRESSION

28 Machine Learning Machine Learning is commonly used to solve two main problems: CLASSIFICATION Discrete Output, representing the most likely class that the input x belongs to REGRESSION Continuous Output, mapping the N dimensional input vector x to an M dimensional vector y

29 Machine Learning Main types of learning:

30 Machine Learning Main types of learning: SUPERVISED LEARNING

31 Machine Learning Main types of learning: Class A Class B SUPERVISED LEARNING

32 Machine Learning Main types of learning: Class A Class B SUPERVISED LEARNING UNSUPERVISED LEARNING

33 Machine Learning Main types of learning: Class A Class B SUPERVISED LEARNING UNSUPERVISED LEARNING

34 Machine Learning Main types of learning: Class A Class B SUPERVISED LEARNING UNSUPERVISED LEARNING

35 Machine Learning Main types of learning: Class A Class B SUPERVISED LEARNING UNSUPERVISED LEARNING many others, such as semi-supervised learning, reinforcement learning, active learning, deep learning, etc..

36 Machine Learning Main types of learning: Class A Class B SUPERVISED LEARNING UNSUPERVISED LEARNING many others, such as semi-supervised learning, reinforcement learning, active learning, deep learning, etc..

37 Machine Learning Supervised Learning

38 Machine Learning Training Data

39 Machine Learning Training Data

40 Machine Learning Training Data Input Vector

41 Machine Learning Training Data Input Vector Target Vector

42 Machine Learning Training Data Learning Algorithm Input Vector Target Vector

43 Machine Learning Model Training Data Learning Algorithm Input Vector Target Vector

44 Machine Learning Model Training Data Learning Algorithm New Datum Prediction

45 Machine Learning Model Training Data Learning Algorithm Class A New Datum Predicted Class Prediction

46 Machine Learning Model Training Data Learning Algorithm Class A New Datum Predicted Class Prediction

47 Machine Learning Offline Model Training Data Learning Algorithm Class A New Datum Predicted Class Prediction

48 Machine Learning Model Training Data Learning Algorithm Online Class A New Datum Predicted Class Prediction

49 The Learning Process Model Training Data Learning Algorithm Class A New Datum Predicted Class Prediction

50 The Learning Process

51 The Learning Process

52 The Learning Process DECISION BOUNDARY

53 The Learning Process DECISION BOUNDARY

54 The Learning Process DECISION BOUNDARY

55 The Learning Process There are many possible decision boundaries! How do we choose the best one?

56 The Learning Process Minimize some error: Num Correctly Classified Examples Num Examples

57 The Learning Process Minimize some error: Num Correctly Classified Examples Num Examples Error = 0.31

58 The Learning Process Minimize some error: Num Correctly Classified Examples Num Examples Error = 0.22

59 The Learning Process Minimize some error: Num Correctly Classified Examples Num Examples Error = 0.12

60 The Learning Process Stop when this error is small Error = 0

61 The Learning Process Need to be careful that we don t overtrain the model...

62 The Learning Process Need to be careful that we don t overtrain the model... Complex decision boundary gets a perfect result on the training data

63 The Learning Process Need to be careful that we don t overtrain the model... Complex decision boundary gets a perfect result on the training data But it might fail terribly with new data

64 The Learning Process Need to be careful that we don t overtrain the model... Complex decision boundary gets a perfect result on the training data But it might fail terribly with new data This is know as OVERFITTING

65 The Learning Process Need to be careful that we don t overtrain the model... A very simple decision boundary might not work either

66 The Learning Process Need to be careful that we don t overtrain the model... A very simple decision boundary might not work either This is know as UNDERFITTING

67 The Learning Process Need to be careful that we don t overtrain the model... Instead, a less complex decision boundary might work much better, even if it does not perfectly reduce the error on the training data

68 The Learning Process Need to be careful that we don t overtrain the model... Instead, a less complex decision boundary might work much better, even if it does not perfectly reduce the error on the training data A model s ability to correctly predict the values of unseen data is know as GENERALIZATION

69 Testing a Model s Generalization Ability

70 Testing a Model s Generalization Ability Important not to use the training data to test a model!

71 Testing a Model s Generalization Ability Important not to use the training data to test a model! Instead use a test dataset

72 Testing a Model s Generalization Ability Important not to use the training data to test a model! Instead use a test dataset Dataset

73 Testing a Model s Generalization Ability Important not to use the training data to test a model! Instead use a test dataset Random Spilt Dataset

74 Testing a Model s Generalization Ability Important not to use the training data to test a model! Instead use a test dataset Random Spilt Training Dataset Dataset

75 Testing a Model s Generalization Ability Important not to use the training data to test a model! Instead use a test dataset Random Spilt Training Dataset Dataset Test Dataset

76 Testing a Model s Generalization Ability Sometimes there is not enough data to create a test dataset

77 Testing a Model s Generalization Ability Sometimes there is not enough data to create a test dataset Instead use K-FOLD CROSS VALIDATION

78 Testing a Model s Generalization Ability Sometimes there is not enough data to create a test dataset Instead use K-FOLD CROSS VALIDATION Dataset

79 Testing a Model s Generalization Ability Sometimes there is not enough data to create a test dataset Instead use K-FOLD CROSS VALIDATION Random Partition Dataset Partition Data into K Folds

80 Testing a Model s Generalization Ability Sometimes there is not enough data to create a test dataset Instead use K-FOLD CROSS VALIDATION Training Dataset Random Partition Dataset Fold 1

81 Testing a Model s Generalization Ability Sometimes there is not enough data to create a test dataset Instead use K-FOLD CROSS VALIDATION Training Dataset Random Partition Dataset Test Dataset Fold 1

82 Testing a Model s Generalization Ability Sometimes there is not enough data to create a test dataset Instead use K-FOLD CROSS VALIDATION Test Dataset Random Partition Training Dataset Dataset Fold 2

83 Testing a Model s Generalization Ability Sometimes there is not enough data to create a test dataset Instead use K-FOLD CROSS VALIDATION Test Dataset Random Partition Training Dataset Dataset Fold 3

84 Testing a Model s Generalization Ability Classification Accuracy = Num Correctly Classified Examples Num Test Examples

85 Testing a Model s Generalization Ability Classification Accuracy = Num Correctly Classified Examples Num Test Examples Precision k = Num Correctly Classified Examples for Class k Num Examples Classified as Class k

86 Testing a Model s Generalization Ability Classification Accuracy = Num Correctly Classified Examples Num Test Examples Precision k = Num Correctly Classified Examples for Class k Num Examples Classified as Class k Recall k = Num Correctly Classified Examples for Class k Num Class k Examples

87 Testing a Model s Generalization Ability Classification Accuracy = Num Correctly Classified Examples Num Test Examples Precision k = Num Correctly Classified Examples for Class k Num Examples Classified as Class k Recall k = Num Correctly Classified Examples for Class k Num Class k Examples F-measure k = 2 * Precision k * Recall k Precision k + Recall k

88 Testing a Model s Generalization Ability Classification Task: Detect the coffee mugs in the image

89 Testing a Model s Generalization Ability Segmentation algorithm gives us 13 possible candidates

90 Testing a Model s Generalization Ability The classification algorithm predicts that the following 5 objects are coffee mugs

91 Testing a Model s Generalization Ability Accuracy =? The classification algorithm predicts that the following 5 objects are coffee mugs

92 Testing a Model s Generalization Ability Accuracy = 10/13 = items were classified correctly, 3 were not

93 Testing a Model s Generalization Ability Accuracy = 10/13 = 0.78 Precision =? Precision k = Num Correctly Classified Examples as Class k Num Examples Classified as Class k

94 Testing a Model s Generalization Ability Accuracy = 10/13 = 0.78 Precision = 4/5 = 0.8 Precision k = Num Correctly Classified Examples as Class k Num Examples Classified as Class k

95 Testing a Model s Generalization Ability Accuracy = 10/13 = 0.78 Precision = 4/5 = 0.8 Recall =? Recall k = Num Correctly Classified Examples as Class k Num Class k Examples

96 Testing a Model s Generalization Ability Accuracy = 10/13 = 0.78 Precision = 4/5 = 0.8 Recall = 4/6 = 0.6 Recall k = Num Correctly Classified Examples as Class k Num Class k Examples

97 Testing a Model s Generalization Ability Accuracy = 10/13 = 0.78 Precision = 4/5 = 0.8 Recall = 4/6 = 0.6 F-Measure = 2 * 0.8 * = 0.69 Recall k = Num Correctly Classified Examples as Class k Num Class k Examples

98 A Simple Classifier Example

99 K-Nearest Neighbor Classifier (KNN)

100 K-Nearest Neighbor Classifier (KNN) Training Data Training Data: - M Labelled Training Examples - Each example is an N- Dimensional Vector

101 K-Nearest Neighbor Classifier (KNN) Training Data Learning Algorithm Training Phase: - Simply save the labelled training examples

102 K-Nearest Neighbor Classifier (KNN) Training Data Learning Algorithm Model Model: - Labelled training examples

103 K-Nearest Neighbor Classifier (KNN) Class? Training Data Learning Algorithm Model New Datum Predicted Class Prediction Phase: - Given a new N-Dimensional Vector, predict which class it belongs to

104 K-Nearest Neighbor Classifier (KNN) Class? Training Data Learning Algorithm Model New Datum Predicted Class Prediction Phase: - Given a new N-Dimensional Vector, predict which class it belongs to - Find the K Nearest Neighbors in the training examples - Classify x as the most likely class (i.e. the most common class in the K Nearest Neighbors) Class A: 2 Class B: 1 Likelihood of belonging to Class A = 0.6

105 K-Nearest Neighbor Classifier (KNN) Class? Training Data Learning Algorithm Model New Datum Predicted Class Prediction Phase: - Given a new N-Dimensional Vector, predict which class it belongs to - Find the K Nearest Neighbors in the training examples - Classify x as the most likely class (i.e. the most common class in the K Nearest Neighbors) Class A: 4 Class B: 6 Likelihood of belonging to Class B = 0.6

106 Hello World - KNN Demo

107 Gesture Recognition

108 Gesture Recognition

109 Gesture Recognition Instead of using the raw data as input to the learning algorithm, we might want to pre-process the data (i.e. scale it, smooth it) and also compute some features from the data which make the classification task easier for the machine-learning algorithm

110 Gesture Recognition Important that we also use the same pre-processing and feature extraction methods when predicting the new data!

111 Gesture Recognition Important that we also use the same pre-processing and feature extraction methods when predicting the new data!

112 Gesture Recognition Classification Task: Recognize different postures of a dancer

113 Gesture Recognition Classification Task: Recognize different postures of a dancer Input Vector: * 480 * 3 =

114 Gesture Recognition Preprocessing: Background Subtraction

115 Gesture Recognition Preprocessing: Background Subtraction Input Vector: * 480 =

116 Gesture Recognition Feature Extraction: Bounding Box Input Vector: = 2

117 Gesture Recognition Important that we also use the same pre-processing and feature extraction methods when predicting the new data!

118 Gesture Recognition As well as pre-processing the input to the classification algorithm, we might also want to process the output of the classifier

119 Gesture Recognition Choosing the right features is REALLY IMPORTANT!

120 Gesture Recognition Choosing the right features is REALLY IMPORTANT! Choosing the right ML algorithm is also REALLY IMPORTANT!

121 Gesture Recognition Choosing the right algorithm to solve your problem:

122 Gesture Recognition Choosing the right algorithm to solve your problem: First you need to categorize your problem:

123 Gesture Recognition Choosing the right algorithm to solve your problem: First you need to categorize your problem: Problem Discrete or Continuous Output?

124 Gesture Recognition Choosing the right algorithm to solve your problem: First you need to categorize your problem: Problem Discrete or Continuous Output? Continuous

125 Gesture Recognition Choosing the right algorithm to solve your problem: First you need to categorize your problem: Problem Discrete or Continuous Output? Continuous REGRESSION PROBLEM

126 Gesture Recognition Choosing the right algorithm to solve your problem: First you need to categorize your problem: Discrete Static Posture or Temporal Gesture? Problem Discrete or Continuous Output? Continuous REGRESSION PROBLEM

127 Gesture Recognition Choosing the right algorithm to solve your problem: First you need to categorize your problem: Discrete Static Posture or Temporal Gesture? STATIC CLASSIFICATION PROBLEM Problem Discrete or Continuous Output? Continuous REGRESSION PROBLEM

128 Gesture Recognition Choosing the right algorithm to solve your problem: First you need to categorize your problem: Problem Discrete Discrete or Continuous Output? Static Posture or Temporal Gesture? STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM Continuous REGRESSION PROBLEM

129 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM PROBLEM

130 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM Adaptive Naive Bayes Classifier (ANBC) TEMPORAL CLASSIFICATION PROBLEM PROBLEM

131 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM Adaptive Naive Bayes Classifier (ANBC) K-Nearest Neighbor (KNN) PROBLEM

132 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM Adaptive Naive Bayes Classifier (ANBC) K-Nearest Neighbor (KNN) AdaBoost PROBLEM

133 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM Adaptive Naive Bayes Classifier (ANBC) K-Nearest Neighbor (KNN) AdaBoost Decision Trees PROBLEM

134 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM Adaptive Naive Bayes Classifier (ANBC) K-Nearest Neighbor (KNN) AdaBoost Decision Trees Support Vector Machine (SVM) PROBLEM

135 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM PROBLEM

136 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM Hidden Markov Model (HMM) PROBLEM

137 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM Hidden Markov Model (HMM) Dynamic Time Warping (DTW) PROBLEM

138 Gesture Recognition Choosing the right algorithm to solve your problem: STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM PROBLEM

139 Gesture Recognition Choosing the right algorithm to solve your problem: Static Posture or Temporal Gesture? STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM REGRESSION PROBLEM

140 Gesture Recognition Choosing the right algorithm to solve your problem: Static Posture or Temporal Gesture? STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM REGRESSION PROBLEM Artificial Neural Network (ANN)

141 Gesture Recognition Choosing the right algorithm to solve your problem: Static Posture or Temporal Gesture? STATIC CLASSIFICATION PROBLEM TEMPORAL CLASSIFICATION PROBLEM REGRESSION PROBLEM

142 Gesture Recognition Choosing the right algorithm to solve your problem:

143 Machine Learning Resources - Great books to get started: Marsland (2009): Machine Learning: An Algorithmic Perspective Witten (2011): Data Mining: Practical Machine Learning Tools and Techniques - More detailed books: Bishop (2007): Pattern Recognition and Machine Learning - Online Lectures: Duda (2001): Pattern Classification Prof. Andrew Ng (Stanford University), Machine Learning Lectures (search for Machine Learning (Stanford) in youtube)

144 Gesture Recognition Toolkit

145 Gesture Recognition Toolkit Adaptive Naive Bayes Classifier K-Nearest Neighbor Dynamic Time Warping Support Vector Machine Classification Modules Regression Modules Artificial Neural Networks Gaussian Mixture Model

146 Gesture Recognition Toolkit Adaptive Naive Bayes Classifier K-Nearest Neighbor Dynamic Time Warping Support Vector Machine Classification Modules Regression Modules Artificial Neural Networks Gaussian Mixture Model Circular Buffer Data Linear Algebra Utils Structures Matrix Timer Training Data Structures Random Range Tracker

147 Gesture Recognition Toolkit Filters FFT Pre Processing Modules Adaptive Naive Bayes Classifier Derivative Zero Crossing Feature Extraction Modules Peak Detection Zero Crossing Counter Movement Trajectory Features Post Processing Modules K-Nearest Neighbor Dynamic Time Warping Support Vector Machine Classification Modules Regression Modules Class Label Filters Artificial Neural Networks Gaussian Mixture Model Circular Buffer Data Linear Algebra Utils Structures Matrix Timer Training Data Structures Random Range Tracker

148 Gesture Recognition Toolkit Classification Modules Pre Processing Modules Feature Extraction Modules Regression Post Processing Modules Modules

149 Gesture Recognition Toolkit Classification Modules Pre Processing Modules Feature Extraction Modules Regression Post Processing Modules Modules Gesture Recognition Pipeline

150 Gesture Recognition Toolkit This is how you setup a new pipeline and set the classifier

151 Gesture Recognition Toolkit This is how you would change the classifier

152 Gesture Recognition Toolkit This is how you setup a more complex pipeline

153 Gesture Recognition Toolkit This is how you train the algorithm at the core of the pipeline

154 Gesture Recognition Toolkit This is how you test the accuracy of the pipeline

155 Gesture Recognition Toolkit You can then easily access the accuracy, precision, recall, etc.

156 Gesture Recognition Toolkit If you want to run k-fold cross validation, then simply state the k-value when you call the train method and the pipeline will do the rest

157 Gesture Recognition Toolkit This is how you perform real-time classification

158 Gesture Recognition Toolkit After the prediction you can then get the predicted class label, predication likelihoods, etc.

Lecture 1: Machine Learning Basics

Lecture 1: Machine Learning Basics 1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3

More information

Python Machine Learning

Python Machine Learning Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

Human Emotion Recognition From Speech

Human Emotion Recognition From Speech RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati

More information

CS Machine Learning

CS Machine Learning CS 478 - Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing

More information

Twitter Sentiment Classification on Sanders Data using Hybrid Approach

Twitter Sentiment Classification on Sanders Data using Hybrid Approach IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 17, Issue 4, Ver. I (July Aug. 2015), PP 118-123 www.iosrjournals.org Twitter Sentiment Classification on Sanders

More information

(Sub)Gradient Descent

(Sub)Gradient Descent (Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include

More information

CSL465/603 - Machine Learning

CSL465/603 - Machine Learning CSL465/603 - Machine Learning Fall 2016 Narayanan C Krishnan ckn@iitrpr.ac.in Introduction CSL465/603 - Machine Learning 1 Administrative Trivia Course Structure 3-0-2 Lecture Timings Monday 9.55-10.45am

More information

Assignment 1: Predicting Amazon Review Ratings

Assignment 1: Predicting Amazon Review Ratings Assignment 1: Predicting Amazon Review Ratings 1 Dataset Analysis Richard Park r2park@acsmail.ucsd.edu February 23, 2015 The dataset selected for this assignment comes from the set of Amazon reviews for

More information

Speech Emotion Recognition Using Support Vector Machine

Speech Emotion Recognition Using Support Vector Machine Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

CLASSIFICATION OF TEXT DOCUMENTS USING INTEGER REPRESENTATION AND REGRESSION: AN INTEGRATED APPROACH

CLASSIFICATION OF TEXT DOCUMENTS USING INTEGER REPRESENTATION AND REGRESSION: AN INTEGRATED APPROACH ISSN: 0976-3104 Danti and Bhushan. ARTICLE OPEN ACCESS CLASSIFICATION OF TEXT DOCUMENTS USING INTEGER REPRESENTATION AND REGRESSION: AN INTEGRATED APPROACH Ajit Danti 1 and SN Bharath Bhushan 2* 1 Department

More information

Learning From the Past with Experiment Databases

Learning From the Past with Experiment Databases Learning From the Past with Experiment Databases Joaquin Vanschoren 1, Bernhard Pfahringer 2, and Geoff Holmes 2 1 Computer Science Dept., K.U.Leuven, Leuven, Belgium 2 Computer Science Dept., University

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X

The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, 2013 10.12753/2066-026X-13-154 DATA MINING SOLUTIONS FOR DETERMINING STUDENT'S PROFILE Adela BÂRA,

More information

Analysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier

Analysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 10, Issue 2, Ver.1 (Mar - Apr.2015), PP 55-61 www.iosrjournals.org Analysis of Emotion

More information

Switchboard Language Model Improvement with Conversational Data from Gigaword

Switchboard Language Model Improvement with Conversational Data from Gigaword Katholieke Universiteit Leuven Faculty of Engineering Master in Artificial Intelligence (MAI) Speech and Language Technology (SLT) Switchboard Language Model Improvement with Conversational Data from Gigaword

More information

Introduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition

Introduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition Introduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition Todd Holloway Two Lecture Series for B551 November 20 & 27, 2007 Indiana University Outline Introduction Bias and

More information

Reducing Features to Improve Bug Prediction

Reducing Features to Improve Bug Prediction Reducing Features to Improve Bug Prediction Shivkumar Shivaji, E. James Whitehead, Jr., Ram Akella University of California Santa Cruz {shiv,ejw,ram}@soe.ucsc.edu Sunghun Kim Hong Kong University of Science

More information

Generative models and adversarial training

Generative models and adversarial training Day 4 Lecture 1 Generative models and adversarial training Kevin McGuinness kevin.mcguinness@dcu.ie Research Fellow Insight Centre for Data Analytics Dublin City University What is a generative model?

More information

Rule Learning With Negation: Issues Regarding Effectiveness

Rule Learning With Negation: Issues Regarding Effectiveness Rule Learning With Negation: Issues Regarding Effectiveness S. Chua, F. Coenen, G. Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX Liverpool, United

More information

Semi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17.

Semi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17. Semi-supervised methods of text processing, and an application to medical concept extraction Yacine Jernite Text-as-Data series September 17. 2015 What do we want from text? 1. Extract information 2. Link

More information

Lecture 1: Basic Concepts of Machine Learning

Lecture 1: Basic Concepts of Machine Learning Lecture 1: Basic Concepts of Machine Learning Cognitive Systems - Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010

More information

A Case Study: News Classification Based on Term Frequency

A Case Study: News Classification Based on Term Frequency A Case Study: News Classification Based on Term Frequency Petr Kroha Faculty of Computer Science University of Technology 09107 Chemnitz Germany kroha@informatik.tu-chemnitz.de Ricardo Baeza-Yates Center

More information

ScienceDirect. A Framework for Clustering Cardiac Patient s Records Using Unsupervised Learning Techniques

ScienceDirect. A Framework for Clustering Cardiac Patient s Records Using Unsupervised Learning Techniques Available online at www.sciencedirect.com ScienceDirect Procedia Computer Science 98 (2016 ) 368 373 The 6th International Conference on Current and Future Trends of Information and Communication Technologies

More information

A study of speaker adaptation for DNN-based speech synthesis

A study of speaker adaptation for DNN-based speech synthesis A study of speaker adaptation for DNN-based speech synthesis Zhizheng Wu, Pawel Swietojanski, Christophe Veaux, Steve Renals, Simon King The Centre for Speech Technology Research (CSTR) University of Edinburgh,

More information

Speech Recognition at ICSI: Broadcast News and beyond

Speech Recognition at ICSI: Broadcast News and beyond Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI

More information

Rule Learning with Negation: Issues Regarding Effectiveness

Rule Learning with Negation: Issues Regarding Effectiveness Rule Learning with Negation: Issues Regarding Effectiveness Stephanie Chua, Frans Coenen, and Grant Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX

More information

Indian Institute of Technology, Kanpur

Indian Institute of Technology, Kanpur Indian Institute of Technology, Kanpur Course Project - CS671A POS Tagging of Code Mixed Text Ayushman Sisodiya (12188) {ayushmn@iitk.ac.in} Donthu Vamsi Krishna (15111016) {vamsi@iitk.ac.in} Sandeep Kumar

More information

Learning Methods in Multilingual Speech Recognition

Learning Methods in Multilingual Speech Recognition Learning Methods in Multilingual Speech Recognition Hui Lin Department of Electrical Engineering University of Washington Seattle, WA 98125 linhui@u.washington.edu Li Deng, Jasha Droppo, Dong Yu, and Alex

More information

Activity Recognition from Accelerometer Data

Activity Recognition from Accelerometer Data Activity Recognition from Accelerometer Data Nishkam Ravi and Nikhil Dandekar and Preetham Mysore and Michael L. Littman Department of Computer Science Rutgers University Piscataway, NJ 08854 {nravi,nikhild,preetham,mlittman}@cs.rutgers.edu

More information

Multivariate k-nearest Neighbor Regression for Time Series data -

Multivariate k-nearest Neighbor Regression for Time Series data - Multivariate k-nearest Neighbor Regression for Time Series data - a novel Algorithm for Forecasting UK Electricity Demand ISF 2013, Seoul, Korea Fahad H. Al-Qahtani Dr. Sven F. Crone Management Science,

More information

Machine Learning from Garden Path Sentences: The Application of Computational Linguistics

Machine Learning from Garden Path Sentences: The Application of Computational Linguistics Machine Learning from Garden Path Sentences: The Application of Computational Linguistics http://dx.doi.org/10.3991/ijet.v9i6.4109 J.L. Du 1, P.F. Yu 1 and M.L. Li 2 1 Guangdong University of Foreign Studies,

More information

WHEN THERE IS A mismatch between the acoustic

WHEN THERE IS A mismatch between the acoustic 808 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 14, NO. 3, MAY 2006 Optimization of Temporal Filters for Constructing Robust Features in Speech Recognition Jeih-Weih Hung, Member,

More information

Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks

Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Devendra Singh Chaplot, Eunhee Rhim, and Jihie Kim Samsung Electronics Co., Ltd. Seoul, South Korea {dev.chaplot,eunhee.rhim,jihie.kim}@samsung.com

More information

A Vector Space Approach for Aspect-Based Sentiment Analysis

A Vector Space Approach for Aspect-Based Sentiment Analysis A Vector Space Approach for Aspect-Based Sentiment Analysis by Abdulaziz Alghunaim B.S., Massachusetts Institute of Technology (2015) Submitted to the Department of Electrical Engineering and Computer

More information

AUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION

AUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 11/2007, ISSN 1642-6037 Marek WIŚNIEWSKI *, Wiesława KUNISZYK-JÓŹKOWIAK *, Elżbieta SMOŁKA *, Waldemar SUSZYŃSKI * HMM, recognition, speech, disorders

More information

Word Segmentation of Off-line Handwritten Documents

Word Segmentation of Off-line Handwritten Documents Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department

More information

CS 446: Machine Learning

CS 446: Machine Learning CS 446: Machine Learning Introduction to LBJava: a Learning Based Programming Language Writing classifiers Christos Christodoulopoulos Parisa Kordjamshidi Motivation 2 Motivation You still have not learnt

More information

Deep search. Enhancing a search bar using machine learning. Ilgün Ilgün & Cedric Reichenbach

Deep search. Enhancing a search bar using machine learning. Ilgün Ilgün & Cedric Reichenbach #BaselOne7 Deep search Enhancing a search bar using machine learning Ilgün Ilgün & Cedric Reichenbach We are not researchers Outline I. Periscope: A search tool II. Goals III. Deep learning IV. Applying

More information

arxiv: v2 [cs.cv] 30 Mar 2017

arxiv: v2 [cs.cv] 30 Mar 2017 Domain Adaptation for Visual Applications: A Comprehensive Survey Gabriela Csurka arxiv:1702.05374v2 [cs.cv] 30 Mar 2017 Abstract The aim of this paper 1 is to give an overview of domain adaptation and

More information

Machine Learning and Data Mining. Ensembles of Learners. Prof. Alexander Ihler

Machine Learning and Data Mining. Ensembles of Learners. Prof. Alexander Ihler Machine Learning and Data Mining Ensembles of Learners Prof. Alexander Ihler Ensemble methods Why learn one classifier when you can learn many? Ensemble: combine many predictors (Weighted) combina

More information

Large-Scale Web Page Classification. Sathi T Marath. Submitted in partial fulfilment of the requirements. for the degree of Doctor of Philosophy

Large-Scale Web Page Classification. Sathi T Marath. Submitted in partial fulfilment of the requirements. for the degree of Doctor of Philosophy Large-Scale Web Page Classification by Sathi T Marath Submitted in partial fulfilment of the requirements for the degree of Doctor of Philosophy at Dalhousie University Halifax, Nova Scotia November 2010

More information

Using Web Searches on Important Words to Create Background Sets for LSI Classification

Using Web Searches on Important Words to Create Background Sets for LSI Classification Using Web Searches on Important Words to Create Background Sets for LSI Classification Sarah Zelikovitz and Marina Kogan College of Staten Island of CUNY 2800 Victory Blvd Staten Island, NY 11314 Abstract

More information

Speech Recognition by Indexing and Sequencing

Speech Recognition by Indexing and Sequencing International Journal of Computer Information Systems and Industrial Management Applications. ISSN 215-7988 Volume 4 (212) pp. 358 365 c MIR Labs, www.mirlabs.net/ijcisim/index.html Speech Recognition

More information

Australian Journal of Basic and Applied Sciences

Australian Journal of Basic and Applied Sciences AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean

More information

Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration

Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration INTERSPEECH 2013 Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration Yan Huang, Dong Yu, Yifan Gong, and Chaojun Liu Microsoft Corporation, One

More information

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng Microsoft Research, One Microsoft Way, Redmond, WA 98052, U.S.A.

More information

ADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION

ADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION ADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION Mitchell McLaren 1, Yun Lei 1, Luciana Ferrer 2 1 Speech Technology and Research Laboratory, SRI International, California, USA 2 Departamento

More information

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering

More information

Time series prediction

Time series prediction Chapter 13 Time series prediction Amaury Lendasse, Timo Honkela, Federico Pouzols, Antti Sorjamaa, Yoan Miche, Qi Yu, Eric Severin, Mark van Heeswijk, Erkki Oja, Francesco Corona, Elia Liitiäinen, Zhanxing

More information

Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages

Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages Nuanwan Soonthornphisaj 1 and Boonserm Kijsirikul 2 Machine Intelligence and Knowledge Discovery Laboratory Department of Computer

More information

Probabilistic Latent Semantic Analysis

Probabilistic Latent Semantic Analysis Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview

More information

SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF)

SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF) SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF) Hans Christian 1 ; Mikhael Pramodana Agus 2 ; Derwin Suhartono 3 1,2,3 Computer Science Department,

More information

Speech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines

Speech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines Speech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines Amit Juneja and Carol Espy-Wilson Department of Electrical and Computer Engineering University of Maryland,

More information

Issues in the Mining of Heart Failure Datasets

Issues in the Mining of Heart Failure Datasets International Journal of Automation and Computing 11(2), April 2014, 162-179 DOI: 10.1007/s11633-014-0778-5 Issues in the Mining of Heart Failure Datasets Nongnuch Poolsawad 1 Lisa Moore 1 Chandrasekhar

More information

Lecture 10: Reinforcement Learning

Lecture 10: Reinforcement Learning Lecture 1: Reinforcement Learning Cognitive Systems II - Machine Learning SS 25 Part III: Learning Programs and Strategies Q Learning, Dynamic Programming Lecture 1: Reinforcement Learning p. Motivation

More information

Linking Task: Identifying authors and book titles in verbose queries

Linking Task: Identifying authors and book titles in verbose queries Linking Task: Identifying authors and book titles in verbose queries Anaïs Ollagnier, Sébastien Fournier, and Patrice Bellot Aix-Marseille University, CNRS, ENSAM, University of Toulon, LSIS UMR 7296,

More information

Computerized Adaptive Psychological Testing A Personalisation Perspective

Computerized Adaptive Psychological Testing A Personalisation Perspective Psychology and the internet: An European Perspective Computerized Adaptive Psychological Testing A Personalisation Perspective Mykola Pechenizkiy mpechen@cc.jyu.fi Introduction Mixed Model of IRT and ES

More information

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents

More information

Artificial Neural Networks written examination

Artificial Neural Networks written examination 1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14

More information

OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS

OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,

More information

ReinForest: Multi-Domain Dialogue Management Using Hierarchical Policies and Knowledge Ontology

ReinForest: Multi-Domain Dialogue Management Using Hierarchical Policies and Knowledge Ontology ReinForest: Multi-Domain Dialogue Management Using Hierarchical Policies and Knowledge Ontology Tiancheng Zhao CMU-LTI-16-006 Language Technologies Institute School of Computer Science Carnegie Mellon

More information

OCR for Arabic using SIFT Descriptors With Online Failure Prediction

OCR for Arabic using SIFT Descriptors With Online Failure Prediction OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,

More information

A Comparison of DHMM and DTW for Isolated Digits Recognition System of Arabic Language

A Comparison of DHMM and DTW for Isolated Digits Recognition System of Arabic Language A Comparison of DHMM and DTW for Isolated Digits Recognition System of Arabic Language Z.HACHKAR 1,3, A. FARCHI 2, B.MOUNIR 1, J. EL ABBADI 3 1 Ecole Supérieure de Technologie, Safi, Morocco. zhachkar2000@yahoo.fr.

More information

Business Analytics and Information Tech COURSE NUMBER: 33:136:494 COURSE TITLE: Data Mining and Business Intelligence

Business Analytics and Information Tech COURSE NUMBER: 33:136:494 COURSE TITLE: Data Mining and Business Intelligence Business Analytics and Information Tech COURSE NUMBER: 33:136:494 COURSE TITLE: Data Mining and Business Intelligence COURSE DESCRIPTION This course presents computing tools and concepts for all stages

More information

POS tagging of Chinese Buddhist texts using Recurrent Neural Networks

POS tagging of Chinese Buddhist texts using Recurrent Neural Networks POS tagging of Chinese Buddhist texts using Recurrent Neural Networks Longlu Qin Department of East Asian Languages and Cultures longlu@stanford.edu Abstract Chinese POS tagging, as one of the most important

More information

Universidade do Minho Escola de Engenharia

Universidade do Minho Escola de Engenharia Universidade do Minho Escola de Engenharia Universidade do Minho Escola de Engenharia Dissertação de Mestrado Knowledge Discovery is the nontrivial extraction of implicit, previously unknown, and potentially

More information

Feature Selection based on Sampling and C4.5 Algorithm to Improve the Quality of Text Classification using Naïve Bayes

Feature Selection based on Sampling and C4.5 Algorithm to Improve the Quality of Text Classification using Naïve Bayes Feature Selection based on Sampling and C4.5 Algorithm to Improve the Quality of Text Classification using Naïve Bayes Viviana Molano 1, Carlos Cobos 1, Martha Mendoza 1, Enrique Herrera-Viedma 2, and

More information

Historical maintenance relevant information roadmap for a self-learning maintenance prediction procedural approach

Historical maintenance relevant information roadmap for a self-learning maintenance prediction procedural approach IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Historical maintenance relevant information roadmap for a self-learning maintenance prediction procedural approach To cite this

More information

BUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING

BUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING BUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING Gábor Gosztolya 1, Tamás Grósz 1, László Tóth 1, David Imseng 2 1 MTA-SZTE Research Group on Artificial

More information

A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation

A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation SLSP-2016 October 11-12 Natalia Tomashenko 1,2,3 natalia.tomashenko@univ-lemans.fr Yuri Khokhlov 3 khokhlov@speechpro.com Yannick

More information

Beyond the Pipeline: Discrete Optimization in NLP

Beyond the Pipeline: Discrete Optimization in NLP Beyond the Pipeline: Discrete Optimization in NLP Tomasz Marciniak and Michael Strube EML Research ggmbh Schloss-Wolfsbrunnenweg 33 69118 Heidelberg, Germany http://www.eml-research.de/nlp Abstract We

More information

An Online Handwriting Recognition System For Turkish

An Online Handwriting Recognition System For Turkish An Online Handwriting Recognition System For Turkish Esra Vural, Hakan Erdogan, Kemal Oflazer, Berrin Yanikoglu Sabanci University, Tuzla, Istanbul, Turkey 34956 ABSTRACT Despite recent developments in

More information

Phonetic- and Speaker-Discriminant Features for Speaker Recognition. Research Project

Phonetic- and Speaker-Discriminant Features for Speaker Recognition. Research Project Phonetic- and Speaker-Discriminant Features for Speaker Recognition by Lara Stoll Research Project Submitted to the Department of Electrical Engineering and Computer Sciences, University of California

More information

Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling

Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling Notebook for PAN at CLEF 2013 Andrés Alfonso Caurcel Díaz 1 and José María Gómez Hidalgo 2 1 Universidad

More information

Course Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE

Course Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE EE-589 Introduction to Neural Assistant Prof. Dr. Turgay IBRIKCI Room # 305 (322) 338 6868 / 139 Wensdays 9:00-12:00 Course Outline The course is divided in two parts: theory and practice. 1. Theory covers

More information

Applications of data mining algorithms to analysis of medical data

Applications of data mining algorithms to analysis of medical data Master Thesis Software Engineering Thesis no: MSE-2007:20 August 2007 Applications of data mining algorithms to analysis of medical data Dariusz Matyja School of Engineering Blekinge Institute of Technology

More information

CS4491/CS 7265 BIG DATA ANALYTICS INTRODUCTION TO THE COURSE. Mingon Kang, PhD Computer Science, Kennesaw State University

CS4491/CS 7265 BIG DATA ANALYTICS INTRODUCTION TO THE COURSE. Mingon Kang, PhD Computer Science, Kennesaw State University CS4491/CS 7265 BIG DATA ANALYTICS INTRODUCTION TO THE COURSE Mingon Kang, PhD Computer Science, Kennesaw State University Self Introduction Mingon Kang, PhD Homepage: http://ksuweb.kennesaw.edu/~mkang9

More information

Axiom 2013 Team Description Paper

Axiom 2013 Team Description Paper Axiom 2013 Team Description Paper Mohammad Ghazanfari, S Omid Shirkhorshidi, Farbod Samsamipour, Hossein Rahmatizadeh Zagheli, Mohammad Mahdavi, Payam Mohajeri, S Abbas Alamolhoda Robotics Scientific Association

More information

Corrective Feedback and Persistent Learning for Information Extraction

Corrective Feedback and Persistent Learning for Information Extraction Corrective Feedback and Persistent Learning for Information Extraction Aron Culotta a, Trausti Kristjansson b, Andrew McCallum a, Paul Viola c a Dept. of Computer Science, University of Massachusetts,

More information

Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models

Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Navdeep Jaitly 1, Vincent Vanhoucke 2, Geoffrey Hinton 1,2 1 University of Toronto 2 Google Inc. ndjaitly@cs.toronto.edu,

More information

ACOUSTIC EVENT DETECTION IN REAL LIFE RECORDINGS

ACOUSTIC EVENT DETECTION IN REAL LIFE RECORDINGS ACOUSTIC EVENT DETECTION IN REAL LIFE RECORDINGS Annamaria Mesaros 1, Toni Heittola 1, Antti Eronen 2, Tuomas Virtanen 1 1 Department of Signal Processing Tampere University of Technology Korkeakoulunkatu

More information

Cross-lingual Short-Text Document Classification for Facebook Comments

Cross-lingual Short-Text Document Classification for Facebook Comments 2014 International Conference on Future Internet of Things and Cloud Cross-lingual Short-Text Document Classification for Facebook Comments Mosab Faqeeh, Nawaf Abdulla, Mahmoud Al-Ayyoub, Yaser Jararweh

More information

Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski

Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Problem Statement and Background Given a collection of 8th grade science questions, possible answer

More information

TRANSFER LEARNING IN MIR: SHARING LEARNED LATENT REPRESENTATIONS FOR MUSIC AUDIO CLASSIFICATION AND SIMILARITY

TRANSFER LEARNING IN MIR: SHARING LEARNED LATENT REPRESENTATIONS FOR MUSIC AUDIO CLASSIFICATION AND SIMILARITY TRANSFER LEARNING IN MIR: SHARING LEARNED LATENT REPRESENTATIONS FOR MUSIC AUDIO CLASSIFICATION AND SIMILARITY Philippe Hamel, Matthew E. P. Davies, Kazuyoshi Yoshii and Masataka Goto National Institute

More information

Using dialogue context to improve parsing performance in dialogue systems

Using dialogue context to improve parsing performance in dialogue systems Using dialogue context to improve parsing performance in dialogue systems Ivan Meza-Ruiz and Oliver Lemon School of Informatics, Edinburgh University 2 Buccleuch Place, Edinburgh I.V.Meza-Ruiz@sms.ed.ac.uk,

More information

Active Learning. Yingyu Liang Computer Sciences 760 Fall

Active Learning. Yingyu Liang Computer Sciences 760 Fall Active Learning Yingyu Liang Computer Sciences 760 Fall 2017 http://pages.cs.wisc.edu/~yliang/cs760/ Some of the slides in these lectures have been adapted/borrowed from materials developed by Mark Craven,

More information

First Grade Standards

First Grade Standards These are the standards for what is taught throughout the year in First Grade. It is the expectation that these skills will be reinforced after they have been taught. Mathematical Practice Standards Taught

More information

Edinburgh Research Explorer

Edinburgh Research Explorer Edinburgh Research Explorer Personalising speech-to-speech translation Citation for published version: Dines, J, Liang, H, Saheer, L, Gibson, M, Byrne, W, Oura, K, Tokuda, K, Yamagishi, J, King, S, Wester,

More information

Chinese Language Parsing with Maximum-Entropy-Inspired Parser

Chinese Language Parsing with Maximum-Entropy-Inspired Parser Chinese Language Parsing with Maximum-Entropy-Inspired Parser Heng Lian Brown University Abstract The Chinese language has many special characteristics that make parsing difficult. The performance of state-of-the-art

More information

Module 9: Performing HIV Rapid Tests (Demo and Practice)

Module 9: Performing HIV Rapid Tests (Demo and Practice) Module 9: Performing HIV Rapid Tests (Demo and Practice) Purpose To provide the participants with necessary knowledge and skills to accurately perform 3 HIV rapid tests and to determine HIV status. Pre-requisite

More information

A survey of multi-view machine learning

A survey of multi-view machine learning Noname manuscript No. (will be inserted by the editor) A survey of multi-view machine learning Shiliang Sun Received: date / Accepted: date Abstract Multi-view learning or learning with multiple distinct

More information

*Net Perceptions, Inc West 78th Street Suite 300 Minneapolis, MN

*Net Perceptions, Inc West 78th Street Suite 300 Minneapolis, MN From: AAAI Technical Report WS-98-08. Compilation copyright 1998, AAAI (www.aaai.org). All rights reserved. Recommender Systems: A GroupLens Perspective Joseph A. Konstan *t, John Riedl *t, AI Borchers,

More information

Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction

Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction INTERSPEECH 2015 Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction Akihiro Abe, Kazumasa Yamamoto, Seiichi Nakagawa Department of Computer

More information

Extracting Opinion Expressions and Their Polarities Exploration of Pipelines and Joint Models

Extracting Opinion Expressions and Their Polarities Exploration of Pipelines and Joint Models Extracting Opinion Expressions and Their Polarities Exploration of Pipelines and Joint Models Richard Johansson and Alessandro Moschitti DISI, University of Trento Via Sommarive 14, 38123 Trento (TN),

More information

Calibration of Confidence Measures in Speech Recognition

Calibration of Confidence Measures in Speech Recognition Submitted to IEEE Trans on Audio, Speech, and Language, July 2010 1 Calibration of Confidence Measures in Speech Recognition Dong Yu, Senior Member, IEEE, Jinyu Li, Member, IEEE, Li Deng, Fellow, IEEE

More information

CS 1103 Computer Science I Honors. Fall Instructor Muller. Syllabus

CS 1103 Computer Science I Honors. Fall Instructor Muller. Syllabus CS 1103 Computer Science I Honors Fall 2016 Instructor Muller Syllabus Welcome to CS1103. This course is an introduction to the art and science of computer programming and to some of the fundamental concepts

More information

Mining Student Evolution Using Associative Classification and Clustering

Mining Student Evolution Using Associative Classification and Clustering Mining Student Evolution Using Associative Classification and Clustering 19 Mining Student Evolution Using Associative Classification and Clustering Kifaya S. Qaddoum, Faculty of Information, Technology

More information

Experiment Databases: Towards an Improved Experimental Methodology in Machine Learning

Experiment Databases: Towards an Improved Experimental Methodology in Machine Learning Experiment Databases: Towards an Improved Experimental Methodology in Machine Learning Hendrik Blockeel and Joaquin Vanschoren Computer Science Dept., K.U.Leuven, Celestijnenlaan 200A, 3001 Leuven, Belgium

More information