Accuracy of Decision Trees. Overview. Entropy and Information Gain. Choosing the Best Attribute to Test First. Decision tree learning wrap up

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "Accuracy of Decision Trees. Overview. Entropy and Information Gain. Choosing the Best Attribute to Test First. Decision tree learning wrap up"

Transcription

1 Overview Accuracy of Decision Trees 1 Decision tree learning wrap up Final exam review Final exam: Monday, May 6th at 10:30am until 12:30pm in Rm. 126 HRBB. % correct on test set Training set size Divide examples into training and test sets. Train using the training set. 1 Measure accuracy of resulting decision tree on the test set. 2 Choosing the Best Attribute to Test First Entropy and Information Gain Use Shannon s information theory to choose the attribute that give the maximum information gain. Entropy(E) = X i2c P i log 2 (P i ) Pick an attribute such that the information gain (or entropy reduction) is maximized. Gain(E; A) = Entropy(E) X alues(a) v2v v j je Entropy(E v) jej Entropy measures the average surprisal of events. Less probable events are more surprising. E: set of examples A: a single attribute E v : set of examples where attribute A = v. jsj : cardinality of set S. 3 4

2 Issues in Decision Tree Learning Key Points Noise and overfitting Missing attribute values from examples Multivalued attribues with large number of possible values Continuous-valued attributes. Decision tree learning: What is the embodied principle (or bias)? How to choose the best attribute? Given a set of examples, choose the best attribute to test first. What are the issues? noise, overfitting, etc. 5 6 Final Exam Review Key Points: slide17 Predicate calculus (first-order logic): 30 points Representing relations in predicate calculus: domains, Probabilistic inference (including belief networks): 30 points Learning (including neural networks, GA, and decision trees): 40 points My research material (perceptual grouping) will not be on the exam. No Lisp programming problems. Interpretation in predicate calculus: what is an interpretation and how it related to a domain. When is an interpretation true or false. prenex normal form: why it is useful, how to convert to, the basic rules used in conversion skolemization: why it is useful, how to do it inference: basics of resolution first step is converting to a standard form. 7 8

3 Key Points: slide18 Key Points: slide19 skolemiztion: why it is useful and how to do it. unification algorithm substitution and unification: why are these necessary and how to do them. factors : definition, and how to derive, why factors are important resolvent : definition, and how to derive 9 10 Key Points: slide20 Key Points: slide21 unification algorithm resolvent : definition, and how to derive factors : definition, and how to derive, why factors are important properties of resolution: sound and complete resolvent : definition, and how to derive theorem proving algorithm: level saturation (two pointer method) theorm proving: strategies for efficient resolution advantages and disadvantages of resolution

4 Key Points: slide23 Key Points: slide24 Application of theorem prover: how to use it to answer questions. Uncertainty: why first-order logic can fail in uncertain domains? Decision theory example: how prob theory and decision theory are combined Probability basics: terminology, notations. Decision theory basics. Joint probability distribution: concept Conditional probability: definition, various ways of representing conditional prob. Axioms of probability: basic axioms, and using them to prove simple equalities. Bayes rule: definition and application Key Points: slide25 Key Points: slide26 Why and when is Bayesian analysis useful? How is subjective belief utilized in Bayesian analysis? How to calculate priors from conditional distributions? How is subjective belief utilized in Bayesian analysis? Bayesian updating: why does it make probabilistic inference efficient when multiple evidence comes in? Belief network: definition, semantics, extracting probabilities of certain conjunction of events

5 Key Points: slide27 Key Points: slide28 Constructing a belief network: what is the procedure? why does node ordering matter? how to order the nodes? Inference in belief networks: what are the kinds of inference? what is the general method? Knowledge engineering: how to formulate the idea and design a system. Types of learning Neural networks: basics The central nervous system: how it differs from conventional computers Key Points: slide29 Key Points: slide30 The central nervous system: how it differs from conventional computers. Basic mechanism of synaptic information transfer Types of neural networks Basic concept of a multi-layer feed-forward network. How hidden units know how much error they caused. Backprop is a gradient descent algorithm. Drawbacks of backprop. Perceptrons: basic idea, and the geometric interpretation. What is the limitation? How to train? 19 20

6 Key Points: slide31 Key Points: slide32 How can backprop be improved? SOM basic algorithm What are the various ways to apply backprop? What kind of tasks is SOM good for? SOM basic algorithm What kind of tasks is SOM good for? Simple recurrent networks: how can it encode sequences, how is it different from standard backprop and how similar are they? Key Points: slide33 Key Points: slide34 Simple recurrent networks: how can it encode sequences, how is it different from standard backprop and who similar is it? Genetic algorithms basics. What are the issues to be solved in genetic algorithms. Genetic algorithms basics

7 Key Points: slide37 Next Time Decision tree learning: What is the embodied principle (or bias)? How to choose the best attribute? Given a set of examples, choose the best attribute to test first. Tuesday: redefined day general Q and A (attendance not required). Recommended reading in AI, neuroscience, cognitive science, philosophy, etc. What are the issues? noise, overfitting, etc

ANNA UNIVERSITY SUBJECT NAME : ARTIFICIAL INTELLIGENCE SUBJECT CODE : CS2351 YEAR/SEM :III / VI QUESTION BANK UNIT I PROBLEM SOLVING 1. What is Intelligence? 2. Describe the four categories under which

More information

Introduction to Machine Learning

Introduction to Machine Learning Introduction to Machine Learning D. De Cao R. Basili Corso di Web Mining e Retrieval a.a. 2008-9 April 6, 2009 Outline Outline Introduction to Machine Learning Outline Outline Introduction to Machine Learning

More information

Artificial Intelligence Lecture 9

Artificial Intelligence Lecture 9 Artificial Intelligence Lecture 9 Lecture plan Prolog Probabilities AI in general (ch. 1) Search based AI (ch. 4) search, games, planning, optimization Agents (ch. 8) applied AI techniques in robots, software

More information

Foundations of Intelligent Systems CSCI (Fall 2015)

Foundations of Intelligent Systems CSCI (Fall 2015) Foundations of Intelligent Systems CSCI-630-01 (Fall 2015) Final Examination, Fri. Dec 18, 2015 Instructor: Richard Zanibbi, Duration: 120 Minutes Name: Instructions The exam questions are worth a total

More information

Machine Learning: Neural Networks. Junbeom Park Radiation Imaging Laboratory, Pusan National University

Machine Learning: Neural Networks. Junbeom Park Radiation Imaging Laboratory, Pusan National University Machine Learning: Neural Networks Junbeom Park (pjb385@gmail.com) Radiation Imaging Laboratory, Pusan National University 1 Contents 1. Introduction 2. Machine Learning Definition and Types Supervised

More information

P(A, B) = P(A B) = P(A) + P(B) - P(A B)

P(A, B) = P(A B) = P(A) + P(B) - P(A B) AND Probability P(A, B) = P(A B) = P(A) + P(B) - P(A B) P(A B) = P(A) + P(B) - P(A B) Area = Probability of Event AND Probability P(A, B) = P(A B) = P(A) + P(B) - P(A B) If, and only if, A and B are independent,

More information

Contents. Chapter 1: Introduction to Artificial Intelligence and Soft Computing

Contents. Chapter 1: Introduction to Artificial Intelligence and Soft Computing Contents Chapter 1: Introduction to Artificial Intelligence and Soft Computing 1.1 Evolution of Computing 1.2 Defining AI 1.3 General Problem Solving Approaches in AI 1.4 The Disciplines of AI 1.4.1 The

More information

Classical Planning. CS 486/686: Introduction to Artificial Intelligence

Classical Planning. CS 486/686: Introduction to Artificial Intelligence Classical Planning CS 486/686: Introduction to Artificial Intelligence 1 Outline Planning Problems Planning as Logical Reasoning STRIPS Language Planning Algorithms Planning Heuristics 2 Introduction Last

More information

IAI : Machine Learning

IAI : Machine Learning IAI : Machine Learning John A. Bullinaria, 2005 1. What is Machine Learning? 2. The Need for Learning 3. Learning in Neural and Evolutionary Systems 4. Problems Facing Expert Systems 5. Learning in Rule

More information

Learning Bayes Networks

Learning Bayes Networks Learning Bayes Networks 6.034 Based on Russell & Norvig, Artificial Intelligence:A Modern Approach, 2nd ed., 2003 and D. Heckerman. A Tutorial on Learning with Bayesian Networks. In Learning in Graphical

More information

Deep Neural Networks for Acoustic Modelling. Bajibabu Bollepalli Hieu Nguyen Rakshith Shetty Pieter Smit (Mentor)

Deep Neural Networks for Acoustic Modelling. Bajibabu Bollepalli Hieu Nguyen Rakshith Shetty Pieter Smit (Mentor) Deep Neural Networks for Acoustic Modelling Bajibabu Bollepalli Hieu Nguyen Rakshith Shetty Pieter Smit (Mentor) Introduction Automatic speech recognition Speech signal Feature Extraction Acoustic Modelling

More information

Course Overview. Yu Hen Hu. Introduction to ANN & Fuzzy Systems

Course Overview. Yu Hen Hu. Introduction to ANN & Fuzzy Systems Course Overview Yu Hen Hu Introduction to ANN & Fuzzy Systems Outline Overview of the course Goals, objectives Background knowledge required Course conduct Content Overview (highlight of each topics) 2

More information

18 LEARNING FROM EXAMPLES

18 LEARNING FROM EXAMPLES 18 LEARNING FROM EXAMPLES An intelligent agent may have to learn, for instance, the following components: A direct mapping from conditions on the current state to actions A means to infer relevant properties

More information

Lecture 1: Machine Learning Basics

Lecture 1: Machine Learning Basics 1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3

More information

Parvathy Sudhir Pillai A W

Parvathy Sudhir Pillai A W Parvathy Sudhir Pillai A0095671W Human thought process! Intertwines AI, Cognitive Science & Neuroscience. Not just cognition, but combining it with perception and actuation What do we need? Are humans

More information

Linear Models Continued: Perceptron & Logistic Regression

Linear Models Continued: Perceptron & Logistic Regression Linear Models Continued: Perceptron & Logistic Regression CMSC 723 / LING 723 / INST 725 Marine Carpuat Slides credit: Graham Neubig, Jacob Eisenstein Linear Models for Classification Feature function

More information

CS 2750: Machine Learning. Neural Networks. Prof. Adriana Kovashka University of Pittsburgh February 28, 2017

CS 2750: Machine Learning. Neural Networks. Prof. Adriana Kovashka University of Pittsburgh February 28, 2017 CS 2750: Machine Learning Neural Networks Prof. Adriana Kovashka University of Pittsburgh February 28, 2017 HW2 due Thursday Announcements Office hours on Thursday: 4:15pm-5:45pm Talk at 3pm: http://www.sam.pitt.edu/arc-

More information

Artificial Neural Networks written examination

Artificial Neural Networks written examination 1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14

More information

Performance Analysis of Various Data Mining Techniques on Banknote Authentication

Performance Analysis of Various Data Mining Techniques on Banknote Authentication International Journal of Engineering Science Invention ISSN (Online): 2319 6734, ISSN (Print): 2319 6726 Volume 5 Issue 2 February 2016 PP.62-71 Performance Analysis of Various Data Mining Techniques on

More information

De La Salle University College of Computer Studies. Course Syllabus

De La Salle University College of Computer Studies. Course Syllabus INTESYS / Intelligent Systems De La Salle University College of Computer Studies Course Syllabus Prerequisites : DISCTRU Type of Course : Basic course Term : Term 1 AY 2012-13 Faculty : Dr. Raymund Sison

More information

A Brief Introduction to Generative Models

A Brief Introduction to Generative Models Theoretical Neuroscience and Computer Vision A Brief Introduction to Generative Models FIAS, Goethe-Universität Frankfurt, Germany FIAS Summer School Frankfurt, August 2008 Contents Introduction Please

More information

Supervised learning can be done by choosing the hypothesis that is most probable given the data: = arg max ) = arg max

Supervised learning can be done by choosing the hypothesis that is most probable given the data: = arg max ) = arg max The learning problem is called realizable if the hypothesis space contains the true function; otherwise it is unrealizable On the other hand, in the name of better generalization ability it may be sensible

More information

Classical Mathematical Logic

Classical Mathematical Logic Classical Mathematical Logic The Semantic Foundations of Logic Richard L. Epstein with contributions by Leslaw W. Szczerba Princeton University Press Princeton and Oxford Contents Preface Acknowledgments

More information

Lecture 1: Introduc4on

Lecture 1: Introduc4on CSC2515 Spring 2014 Introduc4on to Machine Learning Lecture 1: Introduc4on All lecture slides will be available as.pdf on the course website: http://www.cs.toronto.edu/~urtasun/courses/csc2515/csc2515_winter15.html

More information

Review for the Final Exam

Review for the Final Exam Lecture slides for Automated Planning: Theory and Practice Review for the Final Exam Dana S. Nau University of Maryland 5:12 PM April 30, 2012 1 What We ve Covered Chapter 1: Introduction Chapter 2: Representations

More information

Automated Reasoning. Christoph Kreitz. 1. What is Automated Reasoning? 2. Why Automated Reasoning? 3. Achievements

Automated Reasoning. Christoph Kreitz. 1. What is Automated Reasoning? 2. Why Automated Reasoning? 3. Achievements Automated Reasoning Christoph Kreitz 1. What is Automated Reasoning? 2. Why Automated Reasoning? 3. Achievements Logical Reasoning the Center of Intelligence Mathematics Programming Problem Solving Philosophy

More information

Machine Learning (Decision Trees and Intro to Neural Nets) CSCI 3202, Fall 2010

Machine Learning (Decision Trees and Intro to Neural Nets) CSCI 3202, Fall 2010 Machine Learning (Decision Trees and Intro to Neural Nets) CSCI 3202, Fall 2010 Assignments To read this week: Chapter 18, sections 1-4 and 7 Problem Set 3 due next week! Learning a Decision Tree We look

More information

Inventor Chung T. Nguyen NOTTCE. The above identified patent application is available for licensing. Requests for information should be addressed to:

Inventor Chung T. Nguyen NOTTCE. The above identified patent application is available for licensing. Requests for information should be addressed to: Serial No. 802.572 Filing Date 3 February 1997 Inventor Chung T. Nguyen NOTTCE The above identified patent application is available for licensing. Requests for information should be addressed to: OFFICE

More information

Exam for IN4oloTU Artificial Intelligence Techniques

Exam for IN4oloTU Artificial Intelligence Techniques Exam for IN4oloTU Artificial Intelligence Techniques 26 January 2006 This exam will test your knowledge and understanding of Russell and Norvig, Artzficial Intelligence: A Modern Approach. Using the book

More information

Artificial Neural Networks. Andreas Robinson 12/19/2012

Artificial Neural Networks. Andreas Robinson 12/19/2012 Artificial Neural Networks Andreas Robinson 12/19/2012 Introduction Artificial Neural Networks Machine learning technique Learning from past experience/data Predicting/classifying novel data Biologically

More information

Intelligent Systems. Neural Networks. Copyright 2009 Dieter Fensel and Reto Krummenacher

Intelligent Systems. Neural Networks. Copyright 2009 Dieter Fensel and Reto Krummenacher Intelligent Systems Neural Networks Copyright 2009 Dieter Fensel and Reto Krummenacher 1 Where are we? # Title 1 Introduction 2 Propositional Logic 3 Predicate Logic 4 Theorem Proving, Description Logics

More information

CS545 Machine Learning

CS545 Machine Learning Machine learning and related fields CS545 Machine Learning Course Introduction Machine learning: the construction and study of systems that learn from data. Pattern recognition: the same field, different

More information

CS 520: Introduction to Artificial Intelligence CS 520

CS 520: Introduction to Artificial Intelligence CS 520 CS 520: Introduction to Artificial Intelligence Prof. Louis Steinberg 1 Prof. Louis Steinberg CS 520 401 Hill, 445-3581, lou@cs Office hours: Thursday 1-3pm and by appointment TA: Xiaolei Huang (xiaolei@paul)

More information

Artificial Neural Networks

Artificial Neural Networks Artificial Neural Networks Outline Introduction to Neural Network Introduction to Artificial Neural Network Properties of Artificial Neural Network Applications of Artificial Neural Network Demo Neural

More information

Neuro-Fuzzy and Soft Computing chapter 1 J.-S.R. Jang

Neuro-Fuzzy and Soft Computing chapter 1 J.-S.R. Jang Neuro-Fuzzy and chapter 1 J.-S.R. Jang Bill Cheetham Kai Goebel 1 What is covered in this class? We will teach techniques useful in creating intelligent software systems that can deal with the uncertainty

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

Employing External Rich Knowledge for Machine Comprehension

Employing External Rich Knowledge for Machine Comprehension Employing External Rich Knowledge for Machine Comprehension IJCAI-16 Bingning Wang, Shangmin Guo, Kang Liu, Shizhu He, Jun Zhao National Laboratory of Pattern Recognition, Institute of Automation, Chinese

More information

Knowledge representation

Knowledge representation Lecture 1 Knowledge representation Milos Hauskrecht milos@cs.pitt.edu 5329 Sennott Square Course administration Instructor: Milos Hauskrecht 5329 Sennott Square milos@cs.pitt.edu TA: David Krebs 5324 Sennott

More information

Introduction to Computational Neuroscience A. The Brain as an Information Processing Device

Introduction to Computational Neuroscience A. The Brain as an Information Processing Device Introduction to Computational Neuroscience A. The Brain as an Information Processing Device Jackendoff (Consciousness and the Computational Mind, Jackendoff, MIT Press, 1990) argues that we can put off

More information

Session 4: Regularization (Chapter 7)

Session 4: Regularization (Chapter 7) Session 4: Regularization (Chapter 7) Tapani Raiko Aalto University 30 September 2015 Tapani Raiko (Aalto University) Session 4: Regularization (Chapter 7) 30 September 2015 1 / 27 Table of Contents Background

More information

The art of creating machines that perform functions that require intelligence when performed by people.

The art of creating machines that perform functions that require intelligence when performed by people. Department of Computer Science and Engineering Two Mark Questions with Answers Sixth Semester CS1351-ARTIFICIAL INTELLIGENCE UNIT-I 1. Define Artificial Intelligence formulated by Haugeland. The exciting

More information

Rule-based Expert Systems

Rule-based Expert Systems Rule-based Expert Systems What is knowledge? is a theoretical or practical understanding of a subject or a domain. is also the sim of what is currently known, and apparently knowledge is power. Those who

More information

CS 540: Introduction to Artificial Intelligence

CS 540: Introduction to Artificial Intelligence CS 540: Introduction to Artificial Intelligence Midterm Exam: 4:00-5:15 pm, October 25, 2016 B130 Van Vleck CLOSED BOOK (one sheet of notes and a calculator allowed) Write your answers on these pages and

More information

Natural Language Processing with Deep Learning CS224N/Ling284

Natural Language Processing with Deep Learning CS224N/Ling284 Natural Language Processing with Deep Learning CS224N/Ling284 Lecture 8: Recurrent Neural Networks and Language Models Abigail See Announcements Assignment 1: Grades will be released after class Assignment

More information

Artificial Intelligence Recap. Mausam

Artificial Intelligence Recap. Mausam Artificial Intelligence Recap Mausam What is intelligence? (bounded) Rationality We have a performance measure to optimize Given our state of knowledge Choose optimal action Given limited computational

More information

Lecture 1: Basic Concepts of Machine Learning

Lecture 1: Basic Concepts of Machine Learning Lecture 1: Basic Concepts of Machine Learning Cognitive Systems - Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010

More information

Classification with Deep Belief Networks. HussamHebbo Jae Won Kim

Classification with Deep Belief Networks. HussamHebbo Jae Won Kim Classification with Deep Belief Networks HussamHebbo Jae Won Kim Table of Contents Introduction... 3 Neural Networks... 3 Perceptron... 3 Backpropagation... 4 Deep Belief Networks (RBM, Sigmoid Belief

More information

Big Data Analytics Clustering and Classification

Big Data Analytics Clustering and Classification E6893 Big Data Analytics Lecture 4: Big Data Analytics Clustering and Classification Ching-Yung Lin, Ph.D. Adjunct Professor, Dept. of Electrical Engineering and Computer Science September 28th, 2017 1

More information

Machine Learning and Expert Systems

Machine Learning and Expert Systems Machine Learning and Expert Systems By Alexander Bailey Introduction Why use machine learning? Strategies Usefulness and success Collaborative Systems 1 Why Use Machine Learning? Knowledge acquisition

More information

A Review on Classification Techniques in Machine Learning

A Review on Classification Techniques in Machine Learning A Review on Classification Techniques in Machine Learning R. Vijaya Kumar Reddy 1, Dr. U. Ravi Babu 2 1 Research Scholar, Dept. of. CSE, Acharya Nagarjuna University, Guntur, (India) 2 Principal, DRK College

More information

Knowledge-Based - Systems

Knowledge-Based - Systems Knowledge-Based - Systems ; Rajendra Arvind Akerkar Chairman, Technomathematics Research Foundation and Senior Researcher, Western Norway Research institute Priti Srinivas Sajja Sardar Patel University

More information

SOFTCOMPUTING IN MODELING & SIMULATION

SOFTCOMPUTING IN MODELING & SIMULATION SOFTCOMPUTING IN MODELING & SIMULATION 9th July, 2002 Faculty of Science, Philadelphia University Dr. Kasim M. Al-Aubidy Computer & Software Eng. Dept. Philadelphia University The only way not to succeed

More information

Python Machine Learning

Python Machine Learning Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled

More information

Lecture 1. Introduction Bastian Leibe Visual Computing Institute RWTH Aachen University

Lecture 1. Introduction Bastian Leibe Visual Computing Institute RWTH Aachen University Advanced Machine Learning Lecture 1 Introduction 20.10.2015 Bastian Leibe Visual Computing Institute RWTH Aachen University http://www.vision.rwth-aachen.de/ leibe@vision.rwth-aachen.de Organization Lecturer

More information

Deep Learning for AI Yoshua Bengio. August 28th, DS3 Data Science Summer School

Deep Learning for AI Yoshua Bengio. August 28th, DS3 Data Science Summer School Deep Learning for AI Yoshua Bengio August 28th, 2017 @ DS3 Data Science Summer School A new revolution seems to be in the work after the industrial revolution. And Machine Learning, especially Deep Learning,

More information

CAP 6412 Advanced Computer Vision

CAP 6412 Advanced Computer Vision CAP 6412 Advanced Computer Vision http://www.cs.ucf.edu/~bgong/cap6412.html Boqing Gong Feb 25, 2016 Next week: Vision and language Tuesday (03/01) Javier Lores Thursday (03/03) Aisha Urooji [Relation

More information

Today s Lecture. Clustering Methods. Lecture 19: Uncertainty 4. Victor R. Lesser. Example of Multiply Connected BN

Today s Lecture. Clustering Methods. Lecture 19: Uncertainty 4. Victor R. Lesser. Example of Multiply Connected BN Lecture 19: Uncertainty 4 Victor R. Lesser CMPSCI 683 Fall 2010 Today s Lecture Inference in Multiply Connected BNs Clustering methods transform the network into a probabilistically equivalent polytree.

More information

Inductive Learning and Decision Trees

Inductive Learning and Decision Trees Inductive Learning and Decision Trees Doug Downey EECS 349 Spring 2017 with slides from Pedro Domingos, Bryan Pardo Outline Announcements Homework #1 was assigned on Monday (due in five days!) Inductive

More information

Hybrid Learning of Ontology Classes

Hybrid Learning of Ontology Classes Hybrid Learning of Ontology Classes Jens Lehmann July 18, 2007 Jens Lehmann (Uni Leipzig) Hybrid Ontology Class Learning July 18, 2007 1 / 20 Outline 1 Introduction to Description Logics, OWL, and the

More information

Inference and Word Meaning

Inference and Word Meaning Inference and Word Meaning Copyright, 2011, Ted Briscoe (ejb@cl.cam.ac.uk), GS18, Computer Lab 1 Semantics for Underspecified (R)MRS Last week we saw that it is possible to construct an underspecified

More information

(Sub)Gradient Descent

(Sub)Gradient Descent (Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include

More information

EECS 349 Machine Learning

EECS 349 Machine Learning EECS 349 Machine Learning Instructor: Doug Downey (some slides from Pedro Domingos, University of Washington) 1 Logistics Instructor: Doug Downey Email: ddowney@eecs.northwestern.edu Office hours: Mondays

More information

The Generalized Delta Rule and Practical Considerations

The Generalized Delta Rule and Practical Considerations The Generalized Delta Rule and Practical Considerations Introduction to Neural Networks : Lecture 6 John A. Bullinaria, 2004 1. Training a Single Layer Feed-forward Network 2. Deriving the Generalized

More information

Neural Networks. CSC 4504 : Langages formels et applications. J Paul Gibson, D311.

Neural Networks. CSC 4504 : Langages formels et applications. J Paul Gibson, D311. CSC 4504 : Langages formels et applications J Paul Gibson, D311 paul.gibson@telecom-sudparis.eu /~gibson/teaching/csc4504/problem11-neuralnetworks.pdf Neural Networks 1 2 The following slides are a summary

More information

Machine Learning Tom M. Mitchell Machine Learning Department Carnegie Mellon University. January 11, 2011

Machine Learning Tom M. Mitchell Machine Learning Department Carnegie Mellon University. January 11, 2011 Machine Learning 10-701 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 11, 2011 Today: What is machine learning? Decision tree learning Course logistics Readings: The Discipline

More information

AN ADAPTIVE SAMPLING ALGORITHM TO IMPROVE THE PERFORMANCE OF CLASSIFICATION MODELS

AN ADAPTIVE SAMPLING ALGORITHM TO IMPROVE THE PERFORMANCE OF CLASSIFICATION MODELS AN ADAPTIVE SAMPLING ALGORITHM TO IMPROVE THE PERFORMANCE OF CLASSIFICATION MODELS Soroosh Ghorbani Computer and Software Engineering Department, Montréal Polytechnique, Canada Soroosh.Ghorbani@Polymtl.ca

More information

Adaptation of Mamdani Fuzzy Inference System Using Neuro - Genetic Approach for Tactical Air Combat Decision Support System

Adaptation of Mamdani Fuzzy Inference System Using Neuro - Genetic Approach for Tactical Air Combat Decision Support System Adaptation of Mamdani Fuzzy Inference System Using Neuro - Genetic Approach for Tactical Air Combat Decision Support System Cong Tran 1, Lakhmi Jain 1, Ajith Abraham 2 1 School of Electrical and Information

More information

Decision Tree For Playing Tennis

Decision Tree For Playing Tennis Decision Tree For Playing Tennis ROOT NODE BRANCH INTERNAL NODE LEAF NODE Disjunction of conjunctions Another Perspective of a Decision Tree Model Age 60 40 20 NoDefault NoDefault + + NoDefault Default

More information

A Joint Model for Parsing Syntactic and Semantic Dependencies

A Joint Model for Parsing Syntactic and Semantic Dependencies A Joint Model for Parsing Syntactic and Semantic Dependencies Xavier Lluís and Lluís Màrquez TALP Research Centre Software Department (LSI) Technical University of Catalonia (UPC) {xlluis,lluism}@lsi.upc.edu

More information

Reverse Dictionary Using Artificial Neural Networks

Reverse Dictionary Using Artificial Neural Networks International Journal of Research Studies in Science, Engineering and Technology Volume 2, Issue 6, June 2015, PP 14-23 ISSN 2349-4751 (Print) & ISSN 2349-476X (Online) Reverse Dictionary Using Artificial

More information

Decision Tree for Playing Tennis

Decision Tree for Playing Tennis Decision Tree Decision Tree for Playing Tennis (outlook=sunny, wind=strong, humidity=normal,? ) DT for prediction C-section risks Characteristics of Decision Trees Decision trees have many appealing properties

More information

Portfolio Guide. Program: Middle School: Language Arts and Mathematics (Undergraduate) MoStep / Conceptual Framework

Portfolio Guide. Program: Middle School: Language Arts and Mathematics (Undergraduate) MoStep / Conceptual Framework Portfolio Guide Program: Middle School: Language Arts and Mathematics (Undergraduate) Quality Indicators Performance Indicators Artifact and Course 1.2.1.1 The preservice teacher knows the discipline applicable

More information

Problems Connected With Application of Neural Networks in Automatic Face Recognition

Problems Connected With Application of Neural Networks in Automatic Face Recognition Problems Connected With Application of Neural Networks in Automatic Face Recognition Rafał Komański, Bohdan Macukow Faculty of Mathematics and Information Science, Warsaw University of Technology 00-661

More information

Inductive learning. Learning Algorithm. hypothesis. dataset. Dataset must be sufficiently large

Inductive learning. Learning Algorithm. hypothesis. dataset. Dataset must be sufficiently large Inductive learning Learning algorithms like neural networks, decision trees, inductive logic programming, etc. all require a good number of examples to be able to do good predictions. dataset Learning

More information

Natural speech reveals the semantic maps that tile human cerebral cortex

Natural speech reveals the semantic maps that tile human cerebral cortex Natural speech reveals the semantic maps that tile human cerebral cortex Alexander G. Huth, Wendy A. de Heer, Thomas L. Griffiths, Frederic E. Theunissen & Jack L. Gallant (Nature, 2016) You can find a

More information

Structured Discriminative Model For Dialog State Tracking

Structured Discriminative Model For Dialog State Tracking Structured Discriminative Model For Dialog State Tracking Sungjin Lee Language Technologies Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA sungjin.lee@cs.cmu.edu Abstract Many dialog

More information

Backward Sequential Feature Elimination And Joining Algorithms In Machine Learning

Backward Sequential Feature Elimination And Joining Algorithms In Machine Learning San Jose State University SJSU ScholarWorks Master's Projects Master's Theses and Graduate Research Spring 2014 Backward Sequential Feature Elimination And Joining Algorithms In Machine Learning Sanya

More information

eportfolio Guide Missouri State University

eportfolio Guide Missouri State University Mathematics eportfolio Guide Missouri State University Updated February 2014 Missouri State Portfolio Guide MoSPE & Conceptual Framework Standards QUALITY INDICATORS MoSPE 1: Content Knowledge Aligned

More information

Final Exam DATA MINING II - 1DL460

Final Exam DATA MINING II - 1DL460 Uppsala University Department of Information Technology Kjell Orsborn Tore Risch Final Exam 2011-05-27 DATA MINING II - 1DL460 Date... Friday, May 27, 2011 Time... 14:00-19:00 Teacher on duty... Kjell

More information

THE DESIGN OF A LEARNING SYSTEM Lecture 2

THE DESIGN OF A LEARNING SYSTEM Lecture 2 THE DESIGN OF A LEARNING SYSTEM Lecture 2 Challenge: Design a Learning System for Checkers What training experience should the system have? A design choice with great impact on the outcome Choice #1: Direct

More information

Learning Agents: Introduction

Learning Agents: Introduction Learning Agents: Introduction S Luz luzs@cs.tcd.ie October 28, 2014 Learning in agent architectures Agent Learning in agent architectures Agent Learning in agent architectures Agent perception Learning

More information

Machine Learning Tom M. Mitchell Machine Learning Department Carnegie Mellon University. January 12, 2015

Machine Learning Tom M. Mitchell Machine Learning Department Carnegie Mellon University. January 12, 2015 Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: What is machine learning? Decision tree learning Course logistics Readings: The Discipline

More information

Accelerating the Power of Deep Learning With Neural Networks and GPUs

Accelerating the Power of Deep Learning With Neural Networks and GPUs Accelerating the Power of Deep Learning With Neural Networks and GPUs AI goes beyond image recognition. Abstract Deep learning using neural networks and graphics processing units (GPUs) is starting to

More information

CPSC 340: Machine Learning and Data Mining. Course Review/Preview Fall 2015

CPSC 340: Machine Learning and Data Mining. Course Review/Preview Fall 2015 CPSC 340: Machine Learning and Data Mining Course Review/Preview Fall 2015 Admin Assignment 6 due now. We will have office hours as usual next week. Final exam details: December 15: 8:30-11 (WESB 100).

More information

Stay Alert!: Creating a Classifier to Predict Driver Alertness in Real-time

Stay Alert!: Creating a Classifier to Predict Driver Alertness in Real-time Stay Alert!: Creating a Classifier to Predict Driver Alertness in Real-time Aditya Sarkar, Julien Kawawa-Beaudan, Quentin Perrot Friday, December 11, 2014 1 Problem Definition Driving while drowsy inevitably

More information

POLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance

POLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance POLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance Cristina Conati, Kurt VanLehn Intelligent Systems Program University of Pittsburgh Pittsburgh, PA,

More information

CAP 4630 Artificial Intelligence

CAP 4630 Artificial Intelligence CAP 4630 Artificial Intelligence Instructor: Sam Ganzfried sganzfri@cis.fiu.edu 1 Brains vs. AI Competition https://www.youtube.com/watch?v=phrayf1rq0i 2 What is AI? 3 Acting humanly Turing test: https://www.youtube.com/watch?v=sxx-ppebr7k

More information

Exploration vs. Exploitation. CS 473: Artificial Intelligence Reinforcement Learning II. How to Explore? Exploration Functions

Exploration vs. Exploitation. CS 473: Artificial Intelligence Reinforcement Learning II. How to Explore? Exploration Functions CS 473: Artificial Intelligence Reinforcement Learning II Exploration vs. Exploitation Dieter Fox / University of Washington [Most slides were taken from Dan Klein and Pieter Abbeel / CS188 Intro to AI

More information

DESIGNING OPTIMAL NEURO-FUZZY ARCHITECTURES FOR INTELLIGENT QUALITY CONTROL

DESIGNING OPTIMAL NEURO-FUZZY ARCHITECTURES FOR INTELLIGENT QUALITY CONTROL DESIGNING OPTIMAL NEURO-FUZZY ARCHITECTURES FOR INTELLIGENT QUALITY CONTROL Stanimir Yordanov Yordanov Department AIUT, TU Gabrovo, H.Dimitar 4., 5300, Bulgaria, e-mail: sjjordanov@tugab.bg Keywords: Artificial

More information

Big Data Classification using Evolutionary Techniques: A Survey

Big Data Classification using Evolutionary Techniques: A Survey Big Data Classification using Evolutionary Techniques: A Survey Neha Khan nehakhan.sami@gmail.com Mohd Shahid Husain mshahidhusain@ieee.org Mohd Rizwan Beg rizwanbeg@gmail.com Abstract Data over the internet

More information

Lecture 1. Introduction. Probability Theory

Lecture 1. Introduction. Probability Theory Lecture 1. Introduction. Probability Theory COMP90051 Machine Learning Sem2 2017 Lecturer: Trevor Cohn Adapted from slides provided by Ben Rubinstein Why Learn Learning? 2 Motivation We are drowning in

More information

Explanation and Simulation in Cognitive Science

Explanation and Simulation in Cognitive Science Explanation and Simulation in Cognitive Science Simulation and computational modeling Symbolic models Connectionist models Comparing symbolism and connectionism Hybrid architectures Cognitive architectures

More information

Welcome to CMPS 142 and 242: Machine Learning

Welcome to CMPS 142 and 242: Machine Learning Welcome to CMPS 142 and 242: Machine Learning Instructor: David Helmbold, dph@soe.ucsc.edu Office hours: Monday 1:30-2:30, Thursday 4:15-5:00 TA: Aaron Michelony, amichelo@soe.ucsc.edu Web page: www.soe.ucsc.edu/classes/cmps242/fall13/01

More information

Evolving Artificial Neural Networks

Evolving Artificial Neural Networks Evolving Artificial Neural Networks Christof Teuscher Swiss Federal Institute of Technology Lausanne (EPFL) Logic Systems Laboratory (LSL) http://lslwww.epfl.ch christof@teuscher.ch http://www.teuscher.ch/christof

More information

Multilingual Content Extraction Extended with Background Knowledge for Military Intelligence

Multilingual Content Extraction Extended with Background Knowledge for Military Intelligence Multilingual Content Extraction Extended with Background Knowledge for Military Intelligence Dr. Matthias Hecking Fraunhofer FKIE matthias.hecking@fkie.fraunhofer.de Dr. Andreas Wotzlaw University of Cologne

More information

Hot Topics in Machine Learning

Hot Topics in Machine Learning Hot Topics in Machine Learning Winter Term 2016 / 2017 Prof. Marius Kloft, Florian Wenzel October 19, 2016 Organization Organization The seminar is organized by Prof. Marius Kloft and Florian Wenzel (PhD

More information

EECS 349 Machine Learning

EECS 349 Machine Learning EECS 349 Machine Learning Instructor: Doug Downey (some slides from Pedro Domingos, University of Washington) 1 Logistics Instructor: Doug Downey Email: ddowney@eecs.northwestern.edu Office hours: Mondays

More information

CS 2750: Machine Learning. Other Topics. Prof. Adriana Kovashka University of Pittsburgh April 13, 2017

CS 2750: Machine Learning. Other Topics. Prof. Adriana Kovashka University of Pittsburgh April 13, 2017 CS 2750: Machine Learning Other Topics Prof. Adriana Kovashka University of Pittsburgh April 13, 2017 Plan for last lecture Overview of other topics and applications Reinforcement learning Active learning

More information

CS 354R: Computer Game Technology

CS 354R: Computer Game Technology CS 354R: Computer Game Technology AI Decision Trees and Rule Systems Fall 2017 Decision Trees Nodes represent attribute tests One child for each outcome Leaves represent classifications Can have same classification

More information

Objectives. Chapter 2: The Representation of Knowledge. Expert Systems: Principles and Programming, Fourth Edition

Objectives. Chapter 2: The Representation of Knowledge. Expert Systems: Principles and Programming, Fourth Edition Chapter 2: The Representation of Knowledge Expert Systems: Principles and Programming, Fourth Edition Objectives Introduce the study of logic Learn the difference between formal logic and informal logic

More information