On ProjecFon using SAT/SMT

Size: px
Start display at page:

Download "On ProjecFon using SAT/SMT"

Transcription

1 On ProjecFon using SAT/SMT Jörg Brauer (RWTH Aachen University) Andy King (Portcullis Computer Security) Jael Kriener (University of Kent) MPI, Saarbrücken

2 Myself Diploma in CS from University of Kiel (2008) StaFc NICTA ( ) Since 10/2008: PhD RWTH Leading [mc]square project Research interests AutomaFc abstracfon Analysis of binaries Decision procedures (to some extent) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 2

3 Two Topics 1. ExistenFal quanffier eliminafon as incremental SAT solving 2. Approximate projecfon for (non- ) linear constraints 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 3

4 Why SAT? MoFvaFon CNF and SAT- based quan1fier elimina1on can be exponen1ally more efficient than [..] BDDs in cases where the resul1ng fixed points have compact representa1ons in CNF, but not as BDDs. [McM02] SAT- based algorithms are inelegant [Bry08] Require re- engineering of SAT Solver [McM02] Or combinafon with BDDs [LBC03] [Bry08] R.E. Bryant, A View From the Engine Room: ComputaFonal Support for Symbolic Model Checking [LBC03] S.K. Lahiri, R.E. Bryant, B. Cook, A Symbolic Approach to Predicate AbstracFon, CAV 03 [McM02] K. McMillan, Applying SAT Methods in Unbounded Symbolic Model Checking, CAV Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 4

5 QuanFfier EliminaFon in Predicate State variables: Input state: TransiFon relafon: AbstracFon X = {x 1,...,x 6 } Y = {y 1,...,y 6 } ξ =(x 1 x 2 x 3 x 4 x 5 x 6 ) (x 1 x 2 x 3 x 4 x 5 x 6 ) µ = (x 2 y 2 ) (y 2 y 1 ) ((x 4 x 6 ) y 1 ) (x 3 y 4 ) (x 4 y 3 ) (x 5 y 6 ) (x 6 y 5 ) Compute X : µ ξ 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 5

6 QuanFfier EliminaFon by Example Consider ϕ =( x z) (y z) ( x w z) (w z) Goal: eliminate from such that z ϕ z : ϕ in CNF Introduce fresh variables and replace posifve and negafve literals τ(ϕ) = (x z) (y + z) (x w z) (w + z) ( w + w ) ( x + x ) ( y + y ) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 6

7 QuanFfier EliminaFon by Example M = Passing τ(ϕ) to SAT solver gives a model w + 1, w 0, x + 0, x 1, y + 0, y 0, z 1 defines implicant M (w x) This means (w x) = z : ϕ Then add blocking clause 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 7

8 QuanFfier EliminaFon by Example Passing to SAT solver again gives new model M = w + 0, w 0, x + 0, x 1, y + 1, y 0, z 0 Defines new implicant Then ( x y) (w x) ( x y) = z : ϕ UnsaFsfiable in next iterafon, i.e. (w x) ( x y) z : ϕ 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 8

9 Intermission: SorFng Networks i 1 i 2 i 3 o 1 o 2 o 3 Cardinality constraint as o 1 o 2 o 3 in unary encoding i 1 + i 2 + i 3 =2 encoded Guarantees generafon of shortest implicants D. Knuth: The Art of Computer Programming, Vol. 3 N. Een and N. Sörensson. TranslaFng Pseudo- Boolean Constraints into SAT, JSAT Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 9

10 QuanFfier EliminaFon by Example So far: ψ equisafsfiable to z : ϕ in DNF Then Observe: ψ z : ϕ is in CNF n i=1 imp i = ψ ψ = n i=1 imp i ψ = n i=1 imp i z : ϕ = n i=1 imp i CNF 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 10

11 QuanFfier EliminaFon by Example Key idea: Simply re- apply technique to Gives ψ = ((w x) ( x y)) = (w x) ( x y) = ( w x) (x y) τ( ψ) = (w x + ) (x + y ) ( w + w ) ( x + x ) ( y + y ) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 11

12 QuanFfier EliminaFon by Example τ( ψ) = Gives Thus Then (w x + ) (x + y ) ( w + w ) ( x + x ) ( y + y ) (x) = ψ ( w y) = ψ (x) ( w y) ψ z : ϕ ψ ((x) ( w y)) ( x) (w y) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 12

13 Experimental Setup ImplementaFon using MiniSAT Approx. 100 lines of code Different benchmark sets (40 cases) Hardware circuits from ISCAS- 89 and 74x series ATmega16 transfer funcfons for synthesis Value- set abstracfons for PLCs Ranging from 66 vars in 119 clauses to variables in clauses Comparison to hybrid SAT/BDD approach using Cudd library 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 13

14 Experimental Results RunFme Primes win on 32 benchmarks, BDDs on 8 Ranging from 0.001s to 7.096s Building BDDs does not come for free But CNF enumerafon using Cudd is faster Size Primes win on 15 benchmarks, BDDs on 5 IdenFcal on 20 benchmarks Lessons learnt: BDDs depend a lot on dynamic variable reordering heurisfcs SAT depends a lot on the chosen encoding (orders of magnitudes) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 14

15 DistribuFon of Prime Implicants +!" '&!" *!" '%!" )!" '$!" (!" '#!" '!" '!!" &!" &!" %!" %!" $!" $!" #!" #!"!" #" $" %" &" '" (" )" *" +" #!" ##" #$" #%" #&"!" '" #" (" $" )" %" *" &" +" '!" ''" '#" '(" '$" ')" '%" '*" '&" '+" #!" #'" ##" '#" *!" '!" &" )!" (!" '!" %" &!" $" #" %!" $!" #!"!" '" #" (" $" )" %" *" &" +" '!" ''" '#" '("!" #" $" %" &" '" (" )" *" +" #!" ##" #$" #%" #&" 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 15

16 So as to not cause offense McMillan (CAV 02) Lahiri et al. (CAV 03 & CAV 06) Monniaux (CAV 10) Cavada et al. (FMCAD 07) Ketle et al. (TACAS 06) Brauer and King (NFM 11) Brauer and King (CAV 11) Goldberg and Manolios (arxiv 12) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 16

17 Discussion Two- staged algorithm Model enumerafon in DNF using prime implicants SomeFmes much faster (0.018s vs s) Not much slower in worst case Prime implicant generafon on negated formula Converges onto quanffier- free formula from above Second phase is thus anyfme Some more intrinsics in the paper CompeFFve to hybrid SAT/BDD based approaches SystemaFc rather than heurisfc approach Easy to implement (~100 LoC on top of MiniSAT) Cleaned up (larger) source code is available from htp:// There are faster techniques though 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 17

18 Two Topics 1. ExistenFal quanffier eliminafon as incremental SAT solving 2. Approximate projecfon for (non- ) linear constraints Some ideas 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 18

19 The UlFmate Goal (1/3) We have a conjuncfon of integral non- linear inequalifes: y (x 4) y 7 y < (x 5) Such systems are rather heavyweight Over- approximate representafon using some linear template domain possible? 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 19

20 The UlFmate Goal (2/3) Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 20

21 The UlFmate Goal (3/3) Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 21

22 Simpler Example Consider ϕ = y = x x 10 0 y 50 Variable bounds are important here! Approximate using octagons, i.e., Take x + y c, which entails Want to compute least sound 0 c 60 c ±x ± y c 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 22

23 Refining x + y c ϕ = y = x x 10 0 y 50 0 c 60 We know Is ϕ (31 c 60) (0 c 30) (31 c 60) safsfiable? Just query an SMT solver Model (x = 6) (y = 38) entails x + y = 44 Thus (44 c 60) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 23

24 Refining x + y c ϕ = y = x x 10 0 y 50 (44 c 60) Simply split Is No! Hence (44 c 60) (44 c 52) (53 c 60) ϕ (53 c 60) (44 c 52) into safsfiable? 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 24

25 Refining x + y c ϕ = y = x x 10 0 y 50 (44 c 52) Just keep goin! Eventually gives, hence c = 44 x + y 44 Could have stopped prematurely though Kind of an anyfme projecfon algorithm x + y 47 is sound, too 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 25

26 The Result Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 26

27 Solving Non- Linear Constraints in Z3 1. Simplify formula 2. Bit- blast and run SAT solver a. If SAT return SAT b. Otherwise check soundness of transformafon 3. Run general- purpose SMT engine a. Simplex b. Bound propagafon c. Gomory cuts d. Interval spliyng e. Gröbner bases Sound + complete for (very) bounded non- linear integer arithmefc (QF_NIA) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 27

28 Related Work Lot of work on QE for linear and non- linear systems, from Fourier- Motzkin Fll 2011 Approximate methods based on refinements? None known to me (I m no expert though) Hints? Similar strategies found in abstract interpretafon Codish et al. (TPLP 08) Brauer, King and Kowalewski (FMICS 10) Brauer and King (ESOP 11) 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 28

29 Concluding Discussion ProjecFon from (non- ) linear system to (non- ) linear system ApproximaFons based on incremental refinements in some template domain Necessitates bounded problems Opinions? Any useful? Use off- the- shelf SMT solver and straigh orward encodings No need to be a genius 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 29

30 2012 Jörg Brauer, Embedded SoWware Laboratory, RWTH Aachen University 30

AN EXAMPLE OF THE GOMORY CUTTING PLANE ALGORITHM. max z = 3x 1 + 4x 2. 3x 1 x x x x N 2

AN EXAMPLE OF THE GOMORY CUTTING PLANE ALGORITHM. max z = 3x 1 + 4x 2. 3x 1 x x x x N 2 AN EXAMPLE OF THE GOMORY CUTTING PLANE ALGORITHM Consider the integer programme subject to max z = 3x 1 + 4x 2 3x 1 x 2 12 3x 1 + 11x 2 66 The first linear programming relaxation is subject to x N 2 max

More information

BMBF Project ROBUKOM: Robust Communication Networks

BMBF Project ROBUKOM: Robust Communication Networks BMBF Project ROBUKOM: Robust Communication Networks Arie M.C.A. Koster Christoph Helmberg Andreas Bley Martin Grötschel Thomas Bauschert supported by BMBF grant 03MS616A: ROBUKOM Robust Communication Networks,

More information

Computer Science. Embedded systems today. Microcontroller MCR

Computer Science. Embedded systems today. Microcontroller MCR Computer Science Microcontroller Embedded systems today Prof. Dr. Siepmann Fachhochschule Aachen - Aachen University of Applied Sciences 24. März 2009-2 Minuteman missile 1962 Prof. Dr. Siepmann Fachhochschule

More information

Artificial Neural Networks written examination

Artificial Neural Networks written examination 1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14

More information

Visual CP Representation of Knowledge

Visual CP Representation of Knowledge Visual CP Representation of Knowledge Heather D. Pfeiffer and Roger T. Hartley Department of Computer Science New Mexico State University Las Cruces, NM 88003-8001, USA email: hdp@cs.nmsu.edu and rth@cs.nmsu.edu

More information

GACE Computer Science Assessment Test at a Glance

GACE Computer Science Assessment Test at a Glance GACE Computer Science Assessment Test at a Glance Updated May 2017 See the GACE Computer Science Assessment Study Companion for practice questions and preparation resources. Assessment Name Computer Science

More information

Discriminative Learning of Beam-Search Heuristics for Planning

Discriminative Learning of Beam-Search Heuristics for Planning Discriminative Learning of Beam-Search Heuristics for Planning Yuehua Xu School of EECS Oregon State University Corvallis,OR 97331 xuyu@eecs.oregonstate.edu Alan Fern School of EECS Oregon State University

More information

A Reinforcement Learning Variant for Control Scheduling

A Reinforcement Learning Variant for Control Scheduling A Reinforcement Learning Variant for Control Scheduling Aloke Guha Honeywell Sensor and System Development Center 3660 Technology Drive Minneapolis MN 55417 Abstract We present an algorithm based on reinforcement

More information

RANKING AND UNRANKING LEFT SZILARD LANGUAGES. Erkki Mäkinen DEPARTMENT OF COMPUTER SCIENCE UNIVERSITY OF TAMPERE REPORT A ER E P S I M S

RANKING AND UNRANKING LEFT SZILARD LANGUAGES. Erkki Mäkinen DEPARTMENT OF COMPUTER SCIENCE UNIVERSITY OF TAMPERE REPORT A ER E P S I M S N S ER E P S I M TA S UN A I S I T VER RANKING AND UNRANKING LEFT SZILARD LANGUAGES Erkki Mäkinen DEPARTMENT OF COMPUTER SCIENCE UNIVERSITY OF TAMPERE REPORT A-1997-2 UNIVERSITY OF TAMPERE DEPARTMENT OF

More information

Rule Learning With Negation: Issues Regarding Effectiveness

Rule Learning With Negation: Issues Regarding Effectiveness Rule Learning With Negation: Issues Regarding Effectiveness S. Chua, F. Coenen, G. Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX Liverpool, United

More information

The Interface between Phrasal and Functional Constraints

The Interface between Phrasal and Functional Constraints The Interface between Phrasal and Functional Constraints John T. Maxwell III* Xerox Palo Alto Research Center Ronald M. Kaplan t Xerox Palo Alto Research Center Many modern grammatical formalisms divide

More information

Radius STEM Readiness TM

Radius STEM Readiness TM Curriculum Guide Radius STEM Readiness TM While today s teens are surrounded by technology, we face a stark and imminent shortage of graduates pursuing careers in Science, Technology, Engineering, and

More information

Designing a Computer to Play Nim: A Mini-Capstone Project in Digital Design I

Designing a Computer to Play Nim: A Mini-Capstone Project in Digital Design I Session 1793 Designing a Computer to Play Nim: A Mini-Capstone Project in Digital Design I John Greco, Ph.D. Department of Electrical and Computer Engineering Lafayette College Easton, PA 18042 Abstract

More information

An empirical study of learning speed in backpropagation

An empirical study of learning speed in backpropagation Carnegie Mellon University Research Showcase @ CMU Computer Science Department School of Computer Science 1988 An empirical study of learning speed in backpropagation networks Scott E. Fahlman Carnegie

More information

Major Milestones, Team Activities, and Individual Deliverables

Major Milestones, Team Activities, and Individual Deliverables Major Milestones, Team Activities, and Individual Deliverables Milestone #1: Team Semester Proposal Your team should write a proposal that describes project objectives, existing relevant technology, engineering

More information

Rule Learning with Negation: Issues Regarding Effectiveness

Rule Learning with Negation: Issues Regarding Effectiveness Rule Learning with Negation: Issues Regarding Effectiveness Stephanie Chua, Frans Coenen, and Grant Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX

More information

Compositional Semantics

Compositional Semantics Compositional Semantics CMSC 723 / LING 723 / INST 725 MARINE CARPUAT marine@cs.umd.edu Words, bag of words Sequences Trees Meaning Representing Meaning An important goal of NLP/AI: convert natural language

More information

Learning Methods for Fuzzy Systems

Learning Methods for Fuzzy Systems Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8

More information

Getting Started with Deliberate Practice

Getting Started with Deliberate Practice Getting Started with Deliberate Practice Most of the implementation guides so far in Learning on Steroids have focused on conceptual skills. Things like being able to form mental images, remembering facts

More information

DIDACTIC MODEL BRIDGING A CONCEPT WITH PHENOMENA

DIDACTIC MODEL BRIDGING A CONCEPT WITH PHENOMENA DIDACTIC MODEL BRIDGING A CONCEPT WITH PHENOMENA Beba Shternberg, Center for Educational Technology, Israel Michal Yerushalmy University of Haifa, Israel The article focuses on a specific method of constructing

More information

On the Polynomial Degree of Minterm-Cyclic Functions

On the Polynomial Degree of Minterm-Cyclic Functions On the Polynomial Degree of Minterm-Cyclic Functions Edward L. Talmage Advisor: Amit Chakrabarti May 31, 2012 ABSTRACT When evaluating Boolean functions, each bit of input that must be checked is costly,

More information

Approaches to control phenomena handout Obligatory control and morphological case: Icelandic and Basque

Approaches to control phenomena handout Obligatory control and morphological case: Icelandic and Basque Approaches to control phenomena handout 6 5.4 Obligatory control and morphological case: Icelandic and Basque Icelandinc quirky case (displaying properties of both structural and inherent case: lexically

More information

Extending Place Value with Whole Numbers to 1,000,000

Extending Place Value with Whole Numbers to 1,000,000 Grade 4 Mathematics, Quarter 1, Unit 1.1 Extending Place Value with Whole Numbers to 1,000,000 Overview Number of Instructional Days: 10 (1 day = 45 minutes) Content to Be Learned Recognize that a digit

More information

Cal s Dinner Card Deals

Cal s Dinner Card Deals Cal s Dinner Card Deals Overview: In this lesson students compare three linear functions in the context of Dinner Card Deals. Students are required to interpret a graph for each Dinner Card Deal to help

More information

Version Space. Term 2012/2013 LSI - FIB. Javier Béjar cbea (LSI - FIB) Version Space Term 2012/ / 18

Version Space. Term 2012/2013 LSI - FIB. Javier Béjar cbea (LSI - FIB) Version Space Term 2012/ / 18 Version Space Javier Béjar cbea LSI - FIB Term 2012/2013 Javier Béjar cbea (LSI - FIB) Version Space Term 2012/2013 1 / 18 Outline 1 Learning logical formulas 2 Version space Introduction Search strategy

More information

Given a directed graph G =(N A), where N is a set of m nodes and A. destination node, implying a direction for ow to follow. Arcs have limitations

Given a directed graph G =(N A), where N is a set of m nodes and A. destination node, implying a direction for ow to follow. Arcs have limitations 4 Interior point algorithms for network ow problems Mauricio G.C. Resende AT&T Bell Laboratories, Murray Hill, NJ 07974-2070 USA Panos M. Pardalos The University of Florida, Gainesville, FL 32611-6595

More information

A Neural Network GUI Tested on Text-To-Phoneme Mapping

A Neural Network GUI Tested on Text-To-Phoneme Mapping A Neural Network GUI Tested on Text-To-Phoneme Mapping MAARTEN TROMPPER Universiteit Utrecht m.f.a.trompper@students.uu.nl Abstract Text-to-phoneme (T2P) mapping is a necessary step in any speech synthesis

More information

SELF-STUDY QUESTIONNAIRE FOR REVIEW of the COMPUTER SCIENCE PROGRAM

SELF-STUDY QUESTIONNAIRE FOR REVIEW of the COMPUTER SCIENCE PROGRAM Disclaimer: This Self Study was developed to meet the goals of the CAC Session at the 2006 Summit. It should not be considered as a model or a template. ABET Computing Accreditation Commission SELF-STUDY

More information

Cooperative evolutive concept learning: an empirical study

Cooperative evolutive concept learning: an empirical study Cooperative evolutive concept learning: an empirical study Filippo Neri University of Piemonte Orientale Dipartimento di Scienze e Tecnologie Avanzate Piazza Ambrosoli 5, 15100 Alessandria AL, Italy Abstract

More information

School Competition and Efficiency with Publicly Funded Catholic Schools David Card, Martin D. Dooley, and A. Abigail Payne

School Competition and Efficiency with Publicly Funded Catholic Schools David Card, Martin D. Dooley, and A. Abigail Payne School Competition and Efficiency with Publicly Funded Catholic Schools David Card, Martin D. Dooley, and A. Abigail Payne Web Appendix See paper for references to Appendix Appendix 1: Multiple Schools

More information

A Version Space Approach to Learning Context-free Grammars

A Version Space Approach to Learning Context-free Grammars Machine Learning 2: 39~74, 1987 1987 Kluwer Academic Publishers, Boston - Manufactured in The Netherlands A Version Space Approach to Learning Context-free Grammars KURT VANLEHN (VANLEHN@A.PSY.CMU.EDU)

More information

Bachelor Class

Bachelor Class Bachelor Class 2015-2016 Siegfried Nijssen 11 January 2016 Popularity of Topics 1 Popularity of Topics 4 Popularity of Topics Assignment of Topics I contacted all supervisors with the first choices Most

More information

Software Maintenance

Software Maintenance 1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories

More information

University of Groningen. Systemen, planning, netwerken Bosman, Aart

University of Groningen. Systemen, planning, netwerken Bosman, Aart University of Groningen Systemen, planning, netwerken Bosman, Aart IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document

More information

The Strong Minimalist Thesis and Bounded Optimality

The Strong Minimalist Thesis and Bounded Optimality The Strong Minimalist Thesis and Bounded Optimality DRAFT-IN-PROGRESS; SEND COMMENTS TO RICKL@UMICH.EDU Richard L. Lewis Department of Psychology University of Michigan 27 March 2010 1 Purpose of this

More information

Grammars & Parsing, Part 1:

Grammars & Parsing, Part 1: Grammars & Parsing, Part 1: Rules, representations, and transformations- oh my! Sentence VP The teacher Verb gave the lecture 2015-02-12 CS 562/662: Natural Language Processing Game plan for today: Review

More information

Mathematics process categories

Mathematics process categories Mathematics process categories All of the UK curricula define multiple categories of mathematical proficiency that require students to be able to use and apply mathematics, beyond simple recall of facts

More information

Which verb classes and why? Research questions: Semantic Basis Hypothesis (SBH) What verb classes? Why the truth of the SBH matters

Which verb classes and why? Research questions: Semantic Basis Hypothesis (SBH) What verb classes? Why the truth of the SBH matters Which verb classes and why? ean-pierre Koenig, Gail Mauner, Anthony Davis, and reton ienvenue University at uffalo and Streamsage, Inc. Research questions: Participant roles play a role in the syntactic

More information

Continual Curiosity-Driven Skill Acquisition from High-Dimensional Video Inputs for Humanoid Robots

Continual Curiosity-Driven Skill Acquisition from High-Dimensional Video Inputs for Humanoid Robots Continual Curiosity-Driven Skill Acquisition from High-Dimensional Video Inputs for Humanoid Robots Varun Raj Kompella, Marijn Stollenga, Matthew Luciw, Juergen Schmidhuber The Swiss AI Lab IDSIA, USI

More information

arxiv: v1 [cs.cv] 10 May 2017

arxiv: v1 [cs.cv] 10 May 2017 Inferring and Executing Programs for Visual Reasoning Justin Johnson 1 Bharath Hariharan 2 Laurens van der Maaten 2 Judy Hoffman 1 Li Fei-Fei 1 C. Lawrence Zitnick 2 Ross Girshick 2 1 Stanford University

More information

TABLE OF CONTENTS TABLE OF CONTENTS COVER PAGE HALAMAN PENGESAHAN PERNYATAAN NASKAH SOAL TUGAS AKHIR ACKNOWLEDGEMENT FOREWORD

TABLE OF CONTENTS TABLE OF CONTENTS COVER PAGE HALAMAN PENGESAHAN PERNYATAAN NASKAH SOAL TUGAS AKHIR ACKNOWLEDGEMENT FOREWORD TABLE OF CONTENTS TABLE OF CONTENTS COVER PAGE HALAMAN PENGESAHAN PERNYATAAN NASKAH SOAL TUGAS AKHIR ACKNOWLEDGEMENT FOREWORD TABLE OF CONTENTS LIST OF FIGURES LIST OF TABLES LIST OF APPENDICES LIST OF

More information

9.85 Cognition in Infancy and Early Childhood. Lecture 7: Number

9.85 Cognition in Infancy and Early Childhood. Lecture 7: Number 9.85 Cognition in Infancy and Early Childhood Lecture 7: Number What else might you know about objects? Spelke Objects i. Continuity. Objects exist continuously and move on paths that are connected over

More information

Exploring Derivative Functions using HP Prime

Exploring Derivative Functions using HP Prime Exploring Derivative Functions using HP Prime Betty Voon Wan Niu betty@uniten.edu.my College of Engineering Universiti Tenaga Nasional Malaysia Wong Ling Shing Faculty of Health and Life Sciences, INTI

More information

Control and Boundedness

Control and Boundedness Control and Boundedness Having eliminated rules, we would expect constructions to follow from the lexical categories (of heads and specifiers of syntactic constructions) alone. Combinatory syntax simply

More information

Learning Cases to Resolve Conflicts and Improve Group Behavior

Learning Cases to Resolve Conflicts and Improve Group Behavior From: AAAI Technical Report WS-96-02. Compilation copyright 1996, AAAI (www.aaai.org). All rights reserved. Learning Cases to Resolve Conflicts and Improve Group Behavior Thomas Haynes and Sandip Sen Department

More information

CS Machine Learning

CS Machine Learning CS 478 - Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing

More information

Grade 2: Using a Number Line to Order and Compare Numbers Place Value Horizontal Content Strand

Grade 2: Using a Number Line to Order and Compare Numbers Place Value Horizontal Content Strand Grade 2: Using a Number Line to Order and Compare Numbers Place Value Horizontal Content Strand Texas Essential Knowledge and Skills (TEKS): (2.1) Number, operation, and quantitative reasoning. The student

More information

TOPICS LEARNING OUTCOMES ACTIVITES ASSESSMENT Numbers and the number system

TOPICS LEARNING OUTCOMES ACTIVITES ASSESSMENT Numbers and the number system Curriculum Overview Mathematics 1 st term 5º grade - 2010 TOPICS LEARNING OUTCOMES ACTIVITES ASSESSMENT Numbers and the number system Multiplies and divides decimals by 10 or 100. Multiplies and divide

More information

IT Project List. Description

IT Project List. Description PID 270 Early Alert Appointment Tracking for Students (SARS) In Progress 110.1 13 14 The implementation of the SARS package will allow integration of essential components of GRCC's institutional student

More information

CS 1103 Computer Science I Honors. Fall Instructor Muller. Syllabus

CS 1103 Computer Science I Honors. Fall Instructor Muller. Syllabus CS 1103 Computer Science I Honors Fall 2016 Instructor Muller Syllabus Welcome to CS1103. This course is an introduction to the art and science of computer programming and to some of the fundamental concepts

More information

Lecture 1: Machine Learning Basics

Lecture 1: Machine Learning Basics 1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3

More information

Reinforcement Learning by Comparing Immediate Reward

Reinforcement Learning by Comparing Immediate Reward Reinforcement Learning by Comparing Immediate Reward Punit Pandey DeepshikhaPandey Dr. Shishir Kumar Abstract This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate

More information

A. True B. False INVENTORY OF PROCESSES IN COLLEGE COMPOSITION

A. True B. False INVENTORY OF PROCESSES IN COLLEGE COMPOSITION INVENTORY OF PROCESSES IN COLLEGE COMPOSITION This questionnaire describes the different ways that college students go about writing essays and papers. There are no right or wrong answers because there

More information

SELF-STUDY QUESTIONNAIRE FOR REVIEW of the COMPUTER SCIENCE PROGRAM and the INFORMATION SYSTEMS PROGRAM

SELF-STUDY QUESTIONNAIRE FOR REVIEW of the COMPUTER SCIENCE PROGRAM and the INFORMATION SYSTEMS PROGRAM Disclaimer: This Self Study was developed to meet the goals of the CAC Session at the 2006 Summit. It should not be considered as a model or a template. ABET SELF-STUDY QUESTIONNAIRE FOR REVIEW of the

More information

Process to Identify Minimum Passing Criteria and Objective Evidence in Support of ABET EC2000 Criteria Fulfillment

Process to Identify Minimum Passing Criteria and Objective Evidence in Support of ABET EC2000 Criteria Fulfillment Session 2532 Process to Identify Minimum Passing Criteria and Objective Evidence in Support of ABET EC2000 Criteria Fulfillment Dr. Fong Mak, Dr. Stephen Frezza Department of Electrical and Computer Engineering

More information

Detailed course syllabus

Detailed course syllabus Detailed course syllabus 1. Linear regression model. Ordinary least squares method. This introductory class covers basic definitions of econometrics, econometric model, and economic data. Classification

More information

Domain Knowledge in Planning: Representation and Use

Domain Knowledge in Planning: Representation and Use Domain Knowledge in Planning: Representation and Use Patrik Haslum Knowledge Processing Lab Linköping University pahas@ida.liu.se Ulrich Scholz Intellectics Group Darmstadt University of Technology scholz@thispla.net

More information

AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS

AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS 1 CALIFORNIA CONTENT STANDARDS: Chapter 1 ALGEBRA AND WHOLE NUMBERS Algebra and Functions 1.4 Students use algebraic

More information

ISFA2008U_120 A SCHEDULING REINFORCEMENT LEARNING ALGORITHM

ISFA2008U_120 A SCHEDULING REINFORCEMENT LEARNING ALGORITHM Proceedings of 28 ISFA 28 International Symposium on Flexible Automation Atlanta, GA, USA June 23-26, 28 ISFA28U_12 A SCHEDULING REINFORCEMENT LEARNING ALGORITHM Amit Gil, Helman Stern, Yael Edan, and

More information

Human Emotion Recognition From Speech

Human Emotion Recognition From Speech RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati

More information

College Pricing and Income Inequality

College Pricing and Income Inequality College Pricing and Income Inequality Zhifeng Cai U of Minnesota, Rutgers University, and FRB Minneapolis Jonathan Heathcote FRB Minneapolis NBER Income Distribution, July 20, 2017 The views expressed

More information

Page 1 of 11. Curriculum Map: Grade 4 Math Course: Math 4 Sub-topic: General. Grade(s): None specified

Page 1 of 11. Curriculum Map: Grade 4 Math Course: Math 4 Sub-topic: General. Grade(s): None specified Curriculum Map: Grade 4 Math Course: Math 4 Sub-topic: General Grade(s): None specified Unit: Creating a Community of Mathematical Thinkers Timeline: Week 1 The purpose of the Establishing a Community

More information

Statewide Framework Document for:

Statewide Framework Document for: Statewide Framework Document for: 270301 Standards may be added to this document prior to submission, but may not be removed from the framework to meet state credit equivalency requirements. Performance

More information

Computer Science 141: Computing Hardware Course Information Fall 2012

Computer Science 141: Computing Hardware Course Information Fall 2012 Computer Science 141: Computing Hardware Course Information Fall 2012 September 4, 2012 1 Outline The main emphasis of this course is on the basic concepts of digital computing hardware and fundamental

More information

Mathematics subject curriculum

Mathematics subject curriculum Mathematics subject curriculum Dette er ei omsetjing av den fastsette læreplanteksten. Læreplanen er fastsett på Nynorsk Established as a Regulation by the Ministry of Education and Research on 24 June

More information

POLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance

POLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance POLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance Cristina Conati, Kurt VanLehn Intelligent Systems Program University of Pittsburgh Pittsburgh, PA,

More information

South Carolina College- and Career-Ready Standards for Mathematics. Standards Unpacking Documents Grade 5

South Carolina College- and Career-Ready Standards for Mathematics. Standards Unpacking Documents Grade 5 South Carolina College- and Career-Ready Standards for Mathematics Standards Unpacking Documents Grade 5 South Carolina College- and Career-Ready Standards for Mathematics Standards Unpacking Documents

More information

GCSE Mathematics B (Linear) Mark Scheme for November Component J567/04: Mathematics Paper 4 (Higher) General Certificate of Secondary Education

GCSE Mathematics B (Linear) Mark Scheme for November Component J567/04: Mathematics Paper 4 (Higher) General Certificate of Secondary Education GCSE Mathematics B (Linear) Component J567/04: Mathematics Paper 4 (Higher) General Certificate of Secondary Education Mark Scheme for November 2014 Oxford Cambridge and RSA Examinations OCR (Oxford Cambridge

More information

IAT 888: Metacreation Machines endowed with creative behavior. Philippe Pasquier Office 565 (floor 14)

IAT 888: Metacreation Machines endowed with creative behavior. Philippe Pasquier Office 565 (floor 14) IAT 888: Metacreation Machines endowed with creative behavior Philippe Pasquier Office 565 (floor 14) pasquier@sfu.ca Outline of today's lecture A little bit about me A little bit about you What will that

More information

Accelerated Learning Online. Course Outline

Accelerated Learning Online. Course Outline Accelerated Learning Online Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies

More information

Type-driven semantic interpretation and feature dependencies in R-LFG

Type-driven semantic interpretation and feature dependencies in R-LFG Type-driven semantic interpretation and feature dependencies in R-LFG Mark Johnson Revision of 23rd August, 1997 1 Introduction This paper describes a new formalization of Lexical-Functional Grammar called

More information

Natural Language Processing. George Konidaris

Natural Language Processing. George Konidaris Natural Language Processing George Konidaris gdk@cs.brown.edu Fall 2017 Natural Language Processing Understanding spoken/written sentences in a natural language. Major area of research in AI. Why? Humans

More information

Process improvement, The Agile Way! By Ben Linders Published in Methods and Tools, winter

Process improvement, The Agile Way! By Ben Linders Published in Methods and Tools, winter Process improvement, The Agile Way! By Ben Linders Published in Methods and Tools, winter 2010. http://www.methodsandtools.com/ Summary Business needs for process improvement projects are changing. Organizations

More information

An Evaluation of the Interactive-Activation Model Using Masked Partial-Word Priming. Jason R. Perry. University of Western Ontario. Stephen J.

An Evaluation of the Interactive-Activation Model Using Masked Partial-Word Priming. Jason R. Perry. University of Western Ontario. Stephen J. An Evaluation of the Interactive-Activation Model Using Masked Partial-Word Priming Jason R. Perry University of Western Ontario Stephen J. Lupker University of Western Ontario Colin J. Davis Royal Holloway

More information

Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses

Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Thomas F.C. Woodhall Masters Candidate in Civil Engineering Queen s University at Kingston,

More information

Lecture 1: Basic Concepts of Machine Learning

Lecture 1: Basic Concepts of Machine Learning Lecture 1: Basic Concepts of Machine Learning Cognitive Systems - Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010

More information

Multi-label classification via multi-target regression on data streams

Multi-label classification via multi-target regression on data streams Mach Learn (2017) 106:745 770 DOI 10.1007/s10994-016-5613-5 Multi-label classification via multi-target regression on data streams Aljaž Osojnik 1,2 Panče Panov 1 Sašo Džeroski 1,2,3 Received: 26 April

More information

AUTHORITATIVE SOURCES ADULT AND COMMUNITY LEARNING LEARNING PROGRAMMES

AUTHORITATIVE SOURCES ADULT AND COMMUNITY LEARNING LEARNING PROGRAMMES AUTHORITATIVE SOURCES ADULT AND COMMUNITY LEARNING LEARNING PROGRAMMES AUGUST 2001 Contents Sources 2 The White Paper Learning to Succeed 3 The Learning and Skills Council Prospectus 5 Post-16 Funding

More information

Arizona s College and Career Ready Standards Mathematics

Arizona s College and Career Ready Standards Mathematics Arizona s College and Career Ready Mathematics Mathematical Practices Explanations and Examples First Grade ARIZONA DEPARTMENT OF EDUCATION HIGH ACADEMIC STANDARDS FOR STUDENTS State Board Approved June

More information

36TITE 140. Course Description:

36TITE 140. Course Description: 36TITE 140 36TSpreadsheet Software Course Description: 11TCovers use of spreadsheet software to create spreadsheets with formatted cells and cell ranges, control pages, multiple sheets, charts and macros.

More information

Cognitive Modeling. Tower of Hanoi: Description. Tower of Hanoi: The Task. Lecture 5: Models of Problem Solving. Frank Keller.

Cognitive Modeling. Tower of Hanoi: Description. Tower of Hanoi: The Task. Lecture 5: Models of Problem Solving. Frank Keller. Cognitive Modeling Lecture 5: Models of Problem Solving Frank Keller School of Informatics University of Edinburgh keller@inf.ed.ac.uk January 22, 2008 1 2 3 4 Reading: Cooper (2002:Ch. 4). Frank Keller

More information

Teaching Algorithm Development Skills

Teaching Algorithm Development Skills International Journal of Advanced Computer Science, Vol. 3, No. 9, Pp. 466-474, Sep., 2013. Teaching Algorithm Development Skills Jungsoon Yoo, Sung Yoo, Suk Seo, Zhijiang Dong, & Chrisila Pettey Manuscript

More information

Grades. From Your Friends at The MAILBOX

Grades. From Your Friends at The MAILBOX From Your Friends at The MAILBOX Grades 5 6 TEC916 High-Interest Math Problems to Reinforce Your Curriculum Supports NCTM standards Strengthens problem-solving and basic math skills Reinforces key problem-solving

More information

Improving Fairness in Memory Scheduling

Improving Fairness in Memory Scheduling Improving Fairness in Memory Scheduling Using a Team of Learning Automata Aditya Kajwe and Madhu Mutyam Department of Computer Science & Engineering, Indian Institute of Tehcnology - Madras June 14, 2014

More information

Target Language Preposition Selection an Experiment with Transformation-Based Learning and Aligned Bilingual Data

Target Language Preposition Selection an Experiment with Transformation-Based Learning and Aligned Bilingual Data Target Language Preposition Selection an Experiment with Transformation-Based Learning and Aligned Bilingual Data Ebba Gustavii Department of Linguistics and Philology, Uppsala University, Sweden ebbag@stp.ling.uu.se

More information

LEGO MINDSTORMS Education EV3 Coding Activities

LEGO MINDSTORMS Education EV3 Coding Activities LEGO MINDSTORMS Education EV3 Coding Activities s t e e h s k r o W t n e d Stu LEGOeducation.com/MINDSTORMS Contents ACTIVITY 1 Performing a Three Point Turn 3-6 ACTIVITY 2 Written Instructions for a

More information

(Sub)Gradient Descent

(Sub)Gradient Descent (Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include

More information

Algebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview

Algebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview Algebra 1, Quarter 3, Unit 3.1 Line of Best Fit Overview Number of instructional days 6 (1 day assessment) (1 day = 45 minutes) Content to be learned Analyze scatter plots and construct the line of best

More information

Feature-oriented vs. Needs-oriented Product Access for Non-Expert Online Shoppers

Feature-oriented vs. Needs-oriented Product Access for Non-Expert Online Shoppers Feature-oriented vs. Needs-oriented Product Access for Non-Expert Online Shoppers Daniel Felix 1, Christoph Niederberger 1, Patrick Steiger 2 & Markus Stolze 3 1 ETH Zurich, Technoparkstrasse 1, CH-8005

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

IMPROVED MANUFACTURING PROGRAM ALIGNMENT W/ PBOS

IMPROVED MANUFACTURING PROGRAM ALIGNMENT W/ PBOS C2ER / LMI INSTITUTE IMPROVED MANUFACTURING PROGRAM ALIGNMENT W/ PBOS JUNE 09 2016 US DEPARTMENT OF LABOR MULTI-STATE ADVANCED MANUFACTURING CONSORTIUM MULTI-STATE ADVANCED MANUFACTURING CONSORTIUM Introductions

More information

IMGD Technical Game Development I: Iterative Development Techniques. by Robert W. Lindeman

IMGD Technical Game Development I: Iterative Development Techniques. by Robert W. Lindeman IMGD 3000 - Technical Game Development I: Iterative Development Techniques by Robert W. Lindeman gogo@wpi.edu Motivation The last thing you want to do is write critical code near the end of a project Induces

More information

International Journal of Computational Intelligence and Informatics, Vol. 1 : No. 4, January - March 2012

International Journal of Computational Intelligence and Informatics, Vol. 1 : No. 4, January - March 2012 Text-independent Mono and Cross-lingual Speaker Identification with the Constraint of Limited Data Nagaraja B G and H S Jayanna Department of Information Science and Engineering Siddaganga Institute of

More information

FSL-BM: Fuzzy Supervised Learning with Binary Meta-Feature for Classification

FSL-BM: Fuzzy Supervised Learning with Binary Meta-Feature for Classification FSL-BM: Fuzzy Supervised Learning with Binary Meta-Feature for Classification arxiv:1709.09268v2 [cs.lg] 15 Nov 2017 Kamran Kowsari, Nima Bari, Roman Vichr and Farhad A. Goodarzi Department of Computer

More information

Inleiding Taalkunde. Docent: Paola Monachesi. Blok 4, 2001/ Syntax 2. 2 Phrases and constituent structure 2. 3 A minigrammar of Italian 3

Inleiding Taalkunde. Docent: Paola Monachesi. Blok 4, 2001/ Syntax 2. 2 Phrases and constituent structure 2. 3 A minigrammar of Italian 3 Inleiding Taalkunde Docent: Paola Monachesi Blok 4, 2001/2002 Contents 1 Syntax 2 2 Phrases and constituent structure 2 3 A minigrammar of Italian 3 4 Trees 3 5 Developing an Italian lexicon 4 6 S(emantic)-selection

More information

Foothill College Summer 2016

Foothill College Summer 2016 Foothill College Summer 2016 Intermediate Algebra Math 105.04W CRN# 10135 5.0 units Instructor: Yvette Butterworth Text: None; Beoga.net material used Hours: Online Except Final Thurs, 8/4 3:30pm Phone:

More information

AUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION

AUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 11/2007, ISSN 1642-6037 Marek WIŚNIEWSKI *, Wiesława KUNISZYK-JÓŹKOWIAK *, Elżbieta SMOŁKA *, Waldemar SUSZYŃSKI * HMM, recognition, speech, disorders

More information

Infrared Paper Dryer Control Scheme

Infrared Paper Dryer Control Scheme Infrared Paper Dryer Control Scheme INITIAL PROJECT SUMMARY 10/03/2005 DISTRIBUTED MEGAWATTS Carl Lee Blake Peck Rob Schaerer Jay Hudkins 1. Project Overview 1.1 Stake Holders Potlatch Corporation, Idaho

More information

BAUM-WELCH TRAINING FOR SEGMENT-BASED SPEECH RECOGNITION. Han Shu, I. Lee Hetherington, and James Glass

BAUM-WELCH TRAINING FOR SEGMENT-BASED SPEECH RECOGNITION. Han Shu, I. Lee Hetherington, and James Glass BAUM-WELCH TRAINING FOR SEGMENT-BASED SPEECH RECOGNITION Han Shu, I. Lee Hetherington, and James Glass Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology Cambridge,

More information

Exploration. CS : Deep Reinforcement Learning Sergey Levine

Exploration. CS : Deep Reinforcement Learning Sergey Levine Exploration CS 294-112: Deep Reinforcement Learning Sergey Levine Class Notes 1. Homework 4 due on Wednesday 2. Project proposal feedback sent Today s Lecture 1. What is exploration? Why is it a problem?

More information