Introduction to Computational Neuroscience A. The Brain as an Information Processing Device
|
|
- Corey Wilkerson
- 6 years ago
- Views:
Transcription
1 Introduction to Computational Neuroscience A. The Brain as an Information Processing Device Jackendoff (Consciousness and the Computational Mind, Jackendoff, MIT Press, 1990) argues that we can put off questions about the "phenomenological mind", and concern ourselves with the relation between the brain and the "computational mind". The brain is viewed as an information processing device. The mind is viewed as a collection of functions. The principle function of the brain is to process information.
2 Kosslyn & Koenig (Wet Mind: The New Cognitive Neuroscience, Free Press, 1995) propose a Cognitive Neuroscience Triangle: Behavior is at the top of the triangle because the goal is to explain specific abilities which can only be revealed by behavior. Studies in cognitive psychology and linguistics deepen understanding of the phenomena to be explained.
3 According to this view, cognitive neuroscience seeks to understand the nature of the information processing by which the brain produces the observed behavior. Computational analyses & computer models are used to understand how the brain can produce cognitive behaviors. Since the language of information processing is derived from computers, we must use key concepts from this language to specify how the brain processes information.
4 B. Historical Perspective The modern history of artificial intelligence can be traced back to the 1940's. There are two complementary approaches to the field that both go back to those early days. The Serial Symbol Processing approach began in the 1940's, when the architecture of the modern digital computer was designed by John Von Neumann and others. They were heavily influenced by the work of Alan Turing on finite computing machines. The Turing Machine is a list of instructions for carrying out a logical operation. The Von Neumann computer follows this theme. It: a) performs one operation at a time b) operates by an explicit set of instructions c) distinguishes explicitly between stored information & the operations that manipulate information.
5 The Parallel Distributed Processing (PDP) approach has its roots in the work of Donald Hebb. In 1949, Hebb constructed a theoretical framework for the representation of short-term and long-term memory in the nervous system. The functional unit in Hebb's theory is the Nerve Cell Assembly (NCA): a population of mutually excitatory neurons that when excited together becomes functionally linked. He also introduced the Hebbian learning rule: when unit A and unit B are simultaneously excited, the strength of the connection between them is increased. Hebb s work built on the earlier work of McCulloch and Pitts, who proposed a simple model of a neuron as a binary threshold unit. The model neuron computes a weighted sum of its inputs from other units, and outputs a one or zero according to whether this sum is above or below a threshold. McCulloch & Pitts (1943) proved that an assembly of such neurons is capable in principle of universal computation, if the weights are chosen suitably. This means that such an assembly could in principle perform any computation that an ordinary digital computer can.
6 A leading proponent of the PDP approach was Frank Rosenblatt, who developed the concept of the perceptron: a single-layer feedforward network of linear threshold units without feedback. The work focussed on the problem of determining appropriate weights for particular computational tasks. For the single-layer perceptron, Rosenblatt developed a learning algorithm a method for changing the weights iteratively, based on error signals, so that a desired computation was performed.
7 The properties of perceptrons were carefully analyzed by Minsky & Papert in their 1969 book "Perceptrons". They showed that Rosenblatt s learning algorithm only applied to those problems which the network structure is capable of computing. They showed that some elementary computations could not be done by the single-layer perceptron. The simplest example was the exclusive or problem (the output unit turns on if 1 or the other of 2 input lines is on, but not when neither or both are on). Rosenblatt believed that multi-layer structures could overcome the limitations of the simple perceptrons, but he could not discover a learning algorithm for determining the way to arrive at the weights necessary to implement a given calculation.
8 Minsky & Papert s analysis of the limitations of one-layer networks suggested to many in the fields of artificial intelligence and cognitive psychology that perceptron-like computational devices were not useful. This put a damper on the PDP approach, and the late 1960's and most of the 1970's were dominated by the serial processing approach & the Von Neumann computer. However, after many grandiose claims for the serial symbolic processing approach were not fulfilled, there was a resurgence of interest in PDP models in the late 1970's. It was realized that, although Minsky & Papert were exactly correct in their analysis of the one-layer perceptron, their analysis did not extend to multi-layer networks nor to systems with feedback loops. Much of the resurgence of the PDP approach was fueled by discovery of the backward error propagation algorithm, which fulfilled Rosenblatt s dream of a general learning algorithm for multi-layer networks.
9 The PDP approach has gained a wide following since the early 1980's. Many neuroscientists believe that it embodies principles that are more neurally realistic than the serial symbolic approach. Because PDP models are thought to work like brain regions, they are often called Artificial Neural Networks.
10 C. Properties of Artificial Neural Networks 1. Neural networks are organized as layers of units. A feedforward network has an input layer, an output layer, and one or more hidden layers. In recurrent networks, there are excitatory or inhibitory connections from output units back to earlier units, e.g. input units. The feedback modulates the input.
11 2. Each unit has an output which is its activity level, and a threshold which is a level which must be exceeded by the sum of its inputs for the unit to fire (give an output). The output of each unit (neuron) conveys information (defined in most general sense as reduction of uncertainty ) by its activity.
12 3. Connections between units can be excitatory or inhibitory. Each connection has a weight which measures the strength of the influence of 1 unit on another. 4. Inputs and outputs to the network are patterns of activity.
13 5. A neural network is trained by teaching it to produce certain output when given certain input. The backward error propagation training technique: (1) randomize the weights (2) present an input pattern (3) compare the output with the desired output (i.e. compute the error) (4) slightly adjust the weights to reduce the error (5) repeat (2) - (4)
14 6. The trained network functions as an associative memory: it relates patterns from the input domain to corresponding patterns in the output domain. 7. The pattern of weights on the internal connections of the network can be considered to be a representation: it represents the combinations of input features that identify output patterns.
15 8. Input patterns are informationally interpretable in that they have a specific impact on a network s output, i.e. they contain information that is used to direct the network behavior in one way or another. 9. The network can be considered to perform a systematic mapping of input space to output space: it preserves a specific relationship between properties of input and output. The mapping is determined by the connections within the network. 10. Networks perform computations: the informationally interpretable systematic mapping from input to output. 11. The set of input/output mappings performed by a network is the function it computes.
16 12. The systematic relationship between input and output may be described by a rule. (The computational system does not actually contain rules, but is connected in such a way that it can be described by rules). 13. Networks can be linked together so that the output of one network is fed as input to another network. 14. A set of connected networks comprising a larger network may be called a processing subsystem (a subset of the entire nervous system). 15. Processing subsystems carry out algorithms. An algorithm is a set of computational steps that operates on a particular input to produce a particular output. The algorithm can be described without specifying all of the internal steps that are required.
17 D. Concept of Levels 1. Levels of organization Levels are based on structural organization at different scales, e.g. molecular, synaptic, neuronal, network, systems. Each structural level has its own corresponding functional description. A description of algorithm, i.e. how a task is accomplished, may be provided at many different levels. Cognitive phenomena may be associated with a variety of levels.
18 2. Levels of processing Levels are based on pathway distance from sensory receptors. Measured by number of intervening synapses from periphery. Does not imply that information only flows from periphery to more central regions. There are many pathways from higher to lower levels. Also, it is not possible to assign levels outside of sensory systems.
19 3. Levels of analysis Levels are based on classes of questions that can be asked. A good example of this view of levels comes from David Marr (Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. New York: Freeman, pp29-61). Marr identified 3 levels of analysis: a) abstract problem analysis b) algorithm c) physical implementation
20 E. Identifying Networks in the Brain Because of the complexity of the brain, a pragmatic strategy is needed for determining which functions are elementary, and identifying specific networks in the brain that perform those functions. Two basic approaches to this problem are described in reference to levels of analysis: top-down and bottom-up.
21 1. The Marr computational analysis is an example of a topdown approach. It begins with a behavior to be explained & logically analyzes the information processing steps that would be needed to produce it. a) abstract problem analysis: a computational theory is constructed of a subsystem which performs a complex input/output mapping. At this level, the questions are: what is the goal of the computation, why is it appropriate, and what is the logic of the strategy by which it can be carried out? b) algorithm: how can the computational theory be implemented; what is the representation for the input and output, and what is the algorithm for the transformation? c) physical implementation: how can the representation & algorithm be realized physically (in the brain or in a machine)?
22 These levels were proposed by Marr to be independently solvable. His approach has a functionalist flavor it might be interpreted to imply that neuroscience is irrelevant for understanding cognition. These levels may be independent in a formal sense, i.e. an algorithm can be specified without reference to the physical implementation. Many useful algorithms are created in this way. However, algorithms that are relevant to human cognition may require consideration of neurobiological constraints. There are many conceivable solutions to the problem of how a cognitive operation could be accomplished. Furthermore, some functions may be too difficult to understand without considering neurobiology. The assumption of cognitive neuroscience is that neurobiological data provide essential constraints on computational theories. They provide an efficient means of narrowing the search space for computational solutions.
23
24 2. An example of a bottom-up approach, proposed by Freeman, is the theory of Katchalsky sets. Based on neuronal analysis. K0 set: network with common input source, common sign of output, and no interconnections KIe set: network with common input source, common sign of output, dense mutual excitation KIi set: network with common input source, common sign of output, dense mutual inhibition KII set: network with dense interconnections between two KI sets KIII set: combination of KII sets
25
26 CECN attempts a synthesis of top-down and bottom-up approaches. It is concerned with the implementation of highlevel cognitive functions, so it is top-down, but it tries to incorporate fundamental constraints from neuroscience in the Leabra simulator, so it is also bottom-up.
Artificial Neural Networks
Artificial Neural Networks Andres Chavez Math 382/L T/Th 2:00-3:40 April 13, 2010 Chavez2 Abstract The main interest of this paper is Artificial Neural Networks (ANNs). A brief history of the development
More informationCourse Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE
EE-589 Introduction to Neural Assistant Prof. Dr. Turgay IBRIKCI Room # 305 (322) 338 6868 / 139 Wensdays 9:00-12:00 Course Outline The course is divided in two parts: theory and practice. 1. Theory covers
More information1 NETWORKS VERSUS SYMBOL SYSTEMS: TWO APPROACHES TO MODELING COGNITION
NETWORKS VERSUS SYMBOL SYSTEMS 1 1 NETWORKS VERSUS SYMBOL SYSTEMS: TWO APPROACHES TO MODELING COGNITION 1.1 A Revolution in the Making? The rise of cognitivism in psychology, which, by the 1970s, had successfully
More informationProposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science
Proposal of Pattern Recognition as a necessary and sufficient principle to Cognitive Science Gilberto de Paiva Sao Paulo Brazil (May 2011) gilbertodpaiva@gmail.com Abstract. Despite the prevalence of the
More informationLearning Methods for Fuzzy Systems
Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8
More informationA Neural Network GUI Tested on Text-To-Phoneme Mapping
A Neural Network GUI Tested on Text-To-Phoneme Mapping MAARTEN TROMPPER Universiteit Utrecht m.f.a.trompper@students.uu.nl Abstract Text-to-phoneme (T2P) mapping is a necessary step in any speech synthesis
More informationOPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS
OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,
More informationNotes on The Sciences of the Artificial Adapted from a shorter document written for course (Deciding What to Design) 1
Notes on The Sciences of the Artificial Adapted from a shorter document written for course 17-652 (Deciding What to Design) 1 Ali Almossawi December 29, 2005 1 Introduction The Sciences of the Artificial
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More informationEvolution of Symbolisation in Chimpanzees and Neural Nets
Evolution of Symbolisation in Chimpanzees and Neural Nets Angelo Cangelosi Centre for Neural and Adaptive Systems University of Plymouth (UK) a.cangelosi@plymouth.ac.uk Introduction Animal communication
More informationAGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016
AGENDA Advanced Learning Theories Alejandra J. Magana, Ph.D. admagana@purdue.edu Introduction to Learning Theories Role of Learning Theories and Frameworks Learning Design Research Design Dual Coding Theory
More informationArtificial Neural Networks written examination
1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14
More informationAbstractions and the Brain
Abstractions and the Brain Brian D. Josephson Department of Physics, University of Cambridge Cavendish Lab. Madingley Road Cambridge, UK. CB3 OHE bdj10@cam.ac.uk http://www.tcm.phy.cam.ac.uk/~bdj10 ABSTRACT
More information*** * * * COUNCIL * * CONSEIL OFEUROPE * * * DE L'EUROPE. Proceedings of the 9th Symposium on Legal Data Processing in Europe
*** * * * COUNCIL * * CONSEIL OFEUROPE * * * DE L'EUROPE Proceedings of the 9th Symposium on Legal Data Processing in Europe Bonn, 10-12 October 1989 Systems based on artificial intelligence in the legal
More informationNeural Representation and Neural Computation. Philosophical Perspectives, Vol. 4, Action Theory and Philosophy of Mind (1990),
Neural Representation and Neural Computation Patricia Smith Churchland; Terrence J. Sejnowski Philosophical Perspectives, Vol. 4, Action Theory and Philosophy of Mind (1990), 343-382. Stable URL: http://links.jstor.org/sici?sici=1520-8583%28
More informationPython Machine Learning
Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled
More informationForget catastrophic forgetting: AI that learns after deployment
Forget catastrophic forgetting: AI that learns after deployment Anatoly Gorshechnikov CTO, Neurala 1 Neurala at a glance Programming neural networks on GPUs since circa 2 B.C. Founded in 2006 expecting
More informationAccelerated Learning Online. Course Outline
Accelerated Learning Online Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies
More informationSeminar - Organic Computing
Seminar - Organic Computing Self-Organisation of OC-Systems Markus Franke 25.01.2006 Typeset by FoilTEX Timetable 1. Overview 2. Characteristics of SO-Systems 3. Concern with Nature 4. Design-Concepts
More informationBeyond Classroom Solutions: New Design Perspectives for Online Learning Excellence
Educational Technology & Society 5(2) 2002 ISSN 1436-4522 Beyond Classroom Solutions: New Design Perspectives for Online Learning Excellence Moderator & Sumamrizer: Maggie Martinez CEO, The Training Place,
More informationBreaking the Habit of Being Yourself Workshop for Quantum University
Breaking the Habit of Being Yourself Workshop for Quantum University 2 Copyright Dr Joe Dispenza. June 2013. All rights reserved. 3 Copyright Dr Joe Dispenza. June 2013. All rights reserved. 4 Copyright
More informationAccelerated Learning Course Outline
Accelerated Learning Course Outline Course Description The purpose of this course is to make the advances in the field of brain research more accessible to educators. The techniques and strategies of Accelerated
More informationINPE São José dos Campos
INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA
More informationSARDNET: A Self-Organizing Feature Map for Sequences
SARDNET: A Self-Organizing Feature Map for Sequences Daniel L. James and Risto Miikkulainen Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 dljames,risto~cs.utexas.edu
More informationEvolutive Neural Net Fuzzy Filtering: Basic Description
Journal of Intelligent Learning Systems and Applications, 2010, 2: 12-18 doi:10.4236/jilsa.2010.21002 Published Online February 2010 (http://www.scirp.org/journal/jilsa) Evolutive Neural Net Fuzzy Filtering:
More informationCS Machine Learning
CS 478 - Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing
More informationAn OO Framework for building Intelligence and Learning properties in Software Agents
An OO Framework for building Intelligence and Learning properties in Software Agents José A. R. P. Sardinha, Ruy L. Milidiú, Carlos J. P. Lucena, Patrick Paranhos Abstract Software agents are defined as
More informationA cautionary note is research still caught up in an implementer approach to the teacher?
A cautionary note is research still caught up in an implementer approach to the teacher? Jeppe Skott Växjö University, Sweden & the University of Aarhus, Denmark Abstract: In this paper I outline two historically
More informationNeuroscience I. BIOS/PHIL/PSCH 484 MWF 1:00-1:50 Lecture Center F6. Fall credit hours
INSTRUCTOR INFORMATION Dr. John Leonard (course coordinator) Neuroscience I BIOS/PHIL/PSCH 484 MWF 1:00-1:50 Lecture Center F6 Fall 2016 3 credit hours leonard@uic.edu Biological Sciences 3055 SEL 312-996-4261
More informationLecture 1: Basic Concepts of Machine Learning
Lecture 1: Basic Concepts of Machine Learning Cognitive Systems - Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010
More informationGACE Computer Science Assessment Test at a Glance
GACE Computer Science Assessment Test at a Glance Updated May 2017 See the GACE Computer Science Assessment Study Companion for practice questions and preparation resources. Assessment Name Computer Science
More informationWhat can I learn from worms?
What can I learn from worms? Stem cells, regeneration, and models Lesson 7: What does planarian regeneration tell us about human regeneration? I. Overview In this lesson, students use the information that
More informationKnowledge-Based - Systems
Knowledge-Based - Systems ; Rajendra Arvind Akerkar Chairman, Technomathematics Research Foundation and Senior Researcher, Western Norway Research institute Priti Srinivas Sajja Sardar Patel University
More informationSoftware Maintenance
1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories
More informationLitterature review of Soft Systems Methodology
Thomas Schmidt nimrod@mip.sdu.dk October 31, 2006 The primary ressource for this reivew is Peter Checklands article Soft Systems Metodology, secondary ressources are the book Soft Systems Methodology in
More informationBluetooth mlearning Applications for the Classroom of the Future
Bluetooth mlearning Applications for the Classroom of the Future Tracey J. Mehigan Daniel C. Doolan Sabin Tabirca University College Cork, Ireland 2007 Overview Overview Introduction Mobile Learning Bluetooth
More informationKnowledge based expert systems D H A N A N J A Y K A L B A N D E
Knowledge based expert systems D H A N A N J A Y K A L B A N D E What is a knowledge based system? A Knowledge Based System or a KBS is a computer program that uses artificial intelligence to solve problems
More informationBiomedical Sciences (BC98)
Be one of the first to experience the new undergraduate science programme at a university leading the way in biomedical teaching and research Biomedical Sciences (BC98) BA in Cell and Systems Biology BA
More informationNeuro-Symbolic Approaches for Knowledge Representation in Expert Systems
Published in the International Journal of Hybrid Intelligent Systems 1(3-4) (2004) 111-126 Neuro-Symbolic Approaches for Knowledge Representation in Expert Systems Ioannis Hatzilygeroudis and Jim Prentzas
More informationHow People Learn Physics
How People Learn Physics Edward F. (Joe) Redish Dept. Of Physics University Of Maryland AAPM, Houston TX, Work supported in part by NSF grants DUE #04-4-0113 and #05-2-4987 Teaching complex subjects 2
More informationSystem Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks
System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering
More informationSpecification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments
Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Cristina Vertan, Walther v. Hahn University of Hamburg, Natural Language Systems Division Hamburg,
More informationCS 1103 Computer Science I Honors. Fall Instructor Muller. Syllabus
CS 1103 Computer Science I Honors Fall 2016 Instructor Muller Syllabus Welcome to CS1103. This course is an introduction to the art and science of computer programming and to some of the fundamental concepts
More informationCALIFORNIA STATE UNIVERSITY, SAN MARCOS SCHOOL OF EDUCATION
CALIFORNIA STATE UNIVERSITY, SAN MARCOS SCHOOL OF EDUCATION COURSE: EDSL 691: Neuroscience for the Speech-Language Pathologist (3 units) Fall 2012 Wednesdays 9:00-12:00pm Location: KEL 5102 Professor:
More informationDesigning a Computer to Play Nim: A Mini-Capstone Project in Digital Design I
Session 1793 Designing a Computer to Play Nim: A Mini-Capstone Project in Digital Design I John Greco, Ph.D. Department of Electrical and Computer Engineering Lafayette College Easton, PA 18042 Abstract
More informationReinforcement Learning by Comparing Immediate Reward
Reinforcement Learning by Comparing Immediate Reward Punit Pandey DeepshikhaPandey Dr. Shishir Kumar Abstract This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate
More informationA Metacognitive Approach to Support Heuristic Solution of Mathematical Problems
A Metacognitive Approach to Support Heuristic Solution of Mathematical Problems John TIONG Yeun Siew Centre for Research in Pedagogy and Practice, National Institute of Education, Nanyang Technological
More informationIntroduction to Simulation
Introduction to Simulation Spring 2010 Dr. Louis Luangkesorn University of Pittsburgh January 19, 2010 Dr. Louis Luangkesorn ( University of Pittsburgh ) Introduction to Simulation January 19, 2010 1 /
More informationUsing the Attribute Hierarchy Method to Make Diagnostic Inferences about Examinees Cognitive Skills in Algebra on the SAT
The Journal of Technology, Learning, and Assessment Volume 6, Number 6 February 2008 Using the Attribute Hierarchy Method to Make Diagnostic Inferences about Examinees Cognitive Skills in Algebra on the
More informationKnowledge Transfer in Deep Convolutional Neural Nets
Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract
More information1. Answer the questions below on the Lesson Planning Response Document.
Module for Lateral Entry Teachers Lesson Planning Introductory Information about Understanding by Design (UbD) (Sources: Wiggins, G. & McTighte, J. (2005). Understanding by design. Alexandria, VA: ASCD.;
More informationA Pipelined Approach for Iterative Software Process Model
A Pipelined Approach for Iterative Software Process Model Ms.Prasanthi E R, Ms.Aparna Rathi, Ms.Vardhani J P, Mr.Vivek Krishna Electronics and Radar Development Establishment C V Raman Nagar, Bangalore-560093,
More informationAxiom 2013 Team Description Paper
Axiom 2013 Team Description Paper Mohammad Ghazanfari, S Omid Shirkhorshidi, Farbod Samsamipour, Hossein Rahmatizadeh Zagheli, Mohammad Mahdavi, Payam Mohajeri, S Abbas Alamolhoda Robotics Scientific Association
More informationUniversity of Groningen. Systemen, planning, netwerken Bosman, Aart
University of Groningen Systemen, planning, netwerken Bosman, Aart IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document
More information(Sub)Gradient Descent
(Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include
More information1 3-5 = Subtraction - a binary operation
High School StuDEnts ConcEPtions of the Minus Sign Lisa L. Lamb, Jessica Pierson Bishop, and Randolph A. Philipp, Bonnie P Schappelle, Ian Whitacre, and Mindy Lewis - describe their research with students
More informationRadius STEM Readiness TM
Curriculum Guide Radius STEM Readiness TM While today s teens are surrounded by technology, we face a stark and imminent shortage of graduates pursuing careers in Science, Technology, Engineering, and
More informationSpinal Cord. Student Pages. Classroom Ac tivities
Classroom Ac tivities Spinal Cord Student Pages Produced by Regenerative Medicine Partnership in Education Duquesne University Director john A. Pollock (pollock@duq.edu) The spinal column protects the
More informationA Reinforcement Learning Variant for Control Scheduling
A Reinforcement Learning Variant for Control Scheduling Aloke Guha Honeywell Sensor and System Development Center 3660 Technology Drive Minneapolis MN 55417 Abstract We present an algorithm based on reinforcement
More informationQuickStroke: An Incremental On-line Chinese Handwriting Recognition System
QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents
More informationImplementing a tool to Support KAOS-Beta Process Model Using EPF
Implementing a tool to Support KAOS-Beta Process Model Using EPF Malihe Tabatabaie Malihe.Tabatabaie@cs.york.ac.uk Department of Computer Science The University of York United Kingdom Eclipse Process Framework
More informationUsing focal point learning to improve human machine tacit coordination
DOI 10.1007/s10458-010-9126-5 Using focal point learning to improve human machine tacit coordination InonZuckerman SaritKraus Jeffrey S. Rosenschein The Author(s) 2010 Abstract We consider an automated
More informationAn Empirical and Computational Test of Linguistic Relativity
An Empirical and Computational Test of Linguistic Relativity Kathleen M. Eberhard* (eberhard.1@nd.edu) Matthias Scheutz** (mscheutz@cse.nd.edu) Michael Heilman** (mheilman@nd.edu) *Department of Psychology,
More informationMultidisciplinary Engineering Systems 2 nd and 3rd Year College-Wide Courses
Multidisciplinary Engineering Systems 2 nd and 3rd Year College-Wide Courses Kevin Craig College of Engineering Marquette University Milwaukee, WI, USA Mark Nagurka College of Engineering Marquette University
More informationPhysics 270: Experimental Physics
2017 edition Lab Manual Physics 270 3 Physics 270: Experimental Physics Lecture: Lab: Instructor: Office: Email: Tuesdays, 2 3:50 PM Thursdays, 2 4:50 PM Dr. Uttam Manna 313C Moulton Hall umanna@ilstu.edu
More informationLecture 10: Reinforcement Learning
Lecture 1: Reinforcement Learning Cognitive Systems II - Machine Learning SS 25 Part III: Learning Programs and Strategies Q Learning, Dynamic Programming Lecture 1: Reinforcement Learning p. Motivation
More informationConnectionism, Artificial Life, and Dynamical Systems: New approaches to old questions
Connectionism, Artificial Life, and Dynamical Systems: New approaches to old questions Jeffrey L. Elman Department of Cognitive Science University of California, San Diego Introduction Periodically in
More informationMASTER OF SCIENCE (M.S.) MAJOR IN COMPUTER SCIENCE
Master of Science (M.S.) Major in Computer Science 1 MASTER OF SCIENCE (M.S.) MAJOR IN COMPUTER SCIENCE Major Program The programs in computer science are designed to prepare students for doctoral research,
More informationOn Human Computer Interaction, HCI. Dr. Saif al Zahir Electrical and Computer Engineering Department UBC
On Human Computer Interaction, HCI Dr. Saif al Zahir Electrical and Computer Engineering Department UBC Human Computer Interaction HCI HCI is the study of people, computer technology, and the ways these
More informationPurdue Data Summit Communication of Big Data Analytics. New SAT Predictive Validity Case Study
Purdue Data Summit 2017 Communication of Big Data Analytics New SAT Predictive Validity Case Study Paul M. Johnson, Ed.D. Associate Vice President for Enrollment Management, Research & Enrollment Information
More informationThe Strong Minimalist Thesis and Bounded Optimality
The Strong Minimalist Thesis and Bounded Optimality DRAFT-IN-PROGRESS; SEND COMMENTS TO RICKL@UMICH.EDU Richard L. Lewis Department of Psychology University of Michigan 27 March 2010 1 Purpose of this
More informationIntroduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition
Introduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition Todd Holloway Two Lecture Series for B551 November 20 & 27, 2007 Indiana University Outline Introduction Bias and
More informationCS 101 Computer Science I Fall Instructor Muller. Syllabus
CS 101 Computer Science I Fall 2013 Instructor Muller Syllabus Welcome to CS101. This course is an introduction to the art and science of computer programming and to some of the fundamental concepts of
More informationRendezvous with Comet Halley Next Generation of Science Standards
Next Generation of Science Standards 5th Grade 6 th Grade 7 th Grade 8 th Grade 5-PS1-3 Make observations and measurements to identify materials based on their properties. MS-PS1-4 Develop a model that
More informationarxiv: v1 [cs.cv] 10 May 2017
Inferring and Executing Programs for Visual Reasoning Justin Johnson 1 Bharath Hariharan 2 Laurens van der Maaten 2 Judy Hoffman 1 Li Fei-Fei 1 C. Lawrence Zitnick 2 Ross Girshick 2 1 Stanford University
More informationCS177 Python Programming
CS177 Python Programming Recitation 1 Introduction Adapted from John Zelle s Book Slides 1 Course Instructors Dr. Elisha Sacks E-mail: eps@purdue.edu Ruby Tahboub (Course Coordinator) E-mail: rtahboub@purdue.edu
More informationAn empirical study of learning speed in backpropagation
Carnegie Mellon University Research Showcase @ CMU Computer Science Department School of Computer Science 1988 An empirical study of learning speed in backpropagation networks Scott E. Fahlman Carnegie
More informationFUZZY EXPERT. Dr. Kasim M. Al-Aubidy. Philadelphia University. Computer Eng. Dept February 2002 University of Damascus-Syria
FUZZY EXPERT SYSTEMS 16-18 18 February 2002 University of Damascus-Syria Dr. Kasim M. Al-Aubidy Computer Eng. Dept. Philadelphia University What is Expert Systems? ES are computer programs that emulate
More informationLEADERSHIP AND COMMUNICATION SKILLS
LEADERSHIP AND COMMUNICATION SKILLS DEGREE: BACHELOR IN BUSINESS ADMINISTRATION DEGREE COURSE YEAR: 1 ST 1º SEMESTER 2º SEMESTER CATEGORY: BASIC COMPULSORY OPTIONAL NO. OF CREDITS (ECTS): 3 LANGUAGE: ENGLISH
More informationNetworks in Cognitive Science
1 Networks in Cognitive Science Andrea Baronchelli 1,*, Ramon Ferrer-i-Cancho 2, Romualdo Pastor-Satorras 3, Nick Chater 4 and Morten H. Christiansen 5,6 1 Laboratory for the Modeling of Biological and
More informationIssues in the Mining of Heart Failure Datasets
International Journal of Automation and Computing 11(2), April 2014, 162-179 DOI: 10.1007/s11633-014-0778-5 Issues in the Mining of Heart Failure Datasets Nongnuch Poolsawad 1 Lisa Moore 1 Chandrasekhar
More informationChallenge Propagation: towards a mathematical theory of distributed intelligence and the Global Brain
Challenge Propagation: towards a mathematical theory of distributed intelligence and the Global Brain Francis Heylighen Global Brain Institute Vrije Universiteit Brussel 1. Introduction This working paper
More informationTest Effort Estimation Using Neural Network
J. Software Engineering & Applications, 2010, 3: 331-340 doi:10.4236/jsea.2010.34038 Published Online April 2010 (http://www.scirp.org/journal/jsea) 331 Chintala Abhishek*, Veginati Pavan Kumar, Harish
More informationGroup A Lecture 1. Future suite of learning resources. How will these be created?
Group A Lecture 1 Future suite of learning resources Portable electronically based. User-friendly interface no steep learning curve. Adaptive to & Customizable by learner & teacher. Layered guide indexed
More informationA study of speaker adaptation for DNN-based speech synthesis
A study of speaker adaptation for DNN-based speech synthesis Zhizheng Wu, Pawel Swietojanski, Christophe Veaux, Steve Renals, Simon King The Centre for Speech Technology Research (CSTR) University of Edinburgh,
More informationSyntactic systematicity in sentence processing with a recurrent self-organizing network
Syntactic systematicity in sentence processing with a recurrent self-organizing network Igor Farkaš,1 Department of Applied Informatics, Comenius University Mlynská dolina, 842 48 Bratislava, Slovak Republic
More informationProgram evaluation models and related theories: AMEE Guide No. 67
2012; 34: e288 e299 WEB PAPER AMEE GUIDE Program evaluation models and related theories: AMEE Guide No. 67 ANN W. FRYE 1 & PAUL A. HEMMER 2 1 Office of Educational Development, University of Texas Medical
More informationPage 1 of 11. Curriculum Map: Grade 4 Math Course: Math 4 Sub-topic: General. Grade(s): None specified
Curriculum Map: Grade 4 Math Course: Math 4 Sub-topic: General Grade(s): None specified Unit: Creating a Community of Mathematical Thinkers Timeline: Week 1 The purpose of the Establishing a Community
More informationDocument number: 2013/ Programs Committee 6/2014 (July) Agenda Item 42.0 Bachelor of Engineering with Honours in Software Engineering
Document number: 2013/0006139 Programs Committee 6/2014 (July) Agenda Item 42.0 Bachelor of Engineering with Honours in Software Engineering Program Learning Outcomes Threshold Learning Outcomes for Engineering
More informationMathematics subject curriculum
Mathematics subject curriculum Dette er ei omsetjing av den fastsette læreplanteksten. Læreplanen er fastsett på Nynorsk Established as a Regulation by the Ministry of Education and Research on 24 June
More informationSpeaker Identification by Comparison of Smart Methods. Abstract
Journal of mathematics and computer science 10 (2014), 61-71 Speaker Identification by Comparison of Smart Methods Ali Mahdavi Meimand Amin Asadi Majid Mohamadi Department of Electrical Department of Computer
More informationUML MODELLING OF DIGITAL FORENSIC PROCESS MODELS (DFPMs)
UML MODELLING OF DIGITAL FORENSIC PROCESS MODELS (DFPMs) Michael Köhn 1, J.H.P. Eloff 2, MS Olivier 3 1,2,3 Information and Computer Security Architectures (ICSA) Research Group Department of Computer
More informationMYCIN. The MYCIN Task
MYCIN Developed at Stanford University in 1972 Regarded as the first true expert system Assists physicians in the treatment of blood infections Many revisions and extensions over the years The MYCIN Task
More informationBluetooth mlearning Applications for the Classroom of the Future
Bluetooth mlearning Applications for the Classroom of the Future Tracey J. Mehigan, Daniel C. Doolan, Sabin Tabirca Department of Computer Science, University College Cork, College Road, Cork, Ireland
More informationUnsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model
Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng Microsoft Research, One Microsoft Way, Redmond, WA 98052, U.S.A.
More informationarxiv: v1 [math.at] 10 Jan 2016
THE ALGEBRAIC ATIYAH-HIRZEBRUCH SPECTRAL SEQUENCE OF REAL PROJECTIVE SPECTRA arxiv:1601.02185v1 [math.at] 10 Jan 2016 GUOZHEN WANG AND ZHOULI XU Abstract. In this note, we use Curtis s algorithm and the
More informationPlanning with External Events
94 Planning with External Events Jim Blythe School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 blythe@cs.cmu.edu Abstract I describe a planning methodology for domains with uncertainty
More informationDiscriminative Learning of Beam-Search Heuristics for Planning
Discriminative Learning of Beam-Search Heuristics for Planning Yuehua Xu School of EECS Oregon State University Corvallis,OR 97331 xuyu@eecs.oregonstate.edu Alan Fern School of EECS Oregon State University
More informationUniversity of Victoria School of Exercise Science, Physical and Health Education EPHE 245 MOTOR LEARNING. Calendar Description Units: 1.
University of Victoria School of Exercise Science, Physical and Health Education EPHE 245 MOTOR LEARNING Calendar Description Units: 1.5 Hours: 3-2 Neural and cognitive processes underlying human skilled
More informationCLASSIFICATION OF PROGRAM Critical Elements Analysis 1. High Priority Items Phonemic Awareness Instruction
CLASSIFICATION OF PROGRAM Critical Elements Analysis 1 Program Name: Macmillan/McGraw Hill Reading 2003 Date of Publication: 2003 Publisher: Macmillan/McGraw Hill Reviewer Code: 1. X The program meets
More information