Problem formulation and actor identification

Similar documents
Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Lecture 10: Reinforcement Learning

Introduction to Simulation

A Case-Based Approach To Imitation Learning in Robotic Agents

Chapter 2. Intelligent Agents. Outline. Agents and environments. Rationality. PEAS (Performance measure, Environment, Actuators, Sensors)

Knowledge based expert systems D H A N A N J A Y K A L B A N D E

Seminar - Organic Computing

Laboratorio di Intelligenza Artificiale e Robotica

Emergency Management Games and Test Case Utility:

California Professional Standards for Education Leaders (CPSELs)

MASTER OF SCIENCE (M.S.) MAJOR IN COMPUTER SCIENCE

While you are waiting... socrative.com, room number SIMLANG2016

Executive Guide to Simulation for Health

Agents and environments. Intelligent Agents. Reminders. Vacuum-cleaner world. Outline. A vacuum-cleaner agent. Chapter 2 Actuators

Timeline. Recommendations

Learning Methods for Fuzzy Systems

MYCIN. The MYCIN Task

Science Fair Project Handbook

(Sub)Gradient Descent

What is PDE? Research Report. Paul Nichols

An Introduction to Simio for Beginners

Evolution of Collective Commitment during Teamwork

Python Machine Learning

What is a Mental Model?

IAT 888: Metacreation Machines endowed with creative behavior. Philippe Pasquier Office 565 (floor 14)

A 3D SIMULATION GAME TO PRESENT CURTAIN WALL SYSTEMS IN ARCHITECTURAL EDUCATION

Lecture 1: Machine Learning Basics

Laboratorio di Intelligenza Artificiale e Robotica

Lecture 2: Quantifiers and Approximation

Utilizing Soft System Methodology to Increase Productivity of Shell Fabrication Sushant Sudheer Takekar 1 Dr. D.N. Raut 2

COMPUTER-AIDED DESIGN TOOLS THAT ADAPT

Intelligent Agents. Chapter 2. Chapter 2 1

The Enterprise Knowledge Portal: The Concept

A Context-Driven Use Case Creation Process for Specifying Automotive Driver Assistance Systems

University of Groningen. Systemen, planning, netwerken Bosman, Aart

Practice Examination IREB

Lecture 1: Basic Concepts of Machine Learning

Abstractions and the Brain

Purdue Data Summit Communication of Big Data Analytics. New SAT Predictive Validity Case Study

Multiagent Simulation of Learning Environments

Artificial Neural Networks written examination

Axiom 2013 Team Description Paper

Thesis-Proposal Outline/Template

Knowledge-Based - Systems

AMULTIAGENT system [1] can be defined as a group of

ME 443/643 Design Techniques in Mechanical Engineering. Lecture 1: Introduction

Testing A Moving Target: How Do We Test Machine Learning Systems? Peter Varhol Technology Strategy Research, USA

Using focal point learning to improve human machine tacit coordination

What is Thinking (Cognition)?

Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments

MAE Flight Simulation for Aircraft Safety

Litterature review of Soft Systems Methodology

Scientific Method Investigation of Plant Seed Germination

A Genetic Irrational Belief System

ISFA2008U_120 A SCHEDULING REINFORCEMENT LEARNING ALGORITHM

AGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016

Master s Programme in European Studies

Software Development: Programming Paradigms (SCQF level 8)

The Good Judgment Project: A large scale test of different methods of combining expert predictions

Notes on The Sciences of the Artificial Adapted from a shorter document written for course (Deciding What to Design) 1

ECE-492 SENIOR ADVANCED DESIGN PROJECT

A Pipelined Approach for Iterative Software Process Model

ACTION LEARNING: AN INTRODUCTION AND SOME METHODS INTRODUCTION TO ACTION LEARNING

EECS 571 PRINCIPLES OF REAL-TIME COMPUTING Fall 10. Instructor: Kang G. Shin, 4605 CSE, ;

INPE São José dos Campos

A cognitive perspective on pair programming

THE REFLECTIVE SUPERVISION TOOLKIT

ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY DOWNLOAD EBOOK : ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY PDF

Learning Optimal Dialogue Strategies: A Case Study of a Spoken Dialogue Agent for

Reinforcement Learning by Comparing Immediate Reward

Citrine Informatics. The Latest from Citrine. Citrine Informatics. The data analytics platform for the physical world

Is operations research really research?

Visual CP Representation of Knowledge

SHEEO State Authorization Inventory. Indiana Last Updated: October 2011

Geo Risk Scan Getting grips on geotechnical risks

Computer Science 141: Computing Hardware Course Information Fall 2012

Modeling user preferences and norms in context-aware systems

Hardhatting in a Geo-World

APA Basics. APA Formatting. Title Page. APA Sections. Title Page. Title Page

Telekooperation Seminar

The Strong Minimalist Thesis and Bounded Optimality

PRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN PROGRAM AT THE UNIVERSITY OF TWENTE

Applying Fuzzy Rule-Based System on FMEA to Assess the Risks on Project-Based Software Engineering Education

Commanding Officer Decision Superiority: The Role of Technology and the Decision Maker

EFFECTIVE CLASSROOM MANAGEMENT UNDER COMPETENCE BASED EDUCATION SCHEME

On the Combined Behavior of Autonomous Resource Management Agents

Programme Specification

SARDNET: A Self-Organizing Feature Map for Sequences

FUZZY EXPERT. Dr. Kasim M. Al-Aubidy. Philadelphia University. Computer Eng. Dept February 2002 University of Damascus-Syria

Cooperative Training of Power Systems' Restoration Techniques

10.2. Behavior models

Industrial Assessment Center. Don Kasten. IAC Student Webcast. Manager, Technical Operations Center for Advanced Energy Systems.

Delaware Performance Appraisal System Building greater skills and knowledge for educators

Action Models and their Induction

Project Leadership in the Future

Critical Thinking in Everyday Life: 9 Strategies

The NH Parent Partner Program

TABLE OF CONTENTS TABLE OF CONTENTS COVER PAGE HALAMAN PENGESAHAN PERNYATAAN NASKAH SOAL TUGAS AKHIR ACKNOWLEDGEMENT FOREWORD

UC Merced Proceedings of the Annual Meeting of the Cognitive Science Society

Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models

Transcription:

Problem formulation and actor identification Dr. ir. Igor Nikolic 26-11-12 Delft University of Technology Challenge the future

Lecture goals Recap of ABM theory Generative science NetLogo Understand the first step of the method Problem formulation and actor identification 2

Modeling in general All models are wrong, some are useful! (Box 1979) Model a problem, not a system! A model is thrice removed from reality! A computer formalization of the modelers understanding of stakeholdeers understanding of (a part of ) reality 3

Three main schools of Agent thinking Artificial Intelligence AI Agents as autonomous identities solving problems Multi-Agent Systems MAS Distributed control of systems Agent Based Modeling (and Simulation) ABM(S) Simulating (real world) phenomena We will follow the ABM(S) view! 4

Agents are : Encapsulated clearly identifiable, with well-defined boundaries and interfaces; Situated in a particular environment receive input through sensors and act through effectors; Capable of flexible action respond to changes and act in anticipation; Autonomous, meaning that they have control both over their internal state and over their own behavior; Designed to meet objectives they attempt to fulfill a purpose, solve a problem, or achieve goals. Jennings, N. (2000). On agent-based software engineering, Artificial Intelligence 117(2): 277 296. 5

Agent Based Model An Agent is a persistent thing which has some state we find worth representing, and which interacts with other agents, mutually modifying each other s states. The components of an agent-based model are a collection of agents and their states, the rules governing the interactions of the agents and the environment within which they live. C.R. Shalizi. Methods and techniques of complex systems science: An overview. arxiv.org, arxiv.org:nlin/0307015, 2006. URL http://www.citebase.org/abstract?id=oai:arxiv.org:nlin/0307015. 6

Agent Agent is a thing that does things to other things 7

States Agent state and behavior and Model state en behavior Stuff that Agents knows or has (including memory) Can be private or public Can be static or dynamic and can depend on the Rules Eg: Profits, Color,Location, State of an agent is a composite of internal and local and global 8

Rules Agents internal models Decision and transformation rules from inputs and states to action and behavior Can be static or dynamic 9

Types of rules Rule based nested if-then-else structures. Multi Criteria Decision Making Options and weights Inference engines expert systems,facts (states) and decision heuristic Evolutionary Computing find a optimal solution in large solution space (GA) Machine learning Neural Networks for recognizing patterns 10

Actions Based on Other Agents States Rules Agent will perform (or not perform) some action Action can Affect other Agents Own state Own rule Environment Behavior is the overall set of observable actions 11

Environment What the Agent is in. Provides the agents with information and structure Everything that is not an Agent, but is relevant. It affects the Agent, and Agent can affect it. Structure : Soups Space (grid, GIS, etc...) Networks 12

Time ABM take place in discrete time Time progresses in ticks Between two ticks, everything is assumed to happen in the same time, attempting to simulate the parallelism in real world As computers are serial processing machines, the order of Agent iteration is very important. 13

Top-Down modeling Start with the entire system Assumes that you know how the system behaves Formalize (encode) your understanding Try to replicate the observed regularity System description is static 14

Works fine as long as You have good understanding of the system is in its entirety You understand exactly how system components interact with each other. Works great for complicated stuff, airplanes, chemical factories, busses and glue. However, for complex stuff, like socio-technical systems, we need something else... 15

Generative Science If you did not grow it, you did not explain it! (Epstein 1999) build understanding from the bottom up! Central principle : phenomena can be described in terms of interconnected networks of (relatively) simple units. Deterministic and finite rules and parameters of natural phenomena interact with each other to generate complex behavior J.M. Epstein. Agent-based computational models and generative social science. Complexity, 4 (5):41 60, 1999. 16

Generativist Question How could the decentralized local interactions of heterogeneous autonomous agents generate the given regularity? 17

Generativist Experiment Situate an initial population of autonomous heterogeneous agents in a relevant spatial environment; allow them to interact according to simple local rules, and thereby generate - or grow - the macroscopic regularity from the bottom up. Or, given a well understood, well described population of agents, what kinds of behavior are they capable of under different conditions 18

Break 19

Problem formulation and Actor identification Don't model a system, model a problem! 20

What is the problem? By far the most important and difficult question. Stakeholder might not realize what it is. Subquestions : What is the exact lack of insight that we are addressing? What is the observed emergent pattern of interest to us? Is there is a desired emergent pattern, and if so, how is it different from the observed emergent pattern? What is the initial hypothesis on how the emergent patterns emerge, or, whydo the observed and desired emergent patterns differ? 21

What is the exact lack of insight that we are addressing? What it is that we want to know but do now know now? Some fact? Emergent system behavior? Agent behavior / mechanism? Effect of some intervention? This implicitly specifies the model 22

Is there is a desired emergent pattern, and if so, how is it different from the observed emergent pattern? Normative and VERY stakeholder dependent. Will strongly guide how/which model you will build. Implicitly holds the hypothesis about how the system works. 23

What is the initial hypothesis on how the emergent patterns emerge, or, why do the observed and desired emergent patterns differ? Stakeholders statement of the hypothesis is a minimodel. A very valuable insight into how the stakeholder thinks about the system / problem. You will not use this in the actual model creation, but it very insightful to compare to the final model, and see which initial assumptions still hold. 24

Whose problem are we addressing? Make the problem owner explicit. Standard TPM question, rarely asked outside our community. Makes the eventual biases explicit. Your model of socio-technical systems will be biased. 25

Which other actors are involved? Make the social network of actors (not agents!) explicit. Might be very important in highly contested problem. Make sure you talk to all relevant actors to get a socially acceptable model Get an early warning on the problems you might get with model use / outcome interpretation. 26

What is our role? Are we an actor in the system? Might be if you are doing this for a company/govt/etc? If not, are we hired researchers / consultants / etc? What is our potential bias? Our background? Our experience? Our knowledge? 27

Group progress 28