Simulation Tactics, Strategy and Interpretation
|
|
- Chad Dorsey
- 5 years ago
- Views:
Transcription
1 Simulation Tactics, Strategy and Interpretation G A Vignaux August 29,
2 Contents 1 Introduction 3 2 Developing Simulations 5 3 Traces 9 4 Terminating versus non-terminating simulations 15 5 Output Analysis 23 6 Variance reduction Methods 29 7 Other Simulation Topics 36 2
3 1 Introduction A simulation must be written to answer a question, not as a general toy. Ask what are the (specific) effects of doing something. For example: What is the change in average delay time if we increase the number of servers in the system by 1? You must interpret the output with care. Consider the risks involved in a wrong decision. A simulation program must be verified (does it correctly replicate the designed model?) and validated (does it correctly replicate the real situation?) 3
4 1.1 Statistical nature of simulation Runs of the simulation are statistical experiments and must be analysed as such. We must be able to distinguish between (1) variations due to changes in the system configuration and (2) sampling variation in the results. Serial correlation in observations give us problems Control over random variables is a great help. 4
5 2 Developing Simulations Design, Language, developing code, testing, validation. 2.1 Design Initial Design of the model. What questions are to be answered? Modelling with ACDs (2.1.1). 5
6 2.1.1 ACD 6
7 2.2 Simulation Language Choice of a simulation languages. Advantages and limitations of different approaches. Compiled: Simula, Simscript, C-sim, C++-sim Scripted: SimPy Packages: SIMON, HOCUS, Graphical: Simul8 7
8 2.3 Developing code Develop in an incremental manner. DO NOT write all the code out at once. Use Deterministic times at first, NOT random ones. 2.4 Testing Testing, Traces (see Section 3). Unit tests. How do you test a system with random numbers? If you have control over RVs you can find out what they should be. What is the difference between validation and verification? 8
9 3 Traces Trace files are essential for developing, debugging (Section 3.2), and running a simulation. It is a text file generated by the simulation. Consists of a series of lines. Each line records an event. Events: instants when the state of the model changes A trace line consists of: simulation time always first Followed by any other information about the event This format is chosen so some, now unknown, program can read and analyse the trace later. (eg S-Plus, R, ) 9
10 Example Customer 3 arrives Customer 2 departs Customer 2 leaves the system Customer 3 starts service at node Customer 3 departs Customer 3 transfers to node 4 The first element on a line is the time. It is possible to work out when customer 3 arrived, went into service, and departed. 10
11 3.1 Producing a trace Either by print statements or by aspecial version of the simulation package. The simplest way of producing a trace is to include conditional trace statements in the code at suitable points. These can be print statements or calls to a trace method. 11
12 Example 3.2 Here is an example of a trace method for a SimPy Customer process: def trace(self,message): if tracing: print %7.4f pax %03d %s %(now(), self.id, message) If the boolean tracing was set to True (or 1), a statement like self.trace( arrived ) would print a trace line with the simulation time, the customer s identification number, and the message arrived. 12
13 3.2 Traces for debugging Simulation programs are notoriously difficult to get running properly. They involve running artificial parallel interacting processes - rather like simple operating systems. The particular complication is the random numbers built into most simulations. We always build-in the ability to generate a trace file while running the program. We should be able to switch it on or off by setting a parameter for the run so that the trace does not interfere with the results of the run. Using this technique it is usually easy to see any flaws in the logic of the model. If, as we should, we start by using non-random variables when we develop the model this logical verification is much easier with a trace. 13
14 3.3 Traces for output Traces are often use as an intermediate file between the simulation and analysis of the output. The trace records a complete run of the model. It it is written so it is easy for another program to read in, much of the statistical analysis and presentation can be carried out by programs designed to do just that. For example the trace output of a Simscript model might be read in by an S-PLUS script to find serial correlations. It may be useful to run the trace through another script (in Perl, Python or shell script) to massage the data before sending it to the statistical package. 14
15 4 Terminating versus non-terminating simulations There are two general classes of system simulation models: 4.1 Terminating Some models terminate naturally, such as a shop closing its doors at the end of the day. To get more accuracy runs have to be replicated. In many cases we will be interested in transient measurements: such as those where we want to measure the starting effects. For example, the performance of the airport system when a 747 arrives at Auckland. 15
16 4.2 Non-Terminating Non-terminating Some models have no natural termination, such as a 24-hr bus terminal. To get more accuracy, runs have to be increased in length. We would probably be interested in making steady state measurements: such as those needed to compare with theoretical calculations in queue or queue network theory. This leads to some tricky decisions in running the simulations. 16
17 4.2.1 Achieving steady state for non-terminating simulations y 40 Number of restaurants t For non-terminating simulations we want to measure operations in steady-state. 17
18 The easiest way to start a simulation is to have no activity occurring and all queues empty. ( Empty and Idle ). But as this state is not typical, this can bias the results. Two ways out of this difficulty are to use a run-in( or warm-up) period or to start at a typical state. 18
19 4.2.2 Using a warm-up period y 20 Price of Pizza t Reject the results for the warm-up period. The simulation proper begins at the end of the warm-up. Statistics are collected from then on. 19
20 4.2.3 How long should the warm-up period be? There seems to be no sure statistical test for this. One way is to monitor statistics through an entire run and check for the time steady state is reached. Nowadays this can be done using graphical output to check, for example, that average queue lengths are not gradually increasing any more. Otherwise graphs of trace output may suffice. Another is to determining the run-in period in advance and use the same run-in period for all the experiments. This run-in period may be determined by hunch, from an initial simulation or by analysis of a simplified model. 20
21 4.2.4 Starting in a typical state y 40 Number of restaurants t An alternative is to begin each run of the simulation with non-empty conditions that are somehow typical. 21
22 These conditions may be quite complicated. They might be determined from knowledge of the system, from an analysis of the ACD, or from the results of preliminary simulations. This may be difficult to set up; e.g. if you spread entities round the system, all waiting to start the next activity how do you get response times for those initial ones? 22
23 5 Output Analysis Simple statistics (in the Simulation language). SimPy Monitors. Graphical Output (5.1) Simple Comparison of Runs Statistical Analysis of Results (5.2) 23
24 5.1 Graphical Output Simple types of output, eg graphics. Graphs, Histograms. y 600 Number of restaurants x Example. 24
25 5.2 Statistical Analysis Estimation is simplest when the observations are statistically independent and identically distributed. Then the central limit theorem, implying Normal distributions for totals and hence means, can be used to estimate ranges of uncertainty or confidence intervals. But in many simulations, observations of a single variable are likely to be autocorrelated. Then, even though the estimates are not biased our estimates of uncertainty are more difficult. Measure the Correlation and correct for it Replication Batching Regeneration 25
26 5.2.1 Simple Replication The simulation is repeated several times with the same conditions except that different streams of random number are used for each run. This ensures that the replications are independent of each other. Thus for a random variable X resulting from n replications of the same simulation, the mean value is the overall mean of the n replications and the overall variance is the mean of the n variances. 26
27 5.2.2 Batching A single long run is divided into batches of a given number of completions or a fixed time. The measurements made in the batches will be correlated but not very much if the batches are long. The batches are then regarded as replications. 27
28 5.2.3 Regeneration A single long simulation run is broken into batches by dividing the run at regeneration points. These are identical system states where the system appears to start anew in a statistical sense. Thus an M/M/1 queue would have a regeneration point whenever a job leaves it empty. Although the batches are not the same length, the method guarantees that there is no correlation between them. The analysis is described in [1, Ch 23.4]. 28
29 6 Variance reduction Methods These are methods to increase the precision of the response variable estimates. They are often called Monte Carlo methods. They were invented primarily for use in statistical methods of estimating integrals and can be particularly effective there. Results in simulating real discrete-event systems are sometimes disappointing. See [1, Ch 23]. Some methods include (6.1) Common Random Numbers, (6.2) Control Variates, (6.3) Antithetic Variates, and ((6.4) Importance Sampling. 29
30 6.1 Common random numbers This takes advantage of the control we have over the streasm of random numbers used in the simulation. One can hold the sampling variation constant across the alternative policies by using the same random numbers in each run. The differences between results is then (mainly) due to the different policies. Each source of variation in the model can have its own stream of random numbers. For example, the random variates used to generate inter-arrival times, the CPU service time, and the choice of paths would all be from different independent streams. 30
31 In SimPy, this would be done using different random variable objects for each source of variation. For different runs the seeds for each stream are reset to the same initial values. Then, if synchronisation of the random numbers is achieved, each entity retains the same values of random variables for corresponding actions in all the runs and behaves in a similar way. We hope that sampling variation will be minimised. There is positive correlation between runs. The variance of the differences between policies is reduced by the covariance between the corresponding runs. 31
32 6.2 Control Variates Additional observations are made of variables that might be expected to correlate with those being measured. For example, if we are interested in the average response times in a queue and measure W, we might also observe the average service times we generate, S. If a service time is high we would expect the corresponding response time to be high. We also know what the true mean of these service times, T s, should be (since we are generating them from the service time distribution). 32
33 We correct the observed average response time by (some proportion of) the difference between the actual and expected service time means, W = W λ(s T s ), where W is the corrected mean response time. The value of λ can be established by regression measurements in pilot simulation runs. Note that no matter what value of λ is chosen, the estimate of W will remain unbiassed but its variance may be increased if you choose badly. 33
34 6.3 Antithetic Variates Each run is duplicated. The second run in a pair uses an identical random number stream to the first BUT corresponding RVs are negatively correlated. This is usually done by replacing each PRN U i (uniform 0 to 1) by its antithetic value 1 U i. Then a large service time in the first run will have a correspondingly small service time in the antithetic run. Thus the two runs should have resulting measurements X 1 and X 2 that are negatively correlated to some degree. We use the mean of these, (X 1 + X 2 )/2 as the resulting measurement. This should have less sampling variance than either of the two or even of a run the same length of the two put together. 34
35 6.4 Importance Sampling If we are interested in system states that occur very rarely (eg rare failures) we may distort the probabilities so as to increase the chance of this happening in our simulation. We then adjust the results for this distortion. This requires a relatively simple situation so we can produce a probability model so the effect of the distortion can be allowed for.. Dr Peter Smith (ex-mcs, now at Canterbury) is using this technique to study the effect of error detection and correction methods in Telecom transmissions. In these studies bit error rates of 1 in are typical. There is no way to simulate this without the leverage of importance sampling. 35
36 7 Other Simulation Topics Stochastic Optimisation Methods Genetic Algorithms Simulated Annealing Gibbs Sampling 36
37 References [1] Frederick S Hillier and Gerald J. Lieberman. Introduction to Operations Research. McGraw-Hill, 5th edition, [2] Averill M Law and W D Kelton. Simulation Modeling and Analysis. McGraw-Hill, [3] Michael Pidd. Computer simulation in management science. John Wiley & sons Ltd, Chichester, 2nd edition, [4] Michael Pidd, editor. Computer Modelling for discrete simulation. Wiley, [5] Wayne L Winston. Operations Research, Applications and Algorithms. Duxbury Press, 4th edition,
Introduction to Simulation
Introduction to Simulation Spring 2010 Dr. Louis Luangkesorn University of Pittsburgh January 19, 2010 Dr. Louis Luangkesorn ( University of Pittsburgh ) Introduction to Simulation January 19, 2010 1 /
More informationAn Introduction to Simio for Beginners
An Introduction to Simio for Beginners C. Dennis Pegden, Ph.D. This white paper is intended to introduce Simio to a user new to simulation. It is intended for the manufacturing engineer, hospital quality
More informationSTA 225: Introductory Statistics (CT)
Marshall University College of Science Mathematics Department STA 225: Introductory Statistics (CT) Course catalog description A critical thinking course in applied statistical reasoning covering basic
More informationLEGO MINDSTORMS Education EV3 Coding Activities
LEGO MINDSTORMS Education EV3 Coding Activities s t e e h s k r o W t n e d Stu LEGOeducation.com/MINDSTORMS Contents ACTIVITY 1 Performing a Three Point Turn 3-6 ACTIVITY 2 Written Instructions for a
More informationAlgebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview
Algebra 1, Quarter 3, Unit 3.1 Line of Best Fit Overview Number of instructional days 6 (1 day assessment) (1 day = 45 minutes) Content to be learned Analyze scatter plots and construct the line of best
More informationBMBF Project ROBUKOM: Robust Communication Networks
BMBF Project ROBUKOM: Robust Communication Networks Arie M.C.A. Koster Christoph Helmberg Andreas Bley Martin Grötschel Thomas Bauschert supported by BMBF grant 03MS616A: ROBUKOM Robust Communication Networks,
More informationEdexcel GCSE. Statistics 1389 Paper 1H. June Mark Scheme. Statistics Edexcel GCSE
Edexcel GCSE Statistics 1389 Paper 1H June 2007 Mark Scheme Edexcel GCSE Statistics 1389 NOTES ON MARKING PRINCIPLES 1 Types of mark M marks: method marks A marks: accuracy marks B marks: unconditional
More informationPython Machine Learning
Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled
More informationISFA2008U_120 A SCHEDULING REINFORCEMENT LEARNING ALGORITHM
Proceedings of 28 ISFA 28 International Symposium on Flexible Automation Atlanta, GA, USA June 23-26, 28 ISFA28U_12 A SCHEDULING REINFORCEMENT LEARNING ALGORITHM Amit Gil, Helman Stern, Yael Edan, and
More informationSelf Study Report Computer Science
Computer Science undergraduate students have access to undergraduate teaching, and general computing facilities in three buildings. Two large classrooms are housed in the Davis Centre, which hold about
More informationSoftware Maintenance
1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories
More informationLecture 1: Machine Learning Basics
1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3
More informationProbability and Statistics Curriculum Pacing Guide
Unit 1 Terms PS.SPMJ.3 PS.SPMJ.5 Plan and conduct a survey to answer a statistical question. Recognize how the plan addresses sampling technique, randomization, measurement of experimental error and methods
More informationSeminar - Organic Computing
Seminar - Organic Computing Self-Organisation of OC-Systems Markus Franke 25.01.2006 Typeset by FoilTEX Timetable 1. Overview 2. Characteristics of SO-Systems 3. Concern with Nature 4. Design-Concepts
More informationA GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING
A GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING Yong Sun, a * Colin Fidge b and Lin Ma a a CRC for Integrated Engineering Asset Management, School of Engineering Systems, Queensland
More informationGACE Computer Science Assessment Test at a Glance
GACE Computer Science Assessment Test at a Glance Updated May 2017 See the GACE Computer Science Assessment Study Companion for practice questions and preparation resources. Assessment Name Computer Science
More informationCS/SE 3341 Spring 2012
CS/SE 3341 Spring 2012 Probability and Statistics in Computer Science & Software Engineering (Section 001) Instructor: Dr. Pankaj Choudhary Meetings: TuTh 11 30-12 45 p.m. in ECSS 2.412 Office: FO 2.408-B
More informationMeasurement & Analysis in the Real World
Measurement & Analysis in the Real World Tools for Cleaning Messy Data Will Hayes SEI Robert Stoddard SEI Rhonda Brown SEI Software Solutions Conference 2015 November 16 18, 2015 Copyright 2015 Carnegie
More informationImproving Conceptual Understanding of Physics with Technology
INTRODUCTION Improving Conceptual Understanding of Physics with Technology Heidi Jackman Research Experience for Undergraduates, 1999 Michigan State University Advisors: Edwin Kashy and Michael Thoennessen
More informationPhysics 270: Experimental Physics
2017 edition Lab Manual Physics 270 3 Physics 270: Experimental Physics Lecture: Lab: Instructor: Office: Email: Tuesdays, 2 3:50 PM Thursdays, 2 4:50 PM Dr. Uttam Manna 313C Moulton Hall umanna@ilstu.edu
More informationACTL5103 Stochastic Modelling For Actuaries. Course Outline Semester 2, 2014
UNSW Australia Business School School of Risk and Actuarial Studies ACTL5103 Stochastic Modelling For Actuaries Course Outline Semester 2, 2014 Part A: Course-Specific Information Please consult Part B
More informationCircuit Simulators: A Revolutionary E-Learning Platform
Circuit Simulators: A Revolutionary E-Learning Platform Mahi Itagi Padre Conceicao College of Engineering, Verna, Goa, India. itagimahi@gmail.com Akhil Deshpande Gogte Institute of Technology, Udyambag,
More informationMathematics subject curriculum
Mathematics subject curriculum Dette er ei omsetjing av den fastsette læreplanteksten. Læreplanen er fastsett på Nynorsk Established as a Regulation by the Ministry of Education and Research on 24 June
More informationAUTOMATED TROUBLESHOOTING OF MOBILE NETWORKS USING BAYESIAN NETWORKS
AUTOMATED TROUBLESHOOTING OF MOBILE NETWORKS USING BAYESIAN NETWORKS R.Barco 1, R.Guerrero 2, G.Hylander 2, L.Nielsen 3, M.Partanen 2, S.Patel 4 1 Dpt. Ingeniería de Comunicaciones. Universidad de Málaga.
More informationRadius STEM Readiness TM
Curriculum Guide Radius STEM Readiness TM While today s teens are surrounded by technology, we face a stark and imminent shortage of graduates pursuing careers in Science, Technology, Engineering, and
More informationExecutive Guide to Simulation for Health
Executive Guide to Simulation for Health Simulation is used by Healthcare and Human Service organizations across the World to improve their systems of care and reduce costs. Simulation offers evidence
More informationTitle:A Flexible Simulation Platform to Quantify and Manage Emergency Department Crowding
Author's response to reviews Title:A Flexible Simulation Platform to Quantify and Manage Emergency Department Crowding Authors: Joshua E Hurwitz (jehurwitz@ufl.edu) Jo Ann Lee (joann5@ufl.edu) Kenneth
More informationAnalysis of Enzyme Kinetic Data
Analysis of Enzyme Kinetic Data To Marilú Analysis of Enzyme Kinetic Data ATHEL CORNISH-BOWDEN Directeur de Recherche Émérite, Centre National de la Recherche Scientifique, Marseilles OXFORD UNIVERSITY
More informationWhile you are waiting... socrative.com, room number SIMLANG2016
While you are waiting... socrative.com, room number SIMLANG2016 Simulating Language Lecture 4: When will optimal signalling evolve? Simon Kirby simon@ling.ed.ac.uk T H E U N I V E R S I T Y O H F R G E
More informationInfrared Paper Dryer Control Scheme
Infrared Paper Dryer Control Scheme INITIAL PROJECT SUMMARY 10/03/2005 DISTRIBUTED MEGAWATTS Carl Lee Blake Peck Rob Schaerer Jay Hudkins 1. Project Overview 1.1 Stake Holders Potlatch Corporation, Idaho
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More informationThe Round Earth Project. Collaborative VR for Elementary School Kids
Johnson, A., Moher, T., Ohlsson, S., The Round Earth Project - Collaborative VR for Elementary School Kids, In the SIGGRAPH 99 conference abstracts and applications, Los Angeles, California, Aug 8-13,
More informationCognitive Modeling. Tower of Hanoi: Description. Tower of Hanoi: The Task. Lecture 5: Models of Problem Solving. Frank Keller.
Cognitive Modeling Lecture 5: Models of Problem Solving Frank Keller School of Informatics University of Edinburgh keller@inf.ed.ac.uk January 22, 2008 1 2 3 4 Reading: Cooper (2002:Ch. 4). Frank Keller
More informationProbability estimates in a scenario tree
101 Chapter 11 Probability estimates in a scenario tree An expert is a person who has made all the mistakes that can be made in a very narrow field. Niels Bohr (1885 1962) Scenario trees require many numbers.
More informationCS Machine Learning
CS 478 - Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing
More informationIndividual Component Checklist L I S T E N I N G. for use with ONE task ENGLISH VERSION
L I S T E N I N G Individual Component Checklist for use with ONE task ENGLISH VERSION INTRODUCTION This checklist has been designed for use as a practical tool for describing ONE TASK in a test of listening.
More informationGrade 6: Correlated to AGS Basic Math Skills
Grade 6: Correlated to AGS Basic Math Skills Grade 6: Standard 1 Number Sense Students compare and order positive and negative integers, decimals, fractions, and mixed numbers. They find multiples and
More informationKnowledge Transfer in Deep Convolutional Neural Nets
Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract
More informationAGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS
AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS 1 CALIFORNIA CONTENT STANDARDS: Chapter 1 ALGEBRA AND WHOLE NUMBERS Algebra and Functions 1.4 Students use algebraic
More informationSpring 2015 IET4451 Systems Simulation Course Syllabus for Traditional, Hybrid, and Online Classes
Spring 2015 IET4451 Systems Simulation Course Syllabus for Traditional, Hybrid, and Online Classes Instructor: Dr. Gregory L. Wiles Email Address: Use D2L e-mail, or secondly gwiles@spsu.edu Office: M
More informationCS 100: Principles of Computing
CS 100: Principles of Computing Kevin Molloy August 29, 2017 1 Basic Course Information 1.1 Prerequisites: None 1.2 General Education Fulfills Mason Core requirement in Information Technology (ALL). 1.3
More informationThe Nature of Exploratory Testing
The Nature of Exploratory Testing Cem Kaner, J.D., Ph.D. Keynote at the Conference of the Association for Software Testing September 28, 2006 Copyright (c) Cem Kaner 2006. This work is licensed under the
More informationVisit us at:
White Paper Integrating Six Sigma and Software Testing Process for Removal of Wastage & Optimizing Resource Utilization 24 October 2013 With resources working for extended hours and in a pressurized environment,
More informationNCEO Technical Report 27
Home About Publications Special Topics Presentations State Policies Accommodations Bibliography Teleconferences Tools Related Sites Interpreting Trends in the Performance of Special Education Students
More informationChapters 1-5 Cumulative Assessment AP Statistics November 2008 Gillespie, Block 4
Chapters 1-5 Cumulative Assessment AP Statistics Name: November 2008 Gillespie, Block 4 Part I: Multiple Choice This portion of the test will determine 60% of your overall test grade. Each question is
More informationLahore University of Management Sciences. FINN 321 Econometrics Fall Semester 2017
Instructor Syed Zahid Ali Room No. 247 Economics Wing First Floor Office Hours Email szahid@lums.edu.pk Telephone Ext. 8074 Secretary/TA TA Office Hours Course URL (if any) Suraj.lums.edu.pk FINN 321 Econometrics
More informationAxiom 2013 Team Description Paper
Axiom 2013 Team Description Paper Mohammad Ghazanfari, S Omid Shirkhorshidi, Farbod Samsamipour, Hossein Rahmatizadeh Zagheli, Mohammad Mahdavi, Payam Mohajeri, S Abbas Alamolhoda Robotics Scientific Association
More informationENEE 302h: Digital Electronics, Fall 2005 Prof. Bruce Jacob
Course Syllabus ENEE 302h: Digital Electronics, Fall 2005 Prof. Bruce Jacob 1. Basic Information Time & Place Lecture: TuTh 2:00 3:15 pm, CSIC-3118 Discussion Section: Mon 12:00 12:50pm, EGR-1104 Professor
More informationGenerating Test Cases From Use Cases
1 of 13 1/10/2007 10:41 AM Generating Test Cases From Use Cases by Jim Heumann Requirements Management Evangelist Rational Software pdf (155 K) In many organizations, software testing accounts for 30 to
More informationOn the Combined Behavior of Autonomous Resource Management Agents
On the Combined Behavior of Autonomous Resource Management Agents Siri Fagernes 1 and Alva L. Couch 2 1 Faculty of Engineering Oslo University College Oslo, Norway siri.fagernes@iu.hio.no 2 Computer Science
More informationScientific Method Investigation of Plant Seed Germination
Scientific Method Investigation of Plant Seed Germination Learning Objectives Building on the learning objectives from your lab syllabus, you will be expected to: 1. Be able to explain the process of the
More informationGCE. Mathematics (MEI) Mark Scheme for June Advanced Subsidiary GCE Unit 4766: Statistics 1. Oxford Cambridge and RSA Examinations
GCE Mathematics (MEI) Advanced Subsidiary GCE Unit 4766: Statistics 1 Mark Scheme for June 2013 Oxford Cambridge and RSA Examinations OCR (Oxford Cambridge and RSA) is a leading UK awarding body, providing
More informationUniversity of Toronto Physics Practicals. University of Toronto Physics Practicals. University of Toronto Physics Practicals
This is the PowerPoint of an invited talk given to the Physics Education section of the Canadian Association of Physicists annual Congress in Quebec City in July 2008 -- David Harrison, david.harrison@utoronto.ca
More informationSyllabus for CHEM 4660 Introduction to Computational Chemistry Spring 2010
Instructor: Dr. Angela Syllabus for CHEM 4660 Introduction to Computational Chemistry Office Hours: Mondays, 1:00 p.m. 3:00 p.m.; 5:00 6:00 p.m. Office: Chemistry 205C Office Phone: (940) 565-4296 E-mail:
More informationMath 96: Intermediate Algebra in Context
: Intermediate Algebra in Context Syllabus Spring Quarter 2016 Daily, 9:20 10:30am Instructor: Lauri Lindberg Office Hours@ tutoring: Tutoring Center (CAS-504) 8 9am & 1 2pm daily STEM (Math) Center (RAI-338)
More informationTesting A Moving Target: How Do We Test Machine Learning Systems? Peter Varhol Technology Strategy Research, USA
Testing A Moving Target: How Do We Test Machine Learning Systems? Peter Varhol Technology Strategy Research, USA Testing a Moving Target How Do We Test Machine Learning Systems? Peter Varhol, Technology
More informationIntroduction and Motivation
1 Introduction and Motivation Mathematical discoveries, small or great are never born of spontaneous generation. They always presuppose a soil seeded with preliminary knowledge and well prepared by labour,
More informationComparison of network inference packages and methods for multiple networks inference
Comparison of network inference packages and methods for multiple networks inference Nathalie Villa-Vialaneix http://www.nathalievilla.org nathalie.villa@univ-paris1.fr 1ères Rencontres R - BoRdeaux, 3
More informationPlanning with External Events
94 Planning with External Events Jim Blythe School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 blythe@cs.cmu.edu Abstract I describe a planning methodology for domains with uncertainty
More informationMASTER OF SCIENCE (M.S.) MAJOR IN COMPUTER SCIENCE
Master of Science (M.S.) Major in Computer Science 1 MASTER OF SCIENCE (M.S.) MAJOR IN COMPUTER SCIENCE Major Program The programs in computer science are designed to prepare students for doctoral research,
More informationArtificial Neural Networks written examination
1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14
More informationContinual Curiosity-Driven Skill Acquisition from High-Dimensional Video Inputs for Humanoid Robots
Continual Curiosity-Driven Skill Acquisition from High-Dimensional Video Inputs for Humanoid Robots Varun Raj Kompella, Marijn Stollenga, Matthew Luciw, Juergen Schmidhuber The Swiss AI Lab IDSIA, USI
More informationIntelligent Agents. Chapter 2. Chapter 2 1
Intelligent Agents Chapter 2 Chapter 2 1 Outline Agents and environments Rationality PEAS (Performance measure, Environment, Actuators, Sensors) Environment types The structure of agents Chapter 2 2 Agents
More informationDesigning a Computer to Play Nim: A Mini-Capstone Project in Digital Design I
Session 1793 Designing a Computer to Play Nim: A Mini-Capstone Project in Digital Design I John Greco, Ph.D. Department of Electrical and Computer Engineering Lafayette College Easton, PA 18042 Abstract
More informationCommanding Officer Decision Superiority: The Role of Technology and the Decision Maker
Commanding Officer Decision Superiority: The Role of Technology and the Decision Maker Presenter: Dr. Stephanie Hszieh Authors: Lieutenant Commander Kate Shobe & Dr. Wally Wulfeck 14 th International Command
More informationCertified Six Sigma Professionals International Certification Courses in Six Sigma Green Belt
Certification Singapore Institute Certified Six Sigma Professionals Certification Courses in Six Sigma Green Belt ly Licensed Course for Process Improvement/ Assurance Managers and Engineers Leading the
More informationHow do adults reason about their opponent? Typologies of players in a turn-taking game
How do adults reason about their opponent? Typologies of players in a turn-taking game Tamoghna Halder (thaldera@gmail.com) Indian Statistical Institute, Kolkata, India Khyati Sharma (khyati.sharma27@gmail.com)
More informationReinforcement Learning by Comparing Immediate Reward
Reinforcement Learning by Comparing Immediate Reward Punit Pandey DeepshikhaPandey Dr. Shishir Kumar Abstract This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate
More informationTruth Inference in Crowdsourcing: Is the Problem Solved?
Truth Inference in Crowdsourcing: Is the Problem Solved? Yudian Zheng, Guoliang Li #, Yuanbing Li #, Caihua Shan, Reynold Cheng # Department of Computer Science, Tsinghua University Department of Computer
More informationGetting Started with Deliberate Practice
Getting Started with Deliberate Practice Most of the implementation guides so far in Learning on Steroids have focused on conceptual skills. Things like being able to form mental images, remembering facts
More informationUniversity of Groningen. Systemen, planning, netwerken Bosman, Aart
University of Groningen Systemen, planning, netwerken Bosman, Aart IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document
More informationCal s Dinner Card Deals
Cal s Dinner Card Deals Overview: In this lesson students compare three linear functions in the context of Dinner Card Deals. Students are required to interpret a graph for each Dinner Card Deal to help
More informationThe Good Judgment Project: A large scale test of different methods of combining expert predictions
The Good Judgment Project: A large scale test of different methods of combining expert predictions Lyle Ungar, Barb Mellors, Jon Baron, Phil Tetlock, Jaime Ramos, Sam Swift The University of Pennsylvania
More informationM55205-Mastering Microsoft Project 2016
M55205-Mastering Microsoft Project 2016 Course Number: M55205 Category: Desktop Applications Duration: 3 days Certification: Exam 70-343 Overview This three-day, instructor-led course is intended for individuals
More informationShockwheat. Statistics 1, Activity 1
Statistics 1, Activity 1 Shockwheat Students require real experiences with situations involving data and with situations involving chance. They will best learn about these concepts on an intuitive or informal
More informationDRAFT VERSION 2, 02/24/12
DRAFT VERSION 2, 02/24/12 Incentive-Based Budget Model Pilot Project for Academic Master s Program Tuition (Optional) CURRENT The core of support for the university s instructional mission has historically
More informationLab 1 - The Scientific Method
Lab 1 - The Scientific Method As Biologists we are interested in learning more about life. Through observations of the living world we often develop questions about various phenomena occurring around us.
More informationOn-Line Data Analytics
International Journal of Computer Applications in Engineering Sciences [VOL I, ISSUE III, SEPTEMBER 2011] [ISSN: 2231-4946] On-Line Data Analytics Yugandhar Vemulapalli #, Devarapalli Raghu *, Raja Jacob
More informationUse and Adaptation of Open Source Software for Capacity Building to Strengthen Health Research in Low- and Middle-Income Countries
338 Informatics for Health: Connected Citizen-Led Wellness and Population Health R. Randell et al. (Eds.) 2017 European Federation for Medical Informatics (EFMI) and IOS Press. This article is published
More informationExploration. CS : Deep Reinforcement Learning Sergey Levine
Exploration CS 294-112: Deep Reinforcement Learning Sergey Levine Class Notes 1. Homework 4 due on Wednesday 2. Project proposal feedback sent Today s Lecture 1. What is exploration? Why is it a problem?
More informationUtilizing Soft System Methodology to Increase Productivity of Shell Fabrication Sushant Sudheer Takekar 1 Dr. D.N. Raut 2
IJSRD - International Journal for Scientific Research & Development Vol. 2, Issue 04, 2014 ISSN (online): 2321-0613 Utilizing Soft System Methodology to Increase Productivity of Shell Fabrication Sushant
More informationLecture 10: Reinforcement Learning
Lecture 1: Reinforcement Learning Cognitive Systems II - Machine Learning SS 25 Part III: Learning Programs and Strategies Q Learning, Dynamic Programming Lecture 1: Reinforcement Learning p. Motivation
More informationSpecification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments
Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Cristina Vertan, Walther v. Hahn University of Hamburg, Natural Language Systems Division Hamburg,
More informationComputerized Adaptive Psychological Testing A Personalisation Perspective
Psychology and the internet: An European Perspective Computerized Adaptive Psychological Testing A Personalisation Perspective Mykola Pechenizkiy mpechen@cc.jyu.fi Introduction Mixed Model of IRT and ES
More informationStatewide Framework Document for:
Statewide Framework Document for: 270301 Standards may be added to this document prior to submission, but may not be removed from the framework to meet state credit equivalency requirements. Performance
More informationTHEORY OF PLANNED BEHAVIOR MODEL IN ELECTRONIC LEARNING: A PILOT STUDY
THEORY OF PLANNED BEHAVIOR MODEL IN ELECTRONIC LEARNING: A PILOT STUDY William Barnett, University of Louisiana Monroe, barnett@ulm.edu Adrien Presley, Truman State University, apresley@truman.edu ABSTRACT
More informationExperiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling
Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling Notebook for PAN at CLEF 2013 Andrés Alfonso Caurcel Díaz 1 and José María Gómez Hidalgo 2 1 Universidad
More informationPractical Integrated Learning for Machine Element Design
Practical Integrated Learning for Machine Element Design Manop Tantrabandit * Abstract----There are many possible methods to implement the practical-approach-based integrated learning, in which all participants,
More informationWhy Did My Detector Do That?!
Why Did My Detector Do That?! Predicting Keystroke-Dynamics Error Rates Kevin Killourhy and Roy Maxion Dependable Systems Laboratory Computer Science Department Carnegie Mellon University 5000 Forbes Ave,
More informationSTT 231 Test 1. Fill in the Letter of Your Choice to Each Question in the Scantron. Each question is worth 2 point.
STT 231 Test 1 Fill in the Letter of Your Choice to Each Question in the Scantron. Each question is worth 2 point. 1. A professor has kept records on grades that students have earned in his class. If he
More informationCONCEPT MAPS AS A DEVICE FOR LEARNING DATABASE CONCEPTS
CONCEPT MAPS AS A DEVICE FOR LEARNING DATABASE CONCEPTS Pirjo Moen Department of Computer Science P.O. Box 68 FI-00014 University of Helsinki pirjo.moen@cs.helsinki.fi http://www.cs.helsinki.fi/pirjo.moen
More informationWe are strong in research and particularly noted in software engineering, information security and privacy, and humane gaming.
Computer Science 1 COMPUTER SCIENCE Office: Department of Computer Science, ECS, Suite 379 Mail Code: 2155 E Wesley Avenue, Denver, CO 80208 Phone: 303-871-2458 Email: info@cs.du.edu Web Site: Computer
More informationMAKING YOUR OWN ALEXA SKILL SHRIMAI PRABHUMOYE, ALAN W BLACK
MAKING YOUR OWN ALEXA SKILL SHRIMAI PRABHUMOYE, ALAN W BLACK WHAT IS ALEXA? Alexa is an intelligent personal assistant developed by Amazon. It is capable of voice interaction, music playback, making to-do
More informationConceptual modelling for simulation part I: definition and requirements
Loughborough University Institutional Repository Conceptual modelling for simulation part I: definition and requirements This item was submitted to Loughborough University's Institutional Repository by
More informationA Stochastic Model for the Vocabulary Explosion
Words Known A Stochastic Model for the Vocabulary Explosion Colleen C. Mitchell (colleen-mitchell@uiowa.edu) Department of Mathematics, 225E MLH Iowa City, IA 52242 USA Bob McMurray (bob-mcmurray@uiowa.edu)
More informationDetailed course syllabus
Detailed course syllabus 1. Linear regression model. Ordinary least squares method. This introductory class covers basic definitions of econometrics, econometric model, and economic data. Classification
More informationMachine Learning and Data Mining. Ensembles of Learners. Prof. Alexander Ihler
Machine Learning and Data Mining Ensembles of Learners Prof. Alexander Ihler Ensemble methods Why learn one classifier when you can learn many? Ensemble: combine many predictors (Weighted) combina
More informationManagerial Decision Making
Course Business Managerial Decision Making Session 4 Conditional Probability & Bayesian Updating Surveys in the future... attempt to participate is the important thing Work-load goals Average 6-7 hours,
More informationlearning collegiate assessment]
[ collegiate learning assessment] INSTITUTIONAL REPORT 2005 2006 Kalamazoo College council for aid to education 215 lexington avenue floor 21 new york new york 10016-6023 p 212.217.0700 f 212.661.9766
More information