Statistical Modeling

Similar documents
STA 225: Introductory Statistics (CT)

Lecture 1: Machine Learning Basics

The Impact of Formative Assessment and Remedial Teaching on EFL Learners Listening Comprehension N A H I D Z A R E I N A S TA R A N YA S A M I

Assignment 1: Predicting Amazon Review Ratings

Lahore University of Management Sciences. FINN 321 Econometrics Fall Semester 2017

Ryerson University Sociology SOC 483: Advanced Research and Statistics

School of Innovative Technologies and Engineering

MGT/MGP/MGB 261: Investment Analysis

Analysis of Enzyme Kinetic Data

Chromatography Syllabus and Course Information 2 Credits Fall 2016

Python Machine Learning

Self Study Report Computer Science

Algebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview

Firms and Markets Saturdays Summer I 2014

Certified Six Sigma Professionals International Certification Courses in Six Sigma Green Belt

Mathematics Program Assessment Plan

Probability and Game Theory Course Syllabus

The Good Judgment Project: A large scale test of different methods of combining expert predictions

Detailed course syllabus

An Empirical Analysis of the Effects of Mexican American Studies Participation on Student Achievement within Tucson Unified School District

A Simple VQA Model with a Few Tricks and Image Features from Bottom-up Attention

Introduction to Ensemble Learning Featuring Successes in the Netflix Prize Competition

University of Waterloo School of Accountancy. AFM 102: Introductory Management Accounting. Fall Term 2004: Section 4

Exploration. CS : Deep Reinforcement Learning Sergey Levine

CS Machine Learning

ECON 6901 Research Methods for Economists I Spring 2017

ECE-492 SENIOR ADVANCED DESIGN PROJECT

Machine Learning and Data Mining. Ensembles of Learners. Prof. Alexander Ihler

Business Analytics and Information Tech COURSE NUMBER: 33:136:494 COURSE TITLE: Data Mining and Business Intelligence

Hierarchical Linear Models I: Introduction ICPSR 2015

Mathematics subject curriculum

Probabilistic Latent Semantic Analysis

Go fishing! Responsibility judgments when cooperation breaks down

Hierarchical Linear Modeling with Maximum Likelihood, Restricted Maximum Likelihood, and Fully Bayesian Estimation

Theory of Probability

TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE. Pierre Foy

Probability and Statistics Curriculum Pacing Guide

ENME 605 Advanced Control Systems, Fall 2015 Department of Mechanical Engineering

Guidelines for Project I Delivery and Assessment Department of Industrial and Mechanical Engineering Lebanese American University

San José State University Department of Marketing and Decision Sciences BUS 90-06/ Business Statistics Spring 2017 January 26 to May 16, 2017

Statistical Analysis of Climate Change, Renewable Energies, and Sustainability An Independent Investigation for Introduction to Statistics

PM tutor. Estimate Activity Durations Part 2. Presented by Dipo Tepede, PMP, SSBB, MBA. Empowering Excellence. Powered by POeT Solvers Limited

Navigating the PhD Options in CMS

Grade 6: Correlated to AGS Basic Math Skills

S T A T 251 C o u r s e S y l l a b u s I n t r o d u c t i o n t o p r o b a b i l i t y

Generative models and adversarial training

Document number: 2013/ Programs Committee 6/2014 (July) Agenda Item 42.0 Bachelor of Engineering with Honours in Software Engineering

Spring 2014 SYLLABUS Michigan State University STT 430: Probability and Statistics for Engineering

Evaluation of Teach For America:

4.0 CAPACITY AND UTILIZATION

EGRHS Course Fair. Science & Math AP & IB Courses

Lecture 10: Reinforcement Learning

Discovering Statistics

THEORY OF PLANNED BEHAVIOR MODEL IN ELECTRONIC LEARNING: A PILOT STUDY

12- A whirlwind tour of statistics

Multi-Dimensional, Multi-Level, and Multi-Timepoint Item Response Modeling.

CERTIFICATE OF HIGHER EDUCATION IN CONTINUING EDUCATION. Relevant QAA subject benchmarking group:

ECO 3101: Intermediate Microeconomics

learning collegiate assessment]

Introduction and Motivation

Physics Experimental Physics II: Electricity and Magnetism Prof. Eno Spring 2017

CSL465/603 - Machine Learning

Statewide Framework Document for:

Uncertainty concepts, types, sources

ME 443/643 Design Techniques in Mechanical Engineering. Lecture 1: Introduction

Universityy. The content of

Knowledge Synthesis and Integration: Changing Models, Changing Practices

School Size and the Quality of Teaching and Learning

Software Maintenance

A Stochastic Model for the Vocabulary Explosion

BENCHMARK TREND COMPARISON REPORT:

Travis Park, Assoc Prof, Cornell University Donna Pearson, Assoc Prof, University of Louisville. NACTEI National Conference Portland, OR May 16, 2012

An Introduction to Simio for Beginners

Learning From the Past with Experiment Databases

PHD COURSE INTERMEDIATE STATISTICS USING SPSS, 2018

A Model to Predict 24-Hour Urinary Creatinine Level Using Repeated Measurements

Office Hours: Mon & Fri 10:00-12:00. Course Description

HUMAN DEVELOPMENT OVER THE LIFESPAN Psychology 351 Fall 2013

A&S/Business Dual Major

Individual Differences & Item Effects: How to test them, & how to test them well

AP Calculus AB. Nevada Academic Standards that are assessable at the local level only.

ENEE 302h: Digital Electronics, Fall 2005 Prof. Bruce Jacob

GRADUATE STUDENT HANDBOOK Master of Science Programs in Biostatistics

On-the-Fly Customization of Automated Essay Scoring

Conceptual and Procedural Knowledge of a Mathematics Problem: Their Measurement and Their Causal Interrelations

AGRICULTURAL AND EXTENSION EDUCATION

Syllabus Foundations of Finance Summer 2014 FINC-UB

Time series prediction

Major Milestones, Team Activities, and Individual Deliverables

Fall Semester Year 1: 15 hours

STRUCTURAL ENGINEERING PROGRAM INFORMATION FOR GRADUATE STUDENTS

Spring 2015 IET4451 Systems Simulation Course Syllabus for Traditional, Hybrid, and Online Classes

Lecture 15: Test Procedure in Engineering Design

Master s Programme in European Studies

Discovering Statistics

Retrieval in cued recall

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

ACTL5103 Stochastic Modelling For Actuaries. Course Outline Semester 2, 2014

EPI BIO 446 DESIGN, CONDUCT, and ANALYSIS of CLINICAL TRIALS 1.0 Credit SPRING QUARTER 2014

INPE São José dos Campos

Transcription:

Statistical Modeling IB/NRES 509 Instructor: Prof. Michael Dietze TA: Ryan Kelly

Introductions

What is statistical modeling?

What is statistical modeling? Confronting models with data Model fitting / parameter estimation Model comparison Estimation, partitioning, and propagation of uncertainties

What is statistical modeling? Confronting models with data Design the statistical analysis to fit the data rather than the data to fit the test

What is a model?

What is a model? A conceptual, graphical, or mathematical representation / abstraction of some empirical process(es). A mathematical function that formalizes our conceptual model / theory f x =a

Syllabus

Course Materials Reading assignments, lecture slides, project details, etc. are all posted on the lab website http://www.life.illinois.edu/dietze/ib509.html Primary Text: Models for Ecological Data Clark 2007 Princeton U Press Software: R OpenBUGS

Grading Grading will be based on lab reports, a semesterlong project, and three exams. Lab reports/problem sets (10 points each) Semester project project proposal 2/15 model description 3/14 preliminary analysis 4/11 Final report before exam 4 Exams (25, 30, 30, 30 points ) [non-cumulative] Total = 150 = 95 (10) (15) (20) (50) = 115 = 360

Labs Lab starts TODAY Location IGB 0607 LAB IS MANDATORY Labs will be posted on the classroom dropbox Due FOLLOWING WEEK by the start of lab Deposited in classroom electronic dropbox Must be turned in individually Can work together

Semester Project Final product: Journal article on a data analysis You choose topic ENCOURAGED to use your own data Analysis must be new, use concepts from class Methods heavy Four milestones One lab is peer critique

Lecture Four sections Probability theory and Maximum Likelihood Bayesian methods Hierarchical/mixed models Advanced topics Linear regression nonlinear, non-gaussian Time series Spatial Data assimilation In-class problems: bring laptops I may miss a few lectures in early/mid-march

Exams Multiple Choice Matching Fill in the blank Short Answer / Derivation ~15 questions

Expectations You have seen basic calculus at some point Primarily need to follow derivations Basic familiarity with statistical concepts e.g. experimental design, randomization, mean, median, variance Open mind You will work hard You won't 'get' Bayes the first time they see it nd (but will need to by the 2 exam)

Objectives Literacy Read and evaluate advanced stats used in papers Proficiency underlying statistical concepts Software: R, OpenBUGS Exposure to advanced topics Paradigm shift

A bit more on motivation... Data are usually complex Violate the assumptions of classical tests This complexity can be addressed with modern techniques

Example: How much light is a tree getting?

Example: How much light is a tree getting? F I E L D M O D E L Dominant Intermediate Suppressed R E M O T E S E N S I N G

R.S. FIELD MODEL

Linear models Logistic Multinomial FIELD R.S. MODEL

Problem Characteristics Multiple data constraints Non-linear relationships Non-Normal residuals Non-constant variance Latent variables (response variable not being observed directly) Distinction between observation error and process variability Missing data

Statistical Paradigms Classical (e.g. sum of squares) Maximum Likelihood Bayesian

Statistical Paradigms Statistical Estimator Method of Estimation Output Data Complexity Classical Cost Function Analytical Solution Point Estimate Simple No Maximum Likelihood Probability Theory Numerical Optimization Point Estimate Intermediate No Bayesian Probability Theory Sampling Probability Distribution Yes Complex Prior Info

Statistical Paradigms Statistical Estimator Method of Estimation Output Data Complexity Classical Cost Function Analytical Solution Point Estimate Simple No Maximum Likelihood Probability Theory Numerical Optimization Point Estimate Intermediate No Bayesian Probability Theory Sampling Probability Distribution Yes Complex Prior Info The unifying principal for this course is statistical estimation based on probability

Next lecture Will cover basics of probability theory Read Clark 2007 - Chapter 1 Hilborn and Mangel p39-62 (course website) Optional Clark 2007 Appendix D (Probability) Otto and Day Appendix 1 (Math) and 2 (Calculus) (course website)