Designing Multiple Choice Tests to Measure Higher Order Thinking

Size: px
Start display at page:

Download "Designing Multiple Choice Tests to Measure Higher Order Thinking"

Transcription

1 University of North Texas Health Science Center UNTHSC Scholarly Repository Test Item Writing Assessment Designing Multiple Choice Tests to Measure Higher Order Thinking Carol Kominski Follow this and additional works at: Recommended Citation Kominski, Carol, "Designing Multiple Choice Tests to Measure Higher Order Thinking" (2012). Test Item Writing. Paper This Article is brought to you for free and open access by the Assessment at UNTHSC Scholarly Repository. It has been accepted for inclusion in Test Item Writing by an authorized administrator of UNTHSC Scholarly Repository. For more information, please contact

2 Designing Multiple Choice Tests to Measure Higher Order Thinking Carol A. Kominski, Ph.D. Assessment Specialist

3 Learning Outcomes 1. Apply Bloom s conceptual model to construct higher order learning outcomes. 2. Analyze structured vs. unstructured assessments. 3. Evaluate multiple choice test items for quality and skill level. 4. Construct multiple choice test items to assess higher order thinking.

4 Assumptions About Workshop Participants Target audience Primary assessment goals Units for Analysis Outcomes Faculty designing course tests Diagnose strengths and weaknesses Student Higher Order Thinking Learning Outcomes Certify student competence Course

5 Workshop Agenda 1. Bloom s conceptual Model of Higher Order Thinking Learning Outcomes that Assess Higher Order Thinking 2. Structured vs. Unstructured Tests (Pluses and Minuses) Types of Structured Tests 3. Analysis of Multiple choice Test Items General Quality Standards Level of Thinking 4. Construction of Multiple choice Test Items for Higher Order Thinking

6 Just what is higher order thinking?

7 Bloom s taxonomy remix Putting things together; Creative thinking Making Judgment Breaking things down; Critical thinking Using knowledge in new situations Understanding Recall

8 Learning Outcomes: Questions Should Have Yes Answers Clarity Do they specify what students are expected to know and/or be able to do? Communication Are they included in syllabus? Are they communicated in course activities? Relationship to Test Can you report test performance on each outcome?

9 Learning Outcomes that Assess Higher Order Thinking: Key Words Useful websites oms1.html Cognitive_Domain.pdf

10 Definition Remember Understand Apply Analyze Evaluate Create Bloom s Remember Demonstrate an Apply knowledge to Break down objects Make and defend Compile component Bloom s Taxonomy Definition previously learned understanding of the actual situations. or ideas into judgments based ideas into a new information. facts. simpler parts and on internal whole or propose find evidence to support generalizations. evidence or external criteria. alternative solutions. Verbs Arrange Define Describe Duplicate Identify Label List Match Memorize Name Order Outline Recognize Relate Recall Repeat Reproduce Select State Classify Convert Defend Describe Discuss Distinguish Estimate Explain Express Extend Generalized Give example Identify Indicate Infer Locate Paraphrase Predict Recognize Rewrite Review Select Summarize Translate Apply Change Choose Compute Demonstrate Discover Dramatize Employ Illustrate Interpret Manipulate Modify Operate Practice Predict Prepare Produce Relate Schedule Show Sketch Solve Use Write Analyze Appraise Breakdown Calculate Categorize Compare Contrast Criticize Diagram Differentiate Discriminate Distinguish Examine Experiment Identify Illustrate Infer Model Outline Point out Question Relate Select Separate Subdivide Test Appraise Argue Assess Attach Choose Compare Conclude Contrast Defend Describe Discriminate Estimate Evaluate Explain Judge Justify Interpret Relate Predict Rate Select Summarize Support Value Arrange Assemble Categorical Collect Combine Comply Compose Construct Create Design Develop Devise Explain Formulate Generate Plan Prepare Rearrange Reconstruct Relate Reorganize Revise Rewrite Set up Summarize Synthesize Tell Write

11 Structured vs. Unstructured Tests Structured Tests Have limited number of response options. Examples are True False Multiple choice Matching Fill in the blanks Unstructured Tests Have wider variety of response options controlled by test taker. Examples are Technical Writing Oral presentation Procedural demonstration Case study analysis E Portfolio

12 Pluses and Minuses for Structured Response Tests Pluses Comprehensive knowledge assessed efficiently Scoring economical and speedy Moderate to high reliability Amenable to statistical analysis Amenable to collection of comparative and trend data Minuses Test items laborious to construct Higher order thinking skills items even more difficult to construct Impact of cueing, guessing, test savvy, & motivation uncertain Test security a requirement Less related to tasks of professional life

13 Pluses and Minuses for Unstructured Response Tests Pluses Higher order thinking more easily assessed Moderate to high authenticity for real life tasks Requires greater student activity and engagement Minimal influence of guessing and motivation on performance Ease of construction Minuses Necessity for rubric/scoring key construction & calibration Scoring requires significant time Pre calibration of evaluators needed to increase reliability More difficult to assess broad range of knowledge quickly Comparative and trend data harder to collect

14 Examples of Structured Test Items Forced choice True false Multiple Choice (usually 3 5 choices) Matching Allow for use of same options for more than one question Options can be extended (15 20 options) One to one match or unevenly matched lists Fill in the blanks Complete a diagram Cloze test for comprehension where every nth word is omitted Complete a sentence

15 Structured Assessments: Focus on Multiple Choice Items Commonly used Large classes High stakes testing Admission to professional schools Professional licensure Item analysis Highly developed Facilitates systematic item improvement

16 Multiple Choice Items: Basic Guidelines State learning evaluation objectives clearly. Determine level of thinking required. Recall Understanding Application Analysis Evaluation

17 Multiple Choice Question Terminology Test Item Item Stem Alternatives Context Keyed Response Distractors

18 Context Helpful for Higher Order Thinking Questions No Context Usually not needed for testing of factual knowledge Context Skeleton A small amount may be desirable for testing understanding. Context Rich Rich context is usually helpful for assessment of higher order thinking skills like application, analysis, and evaluation.

19 Three Desirable Qualities of Item Stem 1. Succinctness 2. Clear statement of question, problem, or task 3. Positive wording

20 Six Desirable Qualities of Alternatives 1. Similar lengths 2. Correct grammar 3. One correct answer 4. Absence of extremes like never, always, only 5. No all of the above. 6. Mutually exclusive alternatives

21 Let s Try Some Questions

22 Question 1: What is wrong with this question? The way to a man s heart is through his a. aorta b. pulmonary arteries c. pulmonary veins d. stomach Source: Constructing Written Test Questions for the Basic and Clinical Sciences. Third Edition (Revised). National Board of Medical Examiners, 2002, p.15.

23 Question 2: What is wrong with this question? Structured tests a. Usually assess higher order thinking. b. Are better for large classes. c. Do not require a high level of test secruity. d. Requires rubrics or scoring key. e. Are easy to construct. f. All of the above.

24 Question 3: What is wrong with this question? Assume you are a biology professor interested in deciding whether or not team based learning has a significant impact upon your students. You give half the students a lesson in which you employ team based learning and the other half a lesson in which you teach using a traditional lecture. After both lessons, you give students a 100 point test to determine how well they have learned the material covered in each class. If you were to do a 2 tailed t test on the students test results, what is the hypothesis that you are seeking to test? a. Students in the team based learning class will score higher on the test. b. Students in both classes will score about the same on the test. c. Students in the traditional lecture class will score higher on the test. d. All of the above.

25 Question 3: New and Improved An instructor teaching half of his students using team based learning and the other half using traditional lecture gives each group the same test at the end of each class. He performs a 2 tailed t test to compare the two groups. What hypothesis is he testing? a. Students in the team based learning class will score higher. b. Students in both classes will score about the same. c. Students in the traditional lecture class will score higher.

26 Question 4: What level of thinking is assessed? Which of the following blood tests is used in diagnosis and treatment of diabetes? a. Hemoglobin A1C b. C reactive protein (CRP) c. Antinuclear antibodies (ANA) d. Aspartate aminotransferase (AST)

27 Question 5: What level of thinking is assessed? In a routine physical exam John Smith, age 47, had a blood glucose level of 140 and an A1C level of 4.1%. What is the most plausible explanation of these numbers? a. He has Type I diabetes which is probably controlled by insulin. b. He shows early signs of development of Type II diabetes. c. He probably fasted before his blood glucose test. d. He probably did not fast before his blood glucose test.

28 Question 6: What level of thinking is assessed? Two 60 year old male patients have Type 2 diabetes. Each have a BMI of 27. The primary treatment for each is a diet to reduce blood glucose levels. What is the most likely reason Patient #2 did not show a decline in glucose after three months? Weight P#1 Weight P# Jan 1 Feb 1 Mar 1 Apr Glucose P#1 Glucose P#2 1 Jan 1 Feb 1 Mar 1 Apr a. P#1 may have exercised more than P#2. b. P#2 probably leads a more sedentary life than P#1. c. P#1 lost more weight on the glucose reduction diet. d. P#2 may have a more resistant form of diabetes.

29 Question 7: What level of thinking is assessed? Without any other data, which conclusion can you make from reviewing Figure 17? a. The average American uses more drugs than citizens of any country except the United Kingdom. b. The average Mexican or Chilean consumes fewer drugs than citizens from other countries. c. Americans are more likely than residents of other countries to use new drugs. d. Japanese have regulations that make it very difficult to obtain new drugs.

30 Question 8: What level of thinking is asssessed? What data would be most helpful in estimating average levels of personal drug consumption for the countries identified in Figure 17? a. Percent of population in each country buying the covered drugs. b. Average cost of new drugs for each country. c. Average cost of all drugs for each country. d. Population of each country.

31 Question 9: What level of thinking is assessed? Susan and Clara each want to lose weight. Susan goes on a low carbohydrate diet and Clara goes on a Vegan diet. After six months Susan loses 30 and Clara loses 15 pounds. Relative to losing weight, which of the following conclusions is supported? The low carbohydrate diet is more effective at producing weight loss than the Vegan diet. The Vegan diet contains more calories than the low carbohydrate diet. The low carbohydrate diet is easier to maintain than the Vegan diet. Additional information is needed before making any conclusions.

32 Characteristics of Multiple Choice Items That Measure Higher Order Thinking Difficult to construct Must develop context Require lots of context Reading selections Scenarios, vignettes Tables, charts, graphs Require more testing time Reading selections, studying tables and charts Thinking itself more complex Require review by others Other faculty, colleagues, or small sample of students

33 Objectives and Test Items: Dimensions and Guidelines Dimensions Number of learning evaluation outcomes Relative importance of each outcome Total testing time Higher thinking items require more time Guidelines Minimum two items per objective 5 10 items for important learning objectives Additional items increase reliability and validity

Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge

Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge Innov High Educ (2009) 34:93 103 DOI 10.1007/s10755-009-9095-2 Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge Phyllis Blumberg Published online: 3 February

More information

Beyond the Blend: Optimizing the Use of your Learning Technologies. Bryan Chapman, Chapman Alliance

Beyond the Blend: Optimizing the Use of your Learning Technologies. Bryan Chapman, Chapman Alliance 901 Beyond the Blend: Optimizing the Use of your Learning Technologies Bryan Chapman, Chapman Alliance Power Blend Beyond the Blend: Optimizing the Use of Your Learning Infrastructure Facilitator: Bryan

More information

Language Acquisition Chart

Language Acquisition Chart Language Acquisition Chart This chart was designed to help teachers better understand the process of second language acquisition. Please use this chart as a resource for learning more about the way people

More information

Automating Outcome Based Assessment

Automating Outcome Based Assessment Automating Outcome Based Assessment Suseel K Pallapu Graduate Student Department of Computing Studies Arizona State University Polytechnic (East) 01 480 449 3861 harryk@asu.edu ABSTRACT In the last decade,

More information

Taxonomy of the cognitive domain: An example of architectural education program

Taxonomy of the cognitive domain: An example of architectural education program Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 174 ( 2015 ) 3272 3277 INTE 2014 Taxonomy of the cognitive domain: An example of architectural education

More information

Unit 3. Design Activity. Overview. Purpose. Profile

Unit 3. Design Activity. Overview. Purpose. Profile Unit 3 Design Activity Overview Purpose The purpose of the Design Activity unit is to provide students with experience designing a communications product. Students will develop capability with the design

More information

Analysis: Evaluation: Knowledge: Comprehension: Synthesis: Application:

Analysis: Evaluation: Knowledge: Comprehension: Synthesis: Application: In 1956, Benjamin Bloom headed a group of educational psychologists who developed a classification of levels of intellectual behavior important in learning. Bloom found that over 95 % of the test questions

More information

BIOH : Principles of Medical Physiology

BIOH : Principles of Medical Physiology University of Montana ScholarWorks at University of Montana Syllabi Course Syllabi Spring 2--207 BIOH 462.0: Principles of Medical Physiology Laurie A. Minns University of Montana - Missoula, laurie.minns@umontana.edu

More information

Promoting Active Learning in University Classes

Promoting Active Learning in University Classes Promoting Active Learning in University Classes Dr Tony Morrison EDC, January 11 Introduction This workshop follows on from the four earlier 'active learning' workshops conducted in EDC. Approximately

More information

What is PDE? Research Report. Paul Nichols

What is PDE? Research Report. Paul Nichols What is PDE? Research Report Paul Nichols December 2013 WHAT IS PDE? 1 About Pearson Everything we do at Pearson grows out of a clear mission: to help people make progress in their lives through personalized

More information

Innovative Methods for Teaching Engineering Courses

Innovative Methods for Teaching Engineering Courses Innovative Methods for Teaching Engineering Courses KR Chowdhary Former Professor & Head Department of Computer Science and Engineering MBM Engineering College, Jodhpur Present: Director, JIETSETG Email:

More information

CAAP. Content Analysis Report. Sample College. Institution Code: 9011 Institution Type: 4-Year Subgroup: none Test Date: Spring 2011

CAAP. Content Analysis Report. Sample College. Institution Code: 9011 Institution Type: 4-Year Subgroup: none Test Date: Spring 2011 CAAP Content Analysis Report Institution Code: 911 Institution Type: 4-Year Normative Group: 4-year Colleges Introduction This report provides information intended to help postsecondary institutions better

More information

Science Fair Project Handbook

Science Fair Project Handbook Science Fair Project Handbook IDENTIFY THE TESTABLE QUESTION OR PROBLEM: a) Begin by observing your surroundings, making inferences and asking testable questions. b) Look for problems in your life or surroundings

More information

Probability and Statistics Curriculum Pacing Guide

Probability and Statistics Curriculum Pacing Guide Unit 1 Terms PS.SPMJ.3 PS.SPMJ.5 Plan and conduct a survey to answer a statistical question. Recognize how the plan addresses sampling technique, randomization, measurement of experimental error and methods

More information

Instructional Supports for Common Core and Beyond: FORMATIVE ASSESMENT

Instructional Supports for Common Core and Beyond: FORMATIVE ASSESMENT Instructional Supports for Common Core and Beyond: FORMATIVE ASSESMENT Defining Date Guiding Question: Why is it important for everyone to have a common understanding of data and how they are used? Importance

More information

Rubric for Scoring English 1 Unit 1, Rhetorical Analysis

Rubric for Scoring English 1 Unit 1, Rhetorical Analysis FYE Program at Marquette University Rubric for Scoring English 1 Unit 1, Rhetorical Analysis Writing Conventions INTEGRATING SOURCE MATERIAL 3 Proficient Outcome Effectively expresses purpose in the introduction

More information

PEDAGOGICAL LEARNING WALKS: MAKING THE THEORY; PRACTICE

PEDAGOGICAL LEARNING WALKS: MAKING THE THEORY; PRACTICE PEDAGOGICAL LEARNING WALKS: MAKING THE THEORY; PRACTICE DR. BEV FREEDMAN B. Freedman OISE/Norway 2015 LEARNING LEADERS ARE Discuss and share.. THE PURPOSEFUL OF CLASSROOM/SCHOOL OBSERVATIONS IS TO OBSERVE

More information

Activities, Exercises, Assignments Copyright 2009 Cem Kaner 1

Activities, Exercises, Assignments Copyright 2009 Cem Kaner 1 Patterns of activities, iti exercises and assignments Workshop on Teaching Software Testing January 31, 2009 Cem Kaner, J.D., Ph.D. kaner@kaner.com Professor of Software Engineering Florida Institute of

More information

John Jay College of Criminal Justice, CUNY ASSESSMENT REPORT: SPRING Undergraduate Public Administration Major

John Jay College of Criminal Justice, CUNY ASSESSMENT REPORT: SPRING Undergraduate Public Administration Major John Jay College of Criminal Justice, CUNY ASSESSMENT REPORT: SPRING 203 Undergraduate Public Administration Major Maria J. D'Agostino 06.30.203 ANNUAL ASSESSMENT REPORT FALL 20 SPRING 202 2 I. ASSESSMENT

More information

Exemplary Planning Commentary: Secondary Science

Exemplary Planning Commentary: Secondary Science Exemplary Planning Commentary: Secondary Science! This example commentary is for training purposes only. Copying or replicating responses from this example for use on a portfolio violates TPA policies.

More information

EQuIP Review Feedback

EQuIP Review Feedback EQuIP Review Feedback Lesson/Unit Name: On the Rainy River and The Red Convertible (Module 4, Unit 1) Content Area: English language arts Grade Level: 11 Dimension I Alignment to the Depth of the CCSS

More information

School Leadership Rubrics

School Leadership Rubrics School Leadership Rubrics The School Leadership Rubrics define a range of observable leadership and instructional practices that characterize more and less effective schools. These rubrics provide a metric

More information

Biome I Can Statements

Biome I Can Statements Biome I Can Statements I can recognize the meanings of abbreviations. I can use dictionaries, thesauruses, glossaries, textual features (footnotes, sidebars, etc.) and technology to define and pronounce

More information

Statistical Analysis of Climate Change, Renewable Energies, and Sustainability An Independent Investigation for Introduction to Statistics

Statistical Analysis of Climate Change, Renewable Energies, and Sustainability An Independent Investigation for Introduction to Statistics 5/22/2012 Statistical Analysis of Climate Change, Renewable Energies, and Sustainability An Independent Investigation for Introduction to Statistics College of Menominee Nation & University of Wisconsin

More information

South Carolina English Language Arts

South Carolina English Language Arts South Carolina English Language Arts A S O F J U N E 2 0, 2 0 1 0, T H I S S TAT E H A D A D O P T E D T H E CO M M O N CO R E S TAT E S TA N DA R D S. DOCUMENTS REVIEWED South Carolina Academic Content

More information

COMM 210 Principals of Public Relations Loyola University Department of Communication. Course Syllabus Spring 2016

COMM 210 Principals of Public Relations Loyola University Department of Communication. Course Syllabus Spring 2016 COMM 210 Principals of Public Relations Loyola University Department of Communication Course Syllabus Spring 2016 Instructor: Veronica Marshall Course Schedule: Email: vmarshall@luc.edu Tuesdays and Thursdays

More information

Qualitative Site Review Protocol for DC Charter Schools

Qualitative Site Review Protocol for DC Charter Schools Qualitative Site Review Protocol for DC Charter Schools Updated November 2013 DC Public Charter School Board 3333 14 th Street NW, Suite 210 Washington, DC 20010 Phone: 202-328-2600 Fax: 202-328-2661 Table

More information

Lab 1 - The Scientific Method

Lab 1 - The Scientific Method Lab 1 - The Scientific Method As Biologists we are interested in learning more about life. Through observations of the living world we often develop questions about various phenomena occurring around us.

More information

Author: Justyna Kowalczys Stowarzyszenie Angielski w Medycynie (PL) Feb 2015

Author: Justyna Kowalczys Stowarzyszenie Angielski w Medycynie (PL)  Feb 2015 Author: Justyna Kowalczys Stowarzyszenie Angielski w Medycynie (PL) www.angielskiwmedycynie.org.pl Feb 2015 Developing speaking abilities is a prerequisite for HELP in order to promote effective communication

More information

5. UPPER INTERMEDIATE

5. UPPER INTERMEDIATE Triolearn General Programmes adapt the standards and the Qualifications of Common European Framework of Reference (CEFR) and Cambridge ESOL. It is designed to be compatible to the local and the regional

More information

Developing a Language for Assessing Creativity: a taxonomy to support student learning and assessment

Developing a Language for Assessing Creativity: a taxonomy to support student learning and assessment Investigations in university teaching and learning vol. 5 (1) autumn 2008 ISSN 1740-5106 Developing a Language for Assessing Creativity: a taxonomy to support student learning and assessment Janette Harris

More information

Statewide Framework Document for:

Statewide Framework Document for: Statewide Framework Document for: 260102 Standards may be added to this document prior to submission, but may not be removed from the framework to meet state credit equivalency requirements. Performance

More information

Earl of March SS Physical and Health Education Grade 11 Summative Project (15%)

Earl of March SS Physical and Health Education Grade 11 Summative Project (15%) Earl of March SS Physical and Health Education Grade 11 Summative Project (15%) Student Name: PPL 3OQ/P - Summative Project (8%) Task 1 - Time and Stress Management Assignment Objective: To understand,

More information

Providing Feedback to Learners. A useful aide memoire for mentors

Providing Feedback to Learners. A useful aide memoire for mentors Providing Feedback to Learners A useful aide memoire for mentors January 2013 Acknowledgments Our thanks go to academic and clinical colleagues who have helped to critique and add to this document and

More information

Instructions and Guidelines for Promotion and Tenure Review of IUB Librarians

Instructions and Guidelines for Promotion and Tenure Review of IUB Librarians Instructions and Guidelines for Promotion and Tenure Review of IUB Librarians Approved by the IUB Library Faculty June 2012. Future amendment by vote of Bloomington Library Faculty Council. Amended August

More information

PAGE(S) WHERE TAUGHT If sub mission ins not a book, cite appropriate location(s))

PAGE(S) WHERE TAUGHT If sub mission ins not a book, cite appropriate location(s)) Ohio Academic Content Standards Grade Level Indicators (Grade 11) A. ACQUISITION OF VOCABULARY Students acquire vocabulary through exposure to language-rich situations, such as reading books and other

More information

FIGURE IT OUT! MIDDLE SCHOOL TASKS. Texas Performance Standards Project

FIGURE IT OUT! MIDDLE SCHOOL TASKS. Texas Performance Standards Project FIGURE IT OUT! MIDDLE SCHOOL TASKS π 3 cot(πx) a + b = c sinθ MATHEMATICS 8 GRADE 8 This guide links the Figure It Out! unit to the Texas Essential Knowledge and Skills (TEKS) for eighth graders. Figure

More information

Wellness Committee Action Plan. Developed in compliance with the Child Nutrition and Women, Infant and Child (WIC) Reauthorization Act of 2004

Wellness Committee Action Plan. Developed in compliance with the Child Nutrition and Women, Infant and Child (WIC) Reauthorization Act of 2004 Wellness Committee Action Plan Developed in compliance with the Child Nutrition and Women, Infant and Child (WIC) Reauthorization Act of 2004 PREAMBLE Overweight children and adolescents have become a

More information

Introduction to Questionnaire Design

Introduction to Questionnaire Design Introduction to Questionnaire Design Why this seminar is necessary! Bad questions are everywhere! Don t let them happen to you! Fall 2012 Seminar Series University of Illinois www.srl.uic.edu The first

More information

Predatory Reading, & Some Related Hints on Writing. I. Suggestions for Reading

Predatory Reading, & Some Related Hints on Writing. I. Suggestions for Reading Predatory Reading, & Some Related Hints on Writing I. Suggestions for Reading Reading scholarly work requires a different set of skills than you might use when reading, say, a novel for pleasure. Most

More information

Chemistry Senior Seminar - Spring 2016

Chemistry Senior Seminar - Spring 2016 Chemistry 4990- Senior Seminar - Spring 2016 Instructor: Prof. Bob Brown E-mail: bob.brown@usu.edu Phone: 797-0545 Office: W026 Office Hours Monday and Wednesday from 2:00-2:50 PM and by appointment Class

More information

Let's Learn English Lesson Plan

Let's Learn English Lesson Plan Let's Learn English Lesson Plan Introduction: Let's Learn English lesson plans are based on the CALLA approach. See the end of each lesson for more information and resources on teaching with the CALLA

More information

Human Biology: Physiology and Health (Higher) Unit. level 6 (6 SCQF credit points)

Human Biology: Physiology and Health (Higher) Unit. level 6 (6 SCQF credit points) Human Biology: Physiology and Health (Higher) Unit SCQF: level 6 (6 SCQF credit points) Unit code: H4L9 76 Unit outline The general aim of this Unit is to develop skills of scientific inquiry, investigation

More information

Researcher Development Assessment A: Knowledge and intellectual abilities

Researcher Development Assessment A: Knowledge and intellectual abilities Researcher Development Assessment A: Knowledge and intellectual abilities Domain A: Knowledge and intellectual abilities This domain relates to the knowledge and intellectual abilities needed to be able

More information

Nutrition 10 Contemporary Nutrition WINTER 2016

Nutrition 10 Contemporary Nutrition WINTER 2016 Nutrition 10 Contemporary Nutrition WINTER 2016 INSTRUCTOR: Anna Miller, MS., RD PHONE 408.864.5576 EMAIL milleranna@fhda.edu Write NUTR 10 and the time your class starts in the subject line of your e-

More information

How to Judge the Quality of an Objective Classroom Test

How to Judge the Quality of an Objective Classroom Test How to Judge the Quality of an Objective Classroom Test Technical Bulletin #6 Evaluation and Examination Service The University of Iowa (319) 335-0356 HOW TO JUDGE THE QUALITY OF AN OBJECTIVE CLASSROOM

More information

Major Milestones, Team Activities, and Individual Deliverables

Major Milestones, Team Activities, and Individual Deliverables Major Milestones, Team Activities, and Individual Deliverables Milestone #1: Team Semester Proposal Your team should write a proposal that describes project objectives, existing relevant technology, engineering

More information

Pharmaceutical Medicine

Pharmaceutical Medicine Specialty specific guidance on documents to be supplied in evidence for an application for entry onto the Specialist Register with a Certificate of Eligibility for Specialist Registration (CESR) Pharmaceutical

More information

Instructor: Mario D. Garrett, Ph.D. Phone: Office: Hepner Hall (HH) 100

Instructor: Mario D. Garrett, Ph.D.   Phone: Office: Hepner Hall (HH) 100 San Diego State University School of Social Work 610 COMPUTER APPLICATIONS FOR SOCIAL WORK PRACTICE Statistical Package for the Social Sciences Office: Hepner Hall (HH) 100 Instructor: Mario D. Garrett,

More information

Unit 7 Data analysis and design

Unit 7 Data analysis and design 2016 Suite Cambridge TECHNICALS LEVEL 3 IT Unit 7 Data analysis and design A/507/5007 Guided learning hours: 60 Version 2 - revised May 2016 *changes indicated by black vertical line ocr.org.uk/it LEVEL

More information

Be aware there will be a makeup date for missed class time on the Thanksgiving holiday. This will be discussed in class. Course Description

Be aware there will be a makeup date for missed class time on the Thanksgiving holiday. This will be discussed in class. Course Description HDCN 6303-METHODS: GROUP COUNSELING Department of Counseling and Dispute Resolution Southern Methodist University Thursday 6pm 10:15pm Jan Term 2013-14 Be aware there will be a makeup date for missed class

More information

Evidence-based Practice: A Workshop for Training Adult Basic Education, TANF and One Stop Practitioners and Program Administrators

Evidence-based Practice: A Workshop for Training Adult Basic Education, TANF and One Stop Practitioners and Program Administrators Evidence-based Practice: A Workshop for Training Adult Basic Education, TANF and One Stop Practitioners and Program Administrators May 2007 Developed by Cristine Smith, Beth Bingman, Lennox McLendon and

More information

CEFR Overall Illustrative English Proficiency Scales

CEFR Overall Illustrative English Proficiency Scales CEFR Overall Illustrative English Proficiency s CEFR CEFR OVERALL ORAL PRODUCTION Has a good command of idiomatic expressions and colloquialisms with awareness of connotative levels of meaning. Can convey

More information

GRANT WOOD ELEMENTARY School Improvement Plan

GRANT WOOD ELEMENTARY School Improvement Plan GRANT WOOD ELEMENTARY 2014-15 School Improvement Plan Building Leadership Team Cindy Stock and Nicole Shaw, BLT Co-Chairs Lisa Johnson, Kindergarten Liz Altemeier, First Grade Megan Goldensoph, Third Grade

More information

MADERA SCIENCE FAIR 2013 Grades 4 th 6 th Project due date: Tuesday, April 9, 8:15 am Parent Night: Tuesday, April 16, 6:00 8:00 pm

MADERA SCIENCE FAIR 2013 Grades 4 th 6 th Project due date: Tuesday, April 9, 8:15 am Parent Night: Tuesday, April 16, 6:00 8:00 pm MADERA SCIENCE FAIR 2013 Grades 4 th 6 th Project due date: Tuesday, April 9, 8:15 am Parent Night: Tuesday, April 16, 6:00 8:00 pm Why participate in the Science Fair? Science fair projects give students

More information

SCIENCE AND TECHNOLOGY 5: HUMAN ORGAN SYSTEMS

SCIENCE AND TECHNOLOGY 5: HUMAN ORGAN SYSTEMS SCIENCE AND TECHNOLOGY 5: HUMAN ORGAN SYSTEMS NAME: This booklet is an in-class assignment; you must complete all pages during the class work periods provided. You must use full sentences for all sections

More information

Susan K. Woodruff. instructional coaching scale: measuring the impact of coaching interactions

Susan K. Woodruff. instructional coaching scale: measuring the impact of coaching interactions Susan K. Woodruff instructional coaching scale: measuring the impact of coaching interactions Susan K. Woodruff Instructional Coaching Group swoodruf@comcast.net Instructional Coaching Group 301 Homestead

More information

Basic Standards for Residency Training in Internal Medicine. American Osteopathic Association and American College of Osteopathic Internists

Basic Standards for Residency Training in Internal Medicine. American Osteopathic Association and American College of Osteopathic Internists Basic Standards for Residency Training in Internal Medicine American Osteopathic Association and American College of Osteopathic Internists BOT Rev. 2/2011 TABLE OF CONTENTS I. Introduction... 3 II Mission...

More information

EDEXCEL FUNCTIONAL SKILLS PILOT TEACHER S NOTES. Maths Level 2. Chapter 4. Working with measures

EDEXCEL FUNCTIONAL SKILLS PILOT TEACHER S NOTES. Maths Level 2. Chapter 4. Working with measures EDEXCEL FUNCTIONAL SKILLS PILOT TEACHER S NOTES Maths Level 2 Chapter 4 Working with measures SECTION G 1 Time 2 Temperature 3 Length 4 Weight 5 Capacity 6 Conversion between metric units 7 Conversion

More information

TEKS Resource System. Effective Planning from the IFD & Assessment. Presented by: Kristin Arterbury, ESC Region 12

TEKS Resource System. Effective Planning from the IFD & Assessment. Presented by: Kristin Arterbury, ESC Region 12 TEKS Resource System Effective Planning from the IFD & Assessments Presented by: Kristin Arterbury, ESC Region 12 karterbury@esc12.net, 254-297-1115 Assessment Curriculum Instruction planwithifd.wikispaces.com

More information

Developing Students Research Proposal Design through Group Investigation Method

Developing Students Research Proposal Design through Group Investigation Method IOSR Journal of Research & Method in Education (IOSR-JRME) e-issn: 2320 7388,p-ISSN: 2320 737X Volume 7, Issue 1 Ver. III (Jan. - Feb. 2017), PP 37-43 www.iosrjournals.org Developing Students Research

More information

OVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE

OVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE OVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE Mark R. Shinn, Ph.D. Michelle M. Shinn, Ph.D. Formative Evaluation to Inform Teaching Summative Assessment: Culmination measure. Mastery

More information

USF Course Change Proposal Global Citizens Project

USF Course Change Proposal Global Citizens Project This printable form is provided as a resource only for use when collaborating with colleagues or to view the fields required to submit a course proposal. To create a course proposal, login to the system

More information

The College Board Redesigned SAT Grade 12

The College Board Redesigned SAT Grade 12 A Correlation of, 2017 To the Redesigned SAT Introduction This document demonstrates how myperspectives English Language Arts meets the Reading, Writing and Language and Essay Domains of Redesigned SAT.

More information

Outcome Based Education 15/01/2012

Outcome Based Education 15/01/2012 If you are, you breathe. If you breathe, you talk. If you talk, you ASK.. If you ask, you THINK. If you think, you SEARCH.. If you search, you EXPERIENCE. If you experience, you LEARN.. If you learn, you

More information

AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS

AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS 1 CALIFORNIA CONTENT STANDARDS: Chapter 1 ALGEBRA AND WHOLE NUMBERS Algebra and Functions 1.4 Students use algebraic

More information

MASTER S THESIS GUIDE MASTER S PROGRAMME IN COMMUNICATION SCIENCE

MASTER S THESIS GUIDE MASTER S PROGRAMME IN COMMUNICATION SCIENCE MASTER S THESIS GUIDE MASTER S PROGRAMME IN COMMUNICATION SCIENCE University of Amsterdam Graduate School of Communication Kloveniersburgwal 48 1012 CX Amsterdam The Netherlands E-mail address: scripties-cw-fmg@uva.nl

More information

Learning Lesson Study Course

Learning Lesson Study Course Learning Lesson Study Course Developed originally in Japan and adapted by Developmental Studies Center for use in schools across the United States, lesson study is a model of professional development in

More information

ECE-492 SENIOR ADVANCED DESIGN PROJECT

ECE-492 SENIOR ADVANCED DESIGN PROJECT ECE-492 SENIOR ADVANCED DESIGN PROJECT Meeting #3 1 ECE-492 Meeting#3 Q1: Who is not on a team? Q2: Which students/teams still did not select a topic? 2 ENGINEERING DESIGN You have studied a great deal

More information

Secondary English-Language Arts

Secondary English-Language Arts Secondary English-Language Arts Assessment Handbook January 2013 edtpa_secela_01 edtpa stems from a twenty-five-year history of developing performance-based assessments of teaching quality and effectiveness.

More information

West Georgia RESA 99 Brown School Drive Grantville, GA

West Georgia RESA 99 Brown School Drive Grantville, GA Georgia Teacher Academy for Preparation and Pedagogy Pathways to Certification West Georgia RESA 99 Brown School Drive Grantville, GA 20220 770-583-2528 www.westgaresa.org 1 Georgia s Teacher Academy Preparation

More information

Biology 1 General Biology, Lecture Sections: 47231, and Fall 2017

Biology 1 General Biology, Lecture Sections: 47231, and Fall 2017 Instructor: Rana Tayyar, Ph.D. Email: rana.tayyar@rcc.edu Website: http://websites.rcc.edu/tayyar/ Office: MTSC 320 Class Location: MTSC 401 Lecture time: Tuesday and Thursday: 2:00-3:25 PM Biology 1 General

More information

University of Texas at Tyler Nutrition Course Syllabus Summer II 2017 ALHS

University of Texas at Tyler Nutrition Course Syllabus Summer II 2017 ALHS University of Texas at Tyler Nutrition Course Syllabus Summer II 2017 ALHS 1315.460 Instructor: Dr. Jimi Francis, PhD, IBCLC, RDN, LD Office HPC 3100 Office Hours: By appointment Phone: 903-565-5522 E-mail:

More information

TUCSON CAMPUS SCHOOL OF BUSINESS SYLLABUS

TUCSON CAMPUS SCHOOL OF BUSINESS SYLLABUS TUCSON CAMPUS SCHOOL OF BUSINESS SYLLABUS 1. Mission Statement: Wayland Baptist University exists to educate students in an academically challenging, learningfocused and distinctively Christian environment

More information

TCH_LRN 531 Frameworks for Research in Mathematics and Science Education (3 Credits)

TCH_LRN 531 Frameworks for Research in Mathematics and Science Education (3 Credits) Frameworks for Research in Mathematics and Science Education (3 Credits) Professor Office Hours Email Class Location Class Meeting Day * This is the preferred method of communication. Richard Lamb Wednesday

More information

Missouri Mathematics Grade-Level Expectations

Missouri Mathematics Grade-Level Expectations A Correlation of to the Grades K - 6 G/M-223 Introduction This document demonstrates the high degree of success students will achieve when using Scott Foresman Addison Wesley Mathematics in meeting the

More information

Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses

Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Thomas F.C. Woodhall Masters Candidate in Civil Engineering Queen s University at Kingston,

More information

Introduction to Psychology

Introduction to Psychology Course Title Introduction to Psychology Course Number PSYCH-UA.9001001 SAMPLE SYLLABUS Instructor Contact Information André Weinreich aw111@nyu.edu Course Details Wednesdays, 1:30pm to 4:15pm Location

More information

CLASSIFICATION OF PROGRAM Critical Elements Analysis 1. High Priority Items Phonemic Awareness Instruction

CLASSIFICATION OF PROGRAM Critical Elements Analysis 1. High Priority Items Phonemic Awareness Instruction CLASSIFICATION OF PROGRAM Critical Elements Analysis 1 Program Name: Macmillan/McGraw Hill Reading 2003 Date of Publication: 2003 Publisher: Macmillan/McGraw Hill Reviewer Code: 1. X The program meets

More information

MYCIN. The MYCIN Task

MYCIN. The MYCIN Task MYCIN Developed at Stanford University in 1972 Regarded as the first true expert system Assists physicians in the treatment of blood infections Many revisions and extensions over the years The MYCIN Task

More information

BENCHMARK TREND COMPARISON REPORT:

BENCHMARK TREND COMPARISON REPORT: National Survey of Student Engagement (NSSE) BENCHMARK TREND COMPARISON REPORT: CARNEGIE PEER INSTITUTIONS, 2003-2011 PREPARED BY: ANGEL A. SANCHEZ, DIRECTOR KELLI PAYNE, ADMINISTRATIVE ANALYST/ SPECIALIST

More information

Chapter 9 The Beginning Teacher Support Program

Chapter 9 The Beginning Teacher Support Program Chapter 9 The Beginning Teacher Support Program Background Initial, Standard Professional I (SP I) licenses are issued to teachers with fewer than three years of appropriate teaching experience (normally

More information

Reading Grammar Section and Lesson Writing Chapter and Lesson Identify a purpose for reading W1-LO; W2- LO; W3- LO; W4- LO; W5-

Reading Grammar Section and Lesson Writing Chapter and Lesson Identify a purpose for reading W1-LO; W2- LO; W3- LO; W4- LO; W5- New York Grade 7 Core Performance Indicators Grades 7 8: common to all four ELA standards Throughout grades 7 and 8, students demonstrate the following core performance indicators in the key ideas of reading,

More information

An Analysis of the Early Assessment Program (EAP) Assessment for English

An Analysis of the Early Assessment Program (EAP) Assessment for English An Analysis of the Early Assessment Program (EAP) Assessment for English Conducted by Achieve on behalf of the California Diploma Project (ADP) and Policy Analysis for California Education (PACE) October

More information

Practice Examination IREB

Practice Examination IREB IREB Examination Requirements Engineering Advanced Level Elicitation and Consolidation Practice Examination Questionnaire: Set_EN_2013_Public_1.2 Syllabus: Version 1.0 Passed Failed Total number of points

More information

Shank, Matthew D. (2009). Sports marketing: A strategic perspective (4th ed.). Upper Saddle River, NJ: Pearson/Prentice Hall.

Shank, Matthew D. (2009). Sports marketing: A strategic perspective (4th ed.). Upper Saddle River, NJ: Pearson/Prentice Hall. BSM 2801, Sport Marketing Course Syllabus Course Description Examines the theoretical and practical implications of marketing in the sports industry by presenting a framework to help explain and organize

More information

SPECIALIST PERFORMANCE AND EVALUATION SYSTEM

SPECIALIST PERFORMANCE AND EVALUATION SYSTEM SPECIALIST PERFORMANCE AND EVALUATION SYSTEM (Revised 11/2014) 1 Fern Ridge Schools Specialist Performance Review and Evaluation System TABLE OF CONTENTS Timeline of Teacher Evaluation and Observations

More information

Demystifying The Teaching Portfolio

Demystifying The Teaching Portfolio Demystifying The Teaching Portfolio Faculty Development Workshop January 24, 2012 Helen Emery, MD Andrew Luks, MD Mark Whipple MD On behalf of the 2006-07 Teaching Scholars Cohort Helen Emery, MD Andrew

More information

Number of students enrolled in the program in Fall, 2011: 20. Faculty member completing template: Molly Dugan (Date: 1/26/2012)

Number of students enrolled in the program in Fall, 2011: 20. Faculty member completing template: Molly Dugan (Date: 1/26/2012) Program: Journalism Minor Department: Communication Studies Number of students enrolled in the program in Fall, 2011: 20 Faculty member completing template: Molly Dugan (Date: 1/26/2012) Period of reference

More information

Developing True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability

Developing True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability Developing True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability Shih-Bin Chen Dept. of Information and Computer Engineering, Chung-Yuan Christian University Chung-Li, Taiwan

More information

Ohio s New Learning Standards: K-12 World Languages

Ohio s New Learning Standards: K-12 World Languages COMMUNICATION STANDARD Communication: Communicate in languages other than English, both in person and via technology. A. Interpretive Communication (Reading, Listening/Viewing) Learners comprehend the

More information

George Mason University Graduate School of Education Education Leadership Program. Course Syllabus Spring 2006

George Mason University Graduate School of Education Education Leadership Program. Course Syllabus Spring 2006 George Mason University Graduate School of Education Education Leadership Program Course Syllabus Spring 2006 COURSE NUMBER AND TITLE: EDLE 610: Leading Schools and Communities (3 credits) INSTRUCTOR:

More information

EEX Exceptional People: School and Society Spring Table of Contents

EEX Exceptional People: School and Society Spring Table of Contents EEX 3093--Exceptional People: School and Society Spring 2015 Table of Contents Topic Page Number Course Calendar 2-7 Course site 8 Contact Information 8 Text 8 Class Procedures 8 Students with Disabilities

More information

Diagnostic Test. Middle School Mathematics

Diagnostic Test. Middle School Mathematics Diagnostic Test Middle School Mathematics Copyright 2010 XAMonline, Inc. All rights reserved. No part of the material protected by this copyright notice may be reproduced or utilized in any form or by

More information

Protocol for using the Classroom Walkthrough Observation Instrument

Protocol for using the Classroom Walkthrough Observation Instrument Protocol for using the Classroom Walkthrough Observation Instrument Purpose: The purpose of this instrument is to document technology integration in classrooms. Information is recorded about teaching style

More information

Writing Functional Dysphagia Goals

Writing Functional Dysphagia Goals Writing Functional Dysphagia Goals Free PDF ebook Download: Writing Functional Dysphagia Goals Download or Read Online ebook writing functional dysphagia goals in PDF Format From The Best User Guide Database

More information

What is Thinking (Cognition)?

What is Thinking (Cognition)? What is Thinking (Cognition)? Edward De Bono says that thinking is... the deliberate exploration of experience for a purpose. The action of thinking is an exploration, so when one thinks one investigates,

More information

Indiana Collaborative for Project Based Learning. PBL Certification Process

Indiana Collaborative for Project Based Learning. PBL Certification Process Indiana Collaborative for Project Based Learning ICPBL Certification mission is to PBL Certification Process ICPBL Processing Center c/o CELL 1400 East Hanna Avenue Indianapolis, IN 46227 (317) 791-5702

More information

Evaluation of Teach For America:

Evaluation of Teach For America: EA15-536-2 Evaluation of Teach For America: 2014-2015 Department of Evaluation and Assessment Mike Miles Superintendent of Schools This page is intentionally left blank. ii Evaluation of Teach For America:

More information

Modified Systematic Approach to Answering Questions J A M I L A H A L S A I D A N, M S C.

Modified Systematic Approach to Answering Questions J A M I L A H A L S A I D A N, M S C. Modified Systematic Approach to Answering J A M I L A H A L S A I D A N, M S C. Learning Outcomes: Discuss the modified systemic approach to providing answers to questions Determination of the most important

More information