Improving the Evaluation of Interprofessional Education: Moving beyond Attitudinal Measures
|
|
- Ambrose Edwards
- 6 years ago
- Views:
Transcription
1 Improving the Evaluation of Interprofessional Education: Moving beyond Attitudinal Measures VIRGINIA COMMONWEALTH UNIVERSITY UNIVERSITY OF CALIFORNIA SAN FRANCISCO OREGON HEALTH & SCIENCE UNIVERSITY
2 Panel Agenda Virginia Commonwealth University: Use of multisource data to evaluate classroom-based IPE for early learners University of California, San Francisco: Multisource feedback in a longitudinal clinical skills course where medical students are embedded in an interprofessional clinical team Multisource feedback for students and residents who are trained in a patient-centered medical home Oregon Health & Science University: Multisource data for evaluating a large, national study focused on implementing IPE in primary care physician residency continuity clinics Use of Q methodology to evaluate rural IPE
3 Use of Multisource Data to Evaluate Classroom-based IPE for Early Learners Kelly Lockeman, PhD Virginia Commonwealth University
4 Background Two large-scale required IPE courses Fall: Foundations of Interprofessional Practice Spring: Interprofessional Quality Improvement and Patient Safety Classroom-based 1 credit each, pass/fail grading ~500 students each semester 88 interprofessional teams faculty facilitators
5 Assessment Challenges Many Students Few Faculty Limited Time Assessing individual students is resource intensive.
6
7 Our Approach To Assessment Use student learning objectives as a guide. Measure outcomes of individual students and teams. Build measures into course activities. Use validated measures when feasible. Assess validity for course-specific measures. Utilize measures that are easily scored. Provide formative feedback for students. Iterate!
8 Typical Assessment Measures Learner Team Knowledge Quizzes Work products Skills/Performance Attitudes Self-assessment Peer assessment Self-report using validated tools (e.g., SPICE-R2) Work products (Aggregate) Self-report using validated tools (e.g., TDM) Narrative reflections
9 Sample Findings: Individual Learners KNOWLEDGE: Average quiz score 85% (passing = 70%) SKILLS/PERFORMANCE: Peer assessment: Scores depend on rating method Rubric with rating criteria scores highly skewed Budget-based approach normal distribution that clearly identifies low and high performers Self-assessment: Correlates w/ budget-based peer assessment (r =.61, p <.001) ATTITUDES: Significant increase on SPICE-R2 (pre/post)
10 Sample Findings: Teams KNOWLEDGE: Depiction of collaborative care in team work products suggests poor understanding of IPC SKILLS/PERFORMANCE: High scores suggest they can use teamwork to complete tasks effectively ATTITUDES: Students acknowledge the need for and value IPE. Comments suggest that interprofessional socialization as a primary outcome.
11 Considerations Correlation between individual measures is low. Knowledge Skills/Performance Attitudes Students (and faculty) don't know they are lousy assessors. Peer assessment requires practice. Interrater reliability between faculty is challenging. Qualitative analysis of narrative reflections is resource intensive.
12 Conclusions Data from multiple sources useful information for program evaluation, but Keep seeking evidence for validity Review data annually and revise measures as needed Draw from the experience of other institutions Focus on faculty development
13 Thank you! For more information Visit our website: Follow us: Facebook: Contact me directly: Kelly Lockeman, PhD Director of Evaluation and Assessment VCU Center for Interprofessional Education and Collaborative Care
14 An Interprofessional Multi- Source Feedback Tool for Early Learners: Lessons Learned from a Pilot Study Josette Rivera, MD Associate Professor of Medicine Department of Medicine University of California, San Francisco
15 The UCSF Bridges Curriculum To prepare the 21st century physician to work collaboratively in promoting health and reducing suffering while continually improving our health care system Guiding Principles Integration into Interprofessional Collaborative Care Immersion in Authentic Workplace Learning Engagement with Health Care Delivery Systems Campus-wide 5 quarter IPE curriculum, SOM additional IPE coursework 6/19/2015
16 The Clinical Microsystem Clerkship (CMC) Who Medical students (150): First 18 months Faculty coaches (25): each assigned 6 students. Teach direct patient care skills, shepherd students through their microsystems projects Staff: members of the healthcare team and other staff in the microsystem What Students embedded in a clinical microsystem one day/week throughout SF Quality improvement, direct patient care skills, interprofessional collaboration Systems-based project in the microsystem
17 an interprofessional collaboration (IPC) assessment tool for CMC and beyond Opportunity: assess relevant student behaviors in clinical settings Goal: formative assessment at multiple time points, emphasize importance of IPC to students and coaches Considerations: # items, narrative vs. rating scales, #/timing of assessments, # raters, training of raters Tensions: raters in diverse hectic clinical environments, infeasible to train, avoid rating scales causing reluctance to judge Gap: brief, narrative, formative assessment, not setting or specialty specific
18 The Multi-source Feedback Tool Tool Consider both observations & direct interactions with the student Identify their profession Questions: What does X do well to collaborate with other health professionals? What could X improve to collaborate more effectively with other health professionals? Did you work with this student: On their systems improvement project? To provide patient care? Both? Please estimate the number of days you interacted with this student Process Students identify and request feedback from one non-md in their microsystem Request feedback in fall and spring; not required to have same raters Coaches review feedback with individual students, develop individualized plan/goals
19 Compliance Fall 2016: 152 students 111 completed (73%) 41 missing Spring 2017: 152 students 106 completed (70%) 46 missing 9/152 (6%) never received feedback -> written reflection on why Projects only involved physicians Setting chaotic with rotating team members, non-overlapping schedules, only brief interactions
20 Fall 2017 Results 98/111 (88%) raters had 1-8 days of interaction with student Majority positive; only 18 students received constructive feedback desire to understand the job descriptions/responsibilities of each health care professional and is open to seeing how every member of the health care team can contribute never hesitates to reach out to different health care providers for their perspectives or recommendations Good at sharing his ideas and asking for feedback explains his thought processes yet accepts constructive criticism and uses it to improve
21 Spring 2017 Results 86/106 (81%) 1-8 days of interaction with student; 11/106 (10%) >13 days Many more students (35) received constructive feedback become more vocal and express your ideas and thoughts improve upon finding your own unique professional voice and speaking up more in larger interdisciplinary meetings Don t be afraid to make a mistake. You don't need to be perfect and you don't need to know everything. Keep asking questions and continue to put yourself out there.
22 Lessons Learned Feasible: optimistic can increase compliance due to lessons learned Useful: thoughtful & fairly specific feedback without rater training Messaging as important as the tool itself s to students, coaches, and staff explaining purpose of tool Emphasize formative for student development First iteration in fall too early: insufficient contact with others This year->earlier messaging to new coaches, push timeline back
23 Implications for Program Evaluation Although an explicit course expectation, some students not interacting with other professionals in their microsystem Qualitative study with student interviews Outside of projects and assignments, IP interactions did not happen spontaneously or organically Students reluctant to disturb busy staff Coach discussions reveal buy-in and guidance needed Interview microsystem stakeholders to determine what/how students contributed to the microsystem
24 Next Steps Include more structured activities early on to facilitate IP interactions (more team member interviews/shadowing opportunities) Faculty development for current and future coaches Tips for coaches by coaches (ex. select projects that facilitate IP interactions) Workshops on IPE and the hidden curriculum Setting expectations: assist students with compliance, review feedback Expand use of multi-source feedback tool to select clerkships in 3 rd /4 th years Demonstrate trajectory Consistent assessment, continued emphasis on importance of IPC in all 4 years
25 Questions?
26 Multi-level Evaluation of IPE in the Workplace Individuals, Teams, Systems Bridget O Brien, PhD Center for Faculty Educators & Dept of Medicine, University of California, San Francisco Center of Excellence in Primary Care Education, San Francisco VAMC
27 2 San Francisco VA EdPACT Program The Workplace Primary Care clinics for Veterans IP Team-based model of care 3 clinic sites ~18,000 patients The Educational Program Integrated with the clinics Learners part of clinic teams Curriculum emphasizes communication, relationships, & systems MSA NP Student RN Social Work PACT Patient TEAM LVN Pharm Mental Health IM Residen t
28 IPE: An Individual and Collective Enterprise EdPACT evaluation must address goals and objectives of Each professional program: individual competence in communication, interpersonal, and teamwork skills VA primary care clinic: collective competence in team-based care
29 Individual Performance in a Team Evaluation Question Does EdPACT help learners achieve competence in team-based care? Communication, Collaboration, Empowering team members, Situational Awareness Multi-source Feedback Formative assessment to individual learners Aggregate data for program evaluation Instrument Modified version of American Board of Internal Medicine multi-source feedback tool (TEAM) 1 Covers domains such as giving & receiving feedback; respect; empowering others Process All team members rate each learner on the team Learners self-assess using same survey Learners receive a report of their results and review with a faculty member Chesluk BJ et al, 2012 Health Affairs; Chesluk BJ et al, 2015 J Cont Ed Health Prof 2016 Education Showcase
30 Individual Performance in a Team: Example 2016 Education Showcase
31 Program Evaluation: Individual Performance in a Team Does EdPACT help learners achieve competence in team-based care? In 2017, 36 learners rated per year by 63 team members (~80% response rate) Learners rate own performance highest in empowering others and relational domains (respect, acknowledging others contributions), lowest in seeking and giving feedback Team members generally rate learners performance higher than learners rate themselves; similar patterns of highest and lowest performance seeking and giving feedback lowest Implications Broadly focus on feedback Customized learning goals for each learner Communication with team Self-awareness 31
32 Interprofessional Teamwork Evaluation Question To what extent are teams achieving cohesiveness, effective communication, role clarity, clear goals? Team Development Formative feedback for teams to review and use for improvement Program level feedback to address culture, coaching, etc Instrument Team Development Measure 1 Process Administered twice per year Teams review reports and have opportunities to discuss 1 Stock et al, 2013; Survey available at: Education Showcase
33 2016 Education Showcase Interprofessional Teamwork: Example
34 2016 Education Showcase Program Evaluation: Interprofessional Teamwork To what extent are teams achieving cohesiveness, effective communication, role clarity, clear goals? 57 teams over the past 6 years, 8-10 per year 194 out of 247 (79%) individual responses; Response rate within team: 50% to 100% TDM scores range from 55 to 89 Generally increase from fall to spring Spring scores were lowest in 2012 (64.9), peaked in 2013 (70.8), gradually fell (67.8) Scores consistently highest in communication, then cohesiveness, role clarity, goal clarity Huddle coaches & trainees rated goal clarity lower, on average, than other team members Teams with higher TDM scores tend to have more dispersed distribution of responses Implications Consider workplace factors staff turnover, shortages Additional team building activities
35 A Systems-Based Assessment Framework 1 for IPE? Level 3: System readiness for future change -What changes can we anticipate and do our teams and metrics align with these changes? Level 2: Program performance -Is the program & clinic meeting current expectations? Level 1: Individual curriculum components & stakeholders -Are learners & teams meeting expectations? Bowe C, Armstrong E. Assessment for systems learning. Acad Med. 2017; 92:
36 Education Showcase 10/1 Acknowledgements Support for the SFVA Center of Excellence for Primary Care Education is provided by the Veterans Affairs Office of Academic Affiliations Many thanks to the team members who complete the survey each year and to our data manager, Gillian Earnest, who collects and compiles these data THANK YOU!
37 Improving the Evaluation of Interprofessional Education: Moving Beyond Attitudinal Measures Patricia (Patty) Carney, PhD Professor of Family Medicine Oregon Health & Science University
38 PACER (Professionals Accelerating Clinical & Educational Redesign) 3 Year Quasi-Experimental Study Designed to Improve IPE and Co-Learning Among the # Primary Care Disciplines Family Medicine General Internal Medicine General Pediatrics Funded by the Foundations of the ABFM, ABIM, ABP, Josiah Macy Jr. Foundation, ACGME
39 PACER MAP of Sites 27 continuity clinics at 9 institutions across the U.S.
40 Learners included in PACER - FM, IM, Peds Residents & Faculty - PA Students - NP Students - MA Students - Behavioral Health Students - Pharmacy Students
41 Evaluation Design Mixed Methods Approach (Qualitative/Quantitative) - Design is Pre-Post Test Repeated Measures (Quasi-Experimental) No Recreational Data Collection!!!
42 Core Data Collection Instruments Quantitative PACER Training Post Program Survey Attendance logs PCMH Monitor Continuity Clinic Survey Educational Program Survey Faculty Skills Self-Assessment Survey Qualitative Key Informant interviews (Telephone) Focus Groups (at site visits) Direct Observations (collected via Field notes) at site visits and all joint activities
43 Instrument Domains # of Variables Post Program Survey Session quality Overall usefulness Intention to make changes at institution Patient-Centered Medical Home Monitor - Validated - 7 Domains Leadership and engagement QI Team Process Data capacity Patient self-management support Team-based care Cost containment and care management Access and continuity Continuity Clinic Survey Practice characteristics Patient population Educational Program Survey Learning community activities Coaching Activities/ assessment Practice re-design efforts Training re-design efforts Sustainability activities Sustainability and dissemination Faculty Skills Self-Assessment Survey Interprofessional care and education Leadership for change Patient-centered care Stewardship of resources Competency assessment skills Individual characteristics
44
45 Longitudinal Coaching Key component of this project Coaches will attend the collaborative site visits Coaching calls planned quarterly Collecting data as part of these calls and during the collaborative site visits
46 Collaborative Site Visits Provide a Check in opportunity Designed as a Learning Community NOT an Audit Formal Progress Report produced using all contacts and used for evaluation
47
48 First paper fully drafted: The Educational Value of Interprofessional Learners Applying their Developing Team-based Care Skills in Primary Care Ambulatory Training Settings Benefits of Co-learning: Development of Personal Relationships Improved Education, Improved Patient Care Improved Job Satisfaction Enablers of Perceived Benefits: Clinic Culture With open Leadership Empoweres TBC Systemic Factors Clinic layout that fostered TBC (e.g., places to huddle and co-work) Barriers of Realizing Perceived Benefits: Clinic Culture With Top Down Leadership Stymies TBC Systemic Factors Clinic layout that inhibited TBC (e.g., no co-learning space)
49 We are having more fun than we ve ever had in our lives
50 Use of Q methodology to evaluate rural IPE Curt Stilp, EdD, PA-C Director, Oregon Area Health Education Center (AHEC) Assistant Professor, Physician Assistant Program Oregon Health & Science University Portland, Oregon
51 Rural IPE Study Purpose Examine how rural IPE influences student perspectives Search for shared perspectives Rural life Rural team-based care What factors form the perspective
52 Q Method Research Question What factors do students participating in a rural IPE experience consider most important and least important in making a decision to practice teambased care in a rural setting?
53
54 Q Methodology Stephenson, 1953; Brown, 1993 Concourse (Rural, Team-based care, Rural IPE) Literature Previous student s rural IPE journals Q set Set of statements representing thoughts, ideas, opinions on the topic
55 Q Set Statement Category Source 35 total statements 17 - student journals 18 - literature 4 5 from each category Time and sustained presence in a community helped build trust and familiarity. Working together in the clinic serves as great peer support that is needed. Rural communities have limited funds which restrict what care can be provided. IPE leads to a greater understanding of my own role on the health care team. Social Henry & Hooker, 2007 Team Student reflection journal Community Student reflection journal Team Ponzer et al., 2004 The availability of outdoor activities attracts me to the rural setting. Personal Student reflection journal The most effective rural IPE allows for engagement in the community. Education Deutchman et al., 2012
56 Q Sort Post-experience sorting of statements using FlashQ software Sorting grid Most agree Most disagree Subjective ordering of statements in relation to each other and the experience Reveals perspectives
57 Q Sort
58 Data Collection Rural IPE students Two rural locations Four health care professions MD, PA, Dental, Pharmacy 15 from each location 45 participants
59 Q Sort Demographics Late twenties (mean 28.5) Majority PA students (24) Near even split female and male (22 and 23) Majority married/partnered without children (24) Majority not from a rural background (27) Majority were in Coos Bay (28)
60 Q sort Interpretation Factor Analysis Four-step process 1. Correlation 2. Rotation 3. Factor scores 4. Factor array Representative Q sort of participants who sorted similarly shared perspective
61 Q sort Interpretation Factor Analysis Three Perspectives 1. The Team-Oriented Rural Optimist + Team, age, profession, length of time Living together, resources, project, community connection 2. The Independent Rural Impartial + Isolation from family/friends, natural resources, length of time Project, community engagement, team-based approach 3. The Team-Willing Rural Skeptic + First-hand experience, no children, location, length of time Recreation, profession, clinical environment, community
62 Study Conclusions General Rural IPE is useful for understanding rural life and making decisions about where to live and work after graduation Rural IPE needs to have a sustained presence Connection between community involvement and decision to return Specific Rural IPE motivates students to return to practice team-based care Feeling of isolation/remoteness deter a student from returning Rural heritage leads to increased likelihood a student will return
63 Limitations Only 4 health care professions No correlation between qualitative and quantitative No educational sequence data Bias in Q statement development
64 Thank you!
65 Questions & Discussion Alan Dow, MD, MSHA Assistant Vice President of Health Sciences for Interprofessional Education & Collaborative Care Virginia Commonwealth University
The patient-centered medical
Primary Care Residents Want to Learn About the Patient- Centered Medical Home Gerardo Moreno, MD, MSHS; Julia Gold, MD; Maureen Mavrinac, MD BACKGROUND AND OBJECTIVES: The patient-centered medical home
More informationHSC/SOM GOAL 1: IMPROVE HEALTH AND HEALTHCARE IN THE POPULATIONS WE SERVE.
SOM STRATEGIC PLAN 2017-2020 (with metrics/action plan for 2018) revised 8/30/17 HSC/SOM GOAL 1: IMPROVE HEALTH AND HEALTHCARE IN THE POPULATIONS WE SERVE. Measure of success: Improvement in state ranking
More informationInterprofessional Education Assessment Strategies
Interprofessional Education Assessment Strategies December 2, 2016 Webinar Moderated by: Melissa Dinkins, PharmD Presenters! John H. Tegzes, MA, VMD, Dipl. ABVT! Heather B. Congdon, PharmD, BCPS, CDE!
More informationIMSH 2018 Simulation: Making the Impossible Possible
IMSH 2018 Simulation: Making the Impossible Possible You do it every day. You tackle difficult - sometimes seemingly impossible circumstances as you work to improve patient care through simulation-based
More informationSurgical Residency Program & Director KEN N KUO MD, FACS
Surgical Residency Program & Director KEN N KUO MD, FACS 1 Taiwan Surgical Association Residency Director Meeting September 17, 2011 November 5, 2011 2 Three Stages of Education Undergraduate medical education
More informationPathways to Health Professions of the Future
Pathways to Health Professions of the Future Stephen C. Shannon, DO, MPH American Association of Colleges of Osteopathic Medicine Copyright 2014 AACOM, all rights reserved. Photo courtesy of LECOM The
More informationAssessment System for M.S. in Health Professions Education (rev. 4/2011)
Assessment System for M.S. in Health Professions Education (rev. 4/2011) Health professions education programs - Conceptual framework The University of Rochester interdisciplinary program in Health Professions
More informationRC-FM Staff. Objectives 4/22/2013. Geriatric Medicine: Update from the RC-FM. Eileen Anthony, Executive Director; ;
Geriatric Medicine: Update from the RC-FM American Geriatric Society 2013 Annual Meeting Grapevine, TX Peter J. Carek, MD, MS - Chair, RC - FM Eileen Anthony - Executive Director RC-FM Staff Eileen Anthony,
More informationLongitudinal Integrated Clerkship Program Frequently Asked Questions
Longitudinal Integrated Clerkship Program Frequently Asked Questions The University of Vermont Larner College of Medicine offers a rural longitudinal integrated clerkship (LIC) at the Hudson Headwaters
More informationProgram Curriculum. Organ Systems Block 2 Neuro/Behavior/MS/Derm. Comprehensive Assessment 1 week. Modules weeks
Primary Care Program (PC-ACT) Mercer University School of Medicine Christina Kelly, MD, FAAFP and Robert Pallay, MD, FAAFP Program Overview The Mercer University School of Medicine (MUSM) Primary Care
More informationTHE UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT HOUSTON MCGOVERN MEDICAL SCHOOL CATALOG ADDENDUM
THE UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT HOUSTON MCGOVERN MEDICAL SCHOOL 2016-18 CATALOG ADDENDUM Index Page I. Mission II. Fees and Charges III. Curriculum IV. Pre-Entry Program Pages 7-8 CURRENT:
More informationCommon Core Postsecondary Collaborative
Common Core Postsecondary Collaborative Year One Learning Lab April 25, 2013 Sheraton Wild Horse Pass Chandler, Arizona At this Learning Lab, we will share and discuss An Overview of Common Core Postsecondary
More informationSchool Leadership Rubrics
School Leadership Rubrics The School Leadership Rubrics define a range of observable leadership and instructional practices that characterize more and less effective schools. These rubrics provide a metric
More informationThe development of our plan began with our current mission and vision statements, which follow. "Enhancing Louisiana's Health and Environment"
The Associate Dean of Assessment and the Assessment Committee are responsible for the collection, analysis, and dissemination of data collected within the School. Sources of information include internally
More informationThe role of the physician primarily
ORIGINAL ARTICLES Incorporating Population Medicine Into Primary Care Residency Training Wayne S. Dysinger, MD, MPH; Valerie King, MD, MPH; Tina C. Foster, MD, MPH; Dominic Geffken, MD, MPH BACKGROUND
More informationContract Renewal, Tenure, and Promotion a Web Based Faculty Resource
Contract Renewal, Tenure, and Promotion a Web Based Faculty Resource Kristi Kaniho Department of Educational Technology University of Hawaii at Manoa Honolulu, Hawaii, USA kanihok@hawaii.edu Abstract:
More informationTHE UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT HOUSTON MCGOVERN MEDICAL SCHOOL CATALOG ADDENDUM
THE UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT HOUSTON MCGOVERN MEDICAL SCHOOL 2016-18 CATALOG ADDENDUM I. Fees and Charges II. Curriculum Index Page Page 17 CURRENT: Fees and Charges Computer Fee $200
More informationTools to SUPPORT IMPLEMENTATION OF a monitoring system for regularly scheduled series
RSS RSS Tools to SUPPORT IMPLEMENTATION OF a monitoring system for regularly scheduled series DEVELOPED BY the Accreditation council for continuing medical education December 2005; Updated JANUARY 2008
More informationPREPARING FOR THE SITE VISIT IN YOUR FUTURE
PREPARING FOR THE SITE VISIT IN YOUR FUTURE ARC-PA Suzanne York SuzanneYork@arc-pa.org 2016 PAEA Education Forum Minneapolis, MN Saturday, October 15, 2016 TODAY S SESSION WILL INCLUDE: Recommendations
More informationCHA/PA Newsletter. Exploring the Field of Hospitalist Medicine. CHA/PA Fall Banquet
Page 1 of 9 Current information about the CHA/PA Physician Assistant Program at the University of Colorado Denver. Is this email not displaying correctly? View it in your browser. CHA/PA Newsletter Read
More informationEngaging Faculty in Reform:
MARCH 4, 2014 Engaging Faculty in Reform: Building Buy-in, Supporting Instructional Improvement Susan Bickerstaff, Community College Research Center Heidi Johnsen, LaGuardia Community College 1 We conduct
More informationLearning Objectives by Course Matrix Objectives Course # Course Name Psyc Know ledge
APPENDICES Learning Objectives by Course Matrix Objectives Course # Course Name 1 2 3 4 5 6 7 8 9 10 Psyc Know ledge Integration across domains Psyc as Science Critical Thinking Diversity Ethics Applying
More informationMeet the Experts Fall Freebie November 5, 2015
Meet the Experts Fall Freebie November 5, 2015 Presented by: PARTNERS IN MEDICAL EDUCATION, INC. Today s Experts: Christine Redovan, MBA Heather Peters, M.Ed, Ph.D Candace DeMaris, MAIS Lauren McGuire,
More informationUsing Safety Culture to Drive Habitual Excellence. Objectives
Using Safety Culture to Drive Habitual Excellence Michael Leonard, MD September 9, 2012 Disclosure: I am a Principal in a company called Pascal Metrics Inc. that develops and implements safety metrics.
More informationTun your everyday simulation activity into research
Tun your everyday simulation activity into research Chaoyan Dong, PhD, Sengkang Health, SingHealth Md Khairulamin Sungkai, UBD Pre-conference workshop presented at the inaugual conference Pan Asia Simulation
More informationUpdate on the Next Accreditation System Drs. Culley, Ling, and Wood. Anesthesiology April 30, 2014
Accreditation Council for Graduate Medical Education Update on the Next Accreditation System Drs. Culley, Ling, and Wood Anesthesiology April 30, 2014 Background of the Next Accreditation System Louis
More informationEarly Career Awards (ECA) - Overview
ECA.D.2013.08.28 Research Development and Relations For more information contact Daniela Bianco, biancdan@hhsc.ca Early Career Awards - Application Details Early Career Awards (ECA) - Overview The Hamilton
More informationImproving recruitment, hiring, and retention practices for VA psychologists: An analysis of the benefits of Title 38
Improving recruitment, hiring, and retention practices for VA psychologists: An analysis of the benefits of Title 38 Introduction / Summary Recent attention to Veterans mental health services has again
More informationListening to your members: The member satisfaction survey. Presenter: Mary Beth Watt. Outline
Listening to your members: The satisfaction survey Listening to your members: The member satisfaction survey Presenter: Mary Beth Watt 1 Outline Introductions Members as customers Member satisfaction survey
More informationAssessing Digital Identity and Promoting Online Professionalism: Social Media and Medical Education
Assessing Digital Identity and Promoting Online Professionalism: Social Media and Medical Education Terry Kind, MD, MPH Associate Professor of Pediatrics Children s National Medical Center George Washington
More informationGUIDELINES FOR COMBINED TRAINING IN PEDIATRICS AND MEDICAL GENETICS LEADING TO DUAL CERTIFICATION
GUIDELINES FOR COMBINED TRAINING IN PEDIATRICS AND MEDICAL GENETICS LEADING TO DUAL CERTIFICATION PREAMBLE This document is intended to provide educational guidance to program directors in pediatrics and
More informationImplementing Response to Intervention (RTI) National Center on Response to Intervention
Implementing (RTI) Session Agenda Introduction: What is implementation? Why is it important? (NCRTI) Stages of Implementation Considerations for implementing RTI Ineffective strategies Effective strategies
More informationSession 2B From understanding perspectives to informing public policy the potential and challenges for Q findings to inform survey design
Session 2B From understanding perspectives to informing public policy the potential and challenges for Q findings to inform survey design Paper #3 Five Q-to-survey approaches: did they work? Job van Exel
More informationASSESSMENT OF STUDENT LEARNING OUTCOMES WITHIN ACADEMIC PROGRAMS AT WEST CHESTER UNIVERSITY
ASSESSMENT OF STUDENT LEARNING OUTCOMES WITHIN ACADEMIC PROGRAMS AT WEST CHESTER UNIVERSITY The assessment of student learning begins with educational values. Assessment is not an end in itself but a vehicle
More informationPOL EVALUATION PLAN. Created for Lucy Learned, Training Specialist Jet Blue Airways
POL EVALUATION PLAN Created for Lucy Learned, Training Specialist Jet Blue Airways Dear Lucy, Thank you for trusting Davis Consulting Inc. to create an evaluation plan for JetBlue University s Principles
More informationWe Are a Place People Can Call Their Medical Home
Going Lean Agenda Introduction and Objectives Borgess Ambulatory Care and its Guiding Principles Overview of Lean Thinking Benefits of Value-Stream Mapping Transforming Office Practice Outcomes What We
More informationSelf Assessment. InTech Collegiate High School. Jason Stanger, Director 1787 Research Park Way North Logan, UT
Jason Stanger, Director 1787 Research Park Way North Logan, UT 84341-5600 Document Generated On June 13, 2016 TABLE OF CONTENTS Introduction 1 Standard 1: Purpose and Direction 2 Standard 2: Governance
More informationUVM Rural Health Longitudinal Integrated Curriculum Hudson Headwaters Health Network, Queensbury, New York
UVM Rural Health Longitudinal Integrated Curriculum Hudson Headwaters Health Network, Queensbury, New York APPLICATION for AY 2018-2019 Application Deadline: September 8, 2017 Name: Email: Date: Phone:
More informationSection 1: Program Design and Curriculum Planning
1 ESTABLISHING COMMUNITY-BASED RESEARCH NETWORKS Deliverable #3: Summary Report of Curriculum Planning and Research Nurse Participant Conference Section 1: Program Design and Curriculum Planning The long
More informationMission Statement To achieve excellence in our Pharm.D. and graduate programs through innovative education and leading edge research.
Mission Statement To achieve excellence in our Pharm.D. and graduate programs through innovative education and leading edge research. We will achieve our mission by graduating outstanding future pharmacists
More informationA Systems Approach to Principal and Teacher Effectiveness From Pivot Learning Partners
A Systems Approach to Principal and Teacher Effectiveness From Pivot Learning Partners About Our Approach At Pivot Learning Partners (PLP), we help school districts build the systems, structures, and processes
More informationHigher Education / Student Affairs Internship Manual
ELMP 8981 & ELMP 8982 Administrative Internship Higher Education / Student Affairs Internship Manual College of Education & Human Services Department of Education Leadership, Management & Policy Table
More informationLong Beach Unified School District
Long Beach Unified School District Male Academy Closing The Achievement Gap Targeted Intervention College Board A Dream Deferred The Future of African American Education Conference April 25, 2012 Presented
More informationIMPACTFUL, QUANTIFIABLE AND TRANSFORMATIONAL?
IMPACTFUL, QUANTIFIABLE AND TRANSFORMATIONAL? EVALUATION OF THE IMPROVING QUALITY TOGETHER (IQT) NATIONAL LEARNING PROGRAMME Report for 1000 Lives Improvement Service, Public Health Wales Mark Llewellyn,
More informationRCPCH MMC Cohort Study (Part 4) March 2016
RCPCH MMC Cohort Study (Part 4) March 2016 Acknowledgements Dr Simon Clark, Officer for Workforce Planning, RCPCH Dr Carol Ewing, Vice President Health Services, RCPCH Dr Daniel Lumsden, Former Chair,
More informationStrategy for teaching communication skills in dentistry
Strategy for teaching communication in dentistry SADJ July 2010, Vol 65 No 6 p260 - p265 Prof. JG White: Head: Department of Dental Management Sciences, School of Dentistry, University of Pretoria, E-mail:
More information2. Related Documents (refer to policies.rutgers.edu for additional information)
Policy Name: Clinical Affiliation Agreements Approval Authority: RBHS Chancellor Originally Issued: Revisions: 6/20/13 1. Who Should Read This Policy All Rutgers University research faculty and staff within
More informationUniversity of Colorado Skaggs School of Pharmacy and Pharmaceutical Sciences Programmatic Evaluation Plan
University of Colorado Skaggs School of Pharmacy and Pharmaceutical Sciences 2015 Programmatic Evaluation Plan The purpose of this document is to establish and describe the programmatic evaluation plan
More informationONBOARDING NEW TEACHERS: WHAT THEY NEED TO SUCCEED. MSBO Spring 2017
ONBOARDING NEW TEACHERS: WHAT THEY NEED TO SUCCEED MSBO Spring 2017 Objectives Understand onboarding as an integral part of teacher effectiveness and teacher retention Become familiar with effective cultivation
More informationD direct? or I indirect?
Direct vs. Indirect evidence of student learning Quiz Time D direct? or I indirect? 1 Example 1. I can name the capital of Alaska. Strongly Agree Agree Disagree Strongly Disagree Indirect evidence of knowledge
More informationPhase 3 Standard Policies and Procedures
Phase 3 Standard Policies and Procedures 2015 2016 The third year of the curriculum is one of the most exciting years of your medical education because it is the first real opportunity for you to be directly
More informationUse of the Kalamazoo Essential Elements Communication Checklist (Adapted) in an Institutional Interpersonal and Communication Skills Curriculum
Use of the Kalamazoo Essential Elements Communication Checklist (Adapted) in an Institutional Interpersonal and Communication Skills Curriculum Barbara L. Joyce, PhD Timothy Steenbergh, PhD Eric Scher,
More informationState Parental Involvement Plan
A Toolkit for Title I Parental Involvement Section 3 Tools Page 41 Tool 3.1: State Parental Involvement Plan Description This tool serves as an example of one SEA s plan for supporting LEAs and schools
More informationBasic Standards for Residency Training in Internal Medicine. American Osteopathic Association and American College of Osteopathic Internists
Basic Standards for Residency Training in Internal Medicine American Osteopathic Association and American College of Osteopathic Internists BOT Rev. 2/2011 TABLE OF CONTENTS I. Introduction... 3 II Mission...
More informationGame-designed interprofessional education:
Game-designed interprofessional education: Developing, experiencing and implementing the Seniors Healthcare Navigation Challenge Health Sciences Education and Research Commons Health Sciences Council,
More informationCurriculum Assessment Employing the Continuous Quality Improvement Model in Post-Certification Graduate Athletic Training Education Programs
Curriculum Assessment Employing the Continuous Quality Improvement Model in Post-Certification Graduate Athletic Training Education Programs Jennifer C. Teeters, Michelle A. Cleary, Jennifer L. Doherty-Restrepo,
More informationWyoming Psychological Association 2017 Fall Conference Continuing Education for Mental Health Professionals
Wyoming Psychological Association 2017 Fall Conference Continuing Education for Mental Health Professionals Changes in National Healthcare Programs, Assessment and Measurement, and Emerging Mental Health
More informationUIC HEALTH SCIENCE COLLEGES
Academic Mission Report: Board of Trustees March 10, 2010 Joseph A. Flaherty, MD Dean, College of Medicine INNOVATION EXCELLENCE SERVICE Brief History 1858 Illinois Eye and Ear Infirmary opens 1859 College
More informationGreek Teachers Attitudes toward the Inclusion of Students with Special Educational Needs
American Journal of Educational Research, 2014, Vol. 2, No. 4, 208-218 Available online at http://pubs.sciepub.com/education/2/4/6 Science and Education Publishing DOI:10.12691/education-2-4-6 Greek Teachers
More informationDOCTOR OF PHILOSOPHY BOARD PhD PROGRAM REVIEW PROTOCOL
DOCTOR OF PHILOSOPHY BOARD PhD PROGRAM REVIEW PROTOCOL Overview of the Doctor of Philosophy Board The Doctor of Philosophy Board (DPB) is a standing committee of the Johns Hopkins University that reports
More informationMany health care advocates have
Institutional Issues Use for IPEC 2012 Institute with permission from the AAMC Changing the Future of Health Professions: Embedding Interprofessional Education Within an Academic Health Center Amy V. Blue,
More informationBHA 4053, Financial Management in Health Care Organizations Course Syllabus. Course Description. Course Textbook. Course Learning Outcomes.
BHA 4053, Financial Management in Health Care Organizations Course Syllabus Course Description Introduces key aspects of financial management for today's healthcare organizations, addressing diverse factors
More informationACADEMIC AFFAIRS GUIDELINES
ACADEMIC AFFAIRS GUIDELINES Section 8: General Education Title: General Education Assessment Guidelines Number (Current Format) Number (Prior Format) Date Last Revised 8.7 XIV 09/2017 Reference: BOR Policy
More informationMedical student research at Texas Tech University Health Sciences Center: Increasing research participation with a summer research program
Medical education Medical student research at Texas Tech University Health Sciences Center: Increasing research participation with a summer research program Jannette M. Dufour PhD, Ernestine Gregorcyk,
More informationEffective Recruitment and Retention Strategies for Underrepresented Minority Students: Perspectives from Dental Students
Critical Issues in Dental Education Effective Recruitment and Retention Strategies for Underrepresented Minority Students: Perspectives from Dental Students Naty Lopez, Ph.D.; Rose Wadenya, D.M.D., M.S.;
More informationMosbys Pharmacy Technician Third Edition Answers For
Mosbys Third Edition Answers For Free PDF ebook Download: Mosbys Third Edition Answers For Download or Read Online ebook mosbys pharmacy technician third edition answers for in PDF Format From The Best
More informationJoe Public ABC Company
Joe Public ABC Company October 2, 2015 Individual Evaluation Report Table of Contents RESULTS SUMMARY GAP Analysis - Line Chart 03 Observer Ratings With Aggregates 04 Your Strengths & Areas of Opportunity
More informationBlended Learning Module Design Template
INTRODUCTION The blended course you will be designing is comprised of several modules (you will determine the final number of modules in the course as part of the design process). This template is intended
More informationOakland Schools Response to Critics of the Common Core Standards for English Language Arts and Literacy Are These High Quality Standards?
If we want uncommon learning for our children in a time of common standards, we must be willing to lower the voices of discontent that threaten to overpower a teaching force who is learning a precise,
More informationCognitive Apprenticeship Statewide Campus System, Michigan State School of Osteopathic Medicine 2011
Statewide Campus System, Michigan State School of Osteopathic Medicine 2011 Gloria Kuhn, DO, PhD Wayne State University, School of Medicine The is a method of teaching aimed primarily at teaching the thought
More informationColorado State University Department of Construction Management. Assessment Results and Action Plans
Colorado State University Department of Construction Management Assessment Results and Action Plans Updated: Spring 2015 Table of Contents Table of Contents... 2 List of Tables... 3 Table of Figures...
More informationPractical Research. Planning and Design. Paul D. Leedy. Jeanne Ellis Ormrod. Upper Saddle River, New Jersey Columbus, Ohio
SUB Gfittingen 213 789 981 2001 B 865 Practical Research Planning and Design Paul D. Leedy The American University, Emeritus Jeanne Ellis Ormrod University of New Hampshire Upper Saddle River, New Jersey
More informationThe Good Judgment Project: A large scale test of different methods of combining expert predictions
The Good Judgment Project: A large scale test of different methods of combining expert predictions Lyle Ungar, Barb Mellors, Jon Baron, Phil Tetlock, Jaime Ramos, Sam Swift The University of Pennsylvania
More informationThe AAMC Standardized Video Interview: Essentials for the ERAS 2018 Season
The AAMC Standardized Video Interview: Essentials for the ERAS 2018 Season The AAMC Standardized Video Interview: Essentials for the ERAS 2018 Season Association of American Medical Colleges Washington,
More informationJOB OUTLOOK 2018 NOVEMBER 2017 FREE TO NACE MEMBERS $52.00 NONMEMBER PRICE NATIONAL ASSOCIATION OF COLLEGES AND EMPLOYERS
NOVEMBER 2017 FREE TO NACE MEMBERS $52.00 NONMEMBER PRICE JOB OUTLOOK 2018 NATIONAL ASSOCIATION OF COLLEGES AND EMPLOYERS 62 Highland Avenue, Bethlehem, PA 18017 www.naceweb.org 610,868.1421 TABLE OF CONTENTS
More informationTwo heads can be better than one
MODULE 21 MODULE GUIDE 21.1 Two heads can be better than one Why is an understanding of teams so important? What are the foundations of successful teamwork? Formal and informal groups are building blocks
More informationComputer Science and Information Technology 2 rd Assessment Cycle
Assessment of Student Learning Computer Science and Information Technology 2 rd Assessment Cycle 2012-2015 Assessment Plan Background Introduction to Computers and Information Processing provides students
More informationMEDICAL COLLEGE OF WISCONSIN (MCW) WHO WE ARE AND OUR UNIQUE VALUE
MEDICAL COLLEGE OF WISCONSIN (MCW) WHO WE ARE AND OUR UNIQUE VALUE TO THE COMMUNITY Presented by John R. Raymond, Sr., MD President and CEO, MCW June 5, 2017 Agenda 1. Who We Are 2. MCW Financial Model
More informationSupply and Demand of Instructional School Personnel
Supply and Demand of Instructional School Personnel Presentation to the 82 nd Annual Virginia Middle and High School Principals Conference and Exposition Mrs. Patty S. Pitts Assistant Superintendent of
More informationEnvision Success FY2014-FY2017 Strategic Goal 1: Enhancing pathways that guide students to achieve their academic, career, and personal goals
Strategic Goal 1: Enhancing pathways that guide students to achieve their academic, career, and personal goals Institutional Priority: Improve the front door experience Identify metrics appropriate to
More informationKnowledge Synthesis and Integration: Changing Models, Changing Practices
Knowledge Synthesis and Integration: Changing Models, Changing Practices Irvine, California March 16, 2009 Allan Best, Managing Partner, InSource University of British Columbia Diane Finegood, Simon Fraser
More informationEarly Warning System Implementation Guide
Linking Research and Resources for Better High Schools betterhighschools.org September 2010 Early Warning System Implementation Guide For use with the National High School Center s Early Warning System
More informationDate Re Our ref Attachment Direct dial nr 2 februari 2017 Discussion Paper PH
IAASB Attn. Prof. Arnold Schilder, RA Chairman 529 Fifth Avenue, 6th Floor New York, New York 10017 USA Submitted via website Date Re Our ref Attachment Direct dial nr 2 februari 2017 Discussion Paper
More informationFinal Teach For America Interim Certification Program
Teach For America Interim Certification Program Program Rubric Overview The Teach For America (TFA) Interim Certification Program Rubric was designed to provide formative and summative feedback to TFA
More informationRESEARCH ARTICLES Objective Structured Clinical Examinations in Doctor of Pharmacy Programs in the United States
RESEARCH ARTICLES Objective Structured Clinical Examinations in Doctor of Pharmacy Programs in the United States Deborah A. Sturpe, PharmD American Journal of Pharmaceutical Education 2010; 74 (8) Article
More informationCEE 2050: Introduction to Green Engineering
Green and sustainable are two of the buzzwords of your generation. These words reflect real and widespread challenges related to water, natural resources, transportation, energy, global health, and population.
More informationStrategic Practice: Career Practitioner Case Study
Strategic Practice: Career Practitioner Case Study heidi Lund 1 Interpersonal conflict has one of the most negative impacts on today s workplaces. It reduces productivity, increases gossip, and I believe
More informationPreparing for Medical School
Our Mission The mission of The Ohio State University Wexner Medical Center is to improve people s lives through innovation in research, education and patient care. Ohio State s College of Medicine aims
More informationWORK OF LEADERS GROUP REPORT
WORK OF LEADERS GROUP REPORT ASSESSMENT TO ACTION. Sample Report (9 People) Thursday, February 0, 016 This report is provided by: Your Company 13 Main Street Smithtown, MN 531 www.yourcompany.com INTRODUCTION
More information2017 FALL PROFESSIONAL TRAINING CALENDAR
2017 FALL PROFESSIONAL TRAINING CALENDAR Date Title Price Instructor Sept 20, 1:30 4:30pm Feedback to boost employee performance 50 Euros Sept 26, 1:30 4:30pm Dealing with Customer Objections 50 Euros
More informationINSPIRE A NEW GENERATION OF LIFELONG LEARNERS
INSPIRE A NEW GENERATION OF LIFELONG LEARNERS CONTENTS 2 S VISION, MISSION AND CORE VALUES 3 4 S JOURNEY TO DATE WHAT 16 CONTACT DETAILS S VISION, MISSION AND CORE VALUES VISION A leader in innovative
More informationMSW POLICY, PLANNING & ADMINISTRATION (PP&A) CONCENTRATION
MSW POLICY, PLANNING & ADMINISTRATION (PP&A) CONCENTRATION Overview of the Policy, Planning, and Administration Concentration Policy, Planning, and Administration Concentration Goals and Objectives Policy,
More informationDavidson College Library Strategic Plan
Davidson College Library Strategic Plan 2016-2020 1 Introduction The Davidson College Library s Statement of Purpose (Appendix A) identifies three broad categories by which the library - the staff, the
More informationASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE
ASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE March 28, 2002 Prepared by the Writing Intensive General Education Category Course Instructor Group Table of Contents Section Page
More informationImmersion Phase. Phase Directors Bill Cutrer, M.D., M.Ed. Lourdes Estrada, Ph.D. Program Manager Brenna Hansen
Curriculum 2.0: Immersion Phase Phase Directors Bill Cutrer, M.D., M.Ed. Lourdes Estrada, Ph.D. Program Manager Brenna Hansen Program Coordinators Natalie Marler Kacy Morgan Information: immerison.phase@vanderbilt.edu
More informationPost-intervention multi-informant survey on knowledge, attitudes and practices (KAP) on disability and inclusive education
Leonard Cheshire Disability and Inclusive Development Centre University College London Promoting the provision of inclusive primary education for children with disabilities in Mashonaland, West Province,
More informationSTUDENT ASSESSMENT, EVALUATION AND PROMOTION
300-37 Administrative Procedure 360 STUDENT ASSESSMENT, EVALUATION AND PROMOTION Background Maintaining a comprehensive system of student assessment and evaluation is an integral component of the teaching-learning
More informationFY16 UW-Parkside Institutional IT Plan Report
FY16 UW-Parkside Institutional IT Plan Report A. Information Technology & University Strategic Objectives [1-2 pages] 1. How was the plan developed? The plan is a compilation of input received from a wide
More informationVOL VISION 2020 STRATEGIC PLAN IMPLEMENTATION
VOL VISION 2020 STRATEGIC PLAN IMPLEMENTATION CONTENTS Vol Vision 2020 Summary Overview Approach Plan Phase 1 Key Initiatives, Timelines, Accountability Strategy Dashboard Phase 1 Metrics and Indicators
More informationUpdate on Standards and Educator Evaluation
Update on Standards and Educator Evaluation Briana Timmerman, Ph.D. Director Office of Instructional Practices and Evaluations Instructional Leaders Roundtable October 15, 2014 Instructional Practices
More information