Resident Selection Process and Prediction of Clinical Performance in an Obstetrics and Gynecology Program
|
|
- Coral Malone
- 6 years ago
- Views:
Transcription
1 Resident Selection Process and Prediction of Clinical Performance in an Obstetrics and Gynecology Program Alexander Olawaiye John Yeh Matthew Withiam-Leitch Department of Gynecology and Obstetrics University at Buffalo School of Medicine and Biomedical Sciences Buffalo, New York, USA Background: To date, there is no published data showing a correlation between the National Residency Matching Program Rank list position and performance in residency. Purpose: The background was to assess whether a residency applicant selection process is able to predict the subsequent performance of candidates during residency. Methods: Over a period of 3 academic years, resident candidates were invited to a structured interview process. This interview process was used to generate a rank list for the National Residency Matching Program (NRMP). We evaluated the clinical performance of the residents that matched to our program at the end of the 1st postgraduate year. We then examined the correlation between the NRMP rank position and the residents clinical performance score. Results: For the 3 academic years, the residents mean total performance score was similar for the residents for each of the years. There was a positive correlation between the resident candidate NRMP rank list percentile and the subsequent 1st year clinical performance evaluation score (r =.60, p <.001). Conclusions: A structured selection process of residency applicants can predict their subsequent 1st year clinical performance. Teaching and Learning in Medicine, 18(4), The transition from the medical school to residency is a time-consuming process for the students and the program directors. 1 3 The student is anxious to match into a program, which among other considerations would enhance his or her chances of future success in either academic or clinical practice. On the other hand, a program director s major interest is to select candidates who would perform well in residency. 4 6 The current system to recruit medical students to American residency programs is through the National Residency Matching Program (NRMP). Each residency program evaluates resident candidates and generates a rank list of candidates. The methodology to evaluate and rank resident applicants varies by programs. The programs aim to attract the most desirable candidates, and presumably, applicants high on the rank list are those the program feels would be the most successful residents. However, to date, there is no published data showing a correlation between NMRP rank list position and performance in residency. We standardized our resident selection process to be heavily weighed toward an interview process that has Copyright 2006 by Lawrence Erlbaum Associates, Inc. the inclusion of interviewers of multiple backgrounds. The goal of our study was to investigate whether our selection process has produced an applicant rank list that correlates with clinical performance in residency. Materials and Methods In this study, we focused on the resident selection process for the Department of Obstetrics and Gynecology of the University of Buffalo. Our program has 9 first-year resident positions to fill per academic year. In this report, the selection process studied was for residents recruited for these 3 academic years; 2002 to 2003, 2003 to 2004, and 2004 to This study was approved by the Institutional Review Board of the University of Buffalo. Resident Selection Process and NRMP Rank List Development Beginning with academic year 2002 to 2003, we implemented a structured selection process (Figure 1). Correspondence may be sent to Matthew Withiam-Leitch, MD, PhD, University at Buffalo, Department of Gynecology-Obstetrics, 219 Bryant Street, Buffalo, NY 14222, USA. alwl@buffalo.edu 310
2 SELECTION PROCESS AND PERFORMANCE IN RESIDENCY M. Withiam-Leitch initially screened all applicants (> 200/year) received over the electronic residency application system (ERAS). These ERAS applications use a standardized format that included board scores, dean s letter, medical student transcript, personal statements, letters of recommendation, and curriculum vitae. From these ERAS applications, we then invited the screened candidates to interview. During each academic year, there were a total of three interview dates. There were eight evaluators for each interview date. We made a conscious effort to have interviewers that represented the full spectrum of career opportunities available in obstetrics and gynecology. Thus, on each interview day, we included private practice obstetrician-gynecologists, academic generalist obstetrician-gynecologists, maternal fetal medicine specialists, gynecologic oncologists, and reproductive endocrinologists. All invited candidates for all three dates were interviewed by the program director and the two associate program directors. Each candidate was interviewed by a total of six evaluators. Prior to the beginning of each interview day, there was a meeting of the evaluators to discuss the evaluation process and to maintain uniformity in the process. Evaluators were asked to provide a score of 1 to 5 points for each of five categories (communication skills, insight into the specialty, motivation, compassion, and fit into the program). Each evaluator then provided a total composite score of 5 to 25 for each candidate. We then instructed the evaluators to use this composite score to rank the candidates they interviewed from best to worst. Thus, the composite score was used to generate each individual interviewer s own rank list. Because each candidate was interviewed by six attending physicians, each candidate received six rank scores. From the rank scores, we generated an average rank score for each candidate. Finally, using the average rank scores, we ranked all the candidates from best to worst for that particular interview date. At the end of the interview season, a meeting involving all evaluators was held. We generated a final rank list integrating all three interview dates. We facilitated the integration of the three rank lists from the three interview dates by two mechanisms: (a) the program director and the two associate program directors had interviewed all candidates on all interview dates, and (b) several other evaluators had participated on more than one interview date. We subsequently submitted this final rank list to the NRMP. In each academic year, there were different numbers of candidates included on the final NRMP rank list. Therefore, for this study, we generated a rank percentile per candidate per year to depict how high the candidate was ranked in relation to the total number of candidates in that year. This rank percentile controlled for the differences in the number of candidates interviewed per academic year. Resident Clinical Evaluation Process and Total Performance Scores At the end of the first postgraduate year, the recruited residents were evaluated by attending physicians. Each resident s performance was evaluated using a Global Resident Evaluation Form that we developed. We developed the Global Resident Evalua- Figure 1. Summary of methods to generate the National Residency Matching Program (NRMP) rank list of resident candidates. 311
3 OLAWAIYE, YEH, WITHIAM-LEITCH tion Form to evaluate residents according to the standards recently implemented by the Accreditation Council on Graduate Medical Education (ACGME). The ACGME requires that residents be exposed to and trained in six core competencies patient care, medical knowledge, practice-based learning and improvement, interpersonal communication skills, professionalism, and system-based learning. Full-time and volunteer attending faculty scored residents performance on a scale ranging from 1 (poor) to 9(exceptional) in each of the six ACGME core competency areas. For each resident, we then calculated a total performance score by taking an average of the scores from these six core competencies. We used this total performance score (potential range of ) in the analysis performed in this study. Statistics We presented the data as mean ± standard deviation. We did data analysis with a simple linear regression model, analysis of variance tests, t tests, and a variance ratio test using SAS Version 9 (SAS Institute, Inc., Cary, NC, USA). We considered p <.05 statistically significant. We therefore pooled data from these three academic years for our subsequent analysis. Figure 2 shows the relation between the rank positions of all residents and their total performance score as evaluated by attending faculty at the end of the 1st year in residency. There was a correlation between the rank percentile of the candidates and their total performance score. The higher the rank percentile on our NRMP rank list, the better the subsequent clinical performance of the resident. The correlation coefficient was statistically significant (r =.60; p <.001). We further subdivided the residents into two groups: those residents that were ranked in the top half (rank percentile 50% to 99%) and those ranked in the bottom half (0% to 49%). For the top ranked residents, 12 of 12 had a total performance score above 6.0 (Figure 3). On the other hand, only 1 of 14 residents in the bottom half had a total performance score above 6.0. The total performance score of the upper half was significantly higher than the lower half (6.4 ± 0.21 vs. 5.3 ± 0.98; p <.001). Additionally, use of a variance ratio test showed that there was significantly less variance in the total performance score for residents ranked in the top half as compared to residents ranked in the bottom half (Figure 3). Results During the study period, we interviewed 107 candidates 29 applicants for the academic year 2002 to 2003, 38 for 2003 to 2004, and 40 for 2004 to The NRMP rank list position and total performance score for each resident for each of the three academic years is shown in Table 1. The average total performance score did not differ significantly among the three academic years included in the study (p =.78). Conclusions Our study indicates that the applicant selection process can predict subsequent performance of candidates in residency. The NRMP rank list generated from our selection process significantly correlated with the strength of the candidates clinical performance in residency as determined by attending physician evaluations. To our knowledge, this study is the first report that shows a correlation between a program s NRMP rank list and subsequent residents clinical performance. Table 1. NRMP Rank List Position and Total Performance Score for Each of 3 Academic Years 312 Academic Year Resident ID Rank % a Total PS Rank % a Total PS Rank % a Total PS b M Total PS (± SD*) 6.0 (0.85) 5.9 (0.69) 5.7 (1.21) Note: NRMP = National Residency Matching Program. There was no statistically significant difference in the mean total performance score (PS) between the 3 academic years (analysis of variance test; p =.78). a Rank % = rank percentile. b Ninth resident transferred out of program for
4 SELECTION PROCESS AND PERFORMANCE IN RESIDENCY Figure 2. Simple linear regression analysis shows a statistically significant correlation between National Residency Matching Program rank percentile and total performance score. (r =.60, p <.001). Figure 3. Distribution of total performance scores between residents whose National Residency Matching Program (NRMP) rank percentile was in the top 50% and the bottom 50%. A variance ratio test showed that there was a significant difference in the variances between the top 50th percentile and bottom 50th percentile residents (p <.001). Our selection process is heavily weighted toward the interview. The initial screening of candidates from the ERAS system was simply to identify those candidates that presumably had the academic credentials to successfully complete a residency program in obstetrics and gynecology. These traditional credentials medical school transcripts, board scores, and letters of recommendations have been referred to as cognitive attributes These cognitive attributes have been shown to predict future success on standardized exams but have not correlated with success in clinical performance. 4,5 In contrast, the interview has been viewed as a tool to assess noncognitive attributes. Noncognitive attributes such as communication skills, professionalism, ethics, and the like are important attributes of a clinician. 8,13 15 In fact, the new ACGME core competencies are intended to assure that residents are exposed and educated in these noncognitive attributes. This is why we had chosen to focus our selection process on the interview. In fact, several studies have shown that residency program directors regard the interview as the most important component of the residency selection process However, none of these studies have attempted to show a correlation between the interview process and subsequent resident clinical performance. There are two possible reasons to explain how our interview process predicts future resident performance. First, we controlled for the interinterviewer variability by having the attending physicians rank their candidates from best to worse. The composite score of 5 to 25 points was only used by the individual interviewer to generate their personal rank for the candidates they interviewed. We then combined the ranks from these individual interviewers to calculate an average overall rank. This minimizes the potential 313
5 OLAWAIYE, YEH, WITHIAM-LEITCH for an individual interviewer s composite scoring to skew the overall rank list. In other words, this technique helps to control for bias in tendencies by different interviewers for leniency or severity. 19 Second, interviewers consisted of attending physicians from all walks of life. The generalist obstetrician-gynecologist may be most interested in whether a candidate will fit in with others in the program, whereas a subspecialist may focus on the research potential of the candidate. A private practice obstetrician-gynecologist may concentrate an interview assessing whether the candidate has the communications skills to provide good care to their patients. For a candidate to be ranked high on the NRMP rank list, it would have been necessary for multiple evaluators, regardless of their primary interest, to rank the candidate high. In our opinion, it is the breadth of viewpoints of the evaluators that has led to our interview process being able to generate a rank list that predicts the performance of candidates in residency. It should be noted that our approach is in contrast to a trend toward developing a highly structured and standardized interview process to reduce interrater variability. 19,20 Other than our study, there is little published evidence that the interview process can predict future clinical performance. 8,19,21 For example, Komives et al. 21 were unable to show a significant correlation between the applicant interview and resident performance among internal medicine residents. In Komives et al. s 21 study, the resident clinical performance evaluations were done by chief residents and may have been flawed by internal inconsistencies. In our study, the clinical evaluations were done by experienced attending physicians, and we used the average scores from all of them to calculate a total performance score. This approach limited potential bias by one particular attending toward a resident. Additionally, the total performance score we used was calculated using a scale that rated the ACGME core competencies. The ACGME core competencies evaluate many of the same noncognitive attributes as the interview, for instance, communication skills and professionalism. Thus, the qualities assessed in our interview process were similar to the qualities assessed in our total performance score. Bell et al. 22 likewise failed to show a correlation between their selection process and subsequent resident performance in an obstetric and gynecology program. Unlike our study, Bell et al. s 22 resident selection process was heavily weighted toward cognitive attributes such as U.S. Medical Licensing Examination scores and honors in medical school clerkships. Given the preceding, our data suggest that our resident interview process is relatively successful in predicting subsequent resident clinical performance. However, there are limitations and weaknesses. First, our ranking process seems to suggest that residents in the top 50th percentile of the NRMP rank list perform relatively well by our assessment standards. However, we are less able to predict clinical performance in the lower 50th percentile. The variance in clinical performance was significantly greater in these candidates. Second, although our selection process was strongly weighted toward the interview and noncognitive attributes, prior knowledge of the candidate s cognitive attributes may have influenced to some degree the evaluators ranking of a candidate. In the future, comparing the evaluators preinterview and postinterview rank list will help to delineate the potential influence of these cognitive and noncognitive attributes. Third, an attending that evaluated a resident may have also interviewed this resident as a candidate. This unblinded performance evaluation could introduce bias. However, as the resident performance evaluations are done 18 months after the interview season, the evaluators would have to have excellent recall for this bias to occur. Finally, this study only addresses the selection process with regard to performance early in residency. We cannot yet address whether the selection process has any predictive value on resident performance at the end of residency training. In summary, we have described a resident selection process heavily dependent on the interview that leads to an NRMP ranking system that correlated reasonably well with 1st-year clinical performance of residents. It is unlikely for any two programs to have the same criteria for resident selection because each program has different concerns and interests. It is, however, important for each program to formulate a uniform and objective selection process, an essential component of which is an interview process that may predict future performance of the residents. References 1. Wagoner NE, Suriano JR. Recommendations for changing the residency selection process based on a survey of program directors. Academic Medicine 1992;67: Swanson AG. The preresidency syndrome : An incipient epidemic of educational disruption. Journal of Medical Education 1985;60: Weinberg E, Casty F. Results of a survey concerning application for residency training. Journal of Medical Education 1987;62: Erlandson EE, Calhoun JG, Barrack FM, et al. Resident selection: Applicant selection criteria compared with performance. Surgery 1982;92: Hojat M, Gonnella JS, Veloski JJ, Erdmann JB. Is the glass half full or half empty? A reexamination of the associations between assessment measures during medical school and clinical competence after graduation. Academic Medicine 1993;68(2 Suppl.):S69 S Yager J, Strauss GD, Tardiff K. The quality of deans letters from medical schools. Journal of Medical Education 1984;59: Mitchell KJ. Traditional predictors of performance in medical school. Academic Medicine 1990;65:
6 SELECTION PROCESS AND PERFORMANCE IN RESIDENCY 8. Johnson EK, Edwards JC. Current practices in admissions interviews at U.S. medical schools. Academic Medicine 1991;66: Streyffeler L, Altmaier EM, Kuperman S, Patrick LE. Development of a medical school admissions interview Phase 2: Predictive validity of cognitive and non-cognitive attributes. Medical Education Online 2005;10:14. Available at: Accessed August 1, Rippentrop AE, Wong M, Altmaier EM. A content analysis of interviewee reports of medical school admissions interviews. Medical Education Online 2003;8:10. Available at: Accessed August 1, Walton H. Admissions procedures to medical schools. Medical Educaton 1994;28: Collins JP, White GR, Petrie KJ, Willoughby EW. A structured panel interview and group exercise in the selection of medical students. Medical Education 1995;29: Edwards JC, Elam CL, Wagoner NE. An admission model for medical schools. Academic Medicine 2001;76: Rolfe IE, Pearson S, Powis DA, Smith AJ. Time for a review of admission to medical school? Lancet 1995;346: Hojat M, Robeson M, Damjanov I, Veloski JJ, Glaser K, Gonnella JS. Students psychosocial characteristics as predictors of academic performance in medical school. Academic Medicine 1993;68: Wagoner NE, Suriano JR, Stoner JA. Factors used by program directors to select residents. Journal of Medical Education 1986;61: Wagoner NE, Gray GT. Report on a survey of program directors regarding selection factors in graduate medical education. Journal of Medical Education 1979;54: Taylor CA, Weinstein L, Mayhew HE. The process of resident selection: A view from the residency director s desk. Obstetrics and Gynecology 1995;85: Edwards JC, Johnson EK, Molidor JB. The interview in the admissions process. Academic Medicine 1990;65: Luke PE, Altmaier EM, Kuperman S, Ugolini K. A structure interview for medical school admission, Phase 1: Initial procedures and results. Academic Medicine 2001;76: Komives E, Weiss ST, Rosa RM. The applicant interview as a predictor of resident performance. Journal of Medical Education 1984;59: Bell JC, Kanellitsas I, Shaffer L. Selection of obstetrics and gynecology residents on the basis of medical school performance. American Journal of Obstetrics and Gynecology 2002;186:
7
Use of the Kalamazoo Essential Elements Communication Checklist (Adapted) in an Institutional Interpersonal and Communication Skills Curriculum
Use of the Kalamazoo Essential Elements Communication Checklist (Adapted) in an Institutional Interpersonal and Communication Skills Curriculum Barbara L. Joyce, PhD Timothy Steenbergh, PhD Eric Scher,
More informationINTERNAL MEDICINE IN-TRAINING EXAMINATION (IM-ITE SM )
INTERNAL MEDICINE IN-TRAINING EXAMINATION (IM-ITE SM ) GENERAL INFORMATION The Internal Medicine In-Training Examination, produced by the American College of Physicians and co-sponsored by the Alliance
More informationPROFESSIONAL TREATMENT OF TEACHERS AND STUDENT ACADEMIC ACHIEVEMENT. James B. Chapman. Dissertation submitted to the Faculty of the Virginia
PROFESSIONAL TREATMENT OF TEACHERS AND STUDENT ACADEMIC ACHIEVEMENT by James B. Chapman Dissertation submitted to the Faculty of the Virginia Polytechnic Institute and State University in partial fulfillment
More informationGUIDELINES FOR COMBINED TRAINING IN PEDIATRICS AND MEDICAL GENETICS LEADING TO DUAL CERTIFICATION
GUIDELINES FOR COMBINED TRAINING IN PEDIATRICS AND MEDICAL GENETICS LEADING TO DUAL CERTIFICATION PREAMBLE This document is intended to provide educational guidance to program directors in pediatrics and
More informationACADEMIA AND CLINIC. Methods
ACADEMIA AND CLINIC Career Differences between Primary Care and Traditional Trainees in Internal Medicine and Pediatrics John Noble, MD; Robert H. Friedman, MD; Barbara Starfield, MD; Arlene Ash, PhD;
More informationSurgical Residency Program & Director KEN N KUO MD, FACS
Surgical Residency Program & Director KEN N KUO MD, FACS 1 Taiwan Surgical Association Residency Director Meeting September 17, 2011 November 5, 2011 2 Three Stages of Education Undergraduate medical education
More informationLongitudinal Integrated Clerkship Program Frequently Asked Questions
Longitudinal Integrated Clerkship Program Frequently Asked Questions The University of Vermont Larner College of Medicine offers a rural longitudinal integrated clerkship (LIC) at the Hudson Headwaters
More informationTun your everyday simulation activity into research
Tun your everyday simulation activity into research Chaoyan Dong, PhD, Sengkang Health, SingHealth Md Khairulamin Sungkai, UBD Pre-conference workshop presented at the inaugual conference Pan Asia Simulation
More informationPROGRAM REQUIREMENTS FOR RESIDENCY EDUCATION IN DEVELOPMENTAL-BEHAVIORAL PEDIATRICS
In addition to complying with the Program Requirements for Residency Education in the Subspecialties of Pediatrics, programs in developmental-behavioral pediatrics also must comply with the following requirements,
More informationREGULATION RESPECTING THE TERMS AND CONDITIONS FOR THE ISSUANCE OF THE PERMIT AND SPECIALIST'S CERTIFICATES BY THE COLLÈGE DES MÉDECINS DU QUÉBEC
(This version is offered as a courtesy and holds no official value.) Professional Code (R.S.Q., c. C-26, s. 93, sub. c and c.1, 94 par. i and 94.1) DIVISION I GENERAL PROVISIONS 1. The purpose of this
More informationFINAL EXAMINATION OBG4000 AUDIT June 2011 SESSION WRITTEN COMPONENT & LOGBOOK ASSESSMENT
L-UNIVERSITÀ TA MALTA Msida Malta SKOLA MEDIKA Sptar Mater Dei Prof. Charles Savona-Ventura MD, DScMed, FRCOG, AccrCOG, MRCPI Head Department of Obstetrics & Gynaecology UNIVERSITY OF MALTA Msida Malta
More information2. Related Documents (refer to policies.rutgers.edu for additional information)
Policy Name: Clinical Affiliation Agreements Approval Authority: RBHS Chancellor Originally Issued: Revisions: 6/20/13 1. Who Should Read This Policy All Rutgers University research faculty and staff within
More informationUpdate on the Next Accreditation System Drs. Culley, Ling, and Wood. Anesthesiology April 30, 2014
Accreditation Council for Graduate Medical Education Update on the Next Accreditation System Drs. Culley, Ling, and Wood Anesthesiology April 30, 2014 Background of the Next Accreditation System Louis
More informationChapters 1-5 Cumulative Assessment AP Statistics November 2008 Gillespie, Block 4
Chapters 1-5 Cumulative Assessment AP Statistics Name: November 2008 Gillespie, Block 4 Part I: Multiple Choice This portion of the test will determine 60% of your overall test grade. Each question is
More informationThe patient-centered medical
Primary Care Residents Want to Learn About the Patient- Centered Medical Home Gerardo Moreno, MD, MSHS; Julia Gold, MD; Maureen Mavrinac, MD BACKGROUND AND OBJECTIVES: The patient-centered medical home
More informationSTA 225: Introductory Statistics (CT)
Marshall University College of Science Mathematics Department STA 225: Introductory Statistics (CT) Course catalog description A critical thinking course in applied statistical reasoning covering basic
More informationApplications from foundation doctors to specialty training. Reporting tool user guide. Contents. last updated July 2016
Applications from foundation doctors to specialty training Reporting tool user guide last updated July 2016 Contents Overview... 2 Purpose of the reports... 2 The reports can be found on the GMC website:...
More informationRace, Class, and the Selective College Experience
Race, Class, and the Selective College Experience Thomas J. Espenshade Alexandria Walton Radford Chang Young Chung Office of Population Research Princeton University December 15, 2009 1 Overview of NSCE
More informationTIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE. Pierre Foy
TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE Pierre Foy TIMSS Advanced 2015 orks User Guide for the International Database Pierre Foy Contributors: Victoria A.S. Centurino, Kerry E. Cotter,
More informationTHE UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT HOUSTON MCGOVERN MEDICAL SCHOOL CATALOG ADDENDUM
THE UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT HOUSTON MCGOVERN MEDICAL SCHOOL 2016-18 CATALOG ADDENDUM I. Fees and Charges II. Curriculum Index Page Page 17 CURRENT: Fees and Charges Computer Fee $200
More informationThe AAMC Standardized Video Interview: Essentials for the ERAS 2018 Season
The AAMC Standardized Video Interview: Essentials for the ERAS 2018 Season The AAMC Standardized Video Interview: Essentials for the ERAS 2018 Season Association of American Medical Colleges Washington,
More informationTHE UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT HOUSTON MCGOVERN MEDICAL SCHOOL CATALOG ADDENDUM
THE UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT HOUSTON MCGOVERN MEDICAL SCHOOL 2016-18 CATALOG ADDENDUM Index Page I. Mission II. Fees and Charges III. Curriculum IV. Pre-Entry Program Pages 7-8 CURRENT:
More informationTeacher intelligence: What is it and why do we care?
Teacher intelligence: What is it and why do we care? Andrew J McEachin Provost Fellow University of Southern California Dominic J Brewer Associate Dean for Research & Faculty Affairs Clifford H. & Betty
More informationBasic Standards for Residency Training in Internal Medicine. American Osteopathic Association and American College of Osteopathic Internists
Basic Standards for Residency Training in Internal Medicine American Osteopathic Association and American College of Osteopathic Internists BOT Rev. 2/2011 TABLE OF CONTENTS I. Introduction... 3 II Mission...
More informationPhysician Assistant Program Goals, Indicators and Outcomes Report
Physician Assistant Program Goals, Indicators and Outcomes Report 2007-2016 UAB PA Program Goals and Outcomes University of Alabama at Birmingham Master of Science in Physician Assistant Studies Physician
More informationAmerican Journal of Business Education October 2009 Volume 2, Number 7
Factors Affecting Students Grades In Principles Of Economics Orhan Kara, West Chester University, USA Fathollah Bagheri, University of North Dakota, USA Thomas Tolin, West Chester University, USA ABSTRACT
More informationPsychometric Research Brief Office of Shared Accountability
August 2012 Psychometric Research Brief Office of Shared Accountability Linking Measures of Academic Progress in Mathematics and Maryland School Assessment in Mathematics Huafang Zhao, Ph.D. This brief
More informationTHE BROOKDALE HOSPITAL MEDICAL CENTER ONE BROOKDALE PLAZA BROOKLYN, NEW YORK 11212
THE BROOKDALE HOSPITAL MEDICAL CENTER ONE BROOKDALE PLAZA BROOKLYN, NEW YORK 11212 AGREEMENT made this day of, 200, between BROOKDALE HOSPITAL MEDICAL CENTER, a not-for-profit Hospital corporation, hereinafter
More informationMeet the Experts Fall Freebie November 5, 2015
Meet the Experts Fall Freebie November 5, 2015 Presented by: PARTNERS IN MEDICAL EDUCATION, INC. Today s Experts: Christine Redovan, MBA Heather Peters, M.Ed, Ph.D Candace DeMaris, MAIS Lauren McGuire,
More informationHEALTH INFORMATION ADMINISTRATION Bachelor of Science (BS) Degree (IUPUI School of Informatics) IMPORTANT:
HEALTH INFORMATION ADMINISTRATION Bachelor of Science (BS) Degree (IUPUI School of Informatics) IMPORTANT: THIS DRAFT IS MEANT FOR PRELIMINARY PLANNING PURPOSES ONLY. TO PLAN FULLY FOR THIS DEGREE, YOU
More informationA Game-based Assessment of Children s Choices to Seek Feedback and to Revise
A Game-based Assessment of Children s Choices to Seek Feedback and to Revise Maria Cutumisu, Kristen P. Blair, Daniel L. Schwartz, Doris B. Chin Stanford Graduate School of Education Please address all
More informationCurriculum Assessment Employing the Continuous Quality Improvement Model in Post-Certification Graduate Athletic Training Education Programs
Curriculum Assessment Employing the Continuous Quality Improvement Model in Post-Certification Graduate Athletic Training Education Programs Jennifer C. Teeters, Michelle A. Cleary, Jennifer L. Doherty-Restrepo,
More informationThe Impact of Postgraduate Health Technology Innovation Training: Outcomes of the Stanford Biodesign Fellowship
Annals of Biomedical Engineering, Vol. 45, No. 5, May 2017 (Ó 2016) pp. 1163 1171 DOI: 10.1007/s10439-016-1777-1 The Impact of Postgraduate Health Technology Innovation Training: Outcomes of the Stanford
More informationNext Steps for Graduate Medical Education
Next Steps for Graduate Medical Education Osteopathic Graduate Medical Education (OGME) and the Single Graduate Medical Education (GME) Accreditation System A white paper prepared by the American Association
More informationLoyola University Chicago ~ Archives and Special Collections
Accession No.: UA1981.65, 1981.74 STRITCH SCHOOL OF MEDICINE OFFICE OF THE DEAN LOUIS DAVID MOORHEAD, M.D., RECORDS Dates: 1931-1940 Creator: Moorhead, Louis David (1892-1951) Extent: 2.5 linear feet Level
More informationEvaluating Postdoctoral Dental Candidates: Assessing the Need and Recommendations for a National Qualifying Examination
Critical Issues in Dental Education Evaluating Postdoctoral Dental Candidates: Assessing the Need and Recommendations for a National Qualifying Examination Abby J. Brodie, D.M.D., M.S.; Heidi C. Crow,
More informationEffective practices of peer mentors in an undergraduate writing intensive course
Effective practices of peer mentors in an undergraduate writing intensive course April G. Douglass and Dennie L. Smith * Department of Teaching, Learning, and Culture, Texas A&M University This article
More informationHow to Judge the Quality of an Objective Classroom Test
How to Judge the Quality of an Objective Classroom Test Technical Bulletin #6 Evaluation and Examination Service The University of Iowa (319) 335-0356 HOW TO JUDGE THE QUALITY OF AN OBJECTIVE CLASSROOM
More informationAlyson D. Stover, MOT, JD, OTR/L, BCP
Alyson D. Stover, MOT, JD, OTR/L, BCP Curriculum Vitae BIOGRAPHICAL INFORMATION Business Address: Department of Occupational Therapy School of Health & Rehabilitation Sciences University of Pittsburgh
More informationAlgebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview
Algebra 1, Quarter 3, Unit 3.1 Line of Best Fit Overview Number of instructional days 6 (1 day assessment) (1 day = 45 minutes) Content to be learned Analyze scatter plots and construct the line of best
More informationLinking the Ohio State Assessments to NWEA MAP Growth Tests *
Linking the Ohio State Assessments to NWEA MAP Growth Tests * *As of June 2017 Measures of Academic Progress (MAP ) is known as MAP Growth. August 2016 Introduction Northwest Evaluation Association (NWEA
More informationProbability and Statistics Curriculum Pacing Guide
Unit 1 Terms PS.SPMJ.3 PS.SPMJ.5 Plan and conduct a survey to answer a statistical question. Recognize how the plan addresses sampling technique, randomization, measurement of experimental error and methods
More informationAYO DRUGSTORE RECORDS ( )
Ayo Drugstore Records 1 AYO DRUGSTORE RECORDS (1899-1957) Processed September 2012 Bio/History Note Dr. Jackson Joseph Ayo was born 8 January 1869 in Gretna, Louisiana to Hamilton A. Ayo and Severine Foret.
More informationUsing a Simulated Practice to Improve Practice Management Learning
640 October 2009 Family Medicine Practice Management Using a Simulated Practice to Improve Practice Management Learning Leigh LoPresti, MD; Patrick Ginn, MD, MBA; Robert Treat, PhD Background and Objectives:
More informationPredicting the Performance and Success of Construction Management Graduate Students using GRE Scores
Predicting the Performance and of Construction Management Graduate Students using GRE Scores Joel Ochieng Wao, PhD, Kimberly Baylor Bivins, M.Eng and Rogers Hunt III, M.Eng Tuskegee University, Tuskegee,
More informationPREPARING FOR THE SITE VISIT IN YOUR FUTURE
PREPARING FOR THE SITE VISIT IN YOUR FUTURE ARC-PA Suzanne York SuzanneYork@arc-pa.org 2016 PAEA Education Forum Minneapolis, MN Saturday, October 15, 2016 TODAY S SESSION WILL INCLUDE: Recommendations
More informationImproving recruitment, hiring, and retention practices for VA psychologists: An analysis of the benefits of Title 38
Improving recruitment, hiring, and retention practices for VA psychologists: An analysis of the benefits of Title 38 Introduction / Summary Recent attention to Veterans mental health services has again
More informationPharmaceutical Medicine
Specialty specific guidance on documents to be supplied in evidence for an application for entry onto the Specialist Register with a Certificate of Eligibility for Specialist Registration (CESR) Pharmaceutical
More informationWomen in Orthopaedic Fellowships: What Is Their Match Rate, and What Specialties Do They Choose?
Clin Orthop Relat Res (2016) 474:1957 1961 DOI 10.1007/s11999-016-4829-9 Clinical Orthopaedics and Related Research A Publication of The Association of Bone and Joint Surgeons SYMPOSIUM: WOMEN AND UNDERREPRESENTED
More informationClinical Quality in EMS. Noah J. Reiter, MPA, EMT-P EMS Director Lenox Hill Hospital (Rice University 00)
Clinical Quality in EMS Noah J. Reiter, MPA, EMT-P EMS Director Lenox Hill Hospital (Rice University 00) Presentation Overview Rationale Definitions Philosophy Prerequisites for a Successful Program The
More informationUVM Rural Health Longitudinal Integrated Curriculum Hudson Headwaters Health Network, Queensbury, New York
UVM Rural Health Longitudinal Integrated Curriculum Hudson Headwaters Health Network, Queensbury, New York APPLICATION for AY 2018-2019 Application Deadline: September 8, 2017 Name: Email: Date: Phone:
More informationGDP Falls as MBA Rises?
Applied Mathematics, 2013, 4, 1455-1459 http://dx.doi.org/10.4236/am.2013.410196 Published Online October 2013 (http://www.scirp.org/journal/am) GDP Falls as MBA Rises? T. N. Cummins EconomicGPS, Aurora,
More informationRESEARCH ARTICLES Objective Structured Clinical Examinations in Doctor of Pharmacy Programs in the United States
RESEARCH ARTICLES Objective Structured Clinical Examinations in Doctor of Pharmacy Programs in the United States Deborah A. Sturpe, PharmD American Journal of Pharmaceutical Education 2010; 74 (8) Article
More informationMEDICAL COLLEGE OF WISCONSIN (MCW) WHO WE ARE AND OUR UNIQUE VALUE
MEDICAL COLLEGE OF WISCONSIN (MCW) WHO WE ARE AND OUR UNIQUE VALUE TO THE COMMUNITY Presented by John R. Raymond, Sr., MD President and CEO, MCW June 5, 2017 Agenda 1. Who We Are 2. MCW Financial Model
More informationApplication Guidelines for Interventional Radiology Review Committee for Radiology
Application Guidelines for Interventional Radiology Review Committee for Radiology The new interventional radiology residency will replace the current one-year vascular and interventional radiology (VIR)
More informationIMSH 2018 Simulation: Making the Impossible Possible
IMSH 2018 Simulation: Making the Impossible Possible You do it every day. You tackle difficult - sometimes seemingly impossible circumstances as you work to improve patient care through simulation-based
More informationThe Outcome Project of the Accreditation Council for
Development and Initial Validation of a Project-Based Rubric to Assess the Systems-Based Practice Competency of Residents in the Clinical Chemistry Rotation of a Pathology Residency Carolyn R. Vitek, MS;
More informationProcedia - Social and Behavioral Sciences 209 ( 2015 )
Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Sciences 209 ( 2015 ) 503 508 International conference Education, Reflection, Development, ERD 2015, 3-4 July 2015,
More informationRedirected Inbound Call Sampling An Example of Fit for Purpose Non-probability Sample Design
Redirected Inbound Call Sampling An Example of Fit for Purpose Non-probability Sample Design Burton Levine Karol Krotki NISS/WSS Workshop on Inference from Nonprobability Samples September 25, 2017 RTI
More informationGlobal Health Interprofessional Program Summer Zambia
Global Health Interprofessional Program Summer 2018 - Zambia Title of Proposed Project School Faculty name Appointed department(s) Assessment of medical and pharmacy student knowledge of antimicrobial
More informationDo multi-year scholarships increase retention? Results
Do multi-year scholarships increase retention? In the past, Boise State has mainly offered one-year scholarships to new freshmen. Recently, however, the institution moved toward offering more two and four-year
More informationInterprofessional Education Assessment Strategies
Interprofessional Education Assessment Strategies December 2, 2016 Webinar Moderated by: Melissa Dinkins, PharmD Presenters! John H. Tegzes, MA, VMD, Dipl. ABVT! Heather B. Congdon, PharmD, BCPS, CDE!
More informationFaculty Feedback User s Guide
Faculty Feedback User s Guide Contents Description:... 2 Purpose:... 2 Instructions:... 2 Step 1. Logging in.... 2 Step 2. Selecting a course... 3 Step 3. Interacting with the feedback roster.... 3 Faculty
More informationResearch Design & Analysis Made Easy! Brainstorming Worksheet
Brainstorming Worksheet 1) Choose a Topic a) What are you passionate about? b) What are your library s strengths? c) What are your library s weaknesses? d) What is a hot topic in the field right now that
More informationOVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE
OVERVIEW OF CURRICULUM-BASED MEASUREMENT AS A GENERAL OUTCOME MEASURE Mark R. Shinn, Ph.D. Michelle M. Shinn, Ph.D. Formative Evaluation to Inform Teaching Summative Assessment: Culmination measure. Mastery
More informationProgram Information on the Graduate Certificate in Alcohol and Drug Abuse Studies (CADAS)
Program Information on the Graduate Certificate in Alcohol and Drug Abuse Studies (CADAS) This program is designed for students who have either: 1) completed a Master s degree or higher qualification from
More informationCURRICULUM VITAE. COLLEEN M. SANDOR, Ph.D.
CURRICULUM VITAE COLLEEN M. SANDOR, Ph.D. Department of Psychology, Westminster College 1840 South 1300 East Salt Lake City, UT 84105 csandor@westminstercollege.edu Academic Positions 2014-Present Professor
More informationCurriculum Vitae Sheila Gillespie Roth Address: 224 South Homewood Avenue Pittsburgh, Pennsylvania Telephone: (412)
Curriculum Vitae Sheila Gillespie Roth Address: 224 South Homewood Avenue Pittsburgh, Pennsylvania 15208 Telephone: (412) 256-0341 EDUCATION 1991 Ph.D. Administration and Policy Studies University of Pittsburgh
More informationConsultation skills teaching in primary care TEACHING CONSULTING SKILLS * * * * INTRODUCTION
Education for Primary Care (2013) 24: 206 18 2013 Radcliffe Publishing Limited Teaching exchange We start this time with the last of Paul Silverston s articles about undergraduate teaching in primary care.
More informationEffective Recruitment and Retention Strategies for Underrepresented Minority Students: Perspectives from Dental Students
Critical Issues in Dental Education Effective Recruitment and Retention Strategies for Underrepresented Minority Students: Perspectives from Dental Students Naty Lopez, Ph.D.; Rose Wadenya, D.M.D., M.S.;
More informationNational Survey of Student Engagement at UND Highlights for Students. Sue Erickson Carmen Williams Office of Institutional Research April 19, 2012
National Survey of Student Engagement at Highlights for Students Sue Erickson Carmen Williams Office of Institutional Research April 19, 2012 April 19, 2012 Table of Contents NSSE At... 1 NSSE Benchmarks...
More informationMatch Week & Match Day Requested Information Class Meeting Awards Ceremony Match Ceremony
2016 MATCH Match Week & Match Day Requested Information: http://www.bumc.bu.edu/busm/student-life/professional-development/match-week-andmatch-day-requested-information/ Deadline for response : Feb.
More informationMathematics Program Assessment Plan
Mathematics Program Assessment Plan Introduction This assessment plan is tentative and will continue to be refined as needed to best fit the requirements of the Board of Regent s and UAS Program Review
More informationAmerican College of Emergency Physicians National Emergency Medicine Medical Student Award Nomination Form. Due Date: February 14, 2012
Nomination Form Due Date: February 14, 2012 Please follow instructions closely, and make sure you have included all requested information listed on the checklist. Electronic submissions only. Please refrain
More informationMastering Team Skills and Interpersonal Communication. Copyright 2012 Pearson Education, Inc. publishing as Prentice Hall.
Chapter 2 Mastering Team Skills and Interpersonal Communication Chapter 2-1 Communicating Effectively in Teams Chapter 2-2 Communicating Effectively in Teams Collaboration involves working together to
More informationThe Good Judgment Project: A large scale test of different methods of combining expert predictions
The Good Judgment Project: A large scale test of different methods of combining expert predictions Lyle Ungar, Barb Mellors, Jon Baron, Phil Tetlock, Jaime Ramos, Sam Swift The University of Pennsylvania
More informationEffect of Cognitive Apprenticeship Instructional Method on Auto-Mechanics Students
Effect of Cognitive Apprenticeship Instructional Method on Auto-Mechanics Students Abubakar Mohammed Idris Department of Industrial and Technology Education School of Science and Science Education, Federal
More informationASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE
ASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE March 28, 2002 Prepared by the Writing Intensive General Education Category Course Instructor Group Table of Contents Section Page
More informationPSIWORLD Keywords: self-directed learning; personality traits; academic achievement; learning strategies; learning activties.
Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Scien ce s 127 ( 2014 ) 640 644 PSIWORLD 2013 Self-directed learning, personality traits and academic achievement
More informationBiological Sciences, BS and BA
Student Learning Outcomes Assessment Summary Biological Sciences, BS and BA College of Natural Science and Mathematics AY 2012/2013 and 2013/2014 1. Assessment information collected Submitted by: Diane
More informationEMORY UNIVERSITY. SCHOOL OF MEDICINE. Emory School of Medicine records,
EMORY UNIVERSITY. SCHOOL OF MEDICINE. Emory School of Medicine records, 1916-2016 Emory University Health Sciences Archives Woodruff Health Sciences Center Library 1462 Clifton Road, NE Atlanta, GA 30322
More informationCognitive Apprenticeship Statewide Campus System, Michigan State School of Osteopathic Medicine 2011
Statewide Campus System, Michigan State School of Osteopathic Medicine 2011 Gloria Kuhn, DO, PhD Wayne State University, School of Medicine The is a method of teaching aimed primarily at teaching the thought
More informationThe Relation Between Socioeconomic Status and Academic Achievement
Psychological Bulletin 1982, Vol. 91, No. 3, 461-481 Copyright 1982 by the American Psychological Association, Inc. 0033-2909/82/9103-0461S00.75 The Relation Between Socioeconomic Status and Academic Achievement
More informationUnderstanding and Interpreting the NRC s Data-Based Assessment of Research-Doctorate Programs in the United States (2010)
Understanding and Interpreting the NRC s Data-Based Assessment of Research-Doctorate Programs in the United States (2010) Jaxk Reeves, SCC Director Kim Love-Myers, SCC Associate Director Presented at UGA
More informationAnalyzing the Usage of IT in SMEs
IBIMA Publishing Communications of the IBIMA http://www.ibimapublishing.com/journals/cibima/cibima.html Vol. 2010 (2010), Article ID 208609, 10 pages DOI: 10.5171/2010.208609 Analyzing the Usage of IT
More informationSummarizing Webinar Protocol and Guide for Facilitators
Summarizing Webinar Protocol and Guide for Facilitators Bringing STakeholders Together for Engagement in Research for the Selection of Arthroplasty Implant Devices (BeTTER SAID) Title: How can patient
More informationALAMO CITY OPHTHALMOLOGY
34th ANNUAL ALAMO CITY OPHTHALMOLOGY C LINICAL CO NFERE N C E Original Research, Ethics, Patient Safety Projects Saturday, April 12, 2014 San Antonio Country Club 4100 N New Braunfels Avenue 78209 Sponsored
More informationWhat effect does science club have on pupil attitudes, engagement and attainment? Dr S.J. Nolan, The Perse School, June 2014
What effect does science club have on pupil attitudes, engagement and attainment? Introduction Dr S.J. Nolan, The Perse School, June 2014 One of the responsibilities of working in an academically selective
More informationRC-FM Staff. Objectives 4/22/2013. Geriatric Medicine: Update from the RC-FM. Eileen Anthony, Executive Director; ;
Geriatric Medicine: Update from the RC-FM American Geriatric Society 2013 Annual Meeting Grapevine, TX Peter J. Carek, MD, MS - Chair, RC - FM Eileen Anthony - Executive Director RC-FM Staff Eileen Anthony,
More informationWe are delighted to welcome Drayton Saunders to the Community Board of the Sarasota Campus, FSU College of Medicine.
It s sometimes difficult to believe, but the FSU College of Medicine Sarasota Campus accepted its first class of students seven years ago. Since then many changes have occurred in health care, the Sarasota
More informationProposal for an annual meeting format (quality and structure)
Proposal for an annual meeting format (quality and structure) This document was written to come to a uniform structure for the ESPID annual meeting, fulfilling the goals defined in the strategic plan (goal
More informationA Model to Predict 24-Hour Urinary Creatinine Level Using Repeated Measurements
Virginia Commonwealth University VCU Scholars Compass Theses and Dissertations Graduate School 2006 A Model to Predict 24-Hour Urinary Creatinine Level Using Repeated Measurements Donna S. Kroos Virginia
More informationKing-Devick Reading Acceleration Program
King-Devick Reading Acceleration Program The Effect of In-School Saccadic Training on Reading Fluency and Comprehension in First and Second Grade Students: A Randomized Controlled Trial David Dodick, MD*,1;
More informationEffects of a Course on Ophthalmologist Communication Skills: A Pilot Study
Education for Health, Vol. 17, No. 2, July 2004, 163 171 COMMUNICATION Effects of a Course on Ophthalmologist Communication Skills: A Pilot Study ELENA VEGNI & EGIDIO A. MOJA Department of Medicine, Surgery
More informationReading Comprehension Tests Vary in the Skills They Assess: Differential Dependence on Decoding and Oral Comprehension
SCIENTIFIC STUDIES OF READING, 12(3), 281 300 Copyright 2008 Taylor & Francis Group, LLC ISSN: 1088-8438 print / 1532-799X online DOI: 10.1080/10888430802132279 Reading Comprehension Tests Vary in the
More informationDr. Isadore Dyer, Association of American Medical Colleges
Fall/Winter 2013 Volume 60, Number 2 Examiner National Board of Medical Examiners 3750 Market Street Philadelphia, PA 19104-3102 www.nbme.org NBME Plans Its 100th Annual Meeting On May 5, 2015, the NBME
More informationEvaluation of a College Freshman Diversity Research Program
Evaluation of a College Freshman Diversity Research Program Sarah Garner University of Washington, Seattle, Washington 98195 Michael J. Tremmel University of Washington, Seattle, Washington 98195 Sarah
More informationTools to SUPPORT IMPLEMENTATION OF a monitoring system for regularly scheduled series
RSS RSS Tools to SUPPORT IMPLEMENTATION OF a monitoring system for regularly scheduled series DEVELOPED BY the Accreditation council for continuing medical education December 2005; Updated JANUARY 2008
More informationSchool Inspection in Hesse/Germany
Hessisches Kultusministerium School Inspection in Hesse/Germany Contents 1. Introduction...2 2. School inspection as a Procedure for Quality Assurance and Quality Enhancement...2 3. The Hessian framework
More information