Information for universities and policy makers

Transcription

1 Information for universities and policy makers

2 Making a difference to your admissions process The BioMedical Admissions Test (BMAT) is the proven standard for robust, transparent admissions testing. It is used by universities worldwide, to help them select students with the right skills and aptitude to succeed on challenging medical, biomedical, dental and related undergraduate courses. The test goes beyond assessing a student s academic ability at school level. It focuses on key skills needed for success in demanding science-based study, including critical thinking, problem solving, data analysis, communication and application of scientific knowledge. A 2-hour admissions test. Used by world-leading universities since 2003 a proven and established test. Taken around the world in secure, authorised test centres. Suitable for students with English skills at CEFR* Level B2 or above. Developed, administered and marked by Cambridge Assessment Admissions Testing, part of a not-forprofit department of the University of Cambridge. Why use BMAT? Select applicants who will succeed on the course Our research shows a positive relationship between BMAT scores and on-course success. Low BMAT scores have also been shown to be a predictor of students who perform poorly on the course or fail to complete their degree. Fair to all applicants BMAT assesses students in a fair and objective way, giving all applicants an equal chance to demonstrate their potential. We routinely monitor the test performance of different groups (by gender, educational background, etc.) to ensure that there is no bias. Support inclusion To support inclusion, universities are recommended to consider a range of factors when assessing a student s potential, and to not focus solely on school qualifications. BMAT measures skills needed for success in higher education, giving applicants the opportunity to show their potential in addition to their school academic record. Support widening participation We work with universities to put arrangements in place, so that students in financial difficulties can have their test fee reimbursed. Underpinned by research Our dedicated research team conducts rigorous investigations to ensure BMAT conforms to the highest quality standards, and makes a useful contribution to the university admissions process. Assist internationalisation The increasing internationalisation of higher education means a growth in applicants from around the world. BMAT provides a common measure for comparing applicants with a wide range of qualifications. In addition, our global test centre network enables your applicants to take the test in their home country. Free preparation resources The test is designed to be taken with minimal preparation. Support materials are freely available from our website, which means costly preparation courses are unnecessary. *Common European Framework of Reference for Languages (CEFR) the international standard for describing language ability. 2 Information for universities and policy makers

3 What s in BMAT? Section 1: Aptitude and Skills Test focus Question type Timing Tests the ability to apply key skills used in undergraduate study: Problem solving (13 questions) Demands insight to determine how to encode and process numerical information so as to solve problems. Requires candidates to: select relevant information, recognise analogous cases, and determine and apply appropriate numerical and algebraic operations. Understanding argument (10 questions) Presents a series of logical arguments and requires candidates to: identify reasons, assumptions and conclusions, detect flaws and draw conclusions. Data analysis and inference (12 questions) Requires the use of information skills, data interpretation, analysis and scientific inference and deduction to reach appropriate conclusions from material provided in different forms: verbal, statistical and graphical. Section 2: Scientific Knowledge and Applications Tests the ability to apply scientific knowledge typically covered in non-specialist school science and mathematics courses. There are 27 questions in total, including: Multiple choice 60 1 hour 30 Biology (6 8 questions) Chemistry (6 8 questions) Physics (6 8 questions) Mathematics (5 7 questions). Multiple choice 30 minutes Section 3: Writing Task Tests the ability to communicate effectively in writing, organising ideas and presenting them clearly and concisely. 30 Questions provide a short proposition and typically require candidates to: explain or discuss the proposition s implications suggest a counter proposition or argument suggest a (method for) resolution. Candidates are required to answer one question. The questions are based on topics of general, medical or scientific interest. Essay 30 minutes Download the BMAT specification and past papers at: admissionstestingservice.org/resources Information for universities and policy makers 3

4 Who uses BMAT? We work with universities around the world. These include: Read what institutions have to say about BMAT We have chosen to work with Cambridge Assessment Admissions Testing because it has demonstrated that BMAT can deliver robust validity data. BMAT is proven, ethically aligned and most importantly it is fair; it gives our applicants the best possible opportunity to demonstrate their knowledge, excellence and potential, whatever their social backgrounds or educational chronology. We are confident that BMAT will help us to get the right undergraduates from amongst the brightest candidates. We were looking for a selection tool that tested applicants knowledge and their scientific understanding. In particular, we wanted something that showed they are able to construct and clearly demonstrate a good argument. [...] We believe that the BMAT allows students to shine. Darren Beaney Head of Admissions, Recruitment and Widening Participation Brighton and Sussex Medical School (BSMS), UK Dr Gail Nicholls Director of Admissions University of Leeds School of Medicine, UK View more testimonials on our website: admissionstestingservice.org/casestudies 4 Information for universities and policy makers

5 Understanding BMAT scoring and results Scoring Section 1 (Aptitude and Skills) and Section 2 (Scientific Knowledge and Applications) Reported on a 9-point scale 1 (low) to 9 (high). Section 3 (Writing Task) A score for quality of content on a scale of 0 (low) to 5 (high). A score for quality of written English on a scale of A (high) to E (low). Results Results are provided directly to universities in electronic format. Universities receive a scanned copy of the applicant s Writing Task. Results are issued 3 4 weeks after the test session. Applicants receive their results using our online system shortly after universities receive the results. Use of results Results are typically used alongside other information available to admissions staff: Some universities score students applications and place a fixed weighting on the BMAT score, alongside other criteria such as school grades. Other universities use BMAT scores as part of a more holistic review of a student s application. BMAT is typically used pre-interview, to help with shortlisting applicants. Some universities may rank applicants by BMAT score, once they have applied other admissions criteria, such as checking that applicants have met academic requirements. Some universities find that certain sections of BMAT are a particularly good predictor of student success on their course, and place more emphasis on these scores. Some universities use the response to the Writing Task as a basis for discussions at the interview. Information for universities and policy makers 5

6 Underpinned by research Our dedicated team conducts a broad programme of research to ensure the fairness and validity of BMAT for university admissions. Our research agenda is guided by key principles that underpin our approach to admissions testing. Positive impact for test-takers We believe that taking an admissions test like BMAT should have a positive impact for test-takers. The test encompasses critical thinking, data analysis, problem solving, communicative writing, and applying scientific knowledge in novel contexts. BMAT has been designed to ensure that the time test-takers invest in preparing for the test will help to develop skills directly beneficial to their academic work on their degree course. Selection based on potential BMAT provides a snapshot of a student s ability, at the time of their application to medical or related study at university. Our research (see Fig. 1) shows that performance on BMAT is a good predictor of later performance on the course. Tests application of existing knowledge and skills BMAT focuses on knowledge and skills that should be already familiar to students. Extensive research analysis has been undertaken to align the scientific knowledge elements of the test with the knowledge and skills expected in typical school curricula internationally up to age 16. We aim to minimise the amount of new learning or study needed, to ensure that preparation is accessible to all test-takers. Our research into how test-takers prepare for BMAT informs the free preparation materials and advice we provide on our website. Fig. 1: Relationship between BMAT Section 2 scores and high/low performance in the 1 st year of pre-clinical medical study. i) ii) Probability of achieving a 1 st Examination data: Faculty BMAT of Section Biology, 2 University scores of Cambridge. The X-axes cover the range BMAT of BMAT Section scores 2 of scores students. In this study: i) A student with a BMAT Section 2 score of 5.0 has around a 0.1 probability of achieving a 1 st class examination result whereas a student with a score of 7.0 has around a 0.3 probability. ii) Students admitted with a low BMAT Section 2 score have a high probability of achieving a 3 rd class result or below (3 rd class, ordinary, fail or left the course). Probability of achieving a 3 rd or below Information for universities and policy makers

7 Quality assurance and fairness We monitor the performance of our test items to inform our cycle of continuous improvement and ensure questions used in the test conform to the highest quality standards. Advanced statistical analyses are used to monitor the performance of different test-taker groups (e.g. gender, school background) to guard against any potential bias. Highly trained teams of examiners mark the BMAT Writing Task in a standardised process, where they are assessed for the consistency and stability of their marking. Each script is marked by two, and sometimes three, examiners to ensure the fairness of the marks awarded. Collaborative working A broader view of admissions An admissions test is one part of universities admissions process. Our research encompasses wider approaches to selection, looking at key issues including: widening access initiatives to biomedical courses applicants perceptions of the university admissions process the relationship between BMAT and other admissions assessments such as Multiple Mini Interviews. The universities that use BMAT have input into our research programmes. We also fund research in partnership with these universities, to explore the impact of the test in their own admissions context. We hold regular meetings with BMAT-using universities, to discuss key areas for research and review best practice in selection procedures. Information for universities and policy makers 7

8 About Cambridge Assessment Admissions Testing Cambridge Assessment Admissions Testing offers a range of tests to support selection and recruitment for higher education, professional organisations and governments around the world. Underpinned by robust and rigorous research, our assessments include: assessments in thinking skills admissions tests for medicine and healthcare behavioural styles assessment subject-specific admissions tests. We are part of a not-for-profit department of the University of Cambridge. Contact us Stakeholder Relations Cambridge Assessment Admissions Testing 1 Hills Road Cambridge CB1 2EU United Kingdom admissionstesting@cambridgeassessment.org.uk admissionstestingservice.org/institutions/bmat UCLES 2017 CE/2263/7Y01 All details are correct at the time of going to print in January * *