Internal Quality Assurance Processes Dr Neil Sparnon ncsparnon@gmail.com
First... Quality Assurance What is it? Quality assurance can be described as the systematic, structured and continuous attention to quality in terms of quality maintenance and improvement;
Quality Assurance Systems Try to Answer... 1. What is the university trying to do? WHAT? 2. How is the university trying to do it? HOW? 3. How does the university know it works? EVIDENCE; 4. How does the university change in order to improve? FUTURE ACTION.
Context Quality Assurance Context in Europe and the UK
Context - Europe Standards and Guidelines for Quality Assurance in the European Higher Education Area, (ESG), (May 2015) Internal Quality Assurance; External Quality Assurance; Quality Assurance Agencies.
ESG Areas of Internal Quality Assurance Policy for quality assurance; Design and approval of programmes; Student-centred teaching learning and assessment; Student admission, progression, recognition and certification; Teaching staff; Learning resources and student support; Information management; Public information; On-going monitoring and periodic review of programmes; Cyclical external quality assurance.
Student admission, progression, recognition and certification Standard (WHAT) Institutions should consistently apply pre-defined and published regulations covering the student life cycle e.g. student admission, progression, recognition and certification. Guidelines (HOW)
UK Quality Assurance Agency for Higher Education (QAA) Meet European requirements; Define UK standards and practice within this context; Used as a basis for international collaboration and UK funding in HE.
Context United Kingdom The Quality Assurance Code Part A The Setting and Maintenance of Standards (WHAT) Part B Ensuring and Enhancing Academic Quality (HOW) Part C Information (EVIDENCE)
Internal Quality Assurance Mechanisms at Anglia Ruskin University
Quality Assurance in Anglia Ruskin University - Principles Quality is the primary and ultimate responsibility of Senate and Committees to which it may delegate specific responsibilities (Faculties, Associate Colleges etc); Everyone is responsible for developing and maintaining a culture of continuous improvement ; Engagement with students and employers through appropriate representation, consultation and feedback; The use of appropriate external and internal reference points, including the QAA s Quality Assurance Code and the requirements and expectations of professional statutory and regulatory bodies (PSRB);
Quality Assurance in Anglia Ruskin University - Principles The use of external peers in the approval and periodic review of the curriculum; The use of data to inform and drive processes; The provision to increase the opportunity for people to access British education, both in the UK and internationally through a variety of franchised and validated arrangements with approved Associate Colleges.
Infrastructure: The ARU Quality Assurance Unit Responsible for administering and facilitating the operation of Anglia Ruskin's quality assurance and enhancement policies and procedures. 21 staff based at two campuses; Head of the Quality Assurance Unit reports directly to the Pro-Vice Chancellor (Academic).
ARU QAU Principal Areas of Responsibility Taught Courses Approval and Re-approval; Taught Courses - Annual Monitoring; Taught Courses Review; Appointment of External Examiners; Research Degrees; Approval of Associate Colleges; Quality Enhancement Audits.
Principal Activities Regulations (WHAT) Academic Regulations (including Assessment Regulations) Research Degree Regulations Senate Codes of Practice (HOW) Curriculum Approval and Review; Admissions; Assessment (including); Generic Assessment Criteria and Marking Standards Moderation Module Report External Examiners for Taught Courses; Research Degrees; Collaborative Provision; Work-based placement learning.
Quantitative Data Sets (EVIDENCE) Internally Generated Student Module evaluations; Statistics for annual monitoring of curriculum delivery (e,g. module level performance, student continuation and completion rates, award classifications); Statistics for periodic review; Annual Student Experience Survey. Externally Generated Annual National Student Survey; Postgraduate Research Experience Survey; LibQual Survey.
Qualitative Data Sets (EVIDENCE) Internally Generated: Employer engagement mechanisms; Student module evaluations; Outcome reports on Quality Enhancement Audits; Student consultation/representations systems. Externally Generated: External Examiner Reports; Reports of PSRB visits; Department and Associate College reports on Annual Monitoring.
Two Examples of Internal Quality Assurance Procedures Course approval and re-approval, Quality Assurance Audits
Taught Course Approval and Re-approval Purpose Academic standards are bench-marked against national standards and PSRB; Module outcomes collectively contribute to student achievement of course learning outcomes; High quality educational support is provided to enable students to achieve; Teaching team is committed to continuous improvement.
Course Approval and Re-approval Process Step 1: Planning approval Planning approval must be obtained from the Faculty Management Team and the Corporate Management Team before any new course can proceed to approval Step 2: Scheduling of Approval Event by the Quality Assurance Unit (QAU) Once planning approval has been received each proposal will be allocated to an 'event' which will be serviced by an Executive Officer from QAU. A 10 week timetable is recommended. Step 3: Development of curriculum and submission of proposal document The Proposal Team develops the curriculum with input from relevant stakeholders, the culmination of which is a Proposal Document (drafted using the templates and guidance accessible which is considered by the Panel at the approval event.
Course Approval and Re-approval Process Step 4: Event Planning meeting Following receipt of the proposal documentation the Executive Officer convenes a Planning Meeting between the Panel Chair, the Proposal Team Leader, the Technical Officer and the Executive Officer. The planning meeting considers the adequacy of the proposal documentation and determines whether the threshold standard has been met, identifies any further documentary requirements considers and agrees the programme and domestic arrangements for the approval event.
Course Approval and Re-approval Process Step 5: Approval Event The event is typically held 10 weeks after the submission of the documentation by the Team and involves a Chair, Internal and External Panel members, an Executive Officer from QAU and, where appropriate, representatives from Professional, Statutory and Regulatory Bodies. Prior to the approval event, the Executive Officer seeks comments from the Panel on the proposal documentation. Comments are captured on a 'Areas for Discussion' template and are circulated to the Proposal Team in advance of the event. The comments raised form the basis of the agenda for the meeting with the Proposal Team.
Quality Enhancement Audits: Purpose investigate whether existing internal policies and procedures to enhance the student experience are working consistently and effectively in practice; consider whether existing internal policies, procedures and planned outcomes are consistent with external reference points; evaluate whether comparable levels of delivery and service are achieved;
Quality Enhancement Audits: Purpose examine the ownership and effectiveness of existing Anglia Ruskin processes for curriculum delivery and management and the evidence for continuous enhancement; commend strengths and identify examples of good practice inform the continuous development of Anglia Ruskin s policies and procedures for curriculum delivery and management.
Quality Enhancement Audits: Conduct Appointment of an Audit Panel to review: documentation (eg policies, minutes, records) questionnaire surveys (to establish information, or opinions) formal and informal (but minuted) meetings with groups of staff and/or students (to test the implementation in practice of a given procedure) observation (of a meeting) checklist (list of items to be identified or observed) random sampling of work and records audit trails through a procedure, process or area of work to chart developments over time.
Quality Enhancement Audits: Outcomes An audit report is produced following each Quality Enhancement Audit. The report comprises: executive summary the audit strategy main findings quality of learning opportunities maintenance and enhancement of learning opportunities conclusions and recommendations, which may include a recommendation to amend a process summary of good practice Action Plan
Conclusions
Conclusions Context is important BUT... Ultimately, responsibility lies with the institution and affects everyone; Clear statements of importance of QA through: Reporting lines; Infrastructure and resources. Clear Statements at European, National and Institutional Levels around: Standards (What); Practice (How) Evidence (How you know) Follow up actions Systems