Umalusi s research model NQF Research Conference June 2010 Liz Burroughs and Emmanuel Sibanda - Umalusi
Why does Umalusi do research? Is an intrinsic part of Umalusi s approach to quality assuring the standard of education Provides information and insights that drive the work of maintaining and setting standards Motivates changes Umalusi introduces to QA Provides research-based leadership in its area of responsibility Since 2008, has been a mandated responsibility for Umalusi as a Quality Council
What drives Umalusi s research? The need to monitor and understand the standard of the qualifications it certifies The need to investigate problems which impact on the work Umalusi does, or areas which, i.t.o its mandate, Umalusi may need to be accountable for The need to explore ways that could strengthen or alter Umalusi s quality assurance practices The need to be accountable to the public
What kinds of research does Umalusi do? Answers critical questions: new research Explores new areas for growth: commissioned research Reports on routine processes: QAA reports to the Minister and E&A site visit report Research leading to indicators relating to its quality assurance work within education and training
Year What research has Umalusi done? Qualification 2004 1993 and 2004 SC examinations SC 2006 Apples or oranges? School and college subjects SC/old NSC 2007 The f word U Std-based 2007 Making educational judgements 2008 Learning from Africa: the SC and other Anglophone exit qualifications 2008 Maintaining Standards: the SC and the NSC SC/NSC 2009 Examining the foundations GETC:ABET 2009 Signalling performance 2010 2009 Maintaining Standards Report: Overview SC/NSC 2010 The f in NCV: comparing common subjects in the NSC and NC(V) SC NSC/ NC(V) (2010) Evaluating the South African NSC NSC/ I Quals (2010) Foundation Phase research
What are Umalusi s research concerns? The standard of school-leaving certificates The standard in Adult Basic Education and Training The need to reconceptualise Adult and Vocational Education and Training (AVET) Issues in assessment and provision New directions in assessment (eg IRT) Qualifications on the GENFET qualifications framework
Who does Umalusi s research? Umalusi staff Teams of evaluators (eg. Maintaining Standards) Specialist consultants (eg vocational specialists, strategic educational thinkers, IRT experts) Research relationships with universities and HESA Research Forum members provide support and research
How is Umalusi s research done? Conceptualized internally usually to solve a problem Project proposal research questions, methodology, budget, plan, TORs, consultants Instrument Training Report writing Reporting and use of data Sharing of findings more widely: recommendations and improvement plans
What does Umalusi gain from its research? Solutions to challenges it faces; findings about the system: standardization Greater certainty in proposing those solutions or sharing findings with the Departments of Education and the public: implementation of the NCV in colleges An ability to shape thinking and policy nationally as a result of the research: adult matric; curricula & exams New ways of thinking about its mandate: use of anchor items, role in post-school education and training Policy direction: qualifications, practical assessment
How does Umalusi share its research? Reports and papers as publications and on the web Workshops particularly with the most relevant stakeholders Seminar series with CEPD and Wits Regional Seminars dissemination of findings, eg. to universities and provincial departments of education Training eg. examiner and moderator training Conference presentations
How does Umalusi reflect on its research? Self-evaluation and reflection on processes are seen as important and ongoing aspects of the research Making educational judgements (2007) was a retrospective look at Umalusi s research from 2004, and provided the foundation for the work 2008 2010 A similar review is planned for 2010 2011 Indicators report: use of critical data to reflect on quality assurance of education and training, 2010