Calibrating Standards-based Assessment Tasks for English as a First Foreign Language Standard-setting Procedures in Germany
|
|
- Shawn Nelson
- 6 years ago
- Views:
Transcription
1
2 Calibrating Standards-based Assessment Tasks for English as a First Foreign Language Standard-setting Procedures in Germany
3
4 Claudia Harsch, Hans Anand Pant, Olaf Köller (Eds.) Calibrating Standards-based Assessment Tasks for English as a First Foreign Language Standard-setting Procedures in Germany Volume 2 Waxmann 2010 Münster / New York / München / Berlin
5 Bibliographic information published by the Deutsche Nationalbibliothek The Deutsche Nationalbibliothek lists this publication in the Deutsche Nationalbibliografie; detailed bibliographic data are available in the Internet at ISBN Waxmann Verlag GmbH, Münster Cover design: Christian Averbeck, Münster Layout: Stoddart Satz- und Layoutservice, Münster Print: Hubert & Co., Göttingen Printed on age-resistant paper, acid-free as per ISO 9706 All rights reserved Printed in Germany
6 Table of Contents Preamble...7 Claudia Harsch and Simon P. Tiffin-Richards Chapter 1: Setting Standards in Line with the Common European Framework of Reference 1.1 Educational Standards and Standards-based Assessment Educational Reform in Germany The IQB Tests to Evaluate the NES for English as the first Foreign Language (EFL) Test Development Relating IQB Tests to CEF-levels Familiarization Specification Standardization Empirical Validation Rationale for Selecting the Item Pool Description of Panelists Standard-setting Procedure at IQB Possible Avenues Standard-setting Context and Methods Chosen Research into Validity of the Standard-setting Procedure...34 André A. Rupp and Raphaela Porsch Chapter 2: Standard-setting Item Pool 2.1 Overview of Pilot Study Design Sampling Process for Students Test Design Administration of Test Booklets Methodology Analyses for Reading and Listening Comprehension Scales CTT Analyses IRT Analyses Item Fit Analyses Item Bias Analyses Basic Validity Analyses Scale Linking Across Designs Analyses for Written Expression Scale Rating Criteria Rater Training Descriptive Summary Statistics Results from Multi-faceted Rasch Analyses
7 Simon P. Tiffin-Richards Chapter 3: The Bookmark Standard-setting Method 3.1 Background Bookmark Standard-setting Method Design Participants Materials Training Methodological Issues Data Collection Standard-setting Workshop Results Cut-score Summaries...64 Karen Draney and Cathleen Kennedy Chapter 4: The Standard-setting Criterion Mapping Method 4.1 Background Preparation Preparation of the Software Preparation of the Participants...76 Karen Draney, Cathleen Kennedy, Steve Moore and Linda Morell Chapter 5: Procedural Standard-setting Issues 5.1 Criterion Mapping Report of Conduct for Criterion Mapping Data Collection Issues, Problems, Future Recommendations Bookmark Training Session Data Collection Summary and Conclusions Simon P. Tiffin-Richards and Olaf Köller Chapter 6: Comparison and Synthesis of Multiple Standard-setting Methods and Panels 6.1 Setting Educational Standards The Standard-setting Study Panel Composition Factor Method Modification Factor General Conclusions Synthesizing and Reporting Results References Appendices
8 Preamble This document is the second in a multi-part technical report series describing the development, calibration, and validation of standards-based tests for English as a first foreign language at the Institute for Educational Progress (Institut zur Qualitätsentwicklung im Bildungswesen, IQB) in Berlin, Germany. The entire report series can be viewed as the documentary cornerstone to provide evidence for what Bachmann (2005) calls the assessment use argument for these tests, which is comprised of the assessment validity argument and the assessment utilization argument. This second report provides empirical evidence of the calibration study of the test item pool and of the standard-setting procedures. Its aim is to transparently describe the decisions, methods and procedures which led to setting cut-scores and standards in alignment with the National Educational Standards (NES) (i.e., the Länderübergreifende Bildungsstandards) for English as a first foreign language at the upper secondary level for the Hauptschulabschluss (KMK, 2003) and the Mittlerer Bildungsabschluss (KMK, 2004) and in alignment with the Common European Framework of Reference for Languages (CEF) (Council of Europe, 2001). In chapter 1, we outline the aims and charges of the IQB within the context of evaluating the NES in Germany by means of standardized proficiency tests. Since the NES refer to the CEF with regards to the competency model and the proficiency levels they delineate, the process of aligning the proficiency tests to the CEF levels takes center stage in this chapter. We describe the purpose of the tests, the aims of the standard-setting procedures, the rationale of the chosen procedures, as well as the use of the Manual for Linking Language Examinations to the CEF (Council of Europe, 2003a 1 ). Chapter 2 contains relevant empirical information that formed the basis of the item and task selection for the standard-setting process, which is described in the following chapters in more detail. Specifically, this chapter describes the structure of the item pool and the respondent population that were used for the pilot study in terms of their key characteristics. A detailed description of the scaling process for the three domains of reading, listening, and writing is then provided. This description includes a summary of information about model fit and item bias analyses. The following two chapters delineate the two chosen methods, the Bookmark method and the Criterion Mapping method, which was developed by the Berkeley Assessment and Evaluation Research Center (BEAR), University of California, United States. We describe the background, design, participants preparation, and processes. Chapter 5 provides information on conducting the actual standardsetting sessions, including procedures followed, data gathered, and issues and problems that arose, for both the Criterion Mapping and Bookmarking methods. 1 Since the revised version of the Manual was not yet available at the time when the standard-setting project was planned and conducted, we refer to the Preliminary Pilot Version of the Manual (Council of Europe, 2003a). 7
9 The final chapter provides a synthesis of the standard-setting study s results, thoughts on their interpretation, and implications of how the results are reported and presented to stakeholders and policy makers. The standard-setting workshop took place in July 2008 in Potsdam, Germany and was conducted in collaboration with Karen Draney, Cathleen Kennedy, Steve Moore and Linda Morell (BEAR). It was a joint effort of numerous collaborators who were instrumental in planning, preparing and conducting this study: We would particularly like to thank our colleagues from the BEAR Assessment Center, all participants in the workshop who traveled as far as from Switzerland and Norway, and our expert team consisting of Dr. Neus Figueras, Dr. Rita Green, Dr. Felianka Kaftandjieva, Gabriele Kecker, Prof. Dr. Dr. Rainer Lehmann, Dr. Eli Moe, Prof. Dr. Günter Nold, Prof. Dr. Konrad Schroeder and Prof. Dr. Wolfgang Zydatiss for their advice during regular meetings. Last but not least we would like to thank the colleagues and student workers at the IQB who were dedicated to making this workshop and study possible. 8
10 Claudia Harsch and Simon P. Tiffin-Richards Chapter 1: Setting Standards in Line with the Common European Framework of Reference
11
12 1.1 Educational Standards and Standards-based Assessment Educational Reform in Germany Plans for educational reforms in Germany were made after international large-scale achievement studies in the 1990s (such as TIMSS and PISA, e.g., Baumert et al., 2001, Prenzel et al., 2004) revealed mediocre results amongst German 9 th graders (for a more detailed discussion, cf. Rupp, Vock, Harsch, & Köller, 2008 in the Technical Report I). The Standing Conference of the Ministers of Education and Cultural Affairs of the Federal States in Germany (KMK) took several steps to improve educational outcomes. The ministers agreed that only a teaching approach promoting the development of competencies that are based on real-life demands in authentic contexts, coupled with the teaching of basic skills, will achieve the longterm goal of improving the situation of education in general ( bildung-schule/qualitaetssicherung-in-schulen.html). The following essential fields of action were identified by the KMK: increased support for students with learning difficulties, improvement of classroom-based quality development and quality assurance, timely identification of poor readers, revision of the structure of the educational system, specifically with respect to school-leaving certificates and the paths that lead to them, more intensive use of learning periods and of learning opportunities, and development of improved structures for staffing and school organization. The aim of the KMK is to improve the quality of schooling, to make school-leaving certificates comparable across states, and to achieve a general permeability of the educational system within Germany. For this purpose, National Educational Standards (NES) were seen as an important steering instrument (Klieme et al., 2003), because they represent binding conventions for educational output. NES were released in 2003/2004 for the end of primary and lower secondary schooling and they are obligatory for all schools ( home1.htm). The NES targeting the secondary phase of schooling formulate school-leaving qualifications for the core subjects German, Mathematics, and the first Foreign Language English or French. They are a blend of content and performance standards describing core competencies to be acquired by students at the end of lower secondary school. Two different standard documents were released by the KMK for each core subject, the first one describing standards for the track leading to a basic general education school leaving certificate (Hauptschulabschluss) at the end of grade 9 (herein after referred to as HSA-track standards); the second one defining the core competencies for the track leading to a more extensive basic general education school leaving certificate (Mittlerer Schulabschluss) at the end of grade 10 (herein after referred to as MSA-track standards). Policy-makers have decided that the NES should reflect the typical achievement of 11
13 the students. Formally, the NES are normative guidelines for monitoring educational systems, serving the purpose to provide information about cross-sectional achievement status as well as longitudinal achievement trends (Schecker & Parchmann, 2007). In order to coordinate and concentrate different means to steer educational improvement, the KMK (2006) agreed on a Comprehensive Strategy for Educational Quality Monitoring. This strategy proclaims a paradigm shift within the educational policy in Germany towards the concepts of output orientation, reporting and system monitoring. In order to monitor the development of quality within the educational system, educational processes and outcomes are to be evaluated by external means. For that purpose, the KMK (2006) proposed four fundamental procedures: international large-scale assessment studies (such as PISA, PIRLS and TIMSS), centralized evaluation of the NES in a nationwide sample comparing the German federal states (Ländervergleich), state-wide testing schemes at the end of grade 3 and grade 8 linked to the NES (Vergleichsarbeiten), centralized coordinated reporting with regards to educational achievement and other aspects of the educational system (Bildungsberichterstattung von Bund und Ländern). It becomes clear that the NES are a pivotal means for system monitoring and accountability purposes. In order to evaluate, implement and further develop the Standards, a new academic institution was established, the Institute for Educational Progress (Institut zur Qualitätsentwicklung im Bildungswesen, IQB) The IQB The IQB was founded in 2004 by the KMK, institutionally bound to the Humboldt- University at Berlin. The institute is financed by the 16 federal states. The administrative structure of IQB is shown in figure
14 Federal states of Germany Standing Conference of the Ministers of Education and Cultural Affairs of the federal states in Germany Humboldt University Berlin General Secretary Official Committee: Quality assurance in schools Faculty of Philosophy IV Academic experts Board IQB Q Institut zur Qualitätsentwicklung im Bildungswesen Institute for Educational Progress Figure 1.1 Administrative structure of the IQB (from Rupp et al., 2008) In brief, the IQB pursues the aim of operationalizing the NES, providing standardsbased proficiency scales for each domain, assessing achievement levels on these proficiency scales, providing suggestions for further refinement of the Standard documents, and supporting their implementation. Of particular importance for the report here is the development of a large item pool of standards-based test items, which are used to assemble standards-based proficiency tests, which, in turn, are employed to establish the national proficiency scales in alignment with the NES. On the one hand, the test items developed by the IQB serve to define national proficiency scales, and will be used in the nationwide studies starting in 2009 (Ländervergleich as described above). On the other hand, they are made available to the federal states for their own independent use in standardized tests for state-wide or multi-state system monitoring. A small portion of the items will be publicly released to illustrate their design, layout, and purpose. 13
15 1.1.3 Tests to Evaluate the NES for English as the first Foreign Language (EFL) The NES for the first foreign language are based on the Common European Framework of Reference (CEF). The CEF is described as follows by the European Council: Developed through a process of scientific research and wide consultation, this document provides a practical tool for setting clear standards to be attained at successive stages of learning and for evaluating outcomes in an internationally comparable manner. ( ) The CEF provides a basis for the mutual recognition of language qualifications, thus facilitating educational and occupational mobility. It is increasingly used in the reform of national curricula and by international consortia for the comparison of language certificates. On this subject, also consult the following sections: 1. Manual for relating language examinations to the CEF (Pilot project) 2. Illustrations of levels of language proficiency. ( ) The CEF is a document which describes in a comprehensive manner i) the competences necessary for communication, ii) the related knowledge and skills and iii) the situations and domains of communication. The CEF defines levels of attainment in different aspects of its descriptive scheme with illustrative descriptors scale. (Source: The CEF thus provides a competence model which distinguishes relevant categories of communicative competence on six successive levels of proficiency. The levels are A1 (Breakthrough) and A2 (Waystage), characterizing basic users, B1 (Threshold) and B2 (Vantage), characterizing independent users, and C1 (Effective Operational Proficiency) and C2 (Mastery) characterizing proficient users. The NES for the first foreign language target the CEF-level A2 for the HSA-track, and B1/B+ for the MSA-track of the German school system (cf. appendix A and KMK 2003, 2004). The competence model used in the NES is directly derived from the model in the CEF: 14
16 Functional Communicative Competencies Communicative Skills Reading comprehension Listening and audio-visual comprehension Speaking (a) Participation in conversations (b) Connected speech Writing Mediation Availability of Linguistic Resources Vocabulary Grammar Pronunciation and Intonation Orthography / Spelling Intercultural Competencies Socio-cultural orientation knowledge Sensitivity for cultural diversity Practical skills for intercultural encounters Methodological Competencies Text reception (reading comprehension and listening comprehension) Interaction Text production (speaking and writing) Learning strategies Presentation skills and skills for media usage Learning awareness and organization of learning processes Figure 1.2 Competence model in the NES (from Rupp et al., 2008) The competence areas and individual competencies in the NES are grounded in the CEF as they were selected and adapted from the descriptions therein and rearranged into a competence model that suits the German context for standardsbased language learning and standards-based assessment. (For a detailed exposition on how these competencies are linked to the competencies and levels of the CEF, cf. Rupp et al., 2008, Section II). As a result of the complexity of many of the competence areas, neither the CEF (cf. Weir, 2005) nor the NES can provide for competence scales that could supply precise information for the development of test items. Thus, the challenge for the development of standards-based tests at the IQB was to operationalize the coarse-grained descriptions in the NES and in the CEF into test specifications that could guide trained item writers to produce test items that are (a) construct valid, in the sense that they are consistent with theoretical models of language competence, and (b) standard valid, in the sense that they are consistent with the formulations in the NES and the CEF. Section IV of the Technical Report I describes in depths how these challenges were met. The overall purpose of the IQB project Standard Evaluation of the first foreign language English was to develop national proficiency scales for the competence areas of reading comprehension, listening comprehension and writing, whereby the levels of proficiency should reflect the CEF levels A1 to C1. Due to experiences from previous large-scale language assessments in Germany, especially the Study 15
17 of German and English Language Proficiency (Deutsch-Englisch Schülerleistungen International, DESI; Beck & Klieme, 2007), an expected level of proficiency for students in the pilot study sample was available. Based on this information, it was decided that tasks for the HSA-track sample should range from CEF proficiency levels A1 to B1, while tasks for the MSA-track sample should range from CEF proficiency levels A2 to C1; no C2 tasks were used in either sample due to strong expected floor effects. Moreover, C2 tasks were excluded to avoid frustration effects in test-takers. In order to develop the proficiency scales, the IQB was charged to first develop criterion-oriented proficiency tests which operationalize the above mentioned three domains as described in the NES as well as in relevant CEF scales targeting the CEF-levels A1 to C1 (see Rupp et al., 2008 for an overview of the relevant CEF scales). These standards-based tests are designed for large-scale assessment studies for the purpose of system monitoring. However, due to a lack of statistical precision given the small number of items per domain, the actual IQB test booklets are not suitable for individual diagnostic testing Test Development The test development was a collaborative endeavor achieved between September 2005 and July 2007 by an interdisciplinary team of language assessment specialists, didacticians, psychometricians, and a team of up to 20 teachers representing all federal states and school types of Germany. The process was monitored and consulted by a group of internationally renowned experts in the field of language assessment. As the test development in its different stages is described in Rupp et al. (2008, sections IV to VI), we will focus here on those features necessary to understand and judge the process of standard-setting and aligning the IQB tests to the CEF. The test development started with training the teachers in the field of item development by an internationally renowned expert. The teachers were familiarized with the CEF competence model and proficiency levels, and trained in writing test specifications as well as in writing test items. They received nine one-week workshops, during which they developed domain- and level-specific test specifications. In between the workshops, the teachers worked in regional groups, receiving feedback and guidance on a regular basis. The item developers characterized and specified each test item with regards to the targeted domain and level, using a catalogue of characteristics based on the Dutch Grid and the ALTE grids (see appendix B for the respective lists of item characteristics employed by IQB). Each test item within the domain of the receptive skills targets one specific CEF-level only; therefore, the items are called level-specific items. Nevertheless, one task (i. e., a testlet consisting of standardized instruction, reading or listening stimulus and test items) may entail items targeting two adjacent levels. The items testing receptive skills focus on one reading or listening behavior within one task and there is only one format per task. The receptive item pool includes a variety of 16
How do we balance statistical evidence with expert judgement when aligning tests to the CEFR?
How do we balance statistical evidence with expert judgement when aligning tests to the CEFR? Professor Anthony Green CRELLA University of Bedfordshire Colin Finnerty Senior Assessment Manager Oxford University
More informationLinking the Common European Framework of Reference and the Michigan English Language Assessment Battery Technical Report
Linking the Common European Framework of Reference and the Michigan English Language Assessment Battery Technical Report Contact Information All correspondence and mailings should be addressed to: CaMLA
More informationA Brief Profile of the National Educational Panel Study
Page 1 A Brief Profile of the National Educational Panel Study "A national lighthouse casting its beam over international waters" is how the German Minister for Education and Research, Dr. Annette Schavan,
More informationReferencing the Danish Qualifications Framework for Lifelong Learning to the European Qualifications Framework
Referencing the Danish Qualifications for Lifelong Learning to the European Qualifications Referencing the Danish Qualifications for Lifelong Learning to the European Qualifications 2011 Referencing the
More informationSchool Inspection in Hesse/Germany
Hessisches Kultusministerium School Inspection in Hesse/Germany Contents 1. Introduction...2 2. School inspection as a Procedure for Quality Assurance and Quality Enhancement...2 3. The Hessian framework
More informationGroup of National Experts on Vocational Education and Training
Unclassified EDU/EDPC/VET(2013)3 EDU/EDPC/VET(2013)3 Unclassified Organisation de Coopération et de Développement Économiques Organisation for Economic Co-operation and Development 24-Apr-2013 English
More informationArts, Literature and Communication (500.A1)
Arts, Literature and Communication (500.A1) Pre-University Program College Education This document was produced by the Ministère de l Éducation et de l Enseignement supérieur. Coordination and content
More informationELP in whole-school use. Case study Norway. Anita Nyberg
EUROPEAN CENTRE FOR MODERN LANGUAGES 3rd Medium Term Programme ELP in whole-school use Case study Norway Anita Nyberg Summary Kastellet School, Oslo primary and lower secondary school (pupils aged 6 16)
More informationPIRLS 2006 ASSESSMENT FRAMEWORK AND SPECIFICATIONS TIMSS & PIRLS. 2nd Edition. Progress in International Reading Literacy Study.
PIRLS 2006 ASSESSMENT FRAMEWORK AND SPECIFICATIONS Progress in International Reading Literacy Study 2nd Edition February 2006 Ina V.S. Mullis Ann M. Kennedy Michael O. Martin Marian Sainsbury TIMSS & PIRLS
More informationCEF, oral assessment and autonomous learning in daily college practice
CEF, oral assessment and autonomous learning in daily college practice ULB Lut Baten K.U.Leuven An innovative web environment for online oral assessment of intercultural professional contexts 1 Demos The
More informationAccountability in the Netherlands
Accountability in the Netherlands Anton Béguin Cambridge, 19 October 2009 2 Ideal: Unobtrusive indicators of quality 3 Accountability System level international assessments National assessments School
More informationThe recognition, evaluation and accreditation of European Postgraduate Programmes.
1 The recognition, evaluation and accreditation of European Postgraduate Programmes. Sue Lawrence and Nol Reverda Introduction The validation of awards and courses within higher education has traditionally,
More information2013/Q&PQ THE SOUTH AFRICAN QUALIFICATIONS AUTHORITY
2013/Q&PQ THE SOUTH AFRICAN QUALIFICATIONS AUTHORITY Policy and Criteria for the Registration of Qualifications and Part Qualifications on the National Qualifications Framework Compiled and produced by:
More informationINNOVATION SCIENCES TU/e OW 2010 DEPARTMENT OF INDUSTRIAL ENGINEERING AND INNOVATION SCIENCES EINDHOVEN UNIVERSITY OF TECHNOLOGY
INNOVATION SCIENCES TU/e OW 2010 DEPARTMENT OF INDUSTRIAL ENGINEERING AND INNOVATION SCIENCES EINDHOVEN UNIVERSITY OF TECHNOLOGY Quality Assurance Netherlands Universities (QANU) Catharijnesingel 56 P.O
More informationGlobal MBA Master of Business Administration (MBA)
International Foundation for Quality Assurance in Higher Education FIBAA BERLINER FREIHEIT 20-24 D-53111 BONN Programme Qualification awarded on completion: Intended length of programme Type of programme
More informationCase Study 4 Evaluation, testing and assessment. May I help you, madam? English for office communication in an adult education centre
Case Study 4 Evaluation, testing and assessment May I help you, madam? English for office communication in an adult education centre The use of current evaluation, assessment and testing instruments in
More informationPre-vocational Education in Germany and China
Pre-vocational Education in Germany and China Jun Li Pre-vocational Education in Germany and China A Comparison of Curricula and Its Implications Jun Li Tongji University, Shanghai, People s Republic of
More informationHDR Presentation of Thesis Procedures pro-030 Version: 2.01
HDR Presentation of Thesis Procedures pro-030 To be read in conjunction with: Research Practice Policy Version: 2.01 Last amendment: 02 April 2014 Next Review: Apr 2016 Approved By: Academic Board Date:
More informationMODERNISATION OF HIGHER EDUCATION PROGRAMMES IN THE FRAMEWORK OF BOLOGNA: ECTS AND THE TUNING APPROACH
EUROPEAN CREDIT TRANSFER AND ACCUMULATION SYSTEM (ECTS): Priorities and challenges for Lithuanian Higher Education Vilnius 27 April 2011 MODERNISATION OF HIGHER EDUCATION PROGRAMMES IN THE FRAMEWORK OF
More informationHigher Education Review (Embedded Colleges) of Navitas UK Holdings Ltd. Hertfordshire International College
Higher Education Review (Embedded Colleges) of Navitas UK Holdings Ltd April 2016 Contents About this review... 1 Key findings... 2 QAA's judgements about... 2 Good practice... 2 Theme: Digital Literacies...
More informationGERMAN STUDIES (GRMN)
Bucknell University 1 GERMAN STUDIES (GRMN) Faculty Professors: Katherine M. Faull, Peter Keitel (Director) Associate Professors: Bastian Heinsohn, Helen G. Morris-Keitel (Chair) German Studies provides
More informationTABLE OF CONTENTS. By-Law 1: The Faculty Council...3
FACULTY OF SOCIAL SCIENCES, University of Ottawa Faculty By-Laws (November 21, 2017) TABLE OF CONTENTS By-Law 1: The Faculty Council....3 1.1 Mandate... 3 1.2 Members... 3 1.3 Procedures for electing Faculty
More informationEmma Kushtina ODL organisation system analysis. Szczecin University of Technology
Emma Kushtina ODL organisation system analysis Szczecin University of Technology 1 European Higher Education Area Ongoing Bologna Process (1999 2010, ) European Framework of Qualifications Open and Distance
More informationGuidelines for Writing an Internship Report
Guidelines for Writing an Internship Report Master of Commerce (MCOM) Program Bahauddin Zakariya University, Multan Table of Contents Table of Contents... 2 1. Introduction.... 3 2. The Required Components
More informationACADEMIC AFFAIRS GUIDELINES
ACADEMIC AFFAIRS GUIDELINES Section 8: General Education Title: General Education Assessment Guidelines Number (Current Format) Number (Prior Format) Date Last Revised 8.7 XIV 09/2017 Reference: BOR Policy
More informationANGLAIS LANGUE SECONDE
ANGLAIS LANGUE SECONDE ANG-5055-6 DEFINITION OF THE DOMAIN SEPTEMBRE 1995 ANGLAIS LANGUE SECONDE ANG-5055-6 DEFINITION OF THE DOMAIN SEPTEMBER 1995 Direction de la formation générale des adultes Service
More informationHEPCLIL (Higher Education Perspectives on Content and Language Integrated Learning). Vic, 2014.
HEPCLIL (Higher Education Perspectives on Content and Language Integrated Learning). Vic, 2014. Content and Language Integration as a part of a degree reform at Tampere University of Technology Nina Niemelä
More informationEQuIP Review Feedback
EQuIP Review Feedback Lesson/Unit Name: On the Rainy River and The Red Convertible (Module 4, Unit 1) Content Area: English language arts Grade Level: 11 Dimension I Alignment to the Depth of the CCSS
More information5. UPPER INTERMEDIATE
Triolearn General Programmes adapt the standards and the Qualifications of Common European Framework of Reference (CEFR) and Cambridge ESOL. It is designed to be compatible to the local and the regional
More informationExploring the adaptability of the CEFR in the construction of a writing ability scale for test for English majors
Zou and Zhang Language Testing in Asia (2017) 7:18 DOI 10.1186/s40468-017-0050-3 RESEARCH Open Access Exploring the adaptability of the CEFR in the construction of a writing ability scale for test for
More informationState of play of EQF implementation in Montenegro Zora Bogicevic, Ministry of Education Rajko Kosovic, VET Center
State of play of EQF implementation in Montenegro Zora Bogicevic, Ministry of Education Rajko Kosovic, VET Center XXV meeting of the EQF Advisory Group 4-6 June 2014, Brussels MONTENEGRIN QUALIFICATIONS
More informationGuidelines for the Use of the Continuing Education Unit (CEU)
Guidelines for the Use of the Continuing Education Unit (CEU) The UNC Policy Manual The essential educational mission of the University is augmented through a broad range of activities generally categorized
More informationAchievement Level Descriptors for American Literature and Composition
Achievement Level Descriptors for American Literature and Composition Georgia Department of Education September 2015 All Rights Reserved Achievement Levels and Achievement Level Descriptors With the implementation
More informationSusanne Rieger on her objectives as new President of EASC
EASC Newsletter November 2015 Dear members, dear colleagues, With this newsletter we would like to convey to all of you a summary of the information from EASC that may be interesting for members. This
More informationDocument number: 2013/ Programs Committee 6/2014 (July) Agenda Item 42.0 Bachelor of Engineering with Honours in Software Engineering
Document number: 2013/0006139 Programs Committee 6/2014 (July) Agenda Item 42.0 Bachelor of Engineering with Honours in Software Engineering Program Learning Outcomes Threshold Learning Outcomes for Engineering
More informationTHESIS GUIDE FORMAL INSTRUCTION GUIDE FOR MASTER S THESIS WRITING SCHOOL OF BUSINESS
THESIS GUIDE FORMAL INSTRUCTION GUIDE FOR MASTER S THESIS WRITING SCHOOL OF BUSINESS 1. Introduction VERSION: DECEMBER 2015 A master s thesis is more than just a requirement towards your Master of Science
More informationInternational School of Kigali, Rwanda
International School of Kigali, Rwanda Engaging Individuals Encouraging Success Enriching Global Citizens Parent Guide to the Grade 3 Curriculum International School of Kigali, Rwanda Guiding Statements
More informationProficiency Illusion
KINGSBURY RESEARCH CENTER Proficiency Illusion Deborah Adkins, MS 1 Partnering to Help All Kids Learn NWEA.org 503.624.1951 121 NW Everett St., Portland, OR 97209 Executive Summary At the heart of the
More informationInformation for Candidates
Information for Candidates BULATS This information is intended principally for candidates who are intending to take Cambridge ESOL's BULATS Test. It has sections to help them familiarise themselves with
More informationDelaware Performance Appraisal System Building greater skills and knowledge for educators
Delaware Performance Appraisal System Building greater skills and knowledge for educators DPAS-II Guide (Revised) for Teachers Updated August 2017 Table of Contents I. Introduction to DPAS II Purpose of
More informationELS LanguagE CEntrES CurriCuLum OvErviEw & PEDagOgiCaL PhiLOSOPhy
ELS Language Centres Curriculum Overview & Pedagogical Philosophy .. TABLE OF CONTENTS ELS Background. 1 Acceptance of ELS Levels. 1 Features of ELS Language Centres Academic Program 2 English for Academic
More informationForeign Languages. Foreign Languages, General
Foreign Languages, General Program Description This program introduces the fundamentals of language learning (listening, speaking, reading, writing, and culture) with emphasis on language production, grammar,
More information2 di 7 29/06/
2 di 7 29/06/2011 9.09 Preamble The General Conference of the United Nations Educational, Scientific and Cultural Organization, meeting at Paris from 17 October 1989 to 16 November 1989 at its twenty-fifth
More informationPresentation Advice for your Professional Review
Presentation Advice for your Professional Review This document contains useful tips for both aspiring engineers and technicians on: managing your professional development from the start planning your Review
More informationNumber of students enrolled in the program in Fall, 2011: 20. Faculty member completing template: Molly Dugan (Date: 1/26/2012)
Program: Journalism Minor Department: Communication Studies Number of students enrolled in the program in Fall, 2011: 20 Faculty member completing template: Molly Dugan (Date: 1/26/2012) Period of reference
More informationDelaware Performance Appraisal System Building greater skills and knowledge for educators
Delaware Performance Appraisal System Building greater skills and knowledge for educators DPAS-II Guide for Administrators (Assistant Principals) Guide for Evaluating Assistant Principals Revised August
More informationProgramme Specification. BSc (Hons) RURAL LAND MANAGEMENT
Programme Specification BSc (Hons) RURAL LAND MANAGEMENT D GUIDE SEPTEMBER 2016 ROYAL AGRICULTURAL UNIVERSITY, CIRENCESTER PROGRAMME SPECIFICATION BSc (Hons) RURAL LAND MANAGEMENT NB The information contained
More informationMaster s Programme in European Studies
Programme syllabus for the Master s Programme in European Studies 120 higher education credits Second Cycle Confirmed by the Faculty Board of Social Sciences 2015-03-09 2 1. Degree Programme title and
More informationNote: Principal version Modification Amendment Modification Amendment Modification Complete version from 1 October 2014
Note: The following curriculum is a consolidated version. It is legally non-binding and for informational purposes only. The legally binding versions are found in the University of Innsbruck Bulletins
More informationThe IDN Variant Issues Project: A Study of Issues Related to the Delegation of IDN Variant TLDs. 20 April 2011
The IDN Variant Issues Project: A Study of Issues Related to the Delegation of IDN Variant TLDs 20 April 2011 Project Proposal updated based on comments received during the Public Comment period held from
More informationPromotion and Tenure Policy
Promotion and Tenure Policy This policy was ratified by each school in the college in May, 2014. INTRODUCTION The Scripps College of Communication faculty comprises a diverse community of scholar-teachers
More informationIndicators Teacher understands the active nature of student learning and attains information about levels of development for groups of students.
Domain 1- The Learner and Learning 1a: Learner Development The teacher understands how learners grow and develop, recognizing that patterns of learning and development vary individually within and across
More informationReviewed by Florina Erbeli
reviews c e p s Journal Vol.2 N o 3 Year 2012 181 Kormos, J. and Smith, A. M. (2012). Teaching Languages to Students with Specific Learning Differences. Bristol: Multilingual Matters. 232 p., ISBN 978-1-84769-620-5.
More informationDeveloping an Assessment Plan to Learn About Student Learning
Developing an Assessment Plan to Learn About Student Learning By Peggy L. Maki, Senior Scholar, Assessing for Learning American Association for Higher Education (pre-publication version of article that
More informationAudit Of Teaching Assignments. An Integrated Analysis of Teacher Educational Background and Courses Taught October 2007
Audit Of Teaching Assignments October 2007 Audit Of Teaching Assignments Audit of Teaching Assignments Crown copyright, Province of Nova Scotia, 2007 The contents of this publication may be reproduced
More informationGreetings, Ed Morris Executive Director Division of Adult and Career Education Los Angeles Unified School District
Greetings, The thesis of my presentation at this year s California Adult Education Administrators (CAEAA) Conference was that the imprecise and inconsistent nature of the statute authorizing adult education
More informationEuropean Higher Education in a Global Setting. A Strategy for the External Dimension of the Bologna Process. 1. Introduction
European Higher Education in a Global Setting. A Strategy for the External Dimension of the Bologna Process. 1. Introduction The Bologna Declaration (1999) sets out the objective of increasing the international
More informationDesigning a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses
Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Thomas F.C. Woodhall Masters Candidate in Civil Engineering Queen s University at Kingston,
More informationUPPER SECONDARY CURRICULUM OPTIONS AND LABOR MARKET PERFORMANCE: EVIDENCE FROM A GRADUATES SURVEY IN GREECE
UPPER SECONDARY CURRICULUM OPTIONS AND LABOR MARKET PERFORMANCE: EVIDENCE FROM A GRADUATES SURVEY IN GREECE Stamatis Paleocrassas, Panagiotis Rousseas, Vassilia Vretakou Pedagogical Institute, Athens Abstract
More informationInitial English Language Training for Controllers and Pilots. Mr. John Kennedy École Nationale de L Aviation Civile (ENAC) Toulouse, France.
Initial English Language Training for Controllers and Pilots Mr. John Kennedy École Nationale de L Aviation Civile (ENAC) Toulouse, France Summary All French trainee controllers and some French pilots
More informationEvidence-Centered Design: The TOEIC Speaking and Writing Tests
Compendium Study Evidence-Centered Design: The TOEIC Speaking and Writing Tests Susan Hines January 2010 Based on preliminary market data collected by ETS in 2004 from the TOEIC test score users (e.g.,
More informationDEPARTMENT OF SOCIOLOGY CONTACTS: ADDRESS. Full Professor Saša Boţić, Ph.D. HEAD OF THE DEPARTMENT. Assistant Professor Karin Doolan, Ph.D.
DEPARTMENT OF SOCIOLOGY CONTACTS: HEAD OF THE DEPARTMENT NAME AND TITLE Full Saša Boţić, TEL./FAX Tel.: +385(0)23 200 681 E-MAIL ADDRESS sbozic@unizd.hr VICE-HEAD OF THE DEPARTMENT Assistant Karin Doolan,
More informationTen years after the Bologna: Not Bologna has failed, but Berlin and Munich!
EUROPE BULDING POLICY IN GERMANY: THE BOLOGNA PROCESS Ten years after the Bologna: Not Bologna has failed, but Berlin and Munich! Dr. Aneliya Koeva The beginning... The Bologna Declaration of 19 June 1999
More informationPurpose of internal assessment. Guidance and authenticity. Internal assessment. Assessment
Assessment Internal assessment Purpose of internal assessment Internal assessment is an integral part of the course and is compulsory for both SL and HL students. It enables students to demonstrate the
More informationProgramme Specification. MSc in International Real Estate
Programme Specification MSc in International Real Estate IRE GUIDE OCTOBER 2014 ROYAL AGRICULTURAL UNIVERSITY, CIRENCESTER PROGRAMME SPECIFICATION MSc International Real Estate NB The information contained
More informationAn Analysis of the Early Assessment Program (EAP) Assessment for English
An Analysis of the Early Assessment Program (EAP) Assessment for English Conducted by Achieve on behalf of the California Diploma Project (ADP) and Policy Analysis for California Education (PACE) October
More informationLearning Microsoft Office Excel
A Correlation and Narrative Brief of Learning Microsoft Office Excel 2010 2012 To the Tennessee for Tennessee for TEXTBOOK NARRATIVE FOR THE STATE OF TENNESEE Student Edition with CD-ROM (ISBN: 9780135112106)
More informationCELTA. Syllabus and Assessment Guidelines. Third Edition. University of Cambridge ESOL Examinations 1 Hills Road Cambridge CB1 2EU United Kingdom
CELTA Syllabus and Assessment Guidelines Third Edition CELTA (Certificate in Teaching English to Speakers of Other Languages) is accredited by Ofqual (the regulator of qualifications, examinations and
More informationTIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE. Pierre Foy
TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE Pierre Foy TIMSS Advanced 2015 orks User Guide for the International Database Pierre Foy Contributors: Victoria A.S. Centurino, Kerry E. Cotter,
More informationSpecial Edition. Starter Teacher s Pack. Adrian Doff, Sabina Ostrowska & Johanna Stirling With Rachel Thake, Cathy Brabben & Mark Lloyd
Special Edition A1 Starter Teacher s Pack Adrian Doff, Sabina Ostrowska & Johanna Stirling With Rachel Thake, Cathy Brabben & Mark Lloyd Acknowledgements Adrian Doff would like to thank Karen Momber and
More informationStudy on the implementation and development of an ECVET system for apprenticeship
Study on the implementation and development of an ECVET system for apprenticeship Thomas Reglin Gabriele Fietz Forschungsinstitut Betriebliche Bildung (f-bb) ggmbh Nuremberg Isabelle Le Mouillour BIBB,
More informationThe Werner Siemens House. at the University of St.Gallen
PROFESSOR DR. ROBERT WALDBURGER The Werner Siemens House at the 1. The Law and Economics degree course at the The Law and Economics degree course at the was born out of an initiative based on practical
More informationMathematics Program Assessment Plan
Mathematics Program Assessment Plan Introduction This assessment plan is tentative and will continue to be refined as needed to best fit the requirements of the Board of Regent s and UAS Program Review
More informationBASIC EDUCATION IN GHANA IN THE POST-REFORM PERIOD
BASIC EDUCATION IN GHANA IN THE POST-REFORM PERIOD By Abena D. Oduro Centre for Policy Analysis Accra November, 2000 Please do not Quote, Comments Welcome. ABSTRACT This paper reviews the first stage of
More informationFocus on. Learning THE ACCREDITATION MANUAL 2013 WASC EDITION
Focus on Learning THE ACCREDITATION MANUAL ACCREDITING COMMISSION FOR SCHOOLS, WESTERN ASSOCIATION OF SCHOOLS AND COLLEGES www.acswasc.org 10/10/12 2013 WASC EDITION Focus on Learning THE ACCREDITATION
More informationQuality in University Lifelong Learning (ULLL) and the Bologna process
Quality in University Lifelong Learning (ULLL) and the Bologna process The workshop will critique various quality models and tools as a result of EU LLL policy, such as consideration of the European Standards
More informationBilingual Staffing Guidelines
Bilingual Staffing Guidelines Introduction In accordance with the Yukon Languages Act, the Yukon government is committed to ensuring the public can receive government services in English or in French from
More informationEDUCATION AND DECENTRALIZATION
EDUCATION AND DECENTRALIZATION Skopje, 2006 Education and Decentralization: User-friendly Manual Author: Jovan Ananiev, MSc. Project management: OSCE Spillover Monitor Mission to Skopje/Confidence Building
More informationCONNECTICUT GUIDELINES FOR EDUCATOR EVALUATION. Connecticut State Department of Education
CONNECTICUT GUIDELINES FOR EDUCATOR EVALUATION Connecticut State Department of Education October 2017 Preface Connecticut s educators are committed to ensuring that students develop the skills and acquire
More informationUNIVERSITY OF THESSALY DEPARTMENT OF EARLY CHILDHOOD EDUCATION POSTGRADUATE STUDIES INFORMATION GUIDE
UNIVERSITY OF THESSALY DEPARTMENT OF EARLY CHILDHOOD EDUCATION POSTGRADUATE STUDIES INFORMATION GUIDE 2011-2012 CONTENTS Page INTRODUCTION 3 A. BRIEF PRESENTATION OF THE MASTER S PROGRAMME 3 A.1. OVERVIEW
More informationAbbey Academies Trust. Every Child Matters
Abbey Academies Trust Every Child Matters Amended POLICY For Modern Foreign Languages (MFL) September 2005 September 2014 September 2008 September 2011 Every Child Matters within a loving and caring Christian
More informationOklahoma State University Policy and Procedures
Oklahoma State University Policy and Procedures GUIDELINES TO GOVERN WORKLOAD ASSIGNMENTS OF FACULTY MEMBERS 2-0110 ACADEMIC AFFAIRS August 2014 INTRODUCTION 1.01 Oklahoma State University, as a comprehensive
More informationEvidence for Reliability, Validity and Learning Effectiveness
PEARSON EDUCATION Evidence for Reliability, Validity and Learning Effectiveness Introduction Pearson Knowledge Technologies has conducted a large number and wide variety of reliability and validity studies
More informationIB Diploma Subject Selection Brochure
IB Diploma Subject Selection Brochure Mrs Annie Thomson Head of Senior School IB Diploma Coordinator German International School Sydney 33 Myoora Road, Terrey Hills, NSW 2084 P: +61 (0)2 9485 1900 F: +61
More informationPsychometric Research Brief Office of Shared Accountability
August 2012 Psychometric Research Brief Office of Shared Accountability Linking Measures of Academic Progress in Mathematics and Maryland School Assessment in Mathematics Huafang Zhao, Ph.D. This brief
More informationTextbook Evalyation:
STUDIES IN LITERATURE AND LANGUAGE Vol. 1, No. 8, 2010, pp. 54-60 www.cscanada.net ISSN 1923-1555 [Print] ISSN 1923-1563 [Online] www.cscanada.org Textbook Evalyation: EFL Teachers Perspectives on New
More informationELDER MEDIATION INTERNATIONAL NETWORK
ELDER MEDIATION INTERNATIONAL NETWORK Call for Presenters EMIN World Summit Mount Saint Vincent University Halifax, Canada June 25-27, 2014 The call for speakers and panelists for the upcoming Summit is
More informationVTCT Level 3 Award in Education and Training
VTCT Level 3 Award in Education and Training Operational start date: 1st April 2014 Credit value: 12 Total Qualification Time (TQT): 120 Guided learning hours (GLH): 48 Qualification number: 601/2758/2
More informationDefinitions for KRS to Committee for Mathematics Achievement -- Membership, purposes, organization, staffing, and duties
158.842 Definitions for KRS 158.840 to 158.844 -- Committee for Mathematics Achievement -- Membership, purposes, organization, staffing, and duties of committee -- Report to Interim Joint Committee on
More informationPh.D. in Behavior Analysis Ph.d. i atferdsanalyse
Program Description Ph.D. in Behavior Analysis Ph.d. i atferdsanalyse 180 ECTS credits Approval Approved by the Norwegian Agency for Quality Assurance in Education (NOKUT) on the 23rd April 2010 Approved
More informationNATIONAL CENTER FOR EDUCATION STATISTICS RESPONSE TO RECOMMENDATIONS OF THE NATIONAL ASSESSMENT GOVERNING BOARD AD HOC COMMITTEE ON.
NATIONAL CENTER FOR EDUCATION STATISTICS RESPONSE TO RECOMMENDATIONS OF THE NATIONAL ASSESSMENT GOVERNING BOARD AD HOC COMMITTEE ON NAEP TESTING AND REPORTING OF STUDENTS WITH DISABILITIES (SD) AND ENGLISH
More informationGUIDE TO EVALUATING DISTANCE EDUCATION AND CORRESPONDENCE EDUCATION
GUIDE TO EVALUATING DISTANCE EDUCATION AND CORRESPONDENCE EDUCATION A Publication of the Accrediting Commission For Community and Junior Colleges Western Association of Schools and Colleges For use in
More informationThe Oregon Literacy Framework of September 2009 as it Applies to grades K-3
The Oregon Literacy Framework of September 2009 as it Applies to grades K-3 The State Board adopted the Oregon K-12 Literacy Framework (December 2009) as guidance for the State, districts, and schools
More informationAcademic Program Assessment Prior to Implementation (Policy and Procedures)
Academic Program Assessment Prior to Implementation (Policy and Procedures) March 2013 Additional copies of this report may be obtained from: Maritime Provinces Higher Education Commission 82 Westmorland
More informationGuidelines for Project I Delivery and Assessment Department of Industrial and Mechanical Engineering Lebanese American University
Guidelines for Project I Delivery and Assessment Department of Industrial and Mechanical Engineering Lebanese American University Approved: July 6, 2009 Amended: July 28, 2009 Amended: October 30, 2009
More informationASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE
ASSESSMENT REPORT FOR GENERAL EDUCATION CATEGORY 1C: WRITING INTENSIVE March 28, 2002 Prepared by the Writing Intensive General Education Category Course Instructor Group Table of Contents Section Page
More informationSouth Carolina English Language Arts
South Carolina English Language Arts A S O F J U N E 2 0, 2 0 1 0, T H I S S TAT E H A D A D O P T E D T H E CO M M O N CO R E S TAT E S TA N DA R D S. DOCUMENTS REVIEWED South Carolina Academic Content
More informationCollege of Engineering and Applied Science Department of Computer Science
College of Engineering and Applied Science Department of Computer Science Guidelines for Doctor of Philosophy in Engineering Focus Area: Security Last Updated April 2017 I. INTRODUCTION The College of
More informationColorado State University Department of Construction Management. Assessment Results and Action Plans
Colorado State University Department of Construction Management Assessment Results and Action Plans Updated: Spring 2015 Table of Contents Table of Contents... 2 List of Tables... 3 Table of Figures...
More informationIntegrating Common Core Standards and CASAS Content Standards: Improving Instruction and Adult Learner Outcomes
Integrating Common Core Standards and CASAS Content Standards: Improving Instruction and Adult Learner Outcomes Linda Taylor, CASAS ltaylor@casas.or Susana van Bezooijen, CASAS svanb@casas.org CASAS and
More information