ESL Testing ENGL 6373, Spring 2017 Wednesday 4:40 pm - 7:10 pm University of Texas Rio Grande Valley Instructor Information Instructor: Dr. Minhee Eom Office: ELABS 241 Phone: 956-664-3424 E-mail: minhee.eom@utrgv.edu Office Hours: MW 1:00pm - 1:40pm, 3:00 pm- 4:30pm, or by appointment Course Description Evaluations of learners of English as a Second Language (ESL) including theoretical principles and test development guidelines for standardized testing as well as classroom assessments. Areas covered include construct validity, test methods, defining language constructs, scoring, and item evaluation in testing of ESL learning. Student Learning Outcomes The English Department SLO's (student learning outcomes) for the MAESL program as developed by a departmental committee follow: SLO 1 SLO 2 SLO 3 SLO 4 Students will demonstrate a comprehensive understanding of linguistic decisions and the English language phonology, morphology, syntax and semantics. Students will demonstrate an understanding of social, cognitive, and personal variables from research and experience in second language acquisition (SLA). Students will demonstrate a practical application of SLA and the English language to teaching and preparing teaching materials, testing, etc., in prospective real world settings. Students will be able to use discipline-appropriate technology applications (such as library databases, computer applications, internet research, non-print media, multi-media applications, desktop publishing, WebCt, course-based electronic communication, etc.) in preparation, discussion and presentation of the course assignments and/or projects. Course Objectives At the end of course, students should be able to: 1. Define theoretical principles of language testing such as constructs, validity, test methods, scoring and item evaluations (satisfying the SLO #1, 2, & 3). 2. Develop classroom tests for different language skills following test specifications and item writing guidelines (satisfying the SLO #3 & 4). 3. Evaluate overall test usefulness and qualities of English language tests (satisfying the SLO #1, 2 & 3). 4. Interpret the results of standardized tests to make appropriate inference about students language ability (satisfying the SLO #1, 2 & 3). 5. Calculate and interpret basic measurement statistics and indices (satisfying the SLO #3) ENG6373 Spring 2017, 1 of 5
Textbooks Required: Brown, H. D. & Abeywickarama, R. (2010) Language assessment: principles and classroom practices, 2 nd ed. Douglas, D. (2010). Understanding language testing. Recommended: Bachman, L. & Palmer, A. (2010). Language assessment in practice. Oxford University Press. Grading Policy Your final letter grad will consist of the followings: Exams: 40 % Project: 40 % Presentations: 10 % Attendance, Participation & Assignment: 10 % Exam Two exams will be given in class and count 50% of the final grade. Each exam counts 25%. The formats will include short answer questions, essay questions, and some problem solving questions. There is no make-up exam once the exam is administrated. If you cannot be present on the exam day, for an unavoidable legitimate reason, you must take it before the exam is given. There is no work given for extra credits to make up the low grade on exams. This satisfies the MAESL SLOs 1, 2 & 3. Project The project counts 35% of the final grade. For the project, you have two options: one to develop ESL/ELF tests and the other to conduct research related to language testing. For both options, you are required to collect empirical data: to evaluate your test items for the test development project and to produce the data analysis results for the research project. This assignment satisfies the MAESL SLOs 1, 2, 3 & 4. Test development option: In a team of two to three, you will be developing a test for ESL students at any grade level of your choice. This project requires the following deliverables: a. Proposal: Submit the outline of your project with the team member information b. Test overview & construct: You are to document student populations, purpose, and other background information of your test contexts. c. Test specification: For the construct of your test, you are expected to document test specifications and blue print. d. Item writing: You are expected to write items and questions for your test. Multiple choice tests may include about 25 questions. Performance based tests may include three to four questions depending on the nature of your project and the scoring rubrics. e. Item evaluation results: You are expected to recruit and administer your test to about 15-30 students for MC tests or about five students with two raters for performance-based tests. Based on the test taker s performances, you are to analyze and evaluate the quality of your tests. You may be able to complete this part of the project after we finish the topic of mini statistics and grading (see the tentative schedule below). f. Presentation ENG6373 Spring 2017, 2 of 5
Presentation The presentation constitutes 10% of your final grade. You are expected to choose and present a chapter of the required textbook. These assignments satisfy the SLOs 3 & 4. Attendance, Participation & Assignment As a graduate student, you are expected to attend every class and participate in discussions. The attendance and participation account for 10% of your final grade. Letter Grade Assignment Final letter grades of this course will be calculated based on the sum of prorated averages of all the requirements: A: 90-100 B: 80-89 C: 70-79 D: 60-69 F: below 59 General Course Policy Important! Do not simply stop attending and assume that you will be dropped from this course. If you wish to drop, you must contact me. Instructors cannot drop you anymore. IF you miss 25% or more of class times, you may receive an F at the end of the course regardless of your actual grade. Any alteration made in class must be for the benefit of all--students and instructor. Late submissions are not accepted as it would be unfair to the majority of students who do turn in their work as scheduled. If/when extra credit work is given, it is given to the class, not to individuals. Incompletes should be avoided at all costs. You will NOT be given an incomplete for late papers unless for the reasons outlined in the university handbook. In class interruptions--many students find interruptions cause problems in their understanding and note taking. Therefore, please turn off ALL cellular phones. Also, children do not belong in university classes; it is cruel to them! Tentative Schedule This schedule may change for the benefit of the majority of the students. Our class meets once a week, so some class times may be divided to cover lectures & presentations in the first hour and a project workshop in the second half. wk Topics Readings Dues: Test development track 1/18 Introduction; Syllabus 1/25 Test, Measurement; Brown Ch1; Douglas ch1; 2/1 Constructs B&P (handout) Selecting project teams 2/8 Online workshop Assignment Proposal due 2/15 Validity Douglas 2; Brown Ch 2; Chapelle (handout) ENG6373 Spring 2017, 3 of 5
2/22 Test specifications Douglas Ch 3; Brown Ch 3 3/1 Standards-based; standardized assessments; Alternatives in assessment Brown Ch 4, 5, 6; Douglas Ch 4 3/8 Exam 1 Test specification due 3/15 Spring break 3/22 Item writing and scoring rubrics Douglas; Brown Ch 12 3/29 Mini statistics & scoring Douglas Ch 5; Handout Test items due 4/5 Administration; piloting; Brown Ch5; Douglas Ch 4 4/12 Assessing reading, listening, speaking, writing 4/19 Exam 2 Brown Test administration 4/26 Project workshop Score analysis & results 5/3 Project Presentations Paper due Important Note: This syllabus, along with course assignments and due dates, are subject to change. It is the student s responsibility to check Blackboard for corrections or updates to the syllabus. Any changes will be clearly noted in course announcement or through Blackboard announcements or emails. UTRGV Policy STUDENTS WITH DISABILITIES: If you have a documented disability (physical, psychological, learning, or other disability which affects your academic performance) and would like to receive academic accommodations, please inform your instructor and contact Student Accessibility Services to schedule an appointment to initiate services. It is recommended that you schedule an appointment with Student Accessibility Services before classes start. However, accommodations can be provided at any time. Brownsville Campus: Student Accessibility Services is located in Cortez Hall Room 129 and can be contacted by phone at (956) 882-7374 (Voice) or via email at ability@utrgv.edu. Edinburg Campus: Student Accessibility Services is located in 108 University Center and can be contacted by phone at (956) 665-7005 (Voice), (956) 665-3840 (Fax), or via email at ability@utrgv.edu. MANDATORY COURSE EVALUATION PERIOD: Students are required to complete an ONLINE evaluation of this course, accessed through your UTRGV account (https://my.utrgv.edu/home); you will be contacted through email with further instructions. Students who complete their evaluations will have priority access to their grades. Online evaluations will be available: Feb 15 Feb 21 for Module 1 courses Apr 12 Apr 18 for Module 2 courses Apr 12 May 3 for full spring semester courses ATTENDANCE: Students are expected to attend all scheduled classes and may be dropped from the course for excessive absences. UTRGV s attendance policy excuses students from attending class if they are participating in officially sponsored university activities, such as athletics; for observance ENG6373 Spring 2017, 4 of 5
of religious holy days; or for military service. Students should contact the instructor in advance of the excused absence and arrange to make up missed work or examinations. SCHOLASTIC INTEGRITY: As members of a community dedicated to Honesty, Integrity and Respect, students are reminded that those who engage in scholastic dishonesty are subject to disciplinary penalties, including the possibility of failure in the course and expulsion from the University. Scholastic dishonesty includes but is not limited to: cheating, plagiarism, and collusion; submission for credit of any work or materials that are attributable in whole or in part to another person; taking an examination for another person; any act designed to give unfair advantage to a student; or the attempt to commit such acts. Since scholastic dishonesty harms the individual, all students and the integrity of the University, policies on scholastic dishonesty will be strictly enforced (Board of Regents Rules and Regulations and UTRGV Academic Integrity Guidelines). All scholastic dishonesty incidents will be reported to the Dean of Students. SEXUAL HARASSMENT, DISCRIMINATION, and VIOLENCE: In accordance with UT System regulations, your instructor is a responsible employee for reporting purposes under Title IX regulations and so must report any instance, occurring during a student s time in college, of sexual assault, stalking, dating violence, domestic violence, or sexual harassment about which she/he becomes aware during this course through writing, discussion, or personal disclosure. More information can be found at www.utrgv.edu/equity, including confidential resources available on campus. The faculty and staff of UTRGV actively strive to provide a learning, working, and living environment that promotes personal integrity, civility, and mutual respect in an environment free from sexual misconduct and discrimination. COURSE DROPS: According to UTRGV policy, students may drop any class without penalty earning a grade of DR until the official drop date. Following that date, students must be assigned a letter grade and can no longer drop the class. Students considering dropping the class should be aware of the 3-peat rule and the 6-drop rule so they can recognize how dropped classes may affect their academic success. The 6-drop rule refers to Texas law that dictates that undergraduate students may not drop more than six courses during their undergraduate career. Courses dropped at other Texas public higher education institutions will count toward the six-course drop limit. The 3-peat rule refers to additional fees charged to students who take the same class for the third time. ENG6373 Spring 2017, 5 of 5