The Closed Runway Operation Prevention Device: Applying Automatic Speech Recognition Technology for Aviation Safety

Size: px
Start display at page:

Download "The Closed Runway Operation Prevention Device: Applying Automatic Speech Recognition Technology for Aviation Safety"

Transcription

1 MITRE CAASD The Closed Runway Operation Prevention Device: Applying Automatic Speech Recognition Technology for Aviation Safety Shuo Chen Hunter Kopald June 25, 2015 Approved for Public Release; Distribution Unlimited The MITRE Corporation. All rights reserved.

2 2 Outline Overview of closed runway operations Closed Runway Operation Prevention Device (CROPD) Role of speech recognition Automatic speech recognition, in general and in ATC Tuning techniques to tune performance for the ATC domain Language modeling Acoustic model adaptation Semantic interpretation and confidence thresholding Evaluating the CROPD speech recognition performance through field demonstration Implications and future work

3 Overview of Closed Runway Operations 3 Local Controller Transmission American one twenty-three, wind three five zero at eight, runway one left, cleared for takeoff Prevention Mechanisms Standard Operating Procedures Basic memory aids: flight strip placards Additional automation systems that provide alerts Pilot Readback Runway one left, cleared for takeoff, american one twenty-three, X X Operations no longer allowed on runways designated as closed

4 Closed Runway Operation Prevention Device (CROPD) 4 FAA-proposed concept to prevent operations on closed runways by using automatic speech recognition to monitor controller clearances CROPD alerts if both: 1. Clearance detected cleared to land cleared for takeoff line up and wait Other clearances to be added, e.g., cleared touch and go 2. Runway associated with clearance is designated as closed Additional details Only listens to local controller transmissions Not integrated with other tower systems (e.g., ASDE-X) Intended for use at airports both with and without advanced runway safety systems Air Traffic Control Tower! Alert Controller Closed runway status Graphical User Interface Transmission Audio Closed Runway Status Alert Trigger CROPD in Equipment Room Speech recognition and understanding Identify spoken intent: 1. Runway 2. Clearance Alert logic Compare: 1. Runway and clearance detected 2. Closed runway status Trigger alert

5 5 The Role of Speech Recognition Objective of the speech recognition is to detect intent to use a runway United one twenty-three, wind three three zero at six, runway one center cleared to land, traffic departs runway three zero. Recognized numbers One twenty-three Three three zero Six One (center) Logical concept ACID Wind direction Wind speed Runway clearance For CROPD, intent can be considered the presence of a clearance and the runway associated with that clearance Simplifies performance measure to specific phrase-level accuracy Requires disambiguation of phrases that could be confused with runways Requires accurate association of the correct runway with the clearance post-recognition Three zero Runway Not all words in the transmission are equally important to the detection of intent Word Error Rate (WER) is not appropriate Need an application-specific metric Composite measure of both runway and clearance Considers correct association of runway with clearance Use intent as metric, with 5 outcome types CROPD Result Intent: RWY 30, CFT Intent: RWY 19L, CTL No Intent Truth Actual Transmission Intent: RWY30, CFT Correct Intent Incorrect Intent Missed Intent No Intent False Intent False Intent Correct Rejection Speech recognition performance is different from system performance Incorrect speech recognition results do not always translate to incorrect system performance

6 Automatic Speech Recognition 6 In General Automatic speech recognition performance depends not only on the speech input at the time of application, but also on what is already known about the application prior to use In some cases, meaning deduction is more important than word recognition Need to tailor system to the application Need to define what recognition is needed for success With Air Traffic Control ATC characteristics that make automatic speech recognition challenging Acoustic characteristics of audio equipment Acoustic characteristics of the speaker set Rate of speech Pronunciation Accents Deviations from standard phraseology ATC characteristics that facilitate automatic speech recognition Standard phraseology, when followed Acoustic modeling custom pronunciation adaptation Context information: what the system should expect to hear KIAD Airport Diagram 12 19R 1L 19C 1C 30 19L 1R

7 Tuning Recognition Performance: Language Model Creation and Adaptation 7 Language models define the universe of words and word sequences that the speech recognition system is designed to recognize 1. Finite-state grammars Manually defined vocabulary and word sequences Can yield near-perfect recognition in applications where speakers adhere to defined sequences Poor tolerance for phrase deviations 2. Statistical language models (SLMs) Machine-generated vocabulary and probability model of word sequences based on transcription data from target environment Robust to speech variations and disfluencies Can yield improbable word sequences CROPD used both types of models Initial A grammar benchmark containing of speech only runway recognition and performance on local controller audio using clearance the two phrases, CROPD with language common models yielded substitutions, 70% true intent additions, detection and omissions A 50% statistical false intent language detection model trained on 10,000+ transcriptions from the local controller position

8 Tuning Recognition Performance: Acoustic Model Adaptation 8 Acoustic models define the statistical signatures of speech sounds, i.e. phonemes, and specify the sound sequences that form words Default acoustic model usually provided out-of-the-box Methods of adaptation: 1. Pronunciation dictionaries CROPD used both types Acoustic of acoustic Model tuning = techniques = cleared-to-land Manually defined word pronunciations Accounts for common pronunciation variation and non-standard words, e.g. airline names, fix names 2. Automatic acoustic model adaptation Automatic supervised training of existing acoustic model with audio and transcriptions from target speaker set and environment Accounts for channel characteristics and consistent speech patterns, i.e. accents, within a speaker set Custom ATC dictionary Non-standard words, e.g. = niner niner = one Composite = words where coarticulation = and assimilation were frequently observed, e.g. clearedto-land clea da lan = Custom acoustic model adapted with audio and transcriptions from local controller position Second benchmark of speech recognition performance showed improvement increased true intent detection to 89% reduced false intent detection to 18%

9 Tuning Recognition Performance: Post- Recognition Processing 9 Semantic interpretation performs text processing to derive logical concepts from potentially error-filled raw text Apply application-specific reasoning to disambiguate confusable phrases Introduce robustness to recognition error by selectively using only parts of the recognized text For CROPD, a semantic interpretation algorithm was developed Rescores hypotheses based on systemgenerated confidence scores Deduces the most probable combination of clearance and runway Third benchmark of speech recognition performance showed improvement increased true intent detection to 95% reduced false intent detection to 17% Confidence Thresholding uses system-generated scores to bias final result to a specific balance of missed and false detections In CROPD, confidence thresholding is implemented System users must determine what confidence threshold is operationally acceptable Can vary by facility Does not affect speech recognition system Advises the application using the speech recognition whether to accept a recognition result based on its own certainty of accuracy

10 Evaluating Performance through Field Demonstration 10 In summer of 2014, the CROPD was field tested at KIAD as a part of the NAS Passively monitored local controller channel by connecting to the facility voice switch A subset of field audio was selected for performance evaluation The effect of adjusting the confidence threshold was also studied True Intent Transmissions with Intent Incorrect Intent Missed Intent Transmissions without Intent Correct Non-Intent False Intent 92.70% 4.77% 2.54% 90.33% 9.67% Analysis of some of the false and incorrect intent errors showed that the semantic interpretation algorithm could be further improved Erroneously discarding correctly recognized runway phrases Some ambiguous phrases still erroneously tagged as runways

11 11 Implications and Future Work A combination of various tuning techniques can yield significant performance improvements CROPD is a simple, isolated application that demonstrates the feasibility of applying automatic speech recognition on live ATC transmissions Other applications could make use of the same detected clearances for other purposes or detect new instructions for other controller positions More complex applications could also be feasible with the addition of context information from tower automation systems MITRE is currently investigating the benefits of integrating speech recognition with Tower/Surface surveillance data Leverage speech-derived intent to improve safety alert performance Use aircraft and airport state information to improve speech recognition performance

12 2015 The MITRE Corporation. All rights reserved. Questions?

13 Transmission without Intent Transmission with Intent A Closer Look at Recognition vs. System Performance 13 Spoken Intent: 19L, cleared to land Closure: none Detected: none Correct non-alert Spoken Intent: 19L, cleared to land Closure: 19L/1R Detected: none Missed Alert Correct Alert Behavior Incorrect Alert Behavior Spoken runway not closed, no missed or false alert Spoken runway closed, missed alert Missed Intent Detection

14 Transmission without Intent Transmission with Intent A Closer Look at Recognition vs. System Performance 14 Correct Alert Behavior Incorrect Alert Behavior False Intent Detection Detected runway not closed, no false alert Detected runway closed, false alert Spoken Intent: none Closure: none Detected: 19L, cleared to land Correct non-alert Spoken Intent: none Closure: 19L/1R Detected: 19L, cleared to land False Alert

15 Transmission without Intent Transmission with Intent A Closer Look at Recognition vs. System Performance 15 Spoken Intent: 19L, cleared to land Closure: none Detected: 1L, cleared to land Correct non-alert Spoken Intent: 19C, cleared to land Closure: 19C/1C Detected: 1C, cleared to land Correct non-alert Correct Alert Behavior Spoken runway not closed, detected runway not closed, no missed or false alert Spoken runway closed, detected runway is opposite end of spoken runway, alert correctly generated Incorrect Alert Behavior Spoken runway closed, detected runway not closed, missed alert Spoken Intent: 19L, cleared to land Closure: 19L/1R Detected: 1L, cleared to land Missed Alert Detected runway is not closed, no false alert Detected runway is closed, false alert Spoken Intent: 19L, cleared to land Closure: none Detected: 1L, cleared to land Correct non-alert Incorrect Intent Detection Spoken Intent: 19L, cleared to land Closure: 1L/19R Detected: 1L, cleared to land False Alert

Aviation English Solutions

Aviation English Solutions Aviation English Solutions DynEd's Aviation English solutions develop a level of oral English proficiency that can be relied on in times of stress and unpredictability so that concerns for accurate communication

More information

Human Factors Computer Based Training in Air Traffic Control

Human Factors Computer Based Training in Air Traffic Control Paper presented at Ninth International Symposium on Aviation Psychology, Columbus, Ohio, USA, April 28th to May 1st 1997. Human Factors Computer Based Training in Air Traffic Control A. Bellorini 1, P.

More information

Initial English Language Training for Controllers and Pilots. Mr. John Kennedy École Nationale de L Aviation Civile (ENAC) Toulouse, France.

Initial English Language Training for Controllers and Pilots. Mr. John Kennedy École Nationale de L Aviation Civile (ENAC) Toulouse, France. Initial English Language Training for Controllers and Pilots Mr. John Kennedy École Nationale de L Aviation Civile (ENAC) Toulouse, France Summary All French trainee controllers and some French pilots

More information

Speech Recognition at ICSI: Broadcast News and beyond

Speech Recognition at ICSI: Broadcast News and beyond Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI

More information

Measurement & Analysis in the Real World

Measurement & Analysis in the Real World Measurement & Analysis in the Real World Tools for Cleaning Messy Data Will Hayes SEI Robert Stoddard SEI Rhonda Brown SEI Software Solutions Conference 2015 November 16 18, 2015 Copyright 2015 Carnegie

More information

How to Judge the Quality of an Objective Classroom Test

How to Judge the Quality of an Objective Classroom Test How to Judge the Quality of an Objective Classroom Test Technical Bulletin #6 Evaluation and Examination Service The University of Iowa (319) 335-0356 HOW TO JUDGE THE QUALITY OF AN OBJECTIVE CLASSROOM

More information

On-Line Data Analytics

On-Line Data Analytics International Journal of Computer Applications in Engineering Sciences [VOL I, ISSUE III, SEPTEMBER 2011] [ISSN: 2231-4946] On-Line Data Analytics Yugandhar Vemulapalli #, Devarapalli Raghu *, Raja Jacob

More information

What the National Curriculum requires in reading at Y5 and Y6

What the National Curriculum requires in reading at Y5 and Y6 What the National Curriculum requires in reading at Y5 and Y6 Word reading apply their growing knowledge of root words, prefixes and suffixes (morphology and etymology), as listed in Appendix 1 of the

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

Natural Language Analysis and Machine Translation in Pilot - ATC Communication. Boh Wasyliw* & Douglas Clarke $

Natural Language Analysis and Machine Translation in Pilot - ATC Communication. Boh Wasyliw* & Douglas Clarke $ Natural Language Analysis and Machine Translation in Pilot - ATC Communication Boh Wasyliw* & Douglas Clarke $ *De Montfort University, UK $ Cranfield University, UK Abstract A significant factor in air

More information

WE GAVE A LAWYER BASIC MATH SKILLS, AND YOU WON T BELIEVE WHAT HAPPENED NEXT

WE GAVE A LAWYER BASIC MATH SKILLS, AND YOU WON T BELIEVE WHAT HAPPENED NEXT WE GAVE A LAWYER BASIC MATH SKILLS, AND YOU WON T BELIEVE WHAT HAPPENED NEXT PRACTICAL APPLICATIONS OF RANDOM SAMPLING IN ediscovery By Matthew Verga, J.D. INTRODUCTION Anyone who spends ample time working

More information

DEVELOPMENT AND EVALUATION OF AN AUTOMATED PATH PLANNING AID

DEVELOPMENT AND EVALUATION OF AN AUTOMATED PATH PLANNING AID DEVELOPMENT AND EVALUATION OF AN AUTOMATED PATH PLANNING AID A Thesis Presented to The Academic Faculty by Robert M. Watts In Partial Fulfillment of the Requirements for the Degree Master of Science in

More information

STUDIES WITH FABRICATED SWITCHBOARD DATA: EXPLORING SOURCES OF MODEL-DATA MISMATCH

STUDIES WITH FABRICATED SWITCHBOARD DATA: EXPLORING SOURCES OF MODEL-DATA MISMATCH STUDIES WITH FABRICATED SWITCHBOARD DATA: EXPLORING SOURCES OF MODEL-DATA MISMATCH Don McAllaster, Larry Gillick, Francesco Scattone, Mike Newman Dragon Systems, Inc. 320 Nevada Street Newton, MA 02160

More information

Longman English Interactive

Longman English Interactive Longman English Interactive Level 3 Orientation Quick Start 2 Microphone for Speaking Activities 2 Course Navigation 3 Course Home Page 3 Course Overview 4 Course Outline 5 Navigating the Course Page 6

More information

Guidelines for Writing an Internship Report

Guidelines for Writing an Internship Report Guidelines for Writing an Internship Report Master of Commerce (MCOM) Program Bahauddin Zakariya University, Multan Table of Contents Table of Contents... 2 1. Introduction.... 3 2. The Required Components

More information

PAGE(S) WHERE TAUGHT If sub mission ins not a book, cite appropriate location(s))

PAGE(S) WHERE TAUGHT If sub mission ins not a book, cite appropriate location(s)) Ohio Academic Content Standards Grade Level Indicators (Grade 11) A. ACQUISITION OF VOCABULARY Students acquire vocabulary through exposure to language-rich situations, such as reading books and other

More information

Appendix L: Online Testing Highlights and Script

Appendix L: Online Testing Highlights and Script Online Testing Highlights and Script for Fall 2017 Ohio s State Tests Administrations Test administrators must use this document when administering Ohio s State Tests online. It includes step-by-step directions,

More information

Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments

Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Cristina Vertan, Walther v. Hahn University of Hamburg, Natural Language Systems Division Hamburg,

More information

An Automated Data Fusion Process for an Air Defense Scenario

An Automated Data Fusion Process for an Air Defense Scenario 16 th ICCRTS 2011, June An Automated Data Fusion Process for an Air Defense Scenario André Luís Maia Baruffaldi [andre_baruffaldi@yahoo.com.br] José Maria P. de Oliveira [parente@ita.br] Alexandre de Barros

More information

Using dialogue context to improve parsing performance in dialogue systems

Using dialogue context to improve parsing performance in dialogue systems Using dialogue context to improve parsing performance in dialogue systems Ivan Meza-Ruiz and Oliver Lemon School of Informatics, Edinburgh University 2 Buccleuch Place, Edinburgh I.V.Meza-Ruiz@sms.ed.ac.uk,

More information

OCR for Arabic using SIFT Descriptors With Online Failure Prediction

OCR for Arabic using SIFT Descriptors With Online Failure Prediction OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,

More information

ECE-492 SENIOR ADVANCED DESIGN PROJECT

ECE-492 SENIOR ADVANCED DESIGN PROJECT ECE-492 SENIOR ADVANCED DESIGN PROJECT Meeting #3 1 ECE-492 Meeting#3 Q1: Who is not on a team? Q2: Which students/teams still did not select a topic? 2 ENGINEERING DESIGN You have studied a great deal

More information

Education the telstra BLuEPRint

Education the telstra BLuEPRint Education THE TELSTRA BLUEPRINT A quality Education for every child A supportive environment for every teacher And inspirational technology for every budget. is it too much to ask? We don t think so. New

More information

LEGO MINDSTORMS Education EV3 Coding Activities

LEGO MINDSTORMS Education EV3 Coding Activities LEGO MINDSTORMS Education EV3 Coding Activities s t e e h s k r o W t n e d Stu LEGOeducation.com/MINDSTORMS Contents ACTIVITY 1 Performing a Three Point Turn 3-6 ACTIVITY 2 Written Instructions for a

More information

Software Maintenance

Software Maintenance 1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories

More information

Teacher: Mlle PERCHE Maeva High School: Lycée Charles Poncet, Cluses (74) Level: Seconde i.e year old students

Teacher: Mlle PERCHE Maeva High School: Lycée Charles Poncet, Cluses (74) Level: Seconde i.e year old students I. GENERAL OVERVIEW OF THE PROJECT 2 A) TITLE 2 B) CULTURAL LEARNING AIM 2 C) TASKS 2 D) LINGUISTICS LEARNING AIMS 2 II. GROUP WORK N 1: ROUND ROBIN GROUP WORK 2 A) INTRODUCTION 2 B) TASK BASED PLANNING

More information

Mandarin Lexical Tone Recognition: The Gating Paradigm

Mandarin Lexical Tone Recognition: The Gating Paradigm Kansas Working Papers in Linguistics, Vol. 0 (008), p. 8 Abstract Mandarin Lexical Tone Recognition: The Gating Paradigm Yuwen Lai and Jie Zhang University of Kansas Research on spoken word recognition

More information

Lower and Upper Secondary

Lower and Upper Secondary Lower and Upper Secondary Type of Course Age Group Content Duration Target General English Lower secondary Grammar work, reading and comprehension skills, speech and drama. Using Multi-Media CD - Rom 7

More information

Plain Language NAGC Review

Plain Language NAGC Review Plain Language NAGC Review Bruce Corsino FAA Plain Language Program Manager bruce.corsino@faa.gov 202-493-4074 What Is Plain Language? Helps Users: Find what they need; Understand what they find the FIRST

More information

Objectives. Chapter 2: The Representation of Knowledge. Expert Systems: Principles and Programming, Fourth Edition

Objectives. Chapter 2: The Representation of Knowledge. Expert Systems: Principles and Programming, Fourth Edition Chapter 2: The Representation of Knowledge Expert Systems: Principles and Programming, Fourth Edition Objectives Introduce the study of logic Learn the difference between formal logic and informal logic

More information

SOFTWARE EVALUATION TOOL

SOFTWARE EVALUATION TOOL SOFTWARE EVALUATION TOOL Kyle Higgins Randall Boone University of Nevada Las Vegas rboone@unlv.nevada.edu Higgins@unlv.nevada.edu N.B. This form has not been fully validated and is still in development.

More information

Individual Component Checklist L I S T E N I N G. for use with ONE task ENGLISH VERSION

Individual Component Checklist L I S T E N I N G. for use with ONE task ENGLISH VERSION L I S T E N I N G Individual Component Checklist for use with ONE task ENGLISH VERSION INTRODUCTION This checklist has been designed for use as a practical tool for describing ONE TASK in a test of listening.

More information

Modeling user preferences and norms in context-aware systems

Modeling user preferences and norms in context-aware systems Modeling user preferences and norms in context-aware systems Jonas Nilsson, Cecilia Lindmark Jonas Nilsson, Cecilia Lindmark VT 2016 Bachelor's thesis for Computer Science, 15 hp Supervisor: Juan Carlos

More information

PHO 1110 Basic Photography for Photographers. Instructor Information: Materials:

PHO 1110 Basic Photography for Photographers. Instructor Information: Materials: Revised: 5/2017 Nashville State Community College Business & Applied Arts Visual Communications / Photography PHO 1110 Basic Photography for Photographers 3 credit hours An introduction to the fundamentals

More information

Candidates must achieve a grade of at least C2 level in each examination in order to achieve the overall qualification at C2 Level.

Candidates must achieve a grade of at least C2 level in each examination in order to achieve the overall qualification at C2 Level. The Test of Interactive English, C2 Level Qualification Structure The Test of Interactive English consists of two units: Unit Name English English Each Unit is assessed via a separate examination, set,

More information

ANGLAIS LANGUE SECONDE

ANGLAIS LANGUE SECONDE ANGLAIS LANGUE SECONDE ANG-5055-6 DEFINITION OF THE DOMAIN SEPTEMBRE 1995 ANGLAIS LANGUE SECONDE ANG-5055-6 DEFINITION OF THE DOMAIN SEPTEMBER 1995 Direction de la formation générale des adultes Service

More information

Create Quiz Questions

Create Quiz Questions You can create quiz questions within Moodle. Questions are created from the Question bank screen. You will also be able to categorize questions and add them to the quiz body. You can crate multiple-choice,

More information

Web as Corpus. Corpus Linguistics. Web as Corpus 1 / 1. Corpus Linguistics. Web as Corpus. web.pl 3 / 1. Sketch Engine. Corpus Linguistics

Web as Corpus. Corpus Linguistics. Web as Corpus 1 / 1. Corpus Linguistics. Web as Corpus. web.pl 3 / 1. Sketch Engine. Corpus Linguistics (L615) Markus Dickinson Department of Linguistics, Indiana University Spring 2013 The web provides new opportunities for gathering data Viable source of disposable corpora, built ad hoc for specific purposes

More information

Miscommunication and error handling

Miscommunication and error handling CHAPTER 3 Miscommunication and error handling In the previous chapter, conversation and spoken dialogue systems were described from a very general perspective. In this description, a fundamental issue

More information

5. UPPER INTERMEDIATE

5. UPPER INTERMEDIATE Triolearn General Programmes adapt the standards and the Qualifications of Common European Framework of Reference (CEFR) and Cambridge ESOL. It is designed to be compatible to the local and the regional

More information

Literature and the Language Arts Experiencing Literature

Literature and the Language Arts Experiencing Literature Correlation of Literature and the Language Arts Experiencing Literature Grade 9 2 nd edition to the Nebraska Reading/Writing Standards EMC/Paradigm Publishing 875 Montreal Way St. Paul, Minnesota 55102

More information

CEFR Overall Illustrative English Proficiency Scales

CEFR Overall Illustrative English Proficiency Scales CEFR Overall Illustrative English Proficiency s CEFR CEFR OVERALL ORAL PRODUCTION Has a good command of idiomatic expressions and colloquialisms with awareness of connotative levels of meaning. Can convey

More information

Aviation English Training: How long Does it Take?

Aviation English Training: How long Does it Take? Aviation English Training: How long Does it Take? Elizabeth Mathews 2008 I am often asked, How long does it take to achieve ICAO Operational Level 4? Unfortunately, there is no quick and easy answer to

More information

Eye Movements in Speech Technologies: an overview of current research

Eye Movements in Speech Technologies: an overview of current research Eye Movements in Speech Technologies: an overview of current research Mattias Nilsson Department of linguistics and Philology, Uppsala University Box 635, SE-751 26 Uppsala, Sweden Graduate School of Language

More information

SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF)

SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF) SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF) Hans Christian 1 ; Mikhael Pramodana Agus 2 ; Derwin Suhartono 3 1,2,3 Computer Science Department,

More information

AGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016

AGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016 AGENDA Advanced Learning Theories Alejandra J. Magana, Ph.D. admagana@purdue.edu Introduction to Learning Theories Role of Learning Theories and Frameworks Learning Design Research Design Dual Coding Theory

More information

Language Acquisition Chart

Language Acquisition Chart Language Acquisition Chart This chart was designed to help teachers better understand the process of second language acquisition. Please use this chart as a resource for learning more about the way people

More information

Word Segmentation of Off-line Handwritten Documents

Word Segmentation of Off-line Handwritten Documents Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department

More information

Tutor Guidelines Fall 2016

Tutor Guidelines Fall 2016 Mathematics & Statistics Tutor Guidelines Fall 2016 Bluegrass Community and Technical College 1 Mathematics/Statistics Tutor Guidelines The tutoring program is now under Academics. I. Program Structure

More information

Detecting English-French Cognates Using Orthographic Edit Distance

Detecting English-French Cognates Using Orthographic Edit Distance Detecting English-French Cognates Using Orthographic Edit Distance Qiongkai Xu 1,2, Albert Chen 1, Chang i 1 1 The Australian National University, College of Engineering and Computer Science 2 National

More information

learning collegiate assessment]

learning collegiate assessment] [ collegiate learning assessment] INSTITUTIONAL REPORT 2005 2006 Kalamazoo College council for aid to education 215 lexington avenue floor 21 new york new york 10016-6023 p 212.217.0700 f 212.661.9766

More information

Grade 11 Language Arts (2 Semester Course) CURRICULUM. Course Description ENGLISH 11 (2 Semester Course) Duration: 2 Semesters Prerequisite: None

Grade 11 Language Arts (2 Semester Course) CURRICULUM. Course Description ENGLISH 11 (2 Semester Course) Duration: 2 Semesters Prerequisite: None Grade 11 Language Arts (2 Semester Course) CURRICULUM Course Description ENGLISH 11 (2 Semester Course) Duration: 2 Semesters Prerequisite: None Through the integrated study of literature, composition,

More information

Parsing of part-of-speech tagged Assamese Texts

Parsing of part-of-speech tagged Assamese Texts IJCSI International Journal of Computer Science Issues, Vol. 6, No. 1, 2009 ISSN (Online): 1694-0784 ISSN (Print): 1694-0814 28 Parsing of part-of-speech tagged Assamese Texts Mirzanur Rahman 1, Sufal

More information

Lecturing Module

Lecturing Module Lecturing: What, why and when www.facultydevelopment.ca Lecturing Module What is lecturing? Lecturing is the most common and established method of teaching at universities around the world. The traditional

More information

Intra-talker Variation: Audience Design Factors Affecting Lexical Selections

Intra-talker Variation: Audience Design Factors Affecting Lexical Selections Tyler Perrachione LING 451-0 Proseminar in Sound Structure Prof. A. Bradlow 17 March 2006 Intra-talker Variation: Audience Design Factors Affecting Lexical Selections Abstract Although the acoustic and

More information

SIE: Speech Enabled Interface for E-Learning

SIE: Speech Enabled Interface for E-Learning SIE: Speech Enabled Interface for E-Learning Shikha M.Tech Student Lovely Professional University, Phagwara, Punjab INDIA ABSTRACT In today s world, e-learning is very important and popular. E- learning

More information

Lecture 2: Quantifiers and Approximation

Lecture 2: Quantifiers and Approximation Lecture 2: Quantifiers and Approximation Case study: Most vs More than half Jakub Szymanik Outline Number Sense Approximate Number Sense Approximating most Superlative Meaning of most What About Counting?

More information

Radius STEM Readiness TM

Radius STEM Readiness TM Curriculum Guide Radius STEM Readiness TM While today s teens are surrounded by technology, we face a stark and imminent shortage of graduates pursuing careers in Science, Technology, Engineering, and

More information

Interview with a Fictional Character

Interview with a Fictional Character A Podcasting Learning and Evaluation Situation Interview with a Fictional Character Elementary Cycle 3 Solange Moseley, Pedagogical Counselor Sandra Laine, Service national du RÉCIT, Domaine des langues

More information

Listening and Speaking Skills of English Language of Adolescents of Government and Private Schools

Listening and Speaking Skills of English Language of Adolescents of Government and Private Schools Listening and Speaking Skills of English Language of Adolescents of Government and Private Schools Dr. Amardeep Kaur Professor, Babe Ke College of Education, Mudki, Ferozepur, Punjab Abstract The present

More information

English Language and Applied Linguistics. Module Descriptions 2017/18

English Language and Applied Linguistics. Module Descriptions 2017/18 English Language and Applied Linguistics Module Descriptions 2017/18 Level I (i.e. 2 nd Yr.) Modules Please be aware that all modules are subject to availability. If you have any questions about the modules,

More information

Case study Norway case 1

Case study Norway case 1 Case study Norway case 1 School : B (primary school) Theme: Science microorganisms Dates of lessons: March 26-27 th 2015 Age of students: 10-11 (grade 5) Data sources: Pre- and post-interview with 1 teacher

More information

Exams: Accommodations Guidelines. English Language Learners

Exams: Accommodations Guidelines. English Language Learners PSSA Accommodations Guidelines for English Language Learners (ELLs) [Arlen: Please format this page like the cover page for the PSSA Accommodations Guidelines for Students PSSA with IEPs and Students with

More information

National Literacy and Numeracy Framework for years 3/4

National Literacy and Numeracy Framework for years 3/4 1. Oracy National Literacy and Numeracy Framework for years 3/4 Speaking Listening Collaboration and discussion Year 3 - Explain information and ideas using relevant vocabulary - Organise what they say

More information

Jacqueline C. Kowtko, Patti J. Price Speech Research Program, SRI International, Menlo Park, CA 94025

Jacqueline C. Kowtko, Patti J. Price Speech Research Program, SRI International, Menlo Park, CA 94025 DATA COLLECTION AND ANALYSIS IN THE AIR TRAVEL PLANNING DOMAIN Jacqueline C. Kowtko, Patti J. Price Speech Research Program, SRI International, Menlo Park, CA 94025 ABSTRACT We have collected, transcribed

More information

MAE Flight Simulation for Aircraft Safety

MAE Flight Simulation for Aircraft Safety MAE 482 - Flight Simulation for Aircraft Safety SYLLABUS Fall Semester 2013 Instructor: Dr. Mario Perhinschi 521 Engineering Sciences Building 304-293-3301 Mario.Perhinschi@mail.wvu.edu Course main topics:

More information

REVIEW OF CONNECTED SPEECH

REVIEW OF CONNECTED SPEECH Language Learning & Technology http://llt.msu.edu/vol8num1/review2/ January 2004, Volume 8, Number 1 pp. 24-28 REVIEW OF CONNECTED SPEECH Title Connected Speech (North American English), 2000 Platform

More information

Innovative Methods for Teaching Engineering Courses

Innovative Methods for Teaching Engineering Courses Innovative Methods for Teaching Engineering Courses KR Chowdhary Former Professor & Head Department of Computer Science and Engineering MBM Engineering College, Jodhpur Present: Director, JIETSETG Email:

More information

EdIt: A Broad-Coverage Grammar Checker Using Pattern Grammar

EdIt: A Broad-Coverage Grammar Checker Using Pattern Grammar EdIt: A Broad-Coverage Grammar Checker Using Pattern Grammar Chung-Chi Huang Mei-Hua Chen Shih-Ting Huang Jason S. Chang Institute of Information Systems and Applications, National Tsing Hua University,

More information

An Introduction to Simio for Beginners

An Introduction to Simio for Beginners An Introduction to Simio for Beginners C. Dennis Pegden, Ph.D. This white paper is intended to introduce Simio to a user new to simulation. It is intended for the manufacturing engineer, hospital quality

More information

Welcome to MyOutcomes Online, the online course for students using Outcomes Elementary, in the classroom.

Welcome to MyOutcomes Online, the online course for students using Outcomes Elementary, in the classroom. Welcome to MyOutcomes Online, the online course for students using Outcomes Elementary, in the classroom. Before you begin, please take a few moments to read through this guide for some important information

More information

AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS

AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS 1 CALIFORNIA CONTENT STANDARDS: Chapter 1 ALGEBRA AND WHOLE NUMBERS Algebra and Functions 1.4 Students use algebraic

More information

A Quantitative Method for Machine Translation Evaluation

A Quantitative Method for Machine Translation Evaluation A Quantitative Method for Machine Translation Evaluation Jesús Tomás Escola Politècnica Superior de Gandia Universitat Politècnica de València jtomas@upv.es Josep Àngel Mas Departament d Idiomes Universitat

More information

Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge

Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge Innov High Educ (2009) 34:93 103 DOI 10.1007/s10755-009-9095-2 Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge Phyllis Blumberg Published online: 3 February

More information

Organizing Comprehensive Literacy Assessment: How to Get Started

Organizing Comprehensive Literacy Assessment: How to Get Started Organizing Comprehensive Assessment: How to Get Started September 9 & 16, 2009 Questions to Consider How do you design individualized, comprehensive instruction? How can you determine where to begin instruction?

More information

a) analyse sentences, so you know what s going on and how to use that information to help you find the answer.

a) analyse sentences, so you know what s going on and how to use that information to help you find the answer. Tip Sheet I m going to show you how to deal with ten of the most typical aspects of English grammar that are tested on the CAE Use of English paper, part 4. Of course, there are many other grammar points

More information

Cambridgeshire Community Services NHS Trust: delivering excellence in children and young people s health services

Cambridgeshire Community Services NHS Trust: delivering excellence in children and young people s health services Normal Language Development Community Paediatric Audiology Cambridgeshire Community Services NHS Trust: delivering excellence in children and young people s health services Language develops unconsciously

More information

Infrared Paper Dryer Control Scheme

Infrared Paper Dryer Control Scheme Infrared Paper Dryer Control Scheme INITIAL PROJECT SUMMARY 10/03/2005 DISTRIBUTED MEGAWATTS Carl Lee Blake Peck Rob Schaerer Jay Hudkins 1. Project Overview 1.1 Stake Holders Potlatch Corporation, Idaho

More information

21st Century Community Learning Center

21st Century Community Learning Center 21st Century Community Learning Center Grant Overview This Request for Proposal (RFP) is designed to distribute funds to qualified applicants pursuant to Title IV, Part B, of the Elementary and Secondary

More information

Probability estimates in a scenario tree

Probability estimates in a scenario tree 101 Chapter 11 Probability estimates in a scenario tree An expert is a person who has made all the mistakes that can be made in a very narrow field. Niels Bohr (1885 1962) Scenario trees require many numbers.

More information

To the Student: ABOUT THE EXAM

To the Student: ABOUT THE EXAM CMAP Communication Applications #6496 (v.2.0) To the Student: After your registration is complete and your proctor has been approved, you may take the Credit by Examination for CMAP, Communication Applications.

More information

South Carolina English Language Arts

South Carolina English Language Arts South Carolina English Language Arts A S O F J U N E 2 0, 2 0 1 0, T H I S S TAT E H A D A D O P T E D T H E CO M M O N CO R E S TAT E S TA N DA R D S. DOCUMENTS REVIEWED South Carolina Academic Content

More information

DIBELS Next BENCHMARK ASSESSMENTS

DIBELS Next BENCHMARK ASSESSMENTS DIBELS Next BENCHMARK ASSESSMENTS Click to edit Master title style Benchmark Screening Benchmark testing is the systematic process of screening all students on essential skills predictive of later reading

More information

November 2012 MUET (800)

November 2012 MUET (800) November 2012 MUET (800) OVERALL PERFORMANCE A total of 75 589 candidates took the November 2012 MUET. The performance of candidates for each paper, 800/1 Listening, 800/2 Speaking, 800/3 Reading and 800/4

More information

Practical Research. Planning and Design. Paul D. Leedy. Jeanne Ellis Ormrod. Upper Saddle River, New Jersey Columbus, Ohio

Practical Research. Planning and Design. Paul D. Leedy. Jeanne Ellis Ormrod. Upper Saddle River, New Jersey Columbus, Ohio SUB Gfittingen 213 789 981 2001 B 865 Practical Research Planning and Design Paul D. Leedy The American University, Emeritus Jeanne Ellis Ormrod University of New Hampshire Upper Saddle River, New Jersey

More information

LODI UNIFIED SCHOOL DISTRICT. Eliminate Rule Instruction

LODI UNIFIED SCHOOL DISTRICT. Eliminate Rule Instruction LODI UNIFIED SCHOOL DISTRICT Eliminate Rule 6162.52 Instruction High School Exit Examination Definitions Variation means a change in the manner in which the test is presented or administered, or in how

More information

Linking Task: Identifying authors and book titles in verbose queries

Linking Task: Identifying authors and book titles in verbose queries Linking Task: Identifying authors and book titles in verbose queries Anaïs Ollagnier, Sébastien Fournier, and Patrice Bellot Aix-Marseille University, CNRS, ENSAM, University of Toulon, LSIS UMR 7296,

More information

On-the-Fly Customization of Automated Essay Scoring

On-the-Fly Customization of Automated Essay Scoring Research Report On-the-Fly Customization of Automated Essay Scoring Yigal Attali Research & Development December 2007 RR-07-42 On-the-Fly Customization of Automated Essay Scoring Yigal Attali ETS, Princeton,

More information

4-3 Basic Skills and Concepts

4-3 Basic Skills and Concepts 4-3 Basic Skills and Concepts Identifying Binomial Distributions. In Exercises 1 8, determine whether the given procedure results in a binomial distribution. For those that are not binomial, identify at

More information

On the Combined Behavior of Autonomous Resource Management Agents

On the Combined Behavior of Autonomous Resource Management Agents On the Combined Behavior of Autonomous Resource Management Agents Siri Fagernes 1 and Alva L. Couch 2 1 Faculty of Engineering Oslo University College Oslo, Norway siri.fagernes@iu.hio.no 2 Computer Science

More information

Busuu The Mobile App. Review by Musa Nushi & Homa Jenabzadeh, Introduction. 30 TESL Reporter 49 (2), pp

Busuu The Mobile App. Review by Musa Nushi & Homa Jenabzadeh, Introduction. 30 TESL Reporter 49 (2), pp 30 TESL Reporter 49 (2), pp. 30 38 Busuu The Mobile App Review by Musa Nushi & Homa Jenabzadeh, Shahid Beheshti University, Tehran, Iran Introduction Technological innovations are changing the second language

More information

The Internet as a Normative Corpus: Grammar Checking with a Search Engine

The Internet as a Normative Corpus: Grammar Checking with a Search Engine The Internet as a Normative Corpus: Grammar Checking with a Search Engine Jonas Sjöbergh KTH Nada SE-100 44 Stockholm, Sweden jsh@nada.kth.se Abstract In this paper some methods using the Internet as a

More information

The Perception of Nasalized Vowels in American English: An Investigation of On-line Use of Vowel Nasalization in Lexical Access

The Perception of Nasalized Vowels in American English: An Investigation of On-line Use of Vowel Nasalization in Lexical Access The Perception of Nasalized Vowels in American English: An Investigation of On-line Use of Vowel Nasalization in Lexical Access Joyce McDonough 1, Heike Lenhert-LeHouiller 1, Neil Bardhan 2 1 Linguistics

More information

CS 100: Principles of Computing

CS 100: Principles of Computing CS 100: Principles of Computing Kevin Molloy August 29, 2017 1 Basic Course Information 1.1 Prerequisites: None 1.2 General Education Fulfills Mason Core requirement in Information Technology (ALL). 1.3

More information

INSTRUCTIONAL FOCUS DOCUMENT Grade 5/Science

INSTRUCTIONAL FOCUS DOCUMENT Grade 5/Science Exemplar Lesson 01: Comparing Weather and Climate Exemplar Lesson 02: Sun, Ocean, and the Water Cycle State Resources: Connecting to Unifying Concepts through Earth Science Change Over Time RATIONALE:

More information

Basic German: CD/Book Package (LL(R) Complete Basic Courses) By Living Language

Basic German: CD/Book Package (LL(R) Complete Basic Courses) By Living Language Basic German: CD/Book Package (LL(R) Complete Basic Courses) By Living Language If searching for the book by Living Language Basic German: CD/Book Package (LL(R) Complete Basic Courses) in pdf format,

More information

Let's Learn English Lesson Plan

Let's Learn English Lesson Plan Let's Learn English Lesson Plan Introduction: Let's Learn English lesson plans are based on the CALLA approach. See the end of each lesson for more information and resources on teaching with the CALLA

More information

Loughton School s curriculum evening. 28 th February 2017

Loughton School s curriculum evening. 28 th February 2017 Loughton School s curriculum evening 28 th February 2017 Aims of this session Share our approach to teaching writing, reading, SPaG and maths. Share resources, ideas and strategies to support children's

More information