Watson Technical Innovations
|
|
- Eileen Underwood
- 6 years ago
- Views:
Transcription
1 Watson Technical Innovations Murthy Devarakonda, Ph.D. Watson Innovations IBM Research and Watson Group
2 With Precision, Accurate Confidence and Speed, the rest was History
3 Watson answers by finding, reading, scoring and combining evidence IN 1698, THIS COMET DISCOVERER TOOK A SHIP CALLED THE PARAMOUR PINK ON THE FIRST PURELY SCIENTIFIC SEA VOYAGE Question Analysis Important Terms: 1698, comet, paramour, pink, AnswerTypes: comet discoverer Date(1698), Took(discoverer, ship) Called(ship, Paramour Pink) Content (Structured & Unstructured) Primary Search Isaac Newton Wilhelm Tempel HMS Paramour Christiaan Huygens Halley s Comet Edmond Halley Pink Panther Peter Sellers Candidate Answer/Hypothesis Generation High-Speed Evidence Retrieval Term Overlap Classification Relations [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Diverse and Extensible Evidence Scoring Temporal 100 s of NLP Scoring Algorithms 1) Edmond Halley (0.85) 2) Christiaan Huygens (0.20) 3) Peter Sellers (0.05) 4) Merging & Ranking Based on Statistical Machine Learning
4 DeepQA: The architecture underlying Inside Watson Using a highly parallelized architecture generates many hypotheses, collects a wide range of evidence and balances the combined confidences of over 100 different analytics that analyze the evidence form different dimensions Question Question & Topic Analysis Primary Search Multiple Interpretations Answer Sources 100 s sources Question Decomposition Candidate Answer Generation 100 s Possible Answers Hypothesis Generation Answer Scoring 1000 s of Pieces of Evidence Evidenc e Sources Evidence Retrieval Hypothesis and Evidence Scoring Deep Evidence 100,000 s Scores from Scoring many Deep Analysis Algorithms Synthesis Learned Models help combine and weigh the Evidence Balance & Combine Models Models Models Models Models Models Final Confidence Merging & Ranking Hypothesis Generation... Hypothesis and Evidence Scoring Answer & Confidence
5 Taking Watson beyond Jeopardy! (Medical Domain) Understanding Interacting Explaining Learning Specific Questions Question-In/Answer-Out Precise Answers & Accurate Confidences Batch Training Process The type of murmur associated with this condition is harsh, systolic, and increases in intensity with Valsalva From specific questions to rich, incomplete problem scenarios (e.g. EHR) Evidence analysis and look-ahead, drive interactive dialog to refine answers and evidence Move from quality answers to quality answers and evidence Scale domain learning and adaptation rate and efficiency Input, Responses Answers, Corrections, Judgements Entire Medical Record Dialog Refined Answers, Follow-up Questions Responses, Learning Questions Rich Problem Scenarios Interactive Dialog Teach Watson Comparative Evidence Profiles Continuous Training & Learning Process 5
6 Adapting Watson to Medicine: An Example of the Adaptation Algorithm Adaptation Automatic Training Nov 12: 63.3% May 12: 53.7% Nov 11: 52.1%* Content Update Original Jeopardy! Watson May 11: 33.0%* J! : 21.3% May 11: 45.2%* * 2011 results are inflated by an estimated 6% due to use of ACP PIER, from which DD questions are often derived
7 NEJM Medical Concept Annotations Diseases Symptoms Medications Modifiers We use UMLS (Unified Medical Language System) CUIs (Concept Unique Ids) but the vocabulary is noisy.
8 Providing Insights from Electronic Medical Records Understanding Interacting Explaining Learning Specific Questions Question-In/Answer-Out Precise Answers & Accurate Confidences Batch Training Process The type of murmur associated with this condition is harsh, systolic, and increases in intensity with Valsalva From specific questions to rich, incomplete problem scenarios (e.g. EHR) Evidence analysis and look-ahead, drive interactive dialog to refine answers and evidence Move from quality answers to quality answers and evidence Scale domain learning and adaptation rate and efficiency Input, Responses Answers, Corrections, Judgements Entire Medical Record Dialog Refined Answers, Follow-up Questions Responses, Learning Questions Rich Problem Scenarios Interactive Dialog Teach Watson Comparative Evidence Profiles Continuous Training & Learning Process 8
9 An EMR contains plain text & semi-structured data Encounter (Clinical) Notes An EMR (up to 50MBs for a patient) Medications Laboratory
10 Medical Concepts Identification disease or syndrome CUI = C sign or symptom CUI = C
11 Watson Electronic Medical Record Analysis Cognitive Challenges of a Physician Our goal is to significantly enhance a clinician s cognitive process in patient care
12 Patient EMR Summarization Text summarization is a well known problem in Artificial Intelligence The basic idea of summarization is to take a body of information and reduce its size and content to its important points Important properties of a summary are: reduce the workload for the interpreter/understander (simpler) maintain coherence maintain coverage include important events of the story Alterman, Richard. "Understanding and summarization." Artificial Intelligence Review 5.4 (1991): Clinical summarization takes it to a new dimension of complexity Content: EMR text is non-text Interpretation: Use of vast medical knowledge Purpose: Help physician in patient care
13 Identifying Patient s Medical Problems EMR Candidate Generation Feature Generation Score Scoring / Weighting Grouping Notes Clinical Factors Extraction CUIs of unique Disorders (O(100)) Information Extraction Text Segmentation CUI Confidence Term Frequency Note Section Score Score Confidence Term Frequency PMH Note Section Score Graph of grouped Problems Medicines LSA CUI Path LSA Score Score 1.0 Structured Data (Medications, Orders, Lab, etc) CUIs of unique Medications, Orders, Lab, etc. Relationship Lab Tests LSA CUI Path 0 A may treat B Path Pattern Candidate Problems (O(10)) 13
14 Problem List Accuracy Definitions: Recall (sensitivity) = predicted / actual-problems Precision = correct / predicted Specificity = discarded / non-problems As of Mar 2014: Recall upper bound is 90% (the remaining 10% problems do not appear in the Gold Standard EMRs) Recall (sensitivity) = 69.5% Precision (PPV) = 45.2% TNR (specificity) = 95.5% F1 = 0.545, F2 = What about the entered problems in EMRs? Retrieved Problem list Unique Diagnoses Precision = 50% Precision = 40.8% Recall = 15.7% Recall = 19.6%
15 Problem-Oriented Patient Record Summary Medications Procedures Generated Problems List treated by measured by Lab tests Vitals discussed in EMRA determines these relationships & the grouping of their listing Clinical Notes & timeline also, allergies, social history, and demography
16 As the Physician selects Diabetes Mellitus, screen changes to show related active medications and labs When a problem is selected Current and related related labs & meds are meds are highlighted shown Related clinical notes are highlighted Labs show elevated glucose and A1C among the others
17 Continuous Training & Learning Through Inference Chaining Understanding Interacting Explaining Learning Specific Questions Question-In/Answer-Out Precise Answers & Accurate Confidences Batch Training Process The type of murmur associated with this condition is harsh, systolic, and increases in intensity with Valsalva From specific questions to rich, incomplete problem scenarios (e.g. EHR) Evidence analysis and look-ahead, drive interactive dialog to refine answers and evidence Move from quality answers to quality answers and evidence Scale domain learning and adaptation rate and efficiency Input, Responses Answers, Corrections, Judgements Entire Medical Record Dialog Refined Answers, Follow-up Questions Responses, Learning Questions Rich Problem Scenarios Interactive Dialog Teach Watson Comparative Evidence Profiles Continuous Training & Learning Process 17
18 Missing Links Buttons Category: Common Bonds Shirts, TV remote controls, Telephones Mt Everest Edmund Hillary He was first On hearing of the discovery of George Mallory's body, he told reporters he still thinks he was first.
19 Clinical Reasoning - WatsonPaths Start with a scenario description. Extract statements. Generate questions. Ask Watson for answers. Use statements, questions and answers to generate assertions (opinions about relations with confidence). Propagate belief from what we know (the scenario) to what we re considering (our hypotheses). A 63-year-old patient is sent to the neurologist with resting tremor. patient exhibits resting tremor patient has Parkinson s Disease Scenario. Scenario Analysis. Extracted statement. Q: Watson, what causes resting tremor? A. Parkinson s Disease (62%) Inferred statement. Page 19
20 (Simplified) Example Page 20
21 1 Scenario Analysis Scenario 2 Candidate Generation 3 Statement Prioritization 4 Question Generation 5 WatsonPaths Proceed through the numbered steps. Repeat steps 2 through 8 until complete. Completion may be determined differently. One example is to stop after the factors from scenario analysis are connected to the candidates. Page 21 Watson QA Watson QA 6 Process Results to Create New Assertions 7 Find and Evaluate Inferences... Watson QA 8
22 Inference Graphs A 63-year-old patient is sent to the neurologist with... resting tremor... What part of his nervous system is most likely affected? - USMLE Question Scenario Description states patient exhibits resting tremor More inferences. indicates patient has Parkinson s Disease indicates patient s Substantia Nigra is affected A node represents a statement that can be judged true or false. Types of statements are input factors (gray), inferred factors (white) and hypotheses or answers (green). Border strength visually represents Watson s belief that a factor is true. Input Factor An edge represents a relation between the connected statements. Agents make assertions about their confidence in a relation. Belief propagation uses these confidences in deriving belief in relations for the given scenario. Visual edge strength represents both agent confidence and the IBM Confidential propagated belief. Inferred Factor Inference Graph Hypothesis A platform for integrating assertions about a scenario whether from Watson QA, other structured and semi-structured knowledge sources or from the user themselves. A platform for orchestrating the decision process. Page 22
23 The (Less Simplified) Result Page 23
24 Enhanced User Interface for WatsonPaths Page 24
25 Dialoguing to an answer in Clinical Decision Support Present Factors Red, painful eye Blurred vision Family history of arthritis Q: What diagnosis explains the patient s condition? Medical Record Absent Factors Circular rash Fatigue Headache The first symptom of Lyme disease (also called Lyme s disease) Lyme disease for about can 50% affect of people different is body a small, systems, red bull s-eye such rash, the called nervous erythema system, migrans, joints, skin, at the and site of an heart. infected Symptoms tick bite. are often described as Other early, happening acute Lyme in three symptoms stages (although are flu-like not everyone fatigue, achy experiences muscles all or three): joints, fever, chills, stiff neck, swollen 1.A circular glands, rash, and typically a headache. within 1-2 weeks of infection, often is the first sign of infection. Lyme disease 2.Along is with is caused by the rash, the a bacterium person Borrelia may have flu-like burgdorferi and symptoms is is transmitted such to as swollen to humans through lymph nodes, the fatigue, bite of of infected headache, blacklegged ticks. and muscle Typical aches. symptoms include high temperature, headache, fatigue, and a characteristic skin rash called erythema migrans.
26 Thank You
Text-mining the Estonian National Electronic Health Record
Text-mining the Estonian National Electronic Health Record Raul Sirel rsirel@ut.ee 13.11.2015 Outline Electronic Health Records & Text Mining De-identifying the Texts Resolving the Abbreviations Terminology
More informationThe One Minute Preceptor: 5 Microskills for One-On-One Teaching
The One Minute Preceptor: 5 Microskills for One-On-One Teaching Acknowledgements This monograph was developed by the MAHEC Office of Regional Primary Care Education, Asheville, North Carolina. It was developed
More informationMYCIN. The MYCIN Task
MYCIN Developed at Stanford University in 1972 Regarded as the first true expert system Assists physicians in the treatment of blood infections Many revisions and extensions over the years The MYCIN Task
More informationAQUA: An Ontology-Driven Question Answering System
AQUA: An Ontology-Driven Question Answering System Maria Vargas-Vera, Enrico Motta and John Domingue Knowledge Media Institute (KMI) The Open University, Walton Hall, Milton Keynes, MK7 6AA, United Kingdom.
More informationReinForest: Multi-Domain Dialogue Management Using Hierarchical Policies and Knowledge Ontology
ReinForest: Multi-Domain Dialogue Management Using Hierarchical Policies and Knowledge Ontology Tiancheng Zhao CMU-LTI-16-006 Language Technologies Institute School of Computer Science Carnegie Mellon
More informationSemi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17.
Semi-supervised methods of text processing, and an application to medical concept extraction Yacine Jernite Text-as-Data series September 17. 2015 What do we want from text? 1. Extract information 2. Link
More informationSection 3.4 Assessing barriers and facilitators to knowledge use
Section 3.4 Assessing barriers and facilitators to knowledge use France Légaré, MD, PhD Canada Research Chair in Implementation of Shared Decision Making in Primary Care Centre de recherche, Hôpital St-François
More informationDegree Qualification Profiles Intellectual Skills
Degree Qualification Profiles Intellectual Skills Intellectual Skills: These are cross-cutting skills that should transcend disciplinary boundaries. Students need all of these Intellectual Skills to acquire
More informationStrategic Plan Revised November 2012 Reviewed and Updated July 2014
DUKE UNIVERSITY Medical Center Library & Archives Strategic Plan 2011-2016 Revised November 2012 Reviewed and Updated July 2014 Mission Connecting Duke to biomedical knowledge networks. Vision The vision
More informationSpeech Recognition at ICSI: Broadcast News and beyond
Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI
More informationMaximizing Learning Through Course Alignment and Experience with Different Types of Knowledge
Innov High Educ (2009) 34:93 103 DOI 10.1007/s10755-009-9095-2 Maximizing Learning Through Course Alignment and Experience with Different Types of Knowledge Phyllis Blumberg Published online: 3 February
More informationSpecification of the Verity Learning Companion and Self-Assessment Tool
Specification of the Verity Learning Companion and Self-Assessment Tool Sergiu Dascalu* Daniela Saru** Ryan Simpson* Justin Bradley* Eva Sarwar* Joohoon Oh* * Department of Computer Science ** Dept. of
More informationDeveloped by Dr. Carl A. Ferreri & Additional Concepts by Dr. Charles Krebs. Expanded by
Name Date Advanced I Workshop Manual Language Processing and Brain Integration Developed by Dr. Carl A. Ferreri & Additional Concepts by Dr. Charles Krebs Expanded by Dr. Mitchell Corwin 2914 Domingo Ave
More informationGenerating Test Cases From Use Cases
1 of 13 1/10/2007 10:41 AM Generating Test Cases From Use Cases by Jim Heumann Requirements Management Evangelist Rational Software pdf (155 K) In many organizations, software testing accounts for 30 to
More informationCross Language Information Retrieval
Cross Language Information Retrieval RAFFAELLA BERNARDI UNIVERSITÀ DEGLI STUDI DI TRENTO P.ZZA VENEZIA, ROOM: 2.05, E-MAIL: BERNARDI@DISI.UNITN.IT Contents 1 Acknowledgment.............................................
More informationProbabilistic Latent Semantic Analysis
Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview
More informationTun your everyday simulation activity into research
Tun your everyday simulation activity into research Chaoyan Dong, PhD, Sengkang Health, SingHealth Md Khairulamin Sungkai, UBD Pre-conference workshop presented at the inaugual conference Pan Asia Simulation
More informationClinical Quality in EMS. Noah J. Reiter, MPA, EMT-P EMS Director Lenox Hill Hospital (Rice University 00)
Clinical Quality in EMS Noah J. Reiter, MPA, EMT-P EMS Director Lenox Hill Hospital (Rice University 00) Presentation Overview Rationale Definitions Philosophy Prerequisites for a Successful Program The
More informationStudy and Analysis of MYCIN expert system
www.ijecs.in International Journal Of Engineering And Computer Science ISSN: 2319-7242 Volume 4 Issue 10 Oct 2015, Page No. 14861-14865 Study and Analysis of MYCIN expert system 1 Ankur Kumar Meena, 2
More informationTHE USE OF TINTED LENSES AND COLORED OVERLAYS FOR THE TREATMENT OF DYSLEXIA AND OTHER RELATED READING AND LEARNING DISORDERS
FC-B204-040 THE USE OF TINTED LENSES AND COLORED OVERLAYS FOR THE TREATMENT OF DYSLEXIA AND OTHER RELATED READING AND LEARNING DISORDERS Over the past two decades the use of tinted lenses and colored overlays
More informationHoughton Mifflin Online Assessment System Walkthrough Guide
Houghton Mifflin Online Assessment System Walkthrough Guide Page 1 Copyright 2007 by Houghton Mifflin Company. All Rights Reserved. No part of this document may be reproduced or transmitted in any form
More informationIntegration of Problem Based Learning at Kathmandu Medical College. Lama PY 1, Koirala P 2, Bhattarai B 3, Suwal G 4, Deshar S 5
Medical Education, Vol. 2, No. Medical 3, Issue 5, Education Jul.-Sep., 2013 Integration of Problem Based Learning at Kathmandu Medical College Lama PY 1, Koirala P 2, Bhattarai B 3, Suwal G 4, Deshar
More informationDublin City Schools Mathematics Graded Course of Study GRADE 4
I. Content Standard: Number, Number Sense and Operations Standard Students demonstrate number sense, including an understanding of number systems and reasonable estimates using paper and pencil, technology-supported
More informationComputerized Adaptive Psychological Testing A Personalisation Perspective
Psychology and the internet: An European Perspective Computerized Adaptive Psychological Testing A Personalisation Perspective Mykola Pechenizkiy mpechen@cc.jyu.fi Introduction Mixed Model of IRT and ES
More informationRadius STEM Readiness TM
Curriculum Guide Radius STEM Readiness TM While today s teens are surrounded by technology, we face a stark and imminent shortage of graduates pursuing careers in Science, Technology, Engineering, and
More informationThe IDN Variant Issues Project: A Study of Issues Related to the Delegation of IDN Variant TLDs. 20 April 2011
The IDN Variant Issues Project: A Study of Issues Related to the Delegation of IDN Variant TLDs 20 April 2011 Project Proposal updated based on comments received during the Public Comment period held from
More informationRETURNING TEACHER REQUIRED TRAINING MODULE YE TRANSCRIPT
RETURNING TEACHER REQUIRED TRAINING MODULE YE Slide 1. The Dynamic Learning Maps Alternate Assessments are designed to measure what students with significant cognitive disabilities know and can do in relation
More informationKnowledge based expert systems D H A N A N J A Y K A L B A N D E
Knowledge based expert systems D H A N A N J A Y K A L B A N D E What is a knowledge based system? A Knowledge Based System or a KBS is a computer program that uses artificial intelligence to solve problems
More informationApply First Aid Subject Outline
HLTFA301B Apply First Aid Subject Outline My Online Facilitators Contact Details Please add your facilitators name and contact details below: My Online Facilitators Name: My Online Facilitators Phone Number:
More informationGlobal Health Kitwe, Zambia Elective Curriculum
Global Health Kitwe, Zambia Elective Curriculum Title of Clerkship: Global Health Zambia Elective Clerkship Elective Type: Department(s): Clerkship Site: Course Number: Fourth-Year Elective Clerkship Psychiatry,
More informationCase Study Physiology
Case Free PDF ebook Download: Case Download or Read Online ebook case study physiology in PDF Format From The Best User Guide Database Jul 28, 2006 - Some students in Human Anatomy and have little Students
More informationProbability estimates in a scenario tree
101 Chapter 11 Probability estimates in a scenario tree An expert is a person who has made all the mistakes that can be made in a very narrow field. Niels Bohr (1885 1962) Scenario trees require many numbers.
More informationApplications of memory-based natural language processing
Applications of memory-based natural language processing Antal van den Bosch and Roser Morante ILK Research Group Tilburg University Prague, June 24, 2007 Current ILK members Principal investigator: Antal
More informationNew Hampshire Chapter Scientific Meeting
New Hampshire Chapter Scientific Meeting 2017 October 27, 2017 Lyme Inn Lyme, New Hampshire Fostering Excellence in Internal Medicine This educational activity has been designated for 6 CME credits. Meeting
More informationCROSS-LANGUAGE INFORMATION RETRIEVAL USING PARAFAC2
1 CROSS-LANGUAGE INFORMATION RETRIEVAL USING PARAFAC2 Peter A. Chew, Brett W. Bader, Ahmed Abdelali Proceedings of the 13 th SIGKDD, 2007 Tiago Luís Outline 2 Cross-Language IR (CLIR) Latent Semantic Analysis
More informationAGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS
AGS THE GREAT REVIEW GAME FOR PRE-ALGEBRA (CD) CORRELATED TO CALIFORNIA CONTENT STANDARDS 1 CALIFORNIA CONTENT STANDARDS: Chapter 1 ALGEBRA AND WHOLE NUMBERS Algebra and Functions 1.4 Students use algebraic
More informationNotes on The Sciences of the Artificial Adapted from a shorter document written for course (Deciding What to Design) 1
Notes on The Sciences of the Artificial Adapted from a shorter document written for course 17-652 (Deciding What to Design) 1 Ali Almossawi December 29, 2005 1 Introduction The Sciences of the Artificial
More informationUpdate on the Next Accreditation System Drs. Culley, Ling, and Wood. Anesthesiology April 30, 2014
Accreditation Council for Graduate Medical Education Update on the Next Accreditation System Drs. Culley, Ling, and Wood Anesthesiology April 30, 2014 Background of the Next Accreditation System Louis
More informationSummarizing Webinar Protocol and Guide for Facilitators
Summarizing Webinar Protocol and Guide for Facilitators Bringing STakeholders Together for Engagement in Research for the Selection of Arthroplasty Implant Devices (BeTTER SAID) Title: How can patient
More informationPh.D. in Behavior Analysis Ph.d. i atferdsanalyse
Program Description Ph.D. in Behavior Analysis Ph.d. i atferdsanalyse 180 ECTS credits Approval Approved by the Norwegian Agency for Quality Assurance in Education (NOKUT) on the 23rd April 2010 Approved
More informationAUTOMATED TROUBLESHOOTING OF MOBILE NETWORKS USING BAYESIAN NETWORKS
AUTOMATED TROUBLESHOOTING OF MOBILE NETWORKS USING BAYESIAN NETWORKS R.Barco 1, R.Guerrero 2, G.Hylander 2, L.Nielsen 3, M.Partanen 2, S.Patel 4 1 Dpt. Ingeniería de Comunicaciones. Universidad de Málaga.
More informationADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY DOWNLOAD EBOOK : ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY PDF
Read Online and Download Ebook ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY DOWNLOAD EBOOK : ADVANCED MACHINE LEARNING WITH PYTHON BY JOHN HEARTY PDF Click link bellow and free register to download
More informationPROGRAM REQUIREMENTS FOR RESIDENCY EDUCATION IN DEVELOPMENTAL-BEHAVIORAL PEDIATRICS
In addition to complying with the Program Requirements for Residency Education in the Subspecialties of Pediatrics, programs in developmental-behavioral pediatrics also must comply with the following requirements,
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More informationInformation Event Master Thesis
Information Event Master Thesis Dr. Michael J. Kendzia Deputy Program Director MSc IB Building Competence. Crossing Borders. Overview Introduction Prior to the master thesis assignment procedure During
More informationPOLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance
POLA: a student modeling framework for Probabilistic On-Line Assessment of problem solving performance Cristina Conati, Kurt VanLehn Intelligent Systems Program University of Pittsburgh Pittsburgh, PA,
More informationFull text of O L O W Science As Inquiry conference. Science as Inquiry
Page 1 of 5 Full text of O L O W Science As Inquiry conference Reception Meeting Room Resources Oceanside Unifying Concepts and Processes Science As Inquiry Physical Science Life Science Earth & Space
More informationThe Smart/Empire TIPSTER IR System
The Smart/Empire TIPSTER IR System Chris Buckley, Janet Walz Sabir Research, Gaithersburg, MD chrisb,walz@sabir.com Claire Cardie, Scott Mardis, Mandar Mitra, David Pierce, Kiri Wagstaff Department of
More informationSINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF)
SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF) Hans Christian 1 ; Mikhael Pramodana Agus 2 ; Derwin Suhartono 3 1,2,3 Computer Science Department,
More informationOn-Line Data Analytics
International Journal of Computer Applications in Engineering Sciences [VOL I, ISSUE III, SEPTEMBER 2011] [ISSN: 2231-4946] On-Line Data Analytics Yugandhar Vemulapalli #, Devarapalli Raghu *, Raja Jacob
More informationThe Political Engagement Activity Student Guide
The Political Engagement Activity Student Guide Internal Assessment (SL & HL) IB Global Politics UWC Costa Rica CONTENTS INTRODUCTION TO THE POLITICAL ENGAGEMENT ACTIVITY 3 COMPONENT 1: ENGAGEMENT 4 COMPONENT
More informationDisciplinary Literacy in Science
Disciplinary Literacy in Science 18 th UCF Literacy Symposium 4/1/2016 Vicky Zygouris-Coe, Ph.D. UCF, CEDHP vzygouri@ucf.edu April 1, 2016 Objectives Examine the benefits of disciplinary literacy for science
More informationWord Segmentation of Off-line Handwritten Documents
Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department
More informationDimensions of Classroom Behavior Measured by Two Systems of Interaction Analysis
Dimensions of Classroom Behavior Measured by Two Systems of Interaction Analysis the most important and exciting recent development in the study of teaching has been the appearance of sev eral new instruments
More informationIT Students Workshop within Strategic Partnership of Leibniz University and Peter the Great St. Petersburg Polytechnic University
IT Students Workshop within Strategic Partnership of Leibniz University and Peter the Great St. Petersburg Polytechnic University 06.11.16 13.11.16 Hannover Our group from Peter the Great St. Petersburg
More informationAuthor: Justyna Kowalczys Stowarzyszenie Angielski w Medycynie (PL) Feb 2015
Author: Justyna Kowalczys Stowarzyszenie Angielski w Medycynie (PL) www.angielskiwmedycynie.org.pl Feb 2015 Developing speaking abilities is a prerequisite for HELP in order to promote effective communication
More informationA Case-Based Approach To Imitation Learning in Robotic Agents
A Case-Based Approach To Imitation Learning in Robotic Agents Tesca Fitzgerald, Ashok Goel School of Interactive Computing Georgia Institute of Technology, Atlanta, GA 30332, USA {tesca.fitzgerald,goel}@cc.gatech.edu
More informationDeveloping True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability
Developing True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability Shih-Bin Chen Dept. of Information and Computer Engineering, Chung-Yuan Christian University Chung-Li, Taiwan
More informationThe Enterprise Knowledge Portal: The Concept
The Enterprise Knowledge Portal: The Concept Executive Information Systems, Inc. www.dkms.com eisai@home.com (703) 461-8823 (o) 1 A Beginning Where is the life we have lost in living! Where is the wisdom
More informationGraduate Program in Education
SPECIAL EDUCATION THESIS/PROJECT AND SEMINAR (EDME 531-01) SPRING / 2015 Professor: Janet DeRosa, D.Ed. Course Dates: January 11 to May 9, 2015 Phone: 717-258-5389 (home) Office hours: Tuesday evenings
More informationBIOH : Principles of Medical Physiology
University of Montana ScholarWorks at University of Montana Syllabi Course Syllabi Spring 2--207 BIOH 462.0: Principles of Medical Physiology Laurie A. Minns University of Montana - Missoula, laurie.minns@umontana.edu
More informationIntroduction to Information System
Spring Quarter 2015-2016 Meeting day/time: N/A at Online Campus (Distance Learning). Location: Use D2L.depaul.edu to access the course and course materials Instructor: Miranda Standberry-Wallace Office:
More informationPerson Centered Positive Behavior Support Plan (PC PBS) Report Scoring Criteria & Checklist (Rev ) P. 1 of 8
Scoring Criteria & Checklist (Rev. 3 5 07) P. 1 of 8 Name: Case Name: Case #: Rater: Date: Critical Features Note: The plan needs to meet all of the critical features listed below, and needs to obtain
More informationClassroom Assessment Techniques (CATs; Angelo & Cross, 1993)
Classroom Assessment Techniques (CATs; Angelo & Cross, 1993) From: http://warrington.ufl.edu/itsp/docs/instructor/assessmenttechniques.pdf Assessing Prior Knowledge, Recall, and Understanding 1. Background
More informationSusan K. Woodruff. instructional coaching scale: measuring the impact of coaching interactions
Susan K. Woodruff instructional coaching scale: measuring the impact of coaching interactions Susan K. Woodruff Instructional Coaching Group swoodruf@comcast.net Instructional Coaching Group 301 Homestead
More informationSCIENCE AND TECHNOLOGY 5: HUMAN ORGAN SYSTEMS
SCIENCE AND TECHNOLOGY 5: HUMAN ORGAN SYSTEMS NAME: This booklet is an in-class assignment; you must complete all pages during the class work periods provided. You must use full sentences for all sections
More informationAn Introduction to Simio for Beginners
An Introduction to Simio for Beginners C. Dennis Pegden, Ph.D. This white paper is intended to introduce Simio to a user new to simulation. It is intended for the manufacturing engineer, hospital quality
More informationField Experience Management 2011 Training Guides
Field Experience Management 2011 Training Guides Page 1 of 40 Contents Introduction... 3 Helpful Resources Available on the LiveText Conference Visitors Pass... 3 Overview... 5 Development Model for FEM...
More informationConsultation skills teaching in primary care TEACHING CONSULTING SKILLS * * * * INTRODUCTION
Education for Primary Care (2013) 24: 206 18 2013 Radcliffe Publishing Limited Teaching exchange We start this time with the last of Paul Silverston s articles about undergraduate teaching in primary care.
More informationValparaiso Community Schools IHSAA PRE-PARTICIPATION PHYSICAL EVALUATION SCHOOL:
2431 F1/page 1 of 5 Valparaiso Community Schools IHSAA PRE-PARTICIPATION PHYSICAL EVALUATION SCHOOL: HISTORY DATE: Name: Phone ( ) Address: City: Zip: Sex: Age: Date of Birth: Grade: Personal Physician:
More informationUsing dialogue context to improve parsing performance in dialogue systems
Using dialogue context to improve parsing performance in dialogue systems Ivan Meza-Ruiz and Oliver Lemon School of Informatics, Edinburgh University 2 Buccleuch Place, Edinburgh I.V.Meza-Ruiz@sms.ed.ac.uk,
More informationWeb as Corpus. Corpus Linguistics. Web as Corpus 1 / 1. Corpus Linguistics. Web as Corpus. web.pl 3 / 1. Sketch Engine. Corpus Linguistics
(L615) Markus Dickinson Department of Linguistics, Indiana University Spring 2013 The web provides new opportunities for gathering data Viable source of disposable corpora, built ad hoc for specific purposes
More informationEvolutive Neural Net Fuzzy Filtering: Basic Description
Journal of Intelligent Learning Systems and Applications, 2010, 2: 12-18 doi:10.4236/jilsa.2010.21002 Published Online February 2010 (http://www.scirp.org/journal/jilsa) Evolutive Neural Net Fuzzy Filtering:
More informationLearning Optimal Dialogue Strategies: A Case Study of a Spoken Dialogue Agent for
Learning Optimal Dialogue Strategies: A Case Study of a Spoken Dialogue Agent for Email Marilyn A. Walker Jeanne C. Fromer Shrikanth Narayanan walker@research.att.com jeannie@ai.mit.edu shri@research.att.com
More informationLecture 1: Basic Concepts of Machine Learning
Lecture 1: Basic Concepts of Machine Learning Cognitive Systems - Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010
More informationPaper 2. Mathematics test. Calculator allowed. First name. Last name. School KEY STAGE TIER
259574_P2 5-7_KS3_Ma.qxd 1/4/04 4:14 PM Page 1 Ma KEY STAGE 3 TIER 5 7 2004 Mathematics test Paper 2 Calculator allowed Please read this page, but do not open your booklet until your teacher tells you
More informationStatus of the MP Profession in Europe
Status of the MP Profession in Europe John Damilakis, MSc, PhD Prof. of Medical Physics Faculty of Medicine University of Crete, Greece IOMP Chair, E&T Committee EFOMP Vice-President (2014) Basic education:
More informationThe 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X
The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, 2013 10.12753/2066-026X-13-154 DATA MINING SOLUTIONS FOR DETERMINING STUDENT'S PROFILE Adela BÂRA,
More informationA MULTI-AGENT SYSTEM FOR A DISTANCE SUPPORT IN EDUCATIONAL ROBOTICS
A MULTI-AGENT SYSTEM FOR A DISTANCE SUPPORT IN EDUCATIONAL ROBOTICS Sébastien GEORGE Christophe DESPRES Laboratoire d Informatique de l Université du Maine Avenue René Laennec, 72085 Le Mans Cedex 9, France
More informationPaper Reference. Edexcel GCSE Mathematics (Linear) 1380 Paper 1 (Non-Calculator) Foundation Tier. Monday 6 June 2011 Afternoon Time: 1 hour 30 minutes
Centre No. Candidate No. Paper Reference 1 3 8 0 1 F Paper Reference(s) 1380/1F Edexcel GCSE Mathematics (Linear) 1380 Paper 1 (Non-Calculator) Foundation Tier Monday 6 June 2011 Afternoon Time: 1 hour
More informationKnowledge-Based - Systems
Knowledge-Based - Systems ; Rajendra Arvind Akerkar Chairman, Technomathematics Research Foundation and Senior Researcher, Western Norway Research institute Priti Srinivas Sajja Sardar Patel University
More informationMinistry of Education General Administration for Private Education ELT Supervision
Ministry of Education General Administration for Private Education ELT Supervision Reflective teaching An important asset to professional development Introduction Reflective practice is viewed as a means
More informationAbstractions and the Brain
Abstractions and the Brain Brian D. Josephson Department of Physics, University of Cambridge Cavendish Lab. Madingley Road Cambridge, UK. CB3 OHE bdj10@cam.ac.uk http://www.tcm.phy.cam.ac.uk/~bdj10 ABSTRACT
More informationGuide to Teaching Computer Science
Guide to Teaching Computer Science Orit Hazzan Tami Lapidot Noa Ragonis Guide to Teaching Computer Science An Activity-Based Approach Dr. Orit Hazzan Associate Professor Technion - Israel Institute of
More informationStatistical Analysis of Climate Change, Renewable Energies, and Sustainability An Independent Investigation for Introduction to Statistics
5/22/2012 Statistical Analysis of Climate Change, Renewable Energies, and Sustainability An Independent Investigation for Introduction to Statistics College of Menominee Nation & University of Wisconsin
More informationCareers in Medicine Update. George V. Richard, Ph.D. Jeanette L. Calli, M.S. Anita M. Navarro, M.Ed. Kelly K. Stazyk
Careers in Medicine Update George V. Richard, Ph.D. Jeanette L. Calli, M.S. Anita M. Navarro, M.Ed. Kelly K. Stazyk November 3, 2012 The Fall issue of Choices is now available! Scan the QR code to read
More informationModeling user preferences and norms in context-aware systems
Modeling user preferences and norms in context-aware systems Jonas Nilsson, Cecilia Lindmark Jonas Nilsson, Cecilia Lindmark VT 2016 Bachelor's thesis for Computer Science, 15 hp Supervisor: Juan Carlos
More informationAmerican College of Emergency Physicians National Emergency Medicine Medical Student Award Nomination Form. Due Date: February 14, 2012
Nomination Form Due Date: February 14, 2012 Please follow instructions closely, and make sure you have included all requested information listed on the checklist. Electronic submissions only. Please refrain
More informationRover Races Grades: 3-5 Prep Time: ~45 Minutes Lesson Time: ~105 minutes
Rover Races Grades: 3-5 Prep Time: ~45 Minutes Lesson Time: ~105 minutes WHAT STUDENTS DO: Establishing Communication Procedures Following Curiosity on Mars often means roving to places with interesting
More informationAnalysis of the Process of Encoding Guidelines: An Evaluation of GLIF3
Analysis of the Process of Encoding Guidelines: An Evaluation of GLIF3 Vimla L. Patel, Ph.D., D.Sc. 1, 2 Timothy Branch, B.Sc. 1 Dongwen Wang, M.Phil. 2 Mor Peleg, Ph.D. 3 Aziz Boxwala, M.B.B.S., Ph.D.
More informationCOMPUTER-ASSISTED INDEPENDENT STUDY IN MULTIVARIATE CALCULUS
COMPUTER-ASSISTED INDEPENDENT STUDY IN MULTIVARIATE CALCULUS L. Descalço 1, Paula Carvalho 1, J.P. Cruz 1, Paula Oliveira 1, Dina Seabra 2 1 Departamento de Matemática, Universidade de Aveiro (PORTUGAL)
More informationDYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING
University of Craiova, Romania Université de Technologie de Compiègne, France Ph.D. Thesis - Abstract - DYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING Elvira POPESCU Advisors: Prof. Vladimir RĂSVAN
More informationClinical Review Criteria Related to Speech Therapy 1
Clinical Review Criteria Related to Speech Therapy 1 I. Definition Speech therapy is covered for restoration or improved speech in members who have a speechlanguage disorder as a result of a non-chronic
More informationAlgebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview
Algebra 1, Quarter 3, Unit 3.1 Line of Best Fit Overview Number of instructional days 6 (1 day assessment) (1 day = 45 minutes) Content to be learned Analyze scatter plots and construct the line of best
More informationarxiv: v1 [cs.cl] 2 Apr 2017
Word-Alignment-Based Segment-Level Machine Translation Evaluation using Word Embeddings Junki Matsuo and Mamoru Komachi Graduate School of System Design, Tokyo Metropolitan University, Japan matsuo-junki@ed.tmu.ac.jp,
More informationEmporia State University Degree Works Training User Guide Advisor
Emporia State University Degree Works Training User Guide Advisor For use beginning with Catalog Year 2014. Not applicable for students with a Catalog Year prior. Table of Contents Table of Contents Introduction...
More informationIs operations research really research?
Volume 22 (2), pp. 155 180 http://www.orssa.org.za ORiON ISSN 0529-191-X c 2006 Is operations research really research? NJ Manson Received: 2 October 2006; Accepted: 1 November 2006 Abstract This paper
More informationINTERNAL MEDICINE IN-TRAINING EXAMINATION (IM-ITE SM )
INTERNAL MEDICINE IN-TRAINING EXAMINATION (IM-ITE SM ) GENERAL INFORMATION The Internal Medicine In-Training Examination, produced by the American College of Physicians and co-sponsored by the Alliance
More informationSchool of Basic Biomedical Sciences College of Medicine. M.D./Ph.D PROGRAM ACADEMIC POLICIES AND PROCEDURES
School of Basic Biomedical Sciences College of Medicine M.D./Ph.D PROGRAM ACADEMIC POLICIES AND PROCEDURES Objective: The combined M.D./Ph.D. program within the College of Medicine at the University of
More informationRule Learning With Negation: Issues Regarding Effectiveness
Rule Learning With Negation: Issues Regarding Effectiveness S. Chua, F. Coenen, G. Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX Liverpool, United
More information