TOWARDS A KNOWLEDGE-BASED FREE-TEXT RESPONSE ASSESSMENT SYSTEM
|
|
- Elisabeth Norman
- 6 years ago
- Views:
Transcription
1 IADIS International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2008) TOWARDS A KNOWLEDGE-BASED FREE-TEXT RESPONSE ASSESSMENT SYSTEM Panagiotis Blitsas Interdisciplinary Program of Graduate Studies in Basic & Applied Cognitive Science National & Kapodistrian University of Athens Panepistimioupolis, Ilissia, Athens 15784, Greece Maria Grigoriadou Department of Informatics & Telecommunications National & Kapodistrian University of Athens Panepistimioupolis, Ilissia, Athens 15784, Greece ABSTRACT In the present work, the architecture of a knowledge-based free-text response assessment system is presented, which can assess free-text responses on open-ended questions based on text comprehension theories. Its main advantages are the facts of extending the knowledge base and assessing responses on questions of different types. It is constituted from three basic modules: The first module is the Normalization Module (NoM), which is responsible for converting free-text responses into normalized responses, as well as, converting technical text into functional system. The second module is the Functional System Module (FSM), which depicts all entities of a technical text and the relations among them, and is presented, by the representation of microstructure and macrostructure of a Computer Networks domain technical text, according to Denhiere-Baudet Text Comprehension Model. The third module is the Assessment Module (AM), responsible for assessing the normalized responses. It is based on data, obtained by experimental studies on microstructure and macrostructure, constructed by secondary school students, during reading technical texts and responding to questions. KEYWORDS Assessment, Functional system, Microstructure, Macrostructure. 1. INTRODUCTION Nowadays, much effort is put in creating models to simulate psycholinguistic theories with regard to human processes of text comprehension, as the Construction-Integration Model (Kintsch, 2001; Kintsch, 1992), the Theory of Latent Semantic Analysis of Knowledge Representation (Landauer & Dumais 1997), and Denhiere-Baudet Text Comprehension Model (Baudet & Denhiere 1992). Text comprehension models use cognitive representations, which focus in deeper levels of understanding, such as conceptual conclusions based on knowledge, inductive reductions and world knowledge, combined with the surface levels of understanding, which involve lexical processing, syntactic analysis and text interpretation. Our research is focused on Denhiere-Baudet Text Comprehension Model, because it is the most appropriate for elaborating technical text, after analyzing the cognitive categories that are involved in such a kind of texts. According to this model, the individual, while reading a technical text, manufactures, progressively, its representation, namely atoms, states, events and actions of the world that is described in the text, as well as, temporal and causal relations, which connect these cognitive categories. The term 'atom' is used for the entities that participate in the knowledge representation. The term 'state' is static and describes a situation where no change happens during a period of time. The term 'event' describes an action that causes changes, not evoked by a person, but by a non-human action e.g. a machine. An 'action' causes changes and is evoked by a person. 37
2 ISBN: IADIS A technical text depicts a technical system, which contains a set of associated atoms, fixed by hierarchical relations of all/part type. In the case of a technical system, atoms refer to system units. A system unit is a set of entities with a specific function. A technical system, organized as a tree of goal/subgoals, is called a Functional System. According to this model, a technical text should support the construction of two representations, Microstructure and Macrostructure. Microstructure includes two basic structures: (1) Relational structure, which is an ontology of entities and units, which are characterized by the values of their attributes, and one or more static relations among them and (2) Transformational structure, which is the description of the progressive modification of the states of the system units, namely a description of sequence of events executed on these units. Furthermore, in the same structure a description of temporal or/and causal relations among these events is included. Macrostructure includes a teleological structure of goal and subgoals of various operations of the system units and the whole system itself, which, otherwise, are called macroevents. The initial system state changes in order to reach a final state and satisfy a predetermined system goal. In turn, every unit, embodied in the whole system, has been developed, in order to satisfy its own predetermined subgoal. Furthermore, Macrostructure includes Microstructure. So, transformational structure of every unit and, in general, of the whole system is the mean, through which the previous subgoals are being achieved. In the present work, we present the architecture of a free-text response assessment system based on expert's knowledge representation, according to Denhiere-Baudet Text Comprehension Model. This system refers to assessing responses on questions upon the content of technical text, and especially texts about Informatics and Communications. Such a kind of an automated free-text response assessment system on open-ended questions can support students achieving constructivistic learning, while interacting with this. In section 2, the architecture of the Free Text Response Assessment System is presented. In section 3, 4, and 5 the Normalization Module, the Functional System Module and the Assessment Module are presented, respectively. In section 6, there is a discussion about our research and, in section 7 our future plans are presented. 2. ARCHITECTURE OF THE FREE-TEXT RESPONSE ASSESSMENT SYSTEM Figure 1. Architecture of the Free-Text Response Assessment System Figure 1 displays the architecture of the Free-Text Response Assessment System, based on Denhiere-Baudet Text Comprehension Model. 38
3 IADIS International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2008) In detail, the system modules are the following: Normalization Module (NoM): This module is responsible for converting student's free-text response into normalized response through Natural Language Processing (NLP) Functional System Module (FSM): This module is the ontology of the basic structures of the expert's knowledge representation, namely relational and transformational structure of microstructure, and teleological structure of macrostructure, depicted in the technical text. Assessment Module (AM): This module is responsible for rating the normalized response, coming from NoM. The description of these three basic modules and their submodules is following in the next sections. 3. NORMALIZATION MODULE This module has a double role. Its first goal is converting a free-text response into normalized response, and the second one is converting the content of a technical text into ontologies, describing the microstructure and macrostructure, enriching, this way, the content of FSM, which is being described in section 4. When we use the term 'normalized response', we mean the response, which includes the entities, meaning the units, the events and the macroevents, declared explicitly or implicitly in the respective free-text response. In order to achieve the previous goals, the Normalization Module has the following three submodules: Cleaning Module (CleM): It is responsible for cleaning up the student's free-text response from unnecessary words. Collaborating with the FSM, can decide, which word will be cleaned up and which one will be kept, as necessary. It means that when CleM meets a word that constitute entity or relation, appeared in FSM, it will keep this word, and additionally, it will build the representation of student's response. This representation is, in fact, the 'normalized' response. The output of CleM is led, as an input, to NoRM. During this processing stage, there is a need for CleM to collaborate with computational synonym dictionaries, such as WordNet, in order to decide if a word is a synonym of an entity or relation of FSM, so that CleM keeps the word as a necessary one and does not consider it as irrelevant. Conversion Module (CoM): It is responsible for distinguishing the technical text entities, into units, events and macroevents, in order to send them to FSM where microstructure and macrostructure ontologies will be constructed. Normalized Response Module (NoRM): It functions as a buffer of the student's normalized response. Its output is led to AM for estimating the errors, appeared in student's normalized response representation. So far, we have created a tool, in Greek, for implementing the basic submodules of Normalization Module. This tool includes a computational conceptual dictionary and supports input of new concepts and relations among them. Furthermore, it has the capability of accepting as an input a short text, and producing as an output a tree-like ontology of the concepts, which are appeared in the free text, and all the relations among them, belonging to the knowledge base of this tool. Additionally, by using CmapTools software ( an ontology has been manually created. CmapTools gives the opportunity of handling ontological representations and can extract these representations, as entity triads, in form of entity - relation entity. These triads can be inputs to our tool and enrich the knowledge base, which constitutes FSM. 4. FUNCTIONAL SYSTEM MODULE The Functional System Module includes three submodules, which depict the Relational Structure (ReM), the Transformational Structure (TraM) and Teleological Structure (TeM) of expert's knowledge representation. This module takes, as an input, the output of CoM, and constructs the different structures. As an example for representing these three structures of expert's knowledge, we used a technical text, taken from the book 'Computer Science: An overview' (Brookshear, G., 2006). It refers to the combination of bus topology networks toward forming wide area computer networks: The repeater is little more than a device that connects two buses to form a single long bus. The repeater simply passes signals back and forth between the 39
4 ISBN: IADIS two original buses (usually with some form of amplification) without considering the meaning of the signals. A bridge is similar to, but more complex than, a repeater. Like a repeater, it connects two buses, but it does not necessarily pass all messages across the connection. Instead, it looks at the destination address that accompanies each message and forwards a message across the connection only when that message is destined for a computer on the other side. The expert's microstructure and macrostructure representations are following. 4.1 Expert's Microstructure Representation At the microstructure level, there is a description of units, which constitute the system, as well as, the causal relations, which connect them. First stage of realizing microstructure representation is constructing relational structure of the text content. Relational structure has two basic ontologies: taxonomy and partonomy. Taxonomy is a tree-like structure, 'is a' type, which analyzes the taxonomical relations among the entities appeared in the technical text. Partonomy is a tree-like structure too, 'part of' or 'has' type, which expresses all/part-of relations among the text entities. These ontologies have to represent the knowledge, explicitly referred in the text, as well as, the implicit knowledge, which is activated during the reader's comprehending. Examples of text taxonomy and partonomy are following, in form of Prolog facts: is_a(repeater,device). is_a(bridge,device). is_a(bus,lan). is_a(lan,network). part_of(node,bus). part_of(lan,wan). part_of(content,signal). has(bus,csma_cd_protocol). Second stage of realizing expert's microstructure is representing transformational structure. An example of that is shown, schematically, in figure 2. Figure 2. Expert's Transformational Structure 4.2 Expert's Macrostructure Representation Expert's macrostructure includes teleological structure and microstructure. Teleological structure, describing in section 1, is depicted in TeM, and an example, referred to the text, is show schematically, in figure 3. Figure 3. Expert's Macrostructure 40
5 IADIS International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2008) 5. ASSESSMENT MODULE The Assessment Module can assess three kinds of questions: a. Ontological questions, through ReM, such as 'what is' b. Operation questions, through TraM, such as 'how does it work' c. Teleological questions, through TeM, such as 'why' or 'which one' In order to develop the Assessment Module, we had to obtain data of errors students make, during reading technical text and answering questions on microstructure and macrostructure they construct. An experiment on secondary level students took place for estimating the misconceptions students have during comprehending the technical text. Two question types were given to the participants: (i) inference questions, examining the transformational structure students formed during reading and (ii) bridging questions, examining the macrostructure they formed and the recall they achieved from different points of the text. Forms for completing events (for the first question type), and choosing the right device for a specific goal (for the second question type) were given. So, the demanded responses had a normalized form. One example question of each type is following in the next two subsections. 5.1 Response Assessment on Microstructure Questions An example of inference question, referred to transformational structure, which belongs to microstructure, is the following: Describe the operation of a Router, step by step, from the first state, in which the message is located in the source node of the source network to the state, in which the message is located in the destination node of the destination network. Three error types were mentioned on students' responses: missing events in the events sequence events replaced by goals causal errors among events The right sequence of events of Router operation (Router transformational structure) is: (destination network) protocol detection protocol control protocol comparison protocol conversion. For example, in a student's response, the next error types were appeared: (i) Causal error: instead of 'protocol control' precedes 'protocol conversion', in the response 'protocol conversion' precedes 'protocol control', (ii) Event replaced by a subgoal: in place of 'data detection', 'data transfer' appears. Figure 4 displays the analysis of student's transformational structure assessment process, and figure 5 displays an example of automated transformational structure question assessment, implemented in Prolog. In figure 5, AErrors are events replaced by subgoal errors, and BErrors are the causal errors. Finally, MEvents are the missing events in the response. Figure 4. Student's transformational structure assessment process 41
6 ISBN: IADIS Figure 5. Automated transformational structure question assessment example 5.2 Response Assessment on Macrostructure Questions A bridging question demands a response after combining information from more than one point of the given text. An example of bridging question follows: In the case of connecting a Bus with a Ring topology network, which is the device, you have to use? Why the other devices are rejected? Justify your position. This question demands a position and justification for the choice of the right device and for the rejection of the others. The response is based on the macrostructure (including the microstructure of 'repeater', 'bridge', and 'router' devices). Router is not presented in the example text but is appeared in a bigger text, where the example text belongs. The following incomplete sentences were given to the students: The right device is...(1) because...(2) Device... (3) can't be used because... (4) Neither device... (5) can be used because... (6) The right response is: (1) Router, (2) protocol conversion, (3) bridge or repeater, (4) not protocol conversion, (5) repeater or bridge & (6) not protocol conversion. In students' responses, the following error types were appeared: 1. Wrong position (1) or/and justification (2) for the choice of the right device. 2. Wrong positions (3), (5) or/and justification (4), (6) for the rejection of the other devices. 3. Blanks in some of (2), (3), (4), (5) and (6). So, we have three different degrees of assessing. 1. Naïve response, when there is wrong position and justification for the choice of the right device. 2. Incomplete response, when there is right position for the choice of the right device and there is wrong response on (2), (3), (4), (5) or (6), and 3. Full response, when student completed the full right response. Figure 6 displays the analysis of student's macrostructure assessment process, and figure 7 displays an example of automated macrostructure question assessment, implemented in prolog. Figure 6. Student's macrostructure assessment process 42
7 IADIS International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2008) Figure 7. Automated macrostructure question assessment 6. DISCUSSION In this paper, we presented the architecture of a knowledge-based free-text response assessment system. The main purpose of this work was to illustrate the knowledge representation upon a technical text based on the model of Denhière and Baudet for technical text comprehension and the proposition of an automated assessment system, which could assess normalized responses. The fact that the microstructure is not sufficient for the description of a technical system, but the macrostructure is necessary too, is revealed. The complete analysis in microstructure and macrostructure level can support automated reasoning, which in turn, leads to automated comprehension in form of knowledge extraction through these two levels. So far, the most of the systems for computer-assisted assessment of free-text responses are based on the Latent Semantic Analysis Theory (Landauer & Dumais 1997). The main disadvantage of these systems is the fact that they are not incremental, because they are based on vector-oriented analysis. The present system could give a boost to a knowledge-based assessment, with ability of extending the knowledge base by adding new conceptual rules, expressing more causal, spatial and temporal relations, as well as, more goals and subgoals, which can describe new operations of a functional system, which in turn describes the content of a new technical text body. Furthermore, responses on different kinds of questions could be assessed, as bridging, inference and ontological questions. Such a system of automated comprehension and technical text assessment could give a lot of prospects to the way students of technical subjects could interact with computer and through processes of their automated responses assessment can achieve constructivistic learning. The process of an active response assessment can 43
8 ISBN: IADIS help in their meta-knowledge, after giving them the possibility of estimating their errors and error types, and providing the possibility of correction. 7. FUTURE PLANS Our short-term plans include a further study on the misconceptions of students in Computer Science domain, which could provide more explanatory data about the error types they make, while comprehending technical texts, based on their prior knowledge in the domain (Kanidis, E. and Grigoriadou, M., 2007). These studies can help to enrich the Assessment Module with new assessing rules. Furthermore, one of our main goals is the implementation of the system. First, we elaborate the connection of the Normalization Module with computational dictionaries, such as WordNet, Visdic e.t.c. Second, we elaborate the automated enrichment of the Functional System Module knowledge base, in terms of providing an incremental way of inserting new technical text content. ACKNOWLEDGEMENT The work, described in this paper, was partially supported by a grant from the project Language Engineering Tools in Learning Environment: Application, Research, Innovation (Let s LEARN), which is funded by The General Secretariat for Research and Technology (Contract GSRT 092-g). REFERENCES Baudet, S. and Denhiere, G., 1992: Lecture, comprehension de texte et science cognitive. Presses Universitaires de France, Paris. Brookshear, G., Computer Science: An Overview, Pearson Addison Wesley, Ninth Edition Graesser, A. and Tipping, P., 1999: Understanding texts, In: Bechtel, W., Graham, G. (eds.) A Companion to Cognitive Science, Malden MA: Blackwell, Chapter 24. Gruber, T., 1993: Toward Principles for the Design of Ontologies Used for Knowledge Sharing, Technical Report KSL 93-04, Stanford University, Knowledge Systems Laboratory, Revision. Kintsch, W., 2001: Predication. Cognitive Science Vol. 25, pp Kintsch, W., 1992: A cognitive architecture for comprehension. In: Pick, H.L., van den Broek, P., Knill, D.C. (eds.) The study of cognition: Conceptual and methodological issues Washington, DC, American Psychological Association, pp Landauer, T. K. and Dumais, S. T., 1997: A solution to Plato's problem: the Latent Semantic Analysis theory of acquisition, induction and representation of knowledge. Psychological Review, Vol. 104, No. 2, pp Kanidis, E. and Grigoriadou, M., 2007: Reading about Computer Cache Memory: The Effects of Text Structure in Science Learning, Proceedings of the 2th European Conference on Cognitive Science. Lemaire, B, Denhiere, G., et al, 2006: A computational model for simulating text comprehension, Behavior Research methods, Vol. 38 No. 4, pp Rinaldi, F., Dowdall, J., Hess M., Molla, D., Schwitter, R., 2002: Towards Response Extraction: An Application to Technical Domains. In: F. van Harmelen (eds.), Proceeding of the 15 th European Conference on Artificial Intelligence, the Netherlands, Amsterdam IOS Press, pp
AQUA: An Ontology-Driven Question Answering System
AQUA: An Ontology-Driven Question Answering System Maria Vargas-Vera, Enrico Motta and John Domingue Knowledge Media Institute (KMI) The Open University, Walton Hall, Milton Keynes, MK7 6AA, United Kingdom.
More informationVisual CP Representation of Knowledge
Visual CP Representation of Knowledge Heather D. Pfeiffer and Roger T. Hartley Department of Computer Science New Mexico State University Las Cruces, NM 88003-8001, USA email: hdp@cs.nmsu.edu and rth@cs.nmsu.edu
More informationOntologies vs. classification systems
Ontologies vs. classification systems Bodil Nistrup Madsen Copenhagen Business School Copenhagen, Denmark bnm.isv@cbs.dk Hanne Erdman Thomsen Copenhagen Business School Copenhagen, Denmark het.isv@cbs.dk
More informationUSER ADAPTATION IN E-LEARNING ENVIRONMENTS
USER ADAPTATION IN E-LEARNING ENVIRONMENTS Paraskevi Tzouveli Image, Video and Multimedia Systems Laboratory School of Electrical and Computer Engineering National Technical University of Athens tpar@image.
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More informationAbstractions and the Brain
Abstractions and the Brain Brian D. Josephson Department of Physics, University of Cambridge Cavendish Lab. Madingley Road Cambridge, UK. CB3 OHE bdj10@cam.ac.uk http://www.tcm.phy.cam.ac.uk/~bdj10 ABSTRACT
More informationObjectives. Chapter 2: The Representation of Knowledge. Expert Systems: Principles and Programming, Fourth Edition
Chapter 2: The Representation of Knowledge Expert Systems: Principles and Programming, Fourth Edition Objectives Introduce the study of logic Learn the difference between formal logic and informal logic
More informationProbabilistic Latent Semantic Analysis
Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview
More informationCONCEPT MAPS AS A DEVICE FOR LEARNING DATABASE CONCEPTS
CONCEPT MAPS AS A DEVICE FOR LEARNING DATABASE CONCEPTS Pirjo Moen Department of Computer Science P.O. Box 68 FI-00014 University of Helsinki pirjo.moen@cs.helsinki.fi http://www.cs.helsinki.fi/pirjo.moen
More informationA Domain Ontology Development Environment Using a MRD and Text Corpus
A Domain Ontology Development Environment Using a MRD and Text Corpus Naomi Nakaya 1 and Masaki Kurematsu 2 and Takahira Yamaguchi 1 1 Faculty of Information, Shizuoka University 3-5-1 Johoku Hamamatsu
More informationModeling user preferences and norms in context-aware systems
Modeling user preferences and norms in context-aware systems Jonas Nilsson, Cecilia Lindmark Jonas Nilsson, Cecilia Lindmark VT 2016 Bachelor's thesis for Computer Science, 15 hp Supervisor: Juan Carlos
More informationhave to be modeled) or isolated words. Output of the system is a grapheme-tophoneme conversion system which takes as its input the spelling of words,
A Language-Independent, Data-Oriented Architecture for Grapheme-to-Phoneme Conversion Walter Daelemans and Antal van den Bosch Proceedings ESCA-IEEE speech synthesis conference, New York, September 1994
More informationCREATING SHARABLE LEARNING OBJECTS FROM EXISTING DIGITAL COURSE CONTENT
CREATING SHARABLE LEARNING OBJECTS FROM EXISTING DIGITAL COURSE CONTENT Rajendra G. Singh Margaret Bernard Ross Gardler rajsingh@tstt.net.tt mbernard@fsa.uwi.tt rgardler@saafe.org Department of Mathematics
More informationKnowledge Elicitation Tool Classification. Janet E. Burge. Artificial Intelligence Research Group. Worcester Polytechnic Institute
Page 1 of 28 Knowledge Elicitation Tool Classification Janet E. Burge Artificial Intelligence Research Group Worcester Polytechnic Institute Knowledge Elicitation Methods * KE Methods by Interaction Type
More informationTyping versus thinking aloud when reading: Implications for computer-based assessment and training tools
Behavior Research Methods 2006, 38 (2), 211-217 Typing versus thinking aloud when reading: Implications for computer-based assessment and training tools BRENTON MUÑOZ, JOSEPH P. MAGLIANO, and ROBIN SHERIDAN
More informationAgent-Based Software Engineering
Agent-Based Software Engineering Learning Guide Information for Students 1. Description Grade Module Máster Universitario en Ingeniería de Software - European Master on Software Engineering Advanced Software
More informationCircuit Simulators: A Revolutionary E-Learning Platform
Circuit Simulators: A Revolutionary E-Learning Platform Mahi Itagi Padre Conceicao College of Engineering, Verna, Goa, India. itagimahi@gmail.com Akhil Deshpande Gogte Institute of Technology, Udyambag,
More informationA student diagnosing and evaluation system for laboratory-based academic exercises
A student diagnosing and evaluation system for laboratory-based academic exercises Maria Samarakou, Emmanouil Fylladitakis and Pantelis Prentakis Technological Educational Institute (T.E.I.) of Athens
More informationImplementing a tool to Support KAOS-Beta Process Model Using EPF
Implementing a tool to Support KAOS-Beta Process Model Using EPF Malihe Tabatabaie Malihe.Tabatabaie@cs.york.ac.uk Department of Computer Science The University of York United Kingdom Eclipse Process Framework
More informationCWIS 23,3. Nikolaos Avouris Human Computer Interaction Group, University of Patras, Patras, Greece
The current issue and full text archive of this journal is available at wwwemeraldinsightcom/1065-0741htm CWIS 138 Synchronous support and monitoring in web-based educational systems Christos Fidas, Vasilios
More informationReinForest: Multi-Domain Dialogue Management Using Hierarchical Policies and Knowledge Ontology
ReinForest: Multi-Domain Dialogue Management Using Hierarchical Policies and Knowledge Ontology Tiancheng Zhao CMU-LTI-16-006 Language Technologies Institute School of Computer Science Carnegie Mellon
More informationAGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016
AGENDA Advanced Learning Theories Alejandra J. Magana, Ph.D. admagana@purdue.edu Introduction to Learning Theories Role of Learning Theories and Frameworks Learning Design Research Design Dual Coding Theory
More informationSARDNET: A Self-Organizing Feature Map for Sequences
SARDNET: A Self-Organizing Feature Map for Sequences Daniel L. James and Risto Miikkulainen Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 dljames,risto~cs.utexas.edu
More informationEvidence for Reliability, Validity and Learning Effectiveness
PEARSON EDUCATION Evidence for Reliability, Validity and Learning Effectiveness Introduction Pearson Knowledge Technologies has conducted a large number and wide variety of reliability and validity studies
More informationMYCIN. The MYCIN Task
MYCIN Developed at Stanford University in 1972 Regarded as the first true expert system Assists physicians in the treatment of blood infections Many revisions and extensions over the years The MYCIN Task
More informationGACE Computer Science Assessment Test at a Glance
GACE Computer Science Assessment Test at a Glance Updated May 2017 See the GACE Computer Science Assessment Study Companion for practice questions and preparation resources. Assessment Name Computer Science
More informationWhat is a Mental Model?
Mental Models for Program Understanding Dr. Jonathan I. Maletic Computer Science Department Kent State University What is a Mental Model? Internal (mental) representation of a real system s behavior,
More informationDeveloping True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability
Developing True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability Shih-Bin Chen Dept. of Information and Computer Engineering, Chung-Yuan Christian University Chung-Li, Taiwan
More informationPRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN PROGRAM AT THE UNIVERSITY OF TWENTE
INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 6 & 7 SEPTEMBER 2012, ARTESIS UNIVERSITY COLLEGE, ANTWERP, BELGIUM PRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN
More informationConcept Acquisition Without Representation William Dylan Sabo
Concept Acquisition Without Representation William Dylan Sabo Abstract: Contemporary debates in concept acquisition presuppose that cognizers can only acquire concepts on the basis of concepts they already
More informationParsing of part-of-speech tagged Assamese Texts
IJCSI International Journal of Computer Science Issues, Vol. 6, No. 1, 2009 ISSN (Online): 1694-0784 ISSN (Print): 1694-0814 28 Parsing of part-of-speech tagged Assamese Texts Mirzanur Rahman 1, Sufal
More informationStudy and Analysis of MYCIN expert system
www.ijecs.in International Journal Of Engineering And Computer Science ISSN: 2319-7242 Volume 4 Issue 10 Oct 2015, Page No. 14861-14865 Study and Analysis of MYCIN expert system 1 Ankur Kumar Meena, 2
More informationA Context-Driven Use Case Creation Process for Specifying Automotive Driver Assistance Systems
A Context-Driven Use Case Creation Process for Specifying Automotive Driver Assistance Systems Hannes Omasreiter, Eduard Metzker DaimlerChrysler AG Research Information and Communication Postfach 23 60
More informationSeminar - Organic Computing
Seminar - Organic Computing Self-Organisation of OC-Systems Markus Franke 25.01.2006 Typeset by FoilTEX Timetable 1. Overview 2. Characteristics of SO-Systems 3. Concern with Nature 4. Design-Concepts
More informationAn Interactive Intelligent Language Tutor Over The Internet
An Interactive Intelligent Language Tutor Over The Internet Trude Heift Linguistics Department and Language Learning Centre Simon Fraser University, B.C. Canada V5A1S6 E-mail: heift@sfu.ca Abstract: This
More informationLecture 1: Basic Concepts of Machine Learning
Lecture 1: Basic Concepts of Machine Learning Cognitive Systems - Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010
More informationA Case Study: News Classification Based on Term Frequency
A Case Study: News Classification Based on Term Frequency Petr Kroha Faculty of Computer Science University of Technology 09107 Chemnitz Germany kroha@informatik.tu-chemnitz.de Ricardo Baeza-Yates Center
More informationLongest Common Subsequence: A Method for Automatic Evaluation of Handwritten Essays
IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 17, Issue 6, Ver. IV (Nov Dec. 2015), PP 01-07 www.iosrjournals.org Longest Common Subsequence: A Method for
More informationThe 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X
The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, 2013 10.12753/2066-026X-13-154 DATA MINING SOLUTIONS FOR DETERMINING STUDENT'S PROFILE Adela BÂRA,
More informationGetting the Story Right: Making Computer-Generated Stories More Entertaining
Getting the Story Right: Making Computer-Generated Stories More Entertaining K. Oinonen, M. Theune, A. Nijholt, and D. Heylen University of Twente, PO Box 217, 7500 AE Enschede, The Netherlands {k.oinonen
More informationSpecification of the Verity Learning Companion and Self-Assessment Tool
Specification of the Verity Learning Companion and Self-Assessment Tool Sergiu Dascalu* Daniela Saru** Ryan Simpson* Justin Bradley* Eva Sarwar* Joohoon Oh* * Department of Computer Science ** Dept. of
More informationKnowledge-Based - Systems
Knowledge-Based - Systems ; Rajendra Arvind Akerkar Chairman, Technomathematics Research Foundation and Senior Researcher, Western Norway Research institute Priti Srinivas Sajja Sardar Patel University
More informationEffect of Word Complexity on L2 Vocabulary Learning
Effect of Word Complexity on L2 Vocabulary Learning Kevin Dela Rosa Language Technologies Institute Carnegie Mellon University 5000 Forbes Ave. Pittsburgh, PA kdelaros@cs.cmu.edu Maxine Eskenazi Language
More informationModerator: Gary Weckman Ohio University USA
Moderator: Gary Weckman Ohio University USA Robustness in Real-time Complex Systems What is complexity? Interactions? Defy understanding? What is robustness? Predictable performance? Ability to absorb
More informationOrganizational Knowledge Distribution: An Experimental Evaluation
Association for Information Systems AIS Electronic Library (AISeL) AMCIS 24 Proceedings Americas Conference on Information Systems (AMCIS) 12-31-24 : An Experimental Evaluation Surendra Sarnikar University
More informationAUTOMATED TROUBLESHOOTING OF MOBILE NETWORKS USING BAYESIAN NETWORKS
AUTOMATED TROUBLESHOOTING OF MOBILE NETWORKS USING BAYESIAN NETWORKS R.Barco 1, R.Guerrero 2, G.Hylander 2, L.Nielsen 3, M.Partanen 2, S.Patel 4 1 Dpt. Ingeniería de Comunicaciones. Universidad de Málaga.
More informationCaMLA Working Papers
CaMLA Working Papers 2015 02 The Characteristics of the Michigan English Test Reading Texts and Items and their Relationship to Item Difficulty Khaled Barkaoui York University Canada 2015 The Characteristics
More informationAutomating the E-learning Personalization
Automating the E-learning Personalization Fathi Essalmi 1, Leila Jemni Ben Ayed 1, Mohamed Jemni 1, Kinshuk 2, and Sabine Graf 2 1 The Research Laboratory of Technologies of Information and Communication
More informationUniversity of Groningen. Systemen, planning, netwerken Bosman, Aart
University of Groningen Systemen, planning, netwerken Bosman, Aart IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document
More informationThe Learning Model S2P: a formal and a personal dimension
The Learning Model S2P: a formal and a personal dimension Salah Eddine BAHJI, Youssef LEFDAOUI, and Jamila EL ALAMI Abstract The S2P Learning Model was originally designed to try to understand the Game-based
More informationLearning Methods for Fuzzy Systems
Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8
More informationScott Foresman Addison Wesley. envisionmath
PA R E N T G U I D E Scott Foresman Addison Wesley envisionmath Homeschool bundle includes: Student Worktext or Hardcover MindPoint Quiz Show CD-ROM Teacher Edition CD-ROM Because You Know What Matters
More informationA GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING
A GENERIC SPLIT PROCESS MODEL FOR ASSET MANAGEMENT DECISION-MAKING Yong Sun, a * Colin Fidge b and Lin Ma a a CRC for Integrated Engineering Asset Management, School of Engineering Systems, Queensland
More informationThe Pennsylvania State University. The Graduate School. Department of Educational Psychology, Counseling, and Special Education
The Pennsylvania State University The Graduate School Department of Educational Psychology, Counseling, and Special Education INDIVIDUAL DIFFERENCES IN DEEP LEVEL COMPREHENSION: CONTRIBUTIONS OF TEXT STRUCTURE,
More informationEmergency Management Games and Test Case Utility:
IST Project N 027568 IRRIIS Project Rome Workshop, 18-19 October 2006 Emergency Management Games and Test Case Utility: a Synthetic Methodological Socio-Cognitive Perspective Adam Maria Gadomski, ENEA
More informationDesigning e-learning materials with learning objects
Maja Stracenski, M.S. (e-mail: maja.stracenski@zg.htnet.hr) Goran Hudec, Ph. D. (e-mail: ghudec@ttf.hr) Ivana Salopek, B.S. (e-mail: ivana.salopek@ttf.hr) Tekstilno tehnološki fakultet Prilaz baruna Filipovica
More informationLinking Task: Identifying authors and book titles in verbose queries
Linking Task: Identifying authors and book titles in verbose queries Anaïs Ollagnier, Sébastien Fournier, and Patrice Bellot Aix-Marseille University, CNRS, ENSAM, University of Toulon, LSIS UMR 7296,
More informationTransfer Learning Action Models by Measuring the Similarity of Different Domains
Transfer Learning Action Models by Measuring the Similarity of Different Domains Hankui Zhuo 1, Qiang Yang 2, and Lei Li 1 1 Software Research Institute, Sun Yat-sen University, Guangzhou, China. zhuohank@gmail.com,lnslilei@mail.sysu.edu.cn
More informationEXAMINING THE DEVELOPMENT OF FIFTH AND SIXTH GRADE STUDENTS EPISTEMIC CONSIDERATIONS OVER TIME THROUGH AN AUTOMATED ANALYSIS OF EMBEDDED ASSESSMENTS
EXAMINING THE DEVELOPMENT OF FIFTH AND SIXTH GRADE STUDENTS EPISTEMIC CONSIDERATIONS OVER TIME THROUGH AN AUTOMATED ANALYSIS OF EMBEDDED ASSESSMENTS Joshua M. Rosenberg and Christina V. Schwarz Michigan
More informationApplications of memory-based natural language processing
Applications of memory-based natural language processing Antal van den Bosch and Roser Morante ILK Research Group Tilburg University Prague, June 24, 2007 Current ILK members Principal investigator: Antal
More informationCompositional Semantics
Compositional Semantics CMSC 723 / LING 723 / INST 725 MARINE CARPUAT marine@cs.umd.edu Words, bag of words Sequences Trees Meaning Representing Meaning An important goal of NLP/AI: convert natural language
More informationINPE São José dos Campos
INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA
More informationShared Mental Models
Shared Mental Models A Conceptual Analysis Catholijn M. Jonker 1, M. Birna van Riemsdijk 1, and Bas Vermeulen 2 1 EEMCS, Delft University of Technology, Delft, The Netherlands {m.b.vanriemsdijk,c.m.jonker}@tudelft.nl
More informationAction Models and their Induction
Action Models and their Induction Michal Čertický, Comenius University, Bratislava certicky@fmph.uniba.sk March 5, 2013 Abstract By action model, we understand any logic-based representation of effects
More informationLecturing Module
Lecturing: What, why and when www.facultydevelopment.ca Lecturing Module What is lecturing? Lecturing is the most common and established method of teaching at universities around the world. The traditional
More informationSoftware Maintenance
1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories
More informationSemi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17.
Semi-supervised methods of text processing, and an application to medical concept extraction Yacine Jernite Text-as-Data series September 17. 2015 What do we want from text? 1. Extract information 2. Link
More informationUML MODELLING OF DIGITAL FORENSIC PROCESS MODELS (DFPMs)
UML MODELLING OF DIGITAL FORENSIC PROCESS MODELS (DFPMs) Michael Köhn 1, J.H.P. Eloff 2, MS Olivier 3 1,2,3 Information and Computer Security Architectures (ICSA) Research Group Department of Computer
More informationENEE 302h: Digital Electronics, Fall 2005 Prof. Bruce Jacob
Course Syllabus ENEE 302h: Digital Electronics, Fall 2005 Prof. Bruce Jacob 1. Basic Information Time & Place Lecture: TuTh 2:00 3:15 pm, CSIC-3118 Discussion Section: Mon 12:00 12:50pm, EGR-1104 Professor
More informationECE (Fall 2009) Computer Networking Laboratory
ECE 636-101 (Fall 2009) Computer Networking Laboratory Course: ECE 636, Computer Networking Laboratory Section: 101 Time: 6:00-9:00 P.M. Day(s): Monday Session period: 8/31/09-12/7/09 Prerequisites: ECE
More informationLISTENING STRATEGIES AWARENESS: A DIARY STUDY IN A LISTENING COMPREHENSION CLASSROOM
LISTENING STRATEGIES AWARENESS: A DIARY STUDY IN A LISTENING COMPREHENSION CLASSROOM Frances L. Sinanu Victoria Usadya Palupi Antonina Anggraini S. Gita Hastuti Faculty of Language and Literature Satya
More informationAn extended dual search space model of scientific discovery learning
Instructional Science 25: 307 346, 1997. 307 c 1997 Kluwer Academic Publishers. Printed in the Netherlands. An extended dual search space model of scientific discovery learning WOUTER R. VAN JOOLINGEN
More informationUsing dialogue context to improve parsing performance in dialogue systems
Using dialogue context to improve parsing performance in dialogue systems Ivan Meza-Ruiz and Oliver Lemon School of Informatics, Edinburgh University 2 Buccleuch Place, Edinburgh I.V.Meza-Ruiz@sms.ed.ac.uk,
More informationLanguage Acquisition Chart
Language Acquisition Chart This chart was designed to help teachers better understand the process of second language acquisition. Please use this chart as a resource for learning more about the way people
More informationThe Enterprise Knowledge Portal: The Concept
The Enterprise Knowledge Portal: The Concept Executive Information Systems, Inc. www.dkms.com eisai@home.com (703) 461-8823 (o) 1 A Beginning Where is the life we have lost in living! Where is the wisdom
More informationDesigning A Computer Opponent for Wargames: Integrating Planning, Knowledge Acquisition and Learning in WARGLES
In the AAAI 93 Fall Symposium Games: Planning and Learning From: AAAI Technical Report FS-93-02. Compilation copyright 1993, AAAI (www.aaai.org). All rights reserved. Designing A Computer Opponent for
More informationIntegrating Meta-Level and Domain-Level Knowledge for Task-Oriented Dialogue
Advances in Cognitive Systems 3 (2014) 201 219 Submitted 9/2013; published 7/2014 Integrating Meta-Level and Domain-Level Knowledge for Task-Oriented Dialogue Alfredo Gabaldon Pat Langley Silicon Valley
More informationUniversidade do Minho Escola de Engenharia
Universidade do Minho Escola de Engenharia Universidade do Minho Escola de Engenharia Dissertação de Mestrado Knowledge Discovery is the nontrivial extraction of implicit, previously unknown, and potentially
More informationAn Empirical and Computational Test of Linguistic Relativity
An Empirical and Computational Test of Linguistic Relativity Kathleen M. Eberhard* (eberhard.1@nd.edu) Matthias Scheutz** (mscheutz@cse.nd.edu) Michael Heilman** (mheilman@nd.edu) *Department of Psychology,
More informationSpecification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments
Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Cristina Vertan, Walther v. Hahn University of Hamburg, Natural Language Systems Division Hamburg,
More informationDesigning a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses
Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Thomas F.C. Woodhall Masters Candidate in Civil Engineering Queen s University at Kingston,
More informationCollaborative Problem Solving using an Open Modeling Environment
Collaborative Problem Solving using an Open Modeling Environment C. Fidas 1, V. Komis 1, N.M. Avouris 1, A Dimitracopoulou 2 1 University of Patras, Patras, Greece 2 University of the Aegean, Rhodes, Greece
More informationTowards Semantic Facility Data Management
Towards Semantic Facility Data Management Ilkka Niskanen, Anu Purhonen, Jarkko Kuusijärvi Digital Service Research VTT Technical Research Centre of Finland Oulu, Finland {Ilkka.Niskanen, Anu.Purhonen,
More informationIntroduction to HPSG. Introduction. Historical Overview. The HPSG architecture. Signature. Linguistic Objects. Descriptions.
to as a linguistic theory to to a member of the family of linguistic frameworks that are called generative grammars a grammar which is formalized to a high degree and thus makes exact predictions about
More informationEvolutive Neural Net Fuzzy Filtering: Basic Description
Journal of Intelligent Learning Systems and Applications, 2010, 2: 12-18 doi:10.4236/jilsa.2010.21002 Published Online February 2010 (http://www.scirp.org/journal/jilsa) Evolutive Neural Net Fuzzy Filtering:
More informationDYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING
University of Craiova, Romania Université de Technologie de Compiègne, France Ph.D. Thesis - Abstract - DYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING Elvira POPESCU Advisors: Prof. Vladimir RĂSVAN
More informationUC Merced Proceedings of the Annual Meeting of the Cognitive Science Society
UC Merced Proceedings of the nnual Meeting of the Cognitive Science Society Title Multi-modal Cognitive rchitectures: Partial Solution to the Frame Problem Permalink https://escholarship.org/uc/item/8j2825mm
More informationExperience and Innovation Factory: Adaptation of an Experience Factory Model for a Research and Development Laboratory
Experience and Innovation Factory: Adaptation of an Experience Factory Model for a Research and Development Laboratory Full Paper Attany Nathaly L. Araújo, Keli C.V.S. Borges, Sérgio Antônio Andrade de
More informationPatterns for Adaptive Web-based Educational Systems
Patterns for Adaptive Web-based Educational Systems Aimilia Tzanavari, Paris Avgeriou and Dimitrios Vogiatzis University of Cyprus Department of Computer Science 75 Kallipoleos St, P.O. Box 20537, CY-1678
More informationMatching Similarity for Keyword-Based Clustering
Matching Similarity for Keyword-Based Clustering Mohammad Rezaei and Pasi Fränti University of Eastern Finland {rezaei,franti}@cs.uef.fi Abstract. Semantic clustering of objects such as documents, web
More informationVorlesung Mensch-Maschine-Interaktion
Vorlesung Mensch-Maschine-Interaktion Models and Users (1) Ludwig-Maximilians-Universität München LFE Medieninformatik Heinrich Hußmann & Albrecht Schmidt WS2003/2004 http://www.medien.informatik.uni-muenchen.de/
More informationDeveloping a TT-MCTAG for German with an RCG-based Parser
Developing a TT-MCTAG for German with an RCG-based Parser Laura Kallmeyer, Timm Lichte, Wolfgang Maier, Yannick Parmentier, Johannes Dellert University of Tübingen, Germany CNRS-LORIA, France LREC 2008,
More informationCausal Link Semantics for Narrative Planning Using Numeric Fluents
Proceedings, The Thirteenth AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment (AIIDE-17) Causal Link Semantics for Narrative Planning Using Numeric Fluents Rachelyn Farrell,
More informationprehending general textbooks, but are unable to compensate these problems on the micro level in comprehending mathematical texts.
Summary Chapter 1 of this thesis shows that language plays an important role in education. Students are expected to learn from textbooks on their own, to listen actively to the instruction of the teacher,
More informationAssessing Entailer with a Corpus of Natural Language From an Intelligent Tutoring System
Assessing Entailer with a Corpus of Natural Language From an Intelligent Tutoring System Philip M. McCarthy, Vasile Rus, Scott A. Crossley, Sarah C. Bigham, Arthur C. Graesser, & Danielle S. McNamara Institute
More informationMemory-based grammatical error correction
Memory-based grammatical error correction Antal van den Bosch Peter Berck Radboud University Nijmegen Tilburg University P.O. Box 9103 P.O. Box 90153 NL-6500 HD Nijmegen, The Netherlands NL-5000 LE Tilburg,
More informationDOUBLE DEGREE PROGRAM AT EURECOM. June 2017 Caroline HANRAS International Relations Manager
DOUBLE DEGREE PROGRAM AT EURECOM June 2017 Caroline HANRAS International Relations Manager KEY FACTS 1991 Creation by EPFL and Telecom ParisTech 3 Main Fields of Expertise 300 23 Master Students Professors
More informationKLI: Infer KCs from repeated assessment events. Do you know what you know? Ken Koedinger HCI & Psychology CMU Director of LearnLab
KLI: Infer KCs from repeated assessment events Ken Koedinger HCI & Psychology CMU Director of LearnLab Instructional events Explanation, practice, text, rule, example, teacher-student discussion Learning
More informationEECS 571 PRINCIPLES OF REAL-TIME COMPUTING Fall 10. Instructor: Kang G. Shin, 4605 CSE, ;
EECS 571 PRINCIPLES OF REAL-TIME COMPUTING Fall 10 Instructor: Kang G. Shin, 4605 CSE, 763-0391; kgshin@umich.edu Number of credit hours: 4 Class meeting time and room: Regular classes: MW 10:30am noon
More informationText and task authenticity in the EFL classroom
Text and task authenticity in the EFL classroom William Guariento and John Morley There is now a general consensus in language teaching that the use of authentic materials in the classroom is beneficial
More information