A Genetic Optimized Parallel MLP to Improve Classification Accuracy for Web Learning System
|
|
- Shanon Greene
- 5 years ago
- Views:
Transcription
1 A Genetic Optimized Parallel MLP to Improve Classification Accuracy for Web Learning System L. Jayasimman 1, E.George Dharma Prakash Raj 2 1 Department of MCA, JJ College of Engineering and Technology, Trichy, Tamilnadu, India 2 School of Computer Science and Engineering, Bharathidasan University, Trichy, Tamilnadu, India Abstract: Web-based learning system helps to improve the style of learning environment that adapts the learning material to meet learners needs and also can adapt the learning content according to the individuality of learners. Web learning system provides personalized learning environment that is based on user s cognition. Web Based Education-WBE encompasses all aspects and processes of education that use a World Wide Web as a communication medium and supporting technology. With the increasing popularity of web based learning, it is required to recognize the cognition of individual learners. Cognitive theory is widely used to predict the effectiveness of the web learning and multimedia learning. The cognition induced by instructional and multimedia modes are measured by indirect or subjective methods. Questionnaires are a common form of measuring cognition indirectly. In this paper, a questionnaire is prepared to identify the cognition of the student and his website preferences in the web learning environment. Then all the user preferences are classified using proposed neural network classifiers with an optimization technique. The cognitive attributes are used as the training input for the proposed genetically optimized neural network. Keywords: Web Learning System, Classification Accuracy, Genetic Optimization, Parallel Multi Layer Perceptron, Neural Network. 1. INTRODUCTION The real value of Web-based learning lies not in accessing knowledge at any time, any place, and for anyone, but helping the right students to acquire the right skills and knowledge at the right time in order to function as active, self-reflected and collaborative participants in the information based society. Only the Web-based learning becomes a crucial resource for learners and educational institutions[1]. This however can be achieved only by adhering to the learning paradigm and associated. pedagogical principles, and to the factors that constantly affect the development of Web-based learning. Unfortunately, much of the development of Web-based learning is carried out without a true understanding of the issues that are proper to Web-based learning, partly because marketing advertising and technologies still drive the construction process [2]. Clearly, there is a need for a disciplined, systematic approach to the development process for incorporating and translating the specific requirements of Web-based learning into a system that must constantly evolve in order to ensure the relevance, correctness, and completeness of the content available on the Web[3]. Cognitive learning theory [4], states that learning involves a change in a person s cognitive structure, this change occurring when new information/experiences combine with existing knowledge stored in the long term memory (LTM). Learning is meaningful when it connected to what a person already knows. When new information is connected to existing knowledge, it is known as meaningful learning. Effective teachers create learning experiences leading to such learning. Classification is a data mining technique that assigns items in a collection to target categories or classes. The goal of classification is to accurately predict the target class for each case in the data. Neural networks have emerged as an important tool for classification. The recent vast research activities in neural classification have established that neural networks are a promising alternative to various conventional classification methods[5]. The advantage of neural networks lies in the following theoretical aspects. First, neural networks are data driven self-adaptive methods in that they can adjust themselves to the data without any explicit specification of the functional or distributional form of the model. Second, they are universal functional approximators in that neural networks can approximate any function with arbitrary accuracy. The relevance in optimization technique will lead to the genetic approach which has a little chance to get stuck in local minima. Genetic approaches are finding prevalent applications in solving problems requiring efficient and effective search in the synthesis of neural network architectures, scheduling, numerical optimization etc., and results in solutions that are globally optimal or nearly so. Topology optimization, genetic training algorithms and control parameter optimization are the ways in which genetic algorithms are applied in Artificial Neural Network (ANN). In Genetic algorithm, the learning of an Volume 2, Issue 4 July August 2013 Page 315
2 ANN is formulated as a weight optimization problem such as learning rate, momentum rate and the tolerance level is optimized [6]. A great deal of research is going on in the neural networks worldwide and its applications are expanding in various domains and disciplines such as character recognition, image compression, stock market prediction, medicine and many more. Backpropagation has been used in recognition and learning in neural networks. Neural network classifiers have been shown to provide supervised classification results that significantly improve on traditional classification algorithms such as the Bayesian Maximum Likelihood (ML) classifier. The feed forward multilayer perceptron is the predominant neural network architectur. When a new method was used for interpreting the weights of a trained network, it was proven that the neural networks are able to adjust their weights in accordance with the importance of the role each input data source plays during the classification.the use of genetic algorithm in the design of ANN improves the classification Accuracy. Yung et al. [7] predict the stock price using a hybrid Genetic Approach (GA) combined with recurrent NNs describes a number of input variables that help the network to forecast the next day price. For the input variables, technical indicators or signals are used that were developed in deterministic trading techniques. The backpropagation algorithm is prone to get stuck in local minima and highly depends on the initial weights; to avoid this GA is used for optimizing NN s weights. This paper is organized into the following sections. Section 2 briefly describes the related works, section 3 discusses the methodology and genetic algorithm, section 4 describes the results obtained and discusses the same. Finally the section 5 concludes the paper. 2. RELATED WORKS Jan L. Plass [9] proposed a hybrid model that combines cognitive and software engineering approaches regarding the criteria for the design and evaluation of the user interface of foreign language multimedia software. The proposed approach involves a three step design which includes selection of instructional activity that supports cognitive processes of competence, selection of feature attributes and selection of design features. It is still pragmatic to be practical. Based on this proposal, contextualized model of interface design, domain specific evaluation criteria are developed to describe how well the user interface is able to support the cognitive processes involved in the development of linguistic and pragmatic skills and competencies in SLA. Baylari et al [8] proposed a personalized multi agent e- learning system based on item response theory (IRT) and artificial neural network (ANN) which presents adaptive tests (based on IRT) and personalized recommendations (based on ANN). These agents add Adaptivity and interactivity to the learning environment and act as a human instructor which guides the learners in a friendly and personalized teaching environment. The framework is constructed adaptive tests that will be used as a posttest in the system. Thus a multi-agent system is proposed which has the capability of estimating the learners ability based on explicit responses on these tests and presents him/her a personalized and adaptive test based on that ability. Also the system can discover learner s learning problems via learner responses on review tests by using an artificial neural network (ANN) approach and then recommends appropriate learning materials to the student. Experimental results showed that the proposed system can provide personalized and appropriate course material recommendations with the precision of 83.3%, adaptive tests based on the learner s ability, and therefore, can accelerate learning efficiency and effectiveness. Urszula et al. [10] proposed GenPar method of a Neural Network (NN) description in classification problems by means of genetic algorithms. For that reason NN produces the training examples for developed method. In the GenPar two genetic operations are implemented. That is crossover and mutation. Because the individual is a list of genes with variable length, the operators differ from their standard form. Individuals are selected by applying the roulette wheel method because individuals have different genotype length. The work assures that both parents have an equal fine contribution in the offspring chromosome. During the crossover, the offspring chromosome is created by a random choice of a gene from one of the parents till to the length of shorter parent. There are two forms of mutation. The first one, on the higher level, adds or deletes a gene representing a single rule. On the second level it is realized as a random change of binary values like: flag or a bit in the binary sequence for enumerative parameters. Limit values of real attributes, which are implemented as 32 bits numbers, are mutated in the same way. Urszula, [15] gives an appropriate definition of neural network architecture prior to data analysis is crucial for successful data mining. This can be challenging when the underlying model of the data is unknown. The goal of this study was to determine whether the optimizing neural network architecture using genetic programming as a machine learning strategy would improve the ability of neural networks to model and detect nonlinear interactions among genes in studies of common human diseases. Furthermore, the genetic programming optimized neural network is better than the traditional back propagation neural network approach in terms of predictive ability and power to detect gene-gene interactions when non-functional polymorphisms are present. 2.1 Genetic Optimization Techniques Genetic Optimization is the evolutionary approach which aims to improve the solution to a problem by keeping the best combination of input variables. ANN is the best tool for classification and regression. The parameters of the Volume 2, Issue 4 July August 2013 Page 316
3 ANN are optimized with a genetic approach to enhance the classification accuracy. When the ANN is combined with genetic approach, is known as hybrid model which is better performed than the conventional ANN. The Genetic Approach often works with a form of binary coding. If the problems are coded as chromosomes, the populations are initialized. Once the population size is chosen, the initial population is randomly generated. After the initialization step, each chromosome is evaluated by a fitness function. According to the value of the fitness function, the chromosome associated with fittest individuals will be reproduced more often than those associated with unfit individuals. 2.2 Cross-over Cross-over means mating between individuals [11]. A pair of chromosomes is picked up at random and the single-point crossover operator is applied according to a fixed cross-over probability. For this operation, a random number in the range of 0 to the length of the string is generated. This is called the crossover point. Two portions of the strings lying to the right of the crossover point are interchanged to yield two new strings. Mating is the creation of one or more offspring from the parents selected in the pairing process. The most common form of mating involves two parents that use a crossover to produce two offspring. The k-point and flat crossover are among the commonly used crossover techniques. Inkpoint technique, k crossover points within the range of an individual are selected randomly and the individual parts between these points are swapped by the parts of another individual. In this paper, we use two-point crossover technique, where the points are selected, randomly. Using the two-point crossover, each of the parents is divided into three parts. The second part of the individuals is swapped and two offspring is formed. 2.3 Mutation Mutation introduces random modifications [11]. Mutation consists of considering in turn each bit of a given chromosome and changing its value with a predefined low probability called the mutation. After mating process, a part of the offspring is mutated. Random mutations alter a certain number of bits in a mutant offspring. The single point mutation which changes a bit one to zero and vice versa. Mutation points are randomly selected from the Di N bit number of bits in the offspring array. Mutation rate influences convergence of the algorithm. On one hand, large mutation rate increases the diversity of the algorithm which is considered as a good way for avoiding premature convergence. On the other hand, it tends to distract the algorithm from converging on a popular solution. Hence, an appropriate mutation is always needed. 2.4 Selection Selection equates to the survival of the fittest. Fitness is determined by an objective function or by a subjective with lower fitness die and individuals with higher fitness survive [Siv, 11]. 3. METHODOLOGY 3.1 Multi Layer perceptron ANN architecture is also known as a multilayer perceptron (MLP). Neural networks operational principle is simple. Each input layer neuron has a value, so that the input layer holds input vector. Each neuron connects to other neurons in the next neuron layer. Artificial Neural Network s architecture is a neuron layout grouped in layers. ANN s main parameters include: layer numbers, neuron number per layer, connectivity level and neurons interconnector types. A multilayer Perceptron (MLP) is an original Perceptron model variant proposed by Rosenblatt in 1950 [13]. It has one/more hidden layers between input and output layers, neurons are in layers, connections are always directed from lower to upper layers, same layer neurons are not interconnected. The neural network s first layer is the input layer containing n neurons; the last network layer is the output layer, containing m neurons. In the Perceptron model, a neuron with a linear weighted net function and threshold activation function are used. Input to a neuron is a feature vector in n- dimensional feature space. The net function is a weighted sum of inputs: 3.2 Input Layer A predictor variable vector of values is presented to the input layer. The input layer distributes values to each neuron in the hidden layer. In addition to the predictor variables, a constant input of 1.0, called bias is fed to each hidden layer; the bias is multiplied by a weight and added to sum going into the neuron [11]. 3.3 Hidden Layer Neurons between an input and output layers are the hidden layer neurons. Outputs from hidden layer are distributed to the output layer. First hidden layer neurons are directly connected to input layer (data layer) of neural network. 3.4 Output Layer Reaching an output layer neuron, value from every hidden layer neuron is multiplied by a weight (w kj), and resulting weighted values are added, producing a combined value V j. The weighted sum (V j) is fed to a transfer function σ, which outputs value Y k. The Y values are network outputs. The logistic function defined by: Volume 2, Issue 4 July August 2013 Page 317
4 4) Mutation: probability of inherited gene mutation in children was considered 0.1 (gene value is modified to random value). 5) Generation of new Population: The previous population s fittest chromosomes and 6 children generated form a new population for the next generation. 6) Steps 2 to 6 are performed till the number of iterations corresponds to predefined time or maximum generations. Figure 7 Mapping the weights of the neural network from Problem space (left hand side) into a chromosome. 3.5 Genetic Algorithms (GAs) GAs finds approximate solutions to difficult problems through application of evolutionary biology principles to computer science. GAs views learning as a competition between the populations of evolving candidate problem solutions. A fitness function evaluates every solution to decide if it can contribute to next generation solutions. By operations analogous to gene transfer in sexual reproduction, the algorithm generates a new candidate solution [14] problem. The 3 important aspects of using GA are: Definition of objective function. Definition/implementation of genetic representation and Definition/implementation of genetic operators. begin t 0 initialise P(t) evaluate P(t) while(not termination condition) do begin t 0 select P(t) from P(t 1) alter P(t) evaluate P(t) end 3.7 Steps for the genetic algorithm [12] 4. EXPERIMENTAL RESULTS The cognitive behavior of 82 students studying in undergraduate and postgraduate courses was captured using questionnaires. They were initially subjected to go through a known subject and an unknown subject in a popular online learning website [14]. The typical questions were in the areas of Learning ability Indication about meaningfulness of error Message Prefer to read the text rather than to listen to a lecture Visualization of content read as a mental picture Typical questions in the questionnaire are as follows: 1. I prefer content that is challenging so I can learn new things. 2. Compared with other websites this website is better in terms of content. 3. I am so nervous during the online test that I cannot remember facts I have learned 4. I often choose advanced concept links even if they require more work 5. I am sure I can do an excellent job on the problems and tasks assigned for this session 6. I think I will receive a good grade in this class 7. Even when I do poorly on a test I try to learn from my mistakes 8. I think that what I am learning in this class is useful for me to know 9. I think that what we are learning in this website is interesting 10. Understanding this subject is important to me Table 1 Neural network parameters 1) Generation of Population: Initial population generated with 10 chromosomes and population size maintained over generations. 2) Evaluation: Each chromosome evaluated to find fitness. Parent s selection: Here among top 5 chromosomes with better fitness, 4 are chosen randomly to an empty parent chromosome set. Among the 5 with worst fitness, 2 are chosen to the same set. 3) Passage of genes from parents to children: The principle is that identical characteristics between parents should pass on to children. Volume 2, Issue 4 July August 2013 Page 318
5 Table 2 Genetic algorithm parameters Initial population size 20 Maximum generations 20 Number of epochs 500 Momentum optimization Lower bound 0.5 Upper bound 1.0 Step size optimization Lower bound 0.1 Upper bound 0.5 Encoder mechanism Roulette Cross over Single point Cross over probability 0.75 Mutation Uniform Mutation probability 0.01 Table 3 Classification Accuracy Neural Network General Cognition Algorithms MLP 75.6% Parallel MLP 92% Proposed GO PMLP 92.68% The above result shows that GO PMLP gives better classification accuracy. 5. CONCLUSION This study considered a new method to identify and clasifiy the users preferences of web learing system based on his/her cognitive behavior. It was proposed to optimize the weight updating parameters of PMLP (GO PMLP) and improve the classification accuracy. MLP is combined with GA gives better classification accuracy. Questionnaires were used to indentify the cognitive behaviour of the students. The proposed Genetic Optimized PMLP achieves a classification accuracy of 92.68% for web learning data set. References [1] Joi L. Moore, Camille Dickson-Deane, Krista Galyen, e- Learning, online learning, and distance learning environments: Are they the same?, Elsevier Inernet and Higher Education, Volume 14, Issue 2, pp , [2] Thavamalar Govindasamy, Successful implementation of e-learning Pedagogical considerations Internet and Higher Education, Volume 4, Issue 2, pp , [3] Ivan Martinez, Pablo Moreno-Ger, Jose Luis Sierra, Baltasar Fernandez-Manjon, Educational Modeling Languages: A Conceptual Introduction and a High Level Classification, computers and education E- learning, From theory to practice, Springer, pp , [4] Andy Johnson, Applying Cognitive Learning Theory in The Classroom, pp. 1-7, [5] Peter Zhang, Neural Networks for Classification: A Survey IEEE transactions on systems, man, and cybernetics part c: applications and reviews, Volume 30, Number 4, pp , [6] Fausto Pedro, Garcia Marquez, Marta Ramos, Martin Nieto, Recurrent Neural Network and Genetic Algorithm Approaches for a Dual Route Optimization Problem: A Real Case Study, Proceedings of the Sixth International Conference on Management Science and Engineering Management, Lecture Notes in Electrical Engineering-Springer- Verlag, Volume 185, pp , [7] Yung-Keun Kwon, Byung-Ro Moon, A Hybrid Neurogenetic Approach for Stock Forecasting, IEEE Transactions on Neural Networks, Volume 18, Issue 3, pp , [8] Ahmad Baylari, Montazer, Gh. A., Design a personalized e-learning system based on item response theory and artificial neural network approach, Expert Systems with Applications, Volume 36, Issue 4, pp , [9] Jan L Plass, Design and Evaluation of the User Interface of Foreign Language Multimedia software: A Cognitive Approach; Language Learning & Technology, Volume 2, Number 1, pp , [10] Urszula, Rule extraction from neural network by genetic algorithm with Pareto optimization, Springer, pp , [11] S.N. Sivanandam, S.N. Deepa, Principles of Soft computing, Wiley India(P) Ltd., [12] Abdella, M., &Marwala, T., The use of genetic algorithms and neural networks to approximate missing data in database, IEEE 3rd International Conference on in Computational Informatics, pp , [13] Reiterer, H., The development of design aid tools for a human factor based user interface design, International Conference on Man and Cybernetics Systems, pp , [14] Mohamed Ettaouil, Mohamed lazaar, Youssef Ghanou, Architecture optimization model for the multilayer perceptron and clustering, Journal of Volume 2, Issue 4 July August 2013 Page 319
6 Theoretical and Applied Information Technology, Volume 47, Issue 1, pp , [15] Urszula, GA-Based Rule Extraction from Neural Networks for Approximation, Proceedings of the International Multiconference on Computer Science and Information Technology, pp AUTHOR L. Jayasimman working as a Assistant Professor, with department of Computer Application, J.J.College of Engineering and Technology, Trichy, India. He received his M.Tech degree in Bharathidasan University, Trichy, India in Now he is pursuing PhD (Computer Science) in Bharathidasan University. Dr. E. George Dharma Prakash Raj working as a Assistant Professor with School of Computer Science and Engineering, Bharathidasan University, Trichy, India. He has more than twenty years of experience in Academics. He is a Chairman/Member in Board of Studies in Colleges and Universities in India. He is also a member in Research Organizations, International Programme committee member, Reviewer for international/national journals and conferences. Volume 2, Issue 4 July August 2013 Page 320
Artificial Neural Networks written examination
1 (8) Institutionen för informationsteknologi Olle Gällmo Universitetsadjunkt Adress: Lägerhyddsvägen 2 Box 337 751 05 Uppsala Artificial Neural Networks written examination Monday, May 15, 2006 9 00-14
More informationA Neural Network GUI Tested on Text-To-Phoneme Mapping
A Neural Network GUI Tested on Text-To-Phoneme Mapping MAARTEN TROMPPER Universiteit Utrecht m.f.a.trompper@students.uu.nl Abstract Text-to-phoneme (T2P) mapping is a necessary step in any speech synthesis
More informationLearning Methods for Fuzzy Systems
Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8
More informationPython Machine Learning
Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled
More informationOPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS
OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,
More informationThe 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X
The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, 2013 10.12753/2066-026X-13-154 DATA MINING SOLUTIONS FOR DETERMINING STUDENT'S PROFILE Adela BÂRA,
More informationLecture 1: Machine Learning Basics
1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More information(Sub)Gradient Descent
(Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include
More informationKnowledge-Based - Systems
Knowledge-Based - Systems ; Rajendra Arvind Akerkar Chairman, Technomathematics Research Foundation and Senior Researcher, Western Norway Research institute Priti Srinivas Sajja Sardar Patel University
More informationEvolutive Neural Net Fuzzy Filtering: Basic Description
Journal of Intelligent Learning Systems and Applications, 2010, 2: 12-18 doi:10.4236/jilsa.2010.21002 Published Online February 2010 (http://www.scirp.org/journal/jilsa) Evolutive Neural Net Fuzzy Filtering:
More informationEvolution of Symbolisation in Chimpanzees and Neural Nets
Evolution of Symbolisation in Chimpanzees and Neural Nets Angelo Cangelosi Centre for Neural and Adaptive Systems University of Plymouth (UK) a.cangelosi@plymouth.ac.uk Introduction Animal communication
More informationA Reinforcement Learning Variant for Control Scheduling
A Reinforcement Learning Variant for Control Scheduling Aloke Guha Honeywell Sensor and System Development Center 3660 Technology Drive Minneapolis MN 55417 Abstract We present an algorithm based on reinforcement
More informationArtificial Neural Networks
Artificial Neural Networks Andres Chavez Math 382/L T/Th 2:00-3:40 April 13, 2010 Chavez2 Abstract The main interest of this paper is Artificial Neural Networks (ANNs). A brief history of the development
More informationCourse Outline. Course Grading. Where to go for help. Academic Integrity. EE-589 Introduction to Neural Networks NN 1 EE
EE-589 Introduction to Neural Assistant Prof. Dr. Turgay IBRIKCI Room # 305 (322) 338 6868 / 139 Wensdays 9:00-12:00 Course Outline The course is divided in two parts: theory and practice. 1. Theory covers
More informationTest Effort Estimation Using Neural Network
J. Software Engineering & Applications, 2010, 3: 331-340 doi:10.4236/jsea.2010.34038 Published Online April 2010 (http://www.scirp.org/journal/jsea) 331 Chintala Abhishek*, Veginati Pavan Kumar, Harish
More informationLecture 1: Basic Concepts of Machine Learning
Lecture 1: Basic Concepts of Machine Learning Cognitive Systems - Machine Learning Ute Schmid (lecture) Johannes Rabold (practice) Based on slides prepared March 2005 by Maximilian Röglinger, updated 2010
More informationHuman Emotion Recognition From Speech
RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati
More informationQuickStroke: An Incremental On-line Chinese Handwriting Recognition System
QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents
More informationTime series prediction
Chapter 13 Time series prediction Amaury Lendasse, Timo Honkela, Federico Pouzols, Antti Sorjamaa, Yoan Miche, Qi Yu, Eric Severin, Mark van Heeswijk, Erkki Oja, Francesco Corona, Elia Liitiäinen, Zhanxing
More informationLaboratorio di Intelligenza Artificiale e Robotica
Laboratorio di Intelligenza Artificiale e Robotica A.A. 2008-2009 Outline 2 Machine Learning Unsupervised Learning Supervised Learning Reinforcement Learning Genetic Algorithms Genetics-Based Machine Learning
More informationLecture 10: Reinforcement Learning
Lecture 1: Reinforcement Learning Cognitive Systems II - Machine Learning SS 25 Part III: Learning Programs and Strategies Q Learning, Dynamic Programming Lecture 1: Reinforcement Learning p. Motivation
More informationSoftprop: Softmax Neural Network Backpropagation Learning
Softprop: Softmax Neural Networ Bacpropagation Learning Michael Rimer Computer Science Department Brigham Young University Provo, UT 84602, USA E-mail: mrimer@axon.cs.byu.edu Tony Martinez Computer Science
More informationClassification Using ANN: A Review
International Journal of Computational Intelligence Research ISSN 0973-1873 Volume 13, Number 7 (2017), pp. 1811-1820 Research India Publications http://www.ripublication.com Classification Using ANN:
More informationTABLE OF CONTENTS TABLE OF CONTENTS COVER PAGE HALAMAN PENGESAHAN PERNYATAAN NASKAH SOAL TUGAS AKHIR ACKNOWLEDGEMENT FOREWORD
TABLE OF CONTENTS TABLE OF CONTENTS COVER PAGE HALAMAN PENGESAHAN PERNYATAAN NASKAH SOAL TUGAS AKHIR ACKNOWLEDGEMENT FOREWORD TABLE OF CONTENTS LIST OF FIGURES LIST OF TABLES LIST OF APPENDICES LIST OF
More informationSARDNET: A Self-Organizing Feature Map for Sequences
SARDNET: A Self-Organizing Feature Map for Sequences Daniel L. James and Risto Miikkulainen Department of Computer Sciences The University of Texas at Austin Austin, TX 78712 dljames,risto~cs.utexas.edu
More informationI-COMPETERE: Using Applied Intelligence in search of competency gaps in software project managers.
Information Systems Frontiers manuscript No. (will be inserted by the editor) I-COMPETERE: Using Applied Intelligence in search of competency gaps in software project managers. Ricardo Colomo-Palacios
More informationINPE São José dos Campos
INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA
More informationLaboratorio di Intelligenza Artificiale e Robotica
Laboratorio di Intelligenza Artificiale e Robotica A.A. 2008-2009 Outline 2 Machine Learning Unsupervised Learning Supervised Learning Reinforcement Learning Genetic Algorithms Genetics-Based Machine Learning
More informationOrdered Incremental Training with Genetic Algorithms
Ordered Incremental Training with Genetic Algorithms Fangming Zhu, Sheng-Uei Guan* Department of Electrical and Computer Engineering, National University of Singapore, 10 Kent Ridge Crescent, Singapore
More informationMachine Learning and Data Mining. Ensembles of Learners. Prof. Alexander Ihler
Machine Learning and Data Mining Ensembles of Learners Prof. Alexander Ihler Ensemble methods Why learn one classifier when you can learn many? Ensemble: combine many predictors (Weighted) combina
More informationTesting A Moving Target: How Do We Test Machine Learning Systems? Peter Varhol Technology Strategy Research, USA
Testing A Moving Target: How Do We Test Machine Learning Systems? Peter Varhol Technology Strategy Research, USA Testing a Moving Target How Do We Test Machine Learning Systems? Peter Varhol, Technology
More informationEvaluation of Usage Patterns for Web-based Educational Systems using Web Mining
Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl
More informationEvaluation of Usage Patterns for Web-based Educational Systems using Web Mining
Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl
More informationSystem Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks
System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering
More informationSpeech Emotion Recognition Using Support Vector Machine
Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,
More informationKnowledge Transfer in Deep Convolutional Neural Nets
Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract
More informationCS Machine Learning
CS 478 - Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing
More informationAn OO Framework for building Intelligence and Learning properties in Software Agents
An OO Framework for building Intelligence and Learning properties in Software Agents José A. R. P. Sardinha, Ruy L. Milidiú, Carlos J. P. Lucena, Patrick Paranhos Abstract Software agents are defined as
More informationReducing Features to Improve Bug Prediction
Reducing Features to Improve Bug Prediction Shivkumar Shivaji, E. James Whitehead, Jr., Ram Akella University of California Santa Cruz {shiv,ejw,ram}@soe.ucsc.edu Sunghun Kim Hong Kong University of Science
More informationA Case Study: News Classification Based on Term Frequency
A Case Study: News Classification Based on Term Frequency Petr Kroha Faculty of Computer Science University of Technology 09107 Chemnitz Germany kroha@informatik.tu-chemnitz.de Ricardo Baeza-Yates Center
More informationSeminar - Organic Computing
Seminar - Organic Computing Self-Organisation of OC-Systems Markus Franke 25.01.2006 Typeset by FoilTEX Timetable 1. Overview 2. Characteristics of SO-Systems 3. Concern with Nature 4. Design-Concepts
More informationAnalysis of Hybrid Soft and Hard Computing Techniques for Forex Monitoring Systems
Analysis of Hybrid Soft and Hard Computing Techniques for Forex Monitoring Systems Ajith Abraham School of Business Systems, Monash University, Clayton, Victoria 3800, Australia. Email: ajith.abraham@ieee.org
More informationCSL465/603 - Machine Learning
CSL465/603 - Machine Learning Fall 2016 Narayanan C Krishnan ckn@iitrpr.ac.in Introduction CSL465/603 - Machine Learning 1 Administrative Trivia Course Structure 3-0-2 Lecture Timings Monday 9.55-10.45am
More informationReinforcement Learning by Comparing Immediate Reward
Reinforcement Learning by Comparing Immediate Reward Punit Pandey DeepshikhaPandey Dr. Shishir Kumar Abstract This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate
More informationUSER ADAPTATION IN E-LEARNING ENVIRONMENTS
USER ADAPTATION IN E-LEARNING ENVIRONMENTS Paraskevi Tzouveli Image, Video and Multimedia Systems Laboratory School of Electrical and Computer Engineering National Technical University of Athens tpar@image.
More informationRule Learning With Negation: Issues Regarding Effectiveness
Rule Learning With Negation: Issues Regarding Effectiveness S. Chua, F. Coenen, G. Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX Liverpool, United
More informationThe Good Judgment Project: A large scale test of different methods of combining expert predictions
The Good Judgment Project: A large scale test of different methods of combining expert predictions Lyle Ungar, Barb Mellors, Jon Baron, Phil Tetlock, Jaime Ramos, Sam Swift The University of Pennsylvania
More informationWord Segmentation of Off-line Handwritten Documents
Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department
More informationUsing focal point learning to improve human machine tacit coordination
DOI 10.1007/s10458-010-9126-5 Using focal point learning to improve human machine tacit coordination InonZuckerman SaritKraus Jeffrey S. Rosenschein The Author(s) 2010 Abstract We consider an automated
More informationAxiom 2013 Team Description Paper
Axiom 2013 Team Description Paper Mohammad Ghazanfari, S Omid Shirkhorshidi, Farbod Samsamipour, Hossein Rahmatizadeh Zagheli, Mohammad Mahdavi, Payam Mohajeri, S Abbas Alamolhoda Robotics Scientific Association
More informationA Pipelined Approach for Iterative Software Process Model
A Pipelined Approach for Iterative Software Process Model Ms.Prasanthi E R, Ms.Aparna Rathi, Ms.Vardhani J P, Mr.Vivek Krishna Electronics and Radar Development Establishment C V Raman Nagar, Bangalore-560093,
More informationAn empirical study of learning speed in backpropagation
Carnegie Mellon University Research Showcase @ CMU Computer Science Department School of Computer Science 1988 An empirical study of learning speed in backpropagation networks Scott E. Fahlman Carnegie
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationA New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation
A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation SLSP-2016 October 11-12 Natalia Tomashenko 1,2,3 natalia.tomashenko@univ-lemans.fr Yuri Khokhlov 3 khokhlov@speechpro.com Yannick
More informationModel Ensemble for Click Prediction in Bing Search Ads
Model Ensemble for Click Prediction in Bing Search Ads Xiaoliang Ling Microsoft Bing xiaoling@microsoft.com Hucheng Zhou Microsoft Research huzho@microsoft.com Weiwei Deng Microsoft Bing dedeng@microsoft.com
More informationSoftware Maintenance
1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories
More informationRule discovery in Web-based educational systems using Grammar-Based Genetic Programming
Data Mining VI 205 Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming C. Romero, S. Ventura, C. Hervás & P. González Universidad de Córdoba, Campus Universitario de
More informationAustralian Journal of Basic and Applied Sciences
AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean
More informationFramewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures
Framewise Phoneme Classification with Bidirectional LSTM and Other Neural Network Architectures Alex Graves and Jürgen Schmidhuber IDSIA, Galleria 2, 6928 Manno-Lugano, Switzerland TU Munich, Boltzmannstr.
More informationGenerative models and adversarial training
Day 4 Lecture 1 Generative models and adversarial training Kevin McGuinness kevin.mcguinness@dcu.ie Research Fellow Insight Centre for Data Analytics Dublin City University What is a generative model?
More informationWhile you are waiting... socrative.com, room number SIMLANG2016
While you are waiting... socrative.com, room number SIMLANG2016 Simulating Language Lecture 4: When will optimal signalling evolve? Simon Kirby simon@ling.ed.ac.uk T H E U N I V E R S I T Y O H F R G E
More informationAnalysis of Speech Recognition Models for Real Time Captioning and Post Lecture Transcription
Analysis of Speech Recognition Models for Real Time Captioning and Post Lecture Transcription Wilny Wilson.P M.Tech Computer Science Student Thejus Engineering College Thrissur, India. Sindhu.S Computer
More informationarxiv: v1 [cs.cv] 10 May 2017
Inferring and Executing Programs for Visual Reasoning Justin Johnson 1 Bharath Hariharan 2 Laurens van der Maaten 2 Judy Hoffman 1 Li Fei-Fei 1 C. Lawrence Zitnick 2 Ross Girshick 2 1 Stanford University
More informationPh.D in Advance Machine Learning (computer science) PhD submitted, degree to be awarded on convocation, sept B.Tech in Computer science and
Name Qualification Sonia Thomas Ph.D in Advance Machine Learning (computer science) PhD submitted, degree to be awarded on convocation, sept. 2016. M.Tech in Computer science and Engineering. B.Tech in
More informationLanguage Acquisition Fall 2010/Winter Lexical Categories. Afra Alishahi, Heiner Drenhaus
Language Acquisition Fall 2010/Winter 2011 Lexical Categories Afra Alishahi, Heiner Drenhaus Computational Linguistics and Phonetics Saarland University Children s Sensitivity to Lexical Categories Look,
More informationAssignment 1: Predicting Amazon Review Ratings
Assignment 1: Predicting Amazon Review Ratings 1 Dataset Analysis Richard Park r2park@acsmail.ucsd.edu February 23, 2015 The dataset selected for this assignment comes from the set of Amazon reviews for
More informationIssues in the Mining of Heart Failure Datasets
International Journal of Automation and Computing 11(2), April 2014, 162-179 DOI: 10.1007/s11633-014-0778-5 Issues in the Mining of Heart Failure Datasets Nongnuch Poolsawad 1 Lisa Moore 1 Chandrasekhar
More informationSpeaker Identification by Comparison of Smart Methods. Abstract
Journal of mathematics and computer science 10 (2014), 61-71 Speaker Identification by Comparison of Smart Methods Ali Mahdavi Meimand Amin Asadi Majid Mohamadi Department of Electrical Department of Computer
More informationAUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION
JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 11/2007, ISSN 1642-6037 Marek WIŚNIEWSKI *, Wiesława KUNISZYK-JÓŹKOWIAK *, Elżbieta SMOŁKA *, Waldemar SUSZYŃSKI * HMM, recognition, speech, disorders
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationSINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF)
SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF) Hans Christian 1 ; Mikhael Pramodana Agus 2 ; Derwin Suhartono 3 1,2,3 Computer Science Department,
More informationP. Belsis, C. Sgouropoulou, K. Sfikas, G. Pantziou, C. Skourlas, J. Varnas
Exploiting Distance Learning Methods and Multimediaenhanced instructional content to support IT Curricula in Greek Technological Educational Institutes P. Belsis, C. Sgouropoulou, K. Sfikas, G. Pantziou,
More informationUsing the Attribute Hierarchy Method to Make Diagnostic Inferences about Examinees Cognitive Skills in Algebra on the SAT
The Journal of Technology, Learning, and Assessment Volume 6, Number 6 February 2008 Using the Attribute Hierarchy Method to Make Diagnostic Inferences about Examinees Cognitive Skills in Algebra on the
More informationhave to be modeled) or isolated words. Output of the system is a grapheme-tophoneme conversion system which takes as its input the spelling of words,
A Language-Independent, Data-Oriented Architecture for Grapheme-to-Phoneme Conversion Walter Daelemans and Antal van den Bosch Proceedings ESCA-IEEE speech synthesis conference, New York, September 1994
More informationKamaldeep Kaur University School of Information Technology GGS Indraprastha University Delhi
Soft Computing Approaches for Prediction of Software Maintenance Effort Dr. Arvinder Kaur University School of Information Technology GGS Indraprastha University Delhi Kamaldeep Kaur University School
More informationGACE Computer Science Assessment Test at a Glance
GACE Computer Science Assessment Test at a Glance Updated May 2017 See the GACE Computer Science Assessment Study Companion for practice questions and preparation resources. Assessment Name Computer Science
More informationSpeech Recognition at ICSI: Broadcast News and beyond
Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI
More informationLearning Methods in Multilingual Speech Recognition
Learning Methods in Multilingual Speech Recognition Hui Lin Department of Electrical Engineering University of Washington Seattle, WA 98125 linhui@u.washington.edu Li Deng, Jasha Droppo, Dong Yu, and Alex
More informationCLASSIFICATION OF TEXT DOCUMENTS USING INTEGER REPRESENTATION AND REGRESSION: AN INTEGRATED APPROACH
ISSN: 0976-3104 Danti and Bhushan. ARTICLE OPEN ACCESS CLASSIFICATION OF TEXT DOCUMENTS USING INTEGER REPRESENTATION AND REGRESSION: AN INTEGRATED APPROACH Ajit Danti 1 and SN Bharath Bhushan 2* 1 Department
More informationDinesh K. Sharma, Ph.D. Department of Management School of Business and Economics Fayetteville State University
Department of Management School of Business and Economics Fayetteville State University EDUCATION Doctor of Philosophy, Devi Ahilya University, Indore, India (2013) Area of Specialization: Management:
More informationAQUA: An Ontology-Driven Question Answering System
AQUA: An Ontology-Driven Question Answering System Maria Vargas-Vera, Enrico Motta and John Domingue Knowledge Media Institute (KMI) The Open University, Walton Hall, Milton Keynes, MK7 6AA, United Kingdom.
More informationABSTRACT. A major goal of human genetics is the discovery and validation of genetic polymorphisms
ABSTRACT DEODHAR, SUSHAMNA DEODHAR. Using Grammatical Evolution Decision Trees for Detecting Gene-Gene Interactions in Genetic Epidemiology. (Under the direction of Dr. Alison Motsinger-Reif.) A major
More informationOn-Line Data Analytics
International Journal of Computer Applications in Engineering Sciences [VOL I, ISSUE III, SEPTEMBER 2011] [ISSN: 2231-4946] On-Line Data Analytics Yugandhar Vemulapalli #, Devarapalli Raghu *, Raja Jacob
More informationRule Learning with Negation: Issues Regarding Effectiveness
Rule Learning with Negation: Issues Regarding Effectiveness Stephanie Chua, Frans Coenen, and Grant Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX
More informationInternational Journal of Advanced Networking Applications (IJANA) ISSN No. :
International Journal of Advanced Networking Applications (IJANA) ISSN No. : 0975-0290 34 A Review on Dysarthric Speech Recognition Megha Rughani Department of Electronics and Communication, Marwadi Educational
More informationFUZZY EXPERT. Dr. Kasim M. Al-Aubidy. Philadelphia University. Computer Eng. Dept February 2002 University of Damascus-Syria
FUZZY EXPERT SYSTEMS 16-18 18 February 2002 University of Damascus-Syria Dr. Kasim M. Al-Aubidy Computer Eng. Dept. Philadelphia University What is Expert Systems? ES are computer programs that emulate
More informationLearning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models
Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models Stephan Gouws and GJ van Rooyen MIH Medialab, Stellenbosch University SOUTH AFRICA {stephan,gvrooyen}@ml.sun.ac.za
More informationPredicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks
Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Devendra Singh Chaplot, Eunhee Rhim, and Jihie Kim Samsung Electronics Co., Ltd. Seoul, South Korea {dev.chaplot,eunhee.rhim,jihie.kim}@samsung.com
More informationCOMPUTER-ASSISTED INDEPENDENT STUDY IN MULTIVARIATE CALCULUS
COMPUTER-ASSISTED INDEPENDENT STUDY IN MULTIVARIATE CALCULUS L. Descalço 1, Paula Carvalho 1, J.P. Cruz 1, Paula Oliveira 1, Dina Seabra 2 1 Departamento de Matemática, Universidade de Aveiro (PORTUGAL)
More informationNotes on The Sciences of the Artificial Adapted from a shorter document written for course (Deciding What to Design) 1
Notes on The Sciences of the Artificial Adapted from a shorter document written for course 17-652 (Deciding What to Design) 1 Ali Almossawi December 29, 2005 1 Introduction The Sciences of the Artificial
More informationAMULTIAGENT system [1] can be defined as a group of
156 IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART C: APPLICATIONS AND REVIEWS, VOL. 38, NO. 2, MARCH 2008 A Comprehensive Survey of Multiagent Reinforcement Learning Lucian Buşoniu, Robert Babuška,
More informationProbability estimates in a scenario tree
101 Chapter 11 Probability estimates in a scenario tree An expert is a person who has made all the mistakes that can be made in a very narrow field. Niels Bohr (1885 1962) Scenario trees require many numbers.
More informationPRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN PROGRAM AT THE UNIVERSITY OF TWENTE
INTERNATIONAL CONFERENCE ON ENGINEERING AND PRODUCT DESIGN EDUCATION 6 & 7 SEPTEMBER 2012, ARTESIS UNIVERSITY COLLEGE, ANTWERP, BELGIUM PRODUCT COMPLEXITY: A NEW MODELLING COURSE IN THE INDUSTRIAL DESIGN
More informationLearning to Schedule Straight-Line Code
Learning to Schedule Straight-Line Code Eliot Moss, Paul Utgoff, John Cavazos Doina Precup, Darko Stefanović Dept. of Comp. Sci., Univ. of Mass. Amherst, MA 01003 Carla Brodley, David Scheeff Sch. of Elec.
More informationDiscriminative Learning of Beam-Search Heuristics for Planning
Discriminative Learning of Beam-Search Heuristics for Planning Yuehua Xu School of EECS Oregon State University Corvallis,OR 97331 xuyu@eecs.oregonstate.edu Alan Fern School of EECS Oregon State University
More informationPREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES
PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES Po-Sen Huang, Kshitiz Kumar, Chaojun Liu, Yifan Gong, Li Deng Department of Electrical and Computer Engineering,
More informationOn the Combined Behavior of Autonomous Resource Management Agents
On the Combined Behavior of Autonomous Resource Management Agents Siri Fagernes 1 and Alva L. Couch 2 1 Faculty of Engineering Oslo University College Oslo, Norway siri.fagernes@iu.hio.no 2 Computer Science
More informationWhat is a Mental Model?
Mental Models for Program Understanding Dr. Jonathan I. Maletic Computer Science Department Kent State University What is a Mental Model? Internal (mental) representation of a real system s behavior,
More informationAUTOMATED TROUBLESHOOTING OF MOBILE NETWORKS USING BAYESIAN NETWORKS
AUTOMATED TROUBLESHOOTING OF MOBILE NETWORKS USING BAYESIAN NETWORKS R.Barco 1, R.Guerrero 2, G.Hylander 2, L.Nielsen 3, M.Partanen 2, S.Patel 4 1 Dpt. Ingeniería de Comunicaciones. Universidad de Málaga.
More information