Cross-lingual Short-Text Document Classification for Facebook Comments

Size: px
Start display at page:

Download "Cross-lingual Short-Text Document Classification for Facebook Comments"

Transcription

1 2014 International Conference on Future Internet of Things and Cloud Cross-lingual Short-Text Document Classification for Facebook Comments Mosab Faqeeh, Nawaf Abdulla, Mahmoud Al-Ayyoub, Yaser Jararweh and Muhannad Quwaider Jordan University of Science and Technology Irbid, Jordan s: {mos3b.faqeeh, nawaf.iqbal, malayyoub, yaser.amd, Abstract Document Classification (DC) is one of the fundamental problems in text mining. Plenty of works exist on DC with interesting approaches and excellent results; however, most of them focus on a long-text documents written in a single language with English being the most studied language. This work is concerned with the natural step beyond such works which is cross-lingual DC for short-text documents. Specifically, we consider two languages, Arabic and English, and compare the performance of some of the most popular document classifiers on two datasets of short Facebook comments. Apart from limited attempts, the addressed problem has not been studied well enough. The results are encouraging and new insights are obtained. Index Terms document classification; cross-lingual text analysis; social network comments; support vector machine; decision tree; naive Bayes; k-nearest neighbor I. INTRODUCTION The Document Classification (DC) problem is concerned with automatically placing text documents in categories/classes based on their contents. It is one of the fundamental problems in many fields such as text mining, machine learning, natural language processing, information retrieval, etc., with a vast range of applications such as spam filtering [1], authorship authentication [2], [3], gender identification [4], dialect identification [5], [6], native language identification [7], sentiment analysis [8], [9], [10], etc. The DC problem gained more importance due to the explosion in the size of text data available on the Web over the past two decades. Not only this expansion forced people to consider scalability issues (giving rise to important fields such as Big Data), it has also produced special challenges for the DC problem. One such example is the short length of the text document to be classified. Short-text documents (excerpts) exits all over the Web from website summaries to image captions. Most importantly, the comments written on social networks and mobile applications have a rather short length. The prevalence of short-text documents and the additional challenges they pose call for special attention to the problem of Short-text Document Classification (SDC) [11]. In general DC, we are given a large-enough dataset of manually labeled training documents and the objective is to build a classification model based on this dataset capable of accurately predicting the class of an unlabeled document. While this description applies to all supervised learning problems, DC has some special characteristics requiring special attention. For example, DC uses word occurrences in documents to build a feature vector for each document in what is known as the bagof-words (BOW) approach [12]. Such an approach results in a dataset of sparse vectors with high dimensionality due to the high number of features/attributes (i.e., the different words in a natural language). Not all classifiers can handle such high dimensional datasets. However, there are several exceptions such as Naive Bayes (NB), Support Vector Machines (SVM), Decision Trees (DT), etc., which perform very well for the DC problem [1] even with the Arabic language [13]. It is worth mentioning here that the short length of the documents can cause serious degradation in the performance of classifiers due to the small number of words in each short-text document and their low occurrence rate across documents leading to a small number of common words [11]. Hence, SDC is a problem worth studying on its own. The two languages under consideration are Arabic and English. Most existing works on NLP in general consider English text from text processing tools to optimized classifiers. Arabic, on the other hand, is largely understudied despite being one of the six official languages of the UN and being Arabic is the native language of 420 million people living in the Arab world, which spans regions of the Middle East and North Africa (MENA) in addition to parts of East Africa (Horn of Africa) [14]. Moreover, the amount of Arabic content on the Web and the number of Arabic speaking users are growing rapidly [14]. Finally, Arabic is a rich morphological language with many challenging aspects. The importance of the Arabic language and the interesting challenges associated with studying it make it one of the most interesting languages to study. The rest of this paper is organized as follows. In Section II, we present an up-to-date coverage of the addressed problem while, in Section III, we present our research methodology and experimental results. Finally, we conclude the paper and discuss future work guidelines in Section IV. II. LITERATURE REVIEW Since DC is a fundamental problem based on which many problems are formulated in many fields such as machine learning, data mining, information retrieval and natural language processing, there are numerous papers addressing different aspects of it. Since the English language is the most studied language in the literature making it the focal point of the /14 $ IEEE DOI /FiCloud

2 textbooks on NLP and DC, we will simply refer the interested readers to surveys with thorough coverage of DC for the English language such as [15], [12], [1], [16], [17]. Below, we mention some of the interesting works on Arabic DC before discussing the most relevant works in terms of SDC. Since the number and quality of features used to ex-press documents have a direct effect on categorization algorithms, the following discusses the main ideas and techniques of feature reduction and selection and their impact on DC. Duwairi et al. [18] compared between three reduction techniques (stemming, light stemming, and word cluster). KNN was selected for training and testing and the results showed that light stemming yielded the highest accuracy and lowest time of model construction. Another study [19] compared 17 Feature Subset Selection (FSS) metrics. They carried out a comparative study to examine the effect of the feature selection metrics in terms of precision, recall, F1-measure, and model building time. The results in general revealed that Odd Ratio (OR) worked better than the others. Some studies focused on other techniques like N-gram and different distance measures and proved their effects on Arabic DC. For instance, [20] used a statistical method called Maximum Entropy (ME) for the classification of Arab News articles. The author showed that the Dice measures using N-gram outperforms using the Manhattan distance. Similar classifier was used in [21], but different selection and reduction techniques were applied. The author used normalization, stemming and stop words removal to increase the ultimate accuracy. However, many studies focused on the exploited classifiers, and the evolvement of the classifiers used in each study keeps growing alongside pre-processing tasks such as stemming, weighting techniques, N-gram, and so forth. In [22], the authors classified a dataset collected from different Arabic web sites utilizing the Naive Bayes (NB) algorithm and achieved 69% accuracy. In [23], the author used three classification algorithms: K-Nearest Neighbor (KNN), SVM and NB, for classifying each document into one of nine classes (Computer, Economics, Education, Engineering, Law, Medicine, Politics, Religion and Sports). Whilst, in [24], the NB and KNN classifiers were only used to classify Arabic text collected from online Arabic newspapers such as Aljazeera, Al-Ahram, Al-Dostor, etc. Then in [25] proposed a hybrid algorithm for Arabic stemming and compared it to other proposed stemmer, for example, Khoja stemmer. The outcomes were promising and acceptable. Moreover, [26] studied four different term-frequency weighting schemes such as: raw Term Frequency (TF), which improves recall, Inverse Document Frequency (IDF), which improves precision, Term Frequency-Inverse Document frequency (TF-IDF), which improves both recall and precision, and Weighted Inverse Document Frequency (WIDF). Finally, experiments showed that, in general, NB was the best followed by KNN and Rocchio. Researchers have not stopped investigating the impact of several factors on the classification accuracy. These factors include corpora size and diversity, features selection and reduction, targeted language, classification approach, etc. Hence, studies like [27], [28], [28], [29], [30], [31], [32] are comprehensive references for that matter. Most of them illustrate the importance of choosing certain criteria during the training and testing phases and some of them suggested new ideas and vectors which handle the classification process quite differently. For instance, [33] proposed a distance based classifier in which each category is represented by a vector containing the words of the training documents after applying pre-processing and stemming operations. Finally, for comprehensive comparative studies of the different tools for Arabic text preprocessing, attribute selection and reduction and classification, the interested reader is referred to the works of Said et al. [34], Saad [32], Khorsheed and Al-Thubaity [13]. The SDC problem has gained a lot of interest due to the widespread of short-text documents (mainly within Web services and mobile applications) and the special challenges posed by it [11]. The main approach for SDC, which is followed here, is the BOW approach. One advantage of the BOW approach is its language-independence, which means that no special language-specific tools and lexicons are required to apply it. According to [11], [35], previous works on SDC are limited by their dependence on either language-specific syntactic and semantic features or some meta-data injected into each document from external sources such as search engines, WordNet, Wikipedia, etc. This makes them suitable for a very small number of languages such as English and Chinese since the required tools to calculate these features are often unavailable in other languages. This makes BOW the approach of choice in this work since we are interesting in studying the differences in SDC between Arabic and English and we do not want our results to be biased by the effectiveness and quality of the available language-specific tools and lexicons especially considering the huge gap between the English NLP field with its diverse resources and rich studies and the Arabic one, which is still at its early stages of development. Finally, the idea of conducting cross-lingual studies in NLP where the performance of an NLP procedure is evaluated across different natural languages has been considered before in literature such as the case of [11], in which the authors considered the SDC problem for English and Korean. Examples in which both Arabic and English are considered span many subjects including authorship authentication [36], [37], [38], subjectivity and sentiment analysis [39], [40], [8], [41], [42], [43], etc. III. METHODOLOGY This section presents the methodology followed in this work starting with the manual collection, filtering and annotation of the datasets followed by text processing. A. Dataset The objective of this work is to study the problem of crosslingual DC on short texts typically found on social networks. 574

3 Facebook posts are perfect for the purposes of this work due to their abundance and short length. Moreover, Facebook is one of the most popular social network at this time with diverse user-base. This means that collecting a large-enough dataset for each language on various topics is feasible. To ensure consistency, we collected 1,000 comments for each topic of each language. In this pilot study, we limit ourselves to two languages (Arabic and English) and two soft or light topics (weather and food). Future extensions of this work will include more languages and more topics. The Facebook posts are collected using a specialized crawler equipped with basic processing and filtering capabilities. The collected posts are then manually filtered to remove irrelevant, repeated or very short (less than 3 words in length) posts. The documents of the resulting datasets are indeed much shorter than typical DC datasets. Table I shows some length statistics about the collected datasets. The table shows that, on average, each Arabic post contains 39.1 characters or 8.7 words spread across 2.4 lines. An English post, on the other hand, is longer with 62.7 characters or 14.1 words spread across 3 lines. With such short-text posts, it is expected that typical DC classifiers would fail due to the intuitive assumption that such short posts would not contain enough unique keywords to distinguish between classes. Surprisingly, the considered classifiers did so with an unexpected accuracy level as shown in Subsection III-B. Finally, the table shows a tendency to use relatively smaller words (about 4.4 characters/word for both languages). While such number is expected for the Arabic language as shown by previous works like [44], it is a little bit surprising for the English language especially since it is usually assumed that English words are noticeably longer (in terms of number of characters) than Arabic ones [37]. The main justification is lies within the pattern in which social networks posts are written. Specifically, since such posts are often written hastily using a smart phone or a tablet PC, it is natural for them to be short and filled with abbreviations and spelling mistakes. This further complicates the job of the document classifiers. Basic text pre-processing steps are applied to the collected posts remove unwanted characters and stop words. Stemming is then used to ensure that the dimensionality of the problem remain within reasonable bounds. The stemmers used are the Arabic light stemmer and the Porter stemmer, both of which are widely used in the literature. B. Experiments and Results In this section, we present the details of the experiments conducted on the collected datasets and analyze the results providing some insights into the addressed problem of crosslingual short-text document classification. As mentioned in the previous subsection, we have two datasets written in two languages. The two datasets are consistent in the sense that they cover the same topics and are of the same size. We intend to investigate the differences in performance between the following four document classifiers: Support Vector Machines (SVM), Naive Bayes (NB), K-Nearest Neighbor (KNN) and Decision Trees (DT). With the exception of the KNN classifier, these classifiers are known to perform very well for the DC problem [1] and we aim to investigate whether this remains true for the SDC problem. The reason for adding the KNN classifier is because of its high sensitivity to the sparsity and high dimensionality of the DC problem in what is known as the curse of dimensionality. This issue is further amplified in SDC due to the increased sparsity of the dataset. Several libraries exist in the literature with tested and verified implementations of the classifiers under consideration such as WEKA, 1 RapidMiner, 2 Bow, 3 MALLET, 4 KNIME, 5 and LingPipe. 6 The experiments of this work are conducted on the WEKA tool due to the added functionality it offers related to text processing and analysis. The classifiers under consideration are executed on both datasets with the testing method being the holdout method, in which two thirds of the dataset is used for training and the remaining third is reserved for testing. To measure the performance of the classifiers under consideration, four widely used accuracy measures are exploited: precision (p), recall (r), F-measure (F ) and accuracy (a). To explain these measures, it is generally assumed for a binary classification problem such as ours that there is a positive class and a negative one. Precision calculates the ratio of the true positives to the total number of positives predicted by the classifier. The higher the precision, the more accurate the predication of the positive class. On the other hand, recall divides the true positives by the total actual positives belongs to that class. A high recall means high number of comments from the same class is labeled to its exact class. F-measure is weighted average of p and r. Finally, the accuracy computes the ratio of the correctly classified documents regardless of their class. The following are the formulas for these measures [45]: TP p = TP + FP TP r = TP + FN F = 2 p r p + r TP + TN a = TP + FP + TN + FN where TP, FP, TN and FN are the numbers of true positives, false positives, true negatives and false negatives, respectively. True positives and negatives are the correctly classified comments whereas false positives are the number of comments that are incorrectly classified as positive and false negative are the number of comments that are incorrectly classified as negative mccallum/bow/

4 TABLE I STRUCTURE OF THE COLLECTED REVIEWS. Arabic Arabic Arabic English English English Weather Food Dataset Weather Food Dataset Number of lines Average number of characters Average number of words/post Figure 1(d) shows the accuracy measures of the four classifiers under consideration on the Arabic as well as the English datasets. As the figure shows, the employed classifiers achieve higher accuracies on the Arabic dataset than the English one despite the consistency in terms of the covered topics and the English language having slightly longer comments. This observation can be attributed to an inherent characteristic of the language (such as the Arabic keywords of both domains possess more discriminative power compared with their English counterparts) or it can be attributed to the more positive effect stemming has on Arabic due to its morphological nature. The figure shows that using Arabic light stemming improves the accuracy of all classifiers by 4% to 9% while using the Snowball English stemmer has a lower impact with increases between 1% and 3%. The gab, as can be seen from the figure, between classifiers accuracies on the Arabic dataset and the English dataset ranges from 5% and 11%. Similar trends can be observed from Figures 1(a), 1(b) and 1(c) for the presicion, recall and F-measure values. From these figures, it can be observed that while each classifier obtain higher precision than recall, the gap (between the Arabic dataset and the English dataset) in recall is higher than that of the precision. Finally, these figures confirm the superiority of the SVM classifier in SDC and the inferiority of the KNN and DT classifiers. IV. CONCLUSIONS AND FUTURE WORK This work focused on Short-text Document Classification (SDC) in a cross-lingual setting. Specifically, we considered two languages, Arabic and English, and compared the performance of some of the most popular document classifiers on two datasets of short Facebook comments. The results showed interesting trends and observations. For future work, we plan to involve more classifiers, expand the data set classes and size, explore other languages beside Arabic and English. Furthermore, embracing other social networks like Twitter could be the subject of our future goals. REFERENCES [1] C. C. Aggarwal and C. Zhai, A survey of text classification algorithms, in Mining text data. Springer, 2012, pp [2] P. Juola, Authorship attribution, Foundations and Trends in information Retrieval, vol. 1, no. 3, pp , [3] E. Stamatatos, A survey of modern authorship attribution methods, Journal of the American Society for information Science and Technology, vol. 60, no. 3, pp , [4] N. Cheng, R. Chandramouli, and K. Subbalakshmi, Author gender identification from text, Digital Investigation, vol. 8, no. 1, pp , [5] O. F. Zaidan and C. Callison-Burch, The arabic online commentary dataset: an annotated dataset of informal arabic with high dialectal content, in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers-volume 2. Association for Computational Linguistics, 2011, pp [6], Arabic dialect identification, Computational Linguistics, vol. 40, no. 1, pp , [7] J. Tetreault, J. Burstein, and C. Leacock, Eds., Proceedings of the Eighth Workshop on Innovative Use of NLP for Building Educational Applications. Atlanta, Georgia: Association for Computational Linguistics, June [Online]. Available: [8] A. Abbasi, H. Chen, and A. Salem, Sentiment analysis in multiple languages: Feature selection for opinion classification in web forums, ACM Transactions on Information Systems (TOIS), vol. 26, no. 3, p. 12, [9] N. Abdulla, N. Mahyoub, M. Shehab, and M. Al-Ayyoub, Arabic sentiment analysis: Corpus-based and lexicon-based, in Proceedings of The IEEE conference on Applied Electrical Engineering and Computing Technologies (AEECT), [10] M. N. Al-Kabi, N. A. Abdulla, and M. Al-Ayyoub, An analytical study of arabic sentiments: Maktoob case study, in The 8th International Conference for Internet Technology and Secured Transactions (ICITST). IEEE, 2013, pp [11] K. Kim, B.-S. Chung, Y. Choi, S. Lee, J.-Y. Jung, and J. Park, Language independent semantic kernels for short-text classification, Expert Systems with Applications, vol. 41, no. 2, pp , [12] T. Joachims, Learning to classify text using support vector machines: Methods, theory and algorithms. Kluwer Academic Publishers, [13] M. S. Khorsheed and A. O. Al-Thubaity, Comparative evaluation of text classification techniques using a large diverse arabic dataset, Language resources and evaluation, vol. 47, no. 2, pp , [14] N. A. Abdulla, M. Al-Ayyoub, and M. N. Al-Kabi, An extended analytical study of arabic sentiments, International Journal of Big Data Intelligence (IJBDI), to appear. [15] F. Sebastiani, Machine learning in automated text categorization, ACM computing surveys (CSUR), vol. 34, no. 1, pp. 1 47, [16] V. Korde and C. N. Mahender, Text classification and classifiers: A survey, International Journal of Artificial Intelligence & Applications, vol. 3, no. 2, [17] K. Aas and L. Eikvil, Text categorisation: A survey, Raport NR, vol. 941, [18] R. Duwairi, M. N. Al-Refai, and N. Khasawneh, Feature reduction techniques for arabic text categorization, Journal of the American society for information science and technology, vol. 60, no. 11, pp , [19] A. Mesleh, Feature sub-set selection metrics for arabic text classification, Pattern Recognition Letters, vol. 32, no. 14, pp , [20] L. Khreisat, Arabic text classification using n-gram frequency statistics a comparative study, in Conference on Data Mining DMIN 06, 2006, p. 79. [21] A. El-Halees, Arabic text classification using maximum entropy, The Islamic University Journal (Series of Natural Studies and Engineering), vol. 15, pp , [22] M. El Kourdi, A. Bensaid, and T.-e. Rachidi, Automatic arabic document categorization based on the naïve bayes algorithm, in Proceedings of the Workshop on Computational Approaches to Arabic Script-based Languages. Association for Computational Linguistics, 2004, pp [23] A. M. Mesleh, Chi square feature extraction based svms arabic lan- 576

5 (a) Precision (b) Recall (c) F-Measure (d) Accuracy Fig. 1. The accuracy measures of the four classifiers under consideration on the two datasets. guage text categorization system, Journal of Computer Science, vol. 3, no. 6, p. 430, [24] W. Hadi, F. Thabtah, S. ALHawari, and J. Ababneh, Naive bayesian and k-nearest neighbour to categorize arabic text data, in European Simulation and Modeling Conference, 2008, pp [25] M. Hadni, A. Lachkar, and S. A. Ouatik, A new and efficient stemming technique for arabic text categorization, in Multimedia Computing and Systems (ICMCS), 2012 International Conference on. IEEE, 2012, pp [26] G. Kanaan, R. Al-Shalabi, S. Ghwanmeh, and H. Al-Ma adeed, A comparison of text-classification techniques applied to arabic text, Journal of the American society for information science and technology, vol. 60, no. 9, pp , [27] S. Alsaleem, Automated arabic text categorization using svm and nb, Int. Arab J. e-technol., vol. 2, no. 2, pp , [28] F. Harrag, E. El-Qawasmeh, and P. Pichappan, Improving arabic text categorization using decision trees, in Networked Digital Technologies, NDT 09. First International Conference on. IEEE, 2009, pp [29] F. Harrag, E. El-Qawasmah, and A. M. S. Al-Salman, Stemming as a feature reduction technique for arabic text categorization, in Programming and Systems (ISPS), th International Symposium on. IEEE, 2011, pp [30] M. F. Umer and M. Khiyal, Classification of textual documents using learning vector quantization, Information Technology Journal, vol. 6, no. 1, [31] I. Hmeidi, B. Hawashin, and E. El-Qawasmeh, Performance of knn and svm classifiers on full word arabic articles, Advanced Engineering Informatics, vol. 22, no. 1, pp , [32] M. K. Saad, The impact of text preprocessing and term weighting on arabic text classification, Master s thesis, Computer Engineering, The Islamic University-Gaza, [33] R. M. Duwairi, Machine learning for arabic text categorization, Journal of the American Society for Information Science and Technology, vol. 57, no. 8, pp , [34] D. Said, N. M. Wanas, N. M. Darwish, and N. Hegazy, A study of text preprocessing tools for arabic text categorization, in The Second International Conference on Arabic Language, 2009, pp [35] B. Sriram, D. Fuhry, E. Demir, H. Ferhatosmanoglu, and M. Demirbas, Short text classification in twitter to improve information filtering, in Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval. ACM, 2010, pp [36] A. Abbasi and H. Chen, Applying authorship analysis to arabic web content, in Intelligence and Security Informatics. Springer, 2005, pp [37], Applying authorship analysis to extremist-group web forum messages, Intelligent Systems, IEEE, vol. 20, no. 5, pp , [38] E. Stamatatos, Author identification: Using text sampling to handle the class imbalance problem, Information Processing & Management, vol. 44, no. 2, pp , [39] K. Ahmad, D. Cheng, and Y. Almas, Multi-lingual sentiment analysis of financial news streams, in Proc. of the 1st Intl. Conf. on Grid in Finance, [40] Y. Almas and K. Ahmad, A note on extracting sentiments in financial news in english, arabic & urdu, in The Second Workshop on Computational Approaches to Arabic Script-based Languages, 2007, pp [41] C. Banea, R. Mihalcea, and J. Wiebe, Multilingual subjectivity: are 577

6 more languages better? in Proceedings of the 23rd International Conference on Computational Linguistics. Association for Computational Linguistics, 2010, pp [42] M. Rushdi-Saleh, M. T. Martín-Valdivia, L. A. Ureña-López, and J. M. Perea-Ortega, Bilingual experiments with an arabic-english corpus for opinion mining, in Proceedings of Recent Advances in Natural Language Processing, 2011, pp [43], Oca: Opinion corpus for arabic, Journal of the American Society for Information Science and Technology, vol. 62, no. 10, pp , [44] A. Alwajeeh, M. Al-Ayyoub, and I. Hmeidi, On authorship authentication of arabic articles, in The fifth International Conference on Information and Communication Systems (ICICS 2014), [45] I. H. Witten and E. Frank, Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann,

A Case Study: News Classification Based on Term Frequency

A Case Study: News Classification Based on Term Frequency A Case Study: News Classification Based on Term Frequency Petr Kroha Faculty of Computer Science University of Technology 09107 Chemnitz Germany kroha@informatik.tu-chemnitz.de Ricardo Baeza-Yates Center

More information

Rule Learning With Negation: Issues Regarding Effectiveness

Rule Learning With Negation: Issues Regarding Effectiveness Rule Learning With Negation: Issues Regarding Effectiveness S. Chua, F. Coenen, G. Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX Liverpool, United

More information

Reducing Features to Improve Bug Prediction

Reducing Features to Improve Bug Prediction Reducing Features to Improve Bug Prediction Shivkumar Shivaji, E. James Whitehead, Jr., Ram Akella University of California Santa Cruz {shiv,ejw,ram}@soe.ucsc.edu Sunghun Kim Hong Kong University of Science

More information

Rule Learning with Negation: Issues Regarding Effectiveness

Rule Learning with Negation: Issues Regarding Effectiveness Rule Learning with Negation: Issues Regarding Effectiveness Stephanie Chua, Frans Coenen, and Grant Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX

More information

SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF)

SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF) SINGLE DOCUMENT AUTOMATIC TEXT SUMMARIZATION USING TERM FREQUENCY-INVERSE DOCUMENT FREQUENCY (TF-IDF) Hans Christian 1 ; Mikhael Pramodana Agus 2 ; Derwin Suhartono 3 1,2,3 Computer Science Department,

More information

MULTILINGUAL INFORMATION ACCESS IN DIGITAL LIBRARY

MULTILINGUAL INFORMATION ACCESS IN DIGITAL LIBRARY MULTILINGUAL INFORMATION ACCESS IN DIGITAL LIBRARY Chen, Hsin-Hsi Department of Computer Science and Information Engineering National Taiwan University Taipei, Taiwan E-mail: hh_chen@csie.ntu.edu.tw Abstract

More information

A Comparison of Two Text Representations for Sentiment Analysis

A Comparison of Two Text Representations for Sentiment Analysis 010 International Conference on Computer Application and System Modeling (ICCASM 010) A Comparison of Two Text Representations for Sentiment Analysis Jianxiong Wang School of Computer Science & Educational

More information

Linking Task: Identifying authors and book titles in verbose queries

Linking Task: Identifying authors and book titles in verbose queries Linking Task: Identifying authors and book titles in verbose queries Anaïs Ollagnier, Sébastien Fournier, and Patrice Bellot Aix-Marseille University, CNRS, ENSAM, University of Toulon, LSIS UMR 7296,

More information

CLASSIFICATION OF TEXT DOCUMENTS USING INTEGER REPRESENTATION AND REGRESSION: AN INTEGRATED APPROACH

CLASSIFICATION OF TEXT DOCUMENTS USING INTEGER REPRESENTATION AND REGRESSION: AN INTEGRATED APPROACH ISSN: 0976-3104 Danti and Bhushan. ARTICLE OPEN ACCESS CLASSIFICATION OF TEXT DOCUMENTS USING INTEGER REPRESENTATION AND REGRESSION: AN INTEGRATED APPROACH Ajit Danti 1 and SN Bharath Bhushan 2* 1 Department

More information

OCR for Arabic using SIFT Descriptors With Online Failure Prediction

OCR for Arabic using SIFT Descriptors With Online Failure Prediction OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,

More information

Assignment 1: Predicting Amazon Review Ratings

Assignment 1: Predicting Amazon Review Ratings Assignment 1: Predicting Amazon Review Ratings 1 Dataset Analysis Richard Park r2park@acsmail.ucsd.edu February 23, 2015 The dataset selected for this assignment comes from the set of Amazon reviews for

More information

Cross Language Information Retrieval

Cross Language Information Retrieval Cross Language Information Retrieval RAFFAELLA BERNARDI UNIVERSITÀ DEGLI STUDI DI TRENTO P.ZZA VENEZIA, ROOM: 2.05, E-MAIL: BERNARDI@DISI.UNITN.IT Contents 1 Acknowledgment.............................................

More information

Using dialogue context to improve parsing performance in dialogue systems

Using dialogue context to improve parsing performance in dialogue systems Using dialogue context to improve parsing performance in dialogue systems Ivan Meza-Ruiz and Oliver Lemon School of Informatics, Edinburgh University 2 Buccleuch Place, Edinburgh I.V.Meza-Ruiz@sms.ed.ac.uk,

More information

AQUA: An Ontology-Driven Question Answering System

AQUA: An Ontology-Driven Question Answering System AQUA: An Ontology-Driven Question Answering System Maria Vargas-Vera, Enrico Motta and John Domingue Knowledge Media Institute (KMI) The Open University, Walton Hall, Milton Keynes, MK7 6AA, United Kingdom.

More information

Australian Journal of Basic and Applied Sciences

Australian Journal of Basic and Applied Sciences AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean

More information

Word Segmentation of Off-line Handwritten Documents

Word Segmentation of Off-line Handwritten Documents Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department

More information

Python Machine Learning

Python Machine Learning Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled

More information

Twitter Sentiment Classification on Sanders Data using Hybrid Approach

Twitter Sentiment Classification on Sanders Data using Hybrid Approach IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 17, Issue 4, Ver. I (July Aug. 2015), PP 118-123 www.iosrjournals.org Twitter Sentiment Classification on Sanders

More information

Switchboard Language Model Improvement with Conversational Data from Gigaword

Switchboard Language Model Improvement with Conversational Data from Gigaword Katholieke Universiteit Leuven Faculty of Engineering Master in Artificial Intelligence (MAI) Speech and Language Technology (SLT) Switchboard Language Model Improvement with Conversational Data from Gigaword

More information

Learning From the Past with Experiment Databases

Learning From the Past with Experiment Databases Learning From the Past with Experiment Databases Joaquin Vanschoren 1, Bernhard Pfahringer 2, and Geoff Holmes 2 1 Computer Science Dept., K.U.Leuven, Leuven, Belgium 2 Computer Science Dept., University

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks

Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Devendra Singh Chaplot, Eunhee Rhim, and Jihie Kim Samsung Electronics Co., Ltd. Seoul, South Korea {dev.chaplot,eunhee.rhim,jihie.kim}@samsung.com

More information

The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X

The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, 2013 10.12753/2066-026X-13-154 DATA MINING SOLUTIONS FOR DETERMINING STUDENT'S PROFILE Adela BÂRA,

More information

METHODS FOR EXTRACTING AND CLASSIFYING PAIRS OF COGNATES AND FALSE FRIENDS

METHODS FOR EXTRACTING AND CLASSIFYING PAIRS OF COGNATES AND FALSE FRIENDS METHODS FOR EXTRACTING AND CLASSIFYING PAIRS OF COGNATES AND FALSE FRIENDS Ruslan Mitkov (R.Mitkov@wlv.ac.uk) University of Wolverhampton ViktorPekar (v.pekar@wlv.ac.uk) University of Wolverhampton Dimitar

More information

Probabilistic Latent Semantic Analysis

Probabilistic Latent Semantic Analysis Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview

More information

arxiv: v1 [cs.cl] 2 Apr 2017

arxiv: v1 [cs.cl] 2 Apr 2017 Word-Alignment-Based Segment-Level Machine Translation Evaluation using Word Embeddings Junki Matsuo and Mamoru Komachi Graduate School of System Design, Tokyo Metropolitan University, Japan matsuo-junki@ed.tmu.ac.jp,

More information

Multi-Lingual Text Leveling

Multi-Lingual Text Leveling Multi-Lingual Text Leveling Salim Roukos, Jerome Quin, and Todd Ward IBM T. J. Watson Research Center, Yorktown Heights, NY 10598 {roukos,jlquinn,tward}@us.ibm.com Abstract. Determining the language proficiency

More information

Chapter 10 APPLYING TOPIC MODELING TO FORENSIC DATA. 1. Introduction. Alta de Waal, Jacobus Venter and Etienne Barnard

Chapter 10 APPLYING TOPIC MODELING TO FORENSIC DATA. 1. Introduction. Alta de Waal, Jacobus Venter and Etienne Barnard Chapter 10 APPLYING TOPIC MODELING TO FORENSIC DATA Alta de Waal, Jacobus Venter and Etienne Barnard Abstract Most actionable evidence is identified during the analysis phase of digital forensic investigations.

More information

CS 446: Machine Learning

CS 446: Machine Learning CS 446: Machine Learning Introduction to LBJava: a Learning Based Programming Language Writing classifiers Christos Christodoulopoulos Parisa Kordjamshidi Motivation 2 Motivation You still have not learnt

More information

Multilingual Sentiment and Subjectivity Analysis

Multilingual Sentiment and Subjectivity Analysis Multilingual Sentiment and Subjectivity Analysis Carmen Banea and Rada Mihalcea Department of Computer Science University of North Texas rada@cs.unt.edu, carmen.banea@gmail.com Janyce Wiebe Department

More information

Speech Emotion Recognition Using Support Vector Machine

Speech Emotion Recognition Using Support Vector Machine Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,

More information

Matching Similarity for Keyword-Based Clustering

Matching Similarity for Keyword-Based Clustering Matching Similarity for Keyword-Based Clustering Mohammad Rezaei and Pasi Fränti University of Eastern Finland {rezaei,franti}@cs.uef.fi Abstract. Semantic clustering of objects such as documents, web

More information

Disambiguation of Thai Personal Name from Online News Articles

Disambiguation of Thai Personal Name from Online News Articles Disambiguation of Thai Personal Name from Online News Articles Phaisarn Sutheebanjard Graduate School of Information Technology Siam University Bangkok, Thailand mr.phaisarn@gmail.com Abstract Since online

More information

Netpix: A Method of Feature Selection Leading. to Accurate Sentiment-Based Classification Models

Netpix: A Method of Feature Selection Leading. to Accurate Sentiment-Based Classification Models Netpix: A Method of Feature Selection Leading to Accurate Sentiment-Based Classification Models 1 Netpix: A Method of Feature Selection Leading to Accurate Sentiment-Based Classification Models James B.

More information

arxiv: v1 [cs.lg] 3 May 2013

arxiv: v1 [cs.lg] 3 May 2013 Feature Selection Based on Term Frequency and T-Test for Text Categorization Deqing Wang dqwang@nlsde.buaa.edu.cn Hui Zhang hzhang@nlsde.buaa.edu.cn Rui Liu, Weifeng Lv {liurui,lwf}@nlsde.buaa.edu.cn arxiv:1305.0638v1

More information

Learning Methods in Multilingual Speech Recognition

Learning Methods in Multilingual Speech Recognition Learning Methods in Multilingual Speech Recognition Hui Lin Department of Electrical Engineering University of Washington Seattle, WA 98125 linhui@u.washington.edu Li Deng, Jasha Droppo, Dong Yu, and Alex

More information

Detecting Wikipedia Vandalism using Machine Learning Notebook for PAN at CLEF 2011

Detecting Wikipedia Vandalism using Machine Learning Notebook for PAN at CLEF 2011 Detecting Wikipedia Vandalism using Machine Learning Notebook for PAN at CLEF 2011 Cristian-Alexandru Drăgușanu, Marina Cufliuc, Adrian Iftene UAIC: Faculty of Computer Science, Alexandru Ioan Cuza University,

More information

Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification

Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification Tomi Kinnunen and Ismo Kärkkäinen University of Joensuu, Department of Computer Science, P.O. Box 111, 80101 JOENSUU,

More information

Postprint.

Postprint. http://www.diva-portal.org Postprint This is the accepted version of a paper presented at CLEF 2013 Conference and Labs of the Evaluation Forum Information Access Evaluation meets Multilinguality, Multimodality,

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

Product Feature-based Ratings foropinionsummarization of E-Commerce Feedback Comments

Product Feature-based Ratings foropinionsummarization of E-Commerce Feedback Comments Product Feature-based Ratings foropinionsummarization of E-Commerce Feedback Comments Vijayshri Ramkrishna Ingale PG Student, Department of Computer Engineering JSPM s Imperial College of Engineering &

More information

Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming

Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming Data Mining VI 205 Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming C. Romero, S. Ventura, C. Hervás & P. González Universidad de Córdoba, Campus Universitario de

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

Exposé for a Master s Thesis

Exposé for a Master s Thesis Exposé for a Master s Thesis Stefan Selent January 21, 2017 Working Title: TF Relation Mining: An Active Learning Approach Introduction The amount of scientific literature is ever increasing. Especially

More information

OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS

OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,

More information

Lecture 1: Machine Learning Basics

Lecture 1: Machine Learning Basics 1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3

More information

Feature Selection based on Sampling and C4.5 Algorithm to Improve the Quality of Text Classification using Naïve Bayes

Feature Selection based on Sampling and C4.5 Algorithm to Improve the Quality of Text Classification using Naïve Bayes Feature Selection based on Sampling and C4.5 Algorithm to Improve the Quality of Text Classification using Naïve Bayes Viviana Molano 1, Carlos Cobos 1, Martha Mendoza 1, Enrique Herrera-Viedma 2, and

More information

Sentiment Analysis of Tunisian Dialect: Linguistic Resources and Experiments

Sentiment Analysis of Tunisian Dialect: Linguistic Resources and Experiments Sentiment Analysis of Tunisian Dialect: Linguistic Resources and Experiments Salima Mdhaffar 1,2, Fethi Bougares 1, Yannick Estève 1 and Lamia Hadrich-Belguith 2 1 LIUM Lab, University of Le Mans, France

More information

Identification of Opinion Leaders Using Text Mining Technique in Virtual Community

Identification of Opinion Leaders Using Text Mining Technique in Virtual Community Identification of Opinion Leaders Using Text Mining Technique in Virtual Community Chihli Hung Department of Information Management Chung Yuan Christian University Taiwan 32023, R.O.C. chihli@cycu.edu.tw

More information

CS Machine Learning

CS Machine Learning CS 478 - Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing

More information

Using Web Searches on Important Words to Create Background Sets for LSI Classification

Using Web Searches on Important Words to Create Background Sets for LSI Classification Using Web Searches on Important Words to Create Background Sets for LSI Classification Sarah Zelikovitz and Marina Kogan College of Staten Island of CUNY 2800 Victory Blvd Staten Island, NY 11314 Abstract

More information

Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling

Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling Experiments with SMS Translation and Stochastic Gradient Descent in Spanish Text Author Profiling Notebook for PAN at CLEF 2013 Andrés Alfonso Caurcel Díaz 1 and José María Gómez Hidalgo 2 1 Universidad

More information

Large-Scale Web Page Classification. Sathi T Marath. Submitted in partial fulfilment of the requirements. for the degree of Doctor of Philosophy

Large-Scale Web Page Classification. Sathi T Marath. Submitted in partial fulfilment of the requirements. for the degree of Doctor of Philosophy Large-Scale Web Page Classification by Sathi T Marath Submitted in partial fulfilment of the requirements for the degree of Doctor of Philosophy at Dalhousie University Halifax, Nova Scotia November 2010

More information

Detecting English-French Cognates Using Orthographic Edit Distance

Detecting English-French Cognates Using Orthographic Edit Distance Detecting English-French Cognates Using Orthographic Edit Distance Qiongkai Xu 1,2, Albert Chen 1, Chang i 1 1 The Australian National University, College of Engineering and Computer Science 2 National

More information

Cross-Lingual Text Categorization

Cross-Lingual Text Categorization Cross-Lingual Text Categorization Nuria Bel 1, Cornelis H.A. Koster 2, and Marta Villegas 1 1 Grup d Investigació en Lingüística Computacional Universitat de Barcelona, 028 - Barcelona, Spain. {nuria,tona}@gilc.ub.es

More information

A heuristic framework for pivot-based bilingual dictionary induction

A heuristic framework for pivot-based bilingual dictionary induction 2013 International Conference on Culture and Computing A heuristic framework for pivot-based bilingual dictionary induction Mairidan Wushouer, Toru Ishida, Donghui Lin Department of Social Informatics,

More information

Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages

Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages Iterative Cross-Training: An Algorithm for Learning from Unlabeled Web Pages Nuanwan Soonthornphisaj 1 and Boonserm Kijsirikul 2 Machine Intelligence and Knowledge Discovery Laboratory Department of Computer

More information

Semi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17.

Semi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17. Semi-supervised methods of text processing, and an application to medical concept extraction Yacine Jernite Text-as-Data series September 17. 2015 What do we want from text? 1. Extract information 2. Link

More information

Analyzing sentiments in tweets for Tesla Model 3 using SAS Enterprise Miner and SAS Sentiment Analysis Studio

Analyzing sentiments in tweets for Tesla Model 3 using SAS Enterprise Miner and SAS Sentiment Analysis Studio SCSUG Student Symposium 2016 Analyzing sentiments in tweets for Tesla Model 3 using SAS Enterprise Miner and SAS Sentiment Analysis Studio Praneth Guggilla, Tejaswi Jha, Goutam Chakraborty, Oklahoma State

More information

Problems of the Arabic OCR: New Attitudes

Problems of the Arabic OCR: New Attitudes Problems of the Arabic OCR: New Attitudes Prof. O.Redkin, Dr. O.Bernikova Department of Asian and African Studies, St. Petersburg State University, St Petersburg, Russia Abstract - This paper reviews existing

More information

Developing True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability

Developing True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability Developing True/False Test Sheet Generating System with Diagnosing Basic Cognitive Ability Shih-Bin Chen Dept. of Information and Computer Engineering, Chung-Yuan Christian University Chung-Li, Taiwan

More information

Entrepreneurial Discovery and the Demmert/Klein Experiment: Additional Evidence from Germany

Entrepreneurial Discovery and the Demmert/Klein Experiment: Additional Evidence from Germany Entrepreneurial Discovery and the Demmert/Klein Experiment: Additional Evidence from Germany Jana Kitzmann and Dirk Schiereck, Endowed Chair for Banking and Finance, EUROPEAN BUSINESS SCHOOL, International

More information

Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments

Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Cristina Vertan, Walther v. Hahn University of Hamburg, Natural Language Systems Division Hamburg,

More information

The Internet as a Normative Corpus: Grammar Checking with a Search Engine

The Internet as a Normative Corpus: Grammar Checking with a Search Engine The Internet as a Normative Corpus: Grammar Checking with a Search Engine Jonas Sjöbergh KTH Nada SE-100 44 Stockholm, Sweden jsh@nada.kth.se Abstract In this paper some methods using the Internet as a

More information

Language Independent Passage Retrieval for Question Answering

Language Independent Passage Retrieval for Question Answering Language Independent Passage Retrieval for Question Answering José Manuel Gómez-Soriano 1, Manuel Montes-y-Gómez 2, Emilio Sanchis-Arnal 1, Luis Villaseñor-Pineda 2, Paolo Rosso 1 1 Polytechnic University

More information

Longest Common Subsequence: A Method for Automatic Evaluation of Handwritten Essays

Longest Common Subsequence: A Method for Automatic Evaluation of Handwritten Essays IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 17, Issue 6, Ver. IV (Nov Dec. 2015), PP 01-07 www.iosrjournals.org Longest Common Subsequence: A Method for

More information

THE ROLE OF DECISION TREES IN NATURAL LANGUAGE PROCESSING

THE ROLE OF DECISION TREES IN NATURAL LANGUAGE PROCESSING SISOM & ACOUSTICS 2015, Bucharest 21-22 May THE ROLE OF DECISION TREES IN NATURAL LANGUAGE PROCESSING MarilenaăLAZ R 1, Diana MILITARU 2 1 Military Equipment and Technologies Research Agency, Bucharest,

More information

Automating the E-learning Personalization

Automating the E-learning Personalization Automating the E-learning Personalization Fathi Essalmi 1, Leila Jemni Ben Ayed 1, Mohamed Jemni 1, Kinshuk 2, and Sabine Graf 2 1 The Research Laboratory of Technologies of Information and Communication

More information

Arabic Orthography vs. Arabic OCR

Arabic Orthography vs. Arabic OCR Arabic Orthography vs. Arabic OCR Rich Heritage Challenging A Much Needed Technology Mohamed Attia Having consistently been spoken since more than 2000 years and on, Arabic is doubtlessly the oldest among

More information

Time series prediction

Time series prediction Chapter 13 Time series prediction Amaury Lendasse, Timo Honkela, Federico Pouzols, Antti Sorjamaa, Yoan Miche, Qi Yu, Eric Severin, Mark van Heeswijk, Erkki Oja, Francesco Corona, Elia Liitiäinen, Zhanxing

More information

Mining Association Rules in Student s Assessment Data

Mining Association Rules in Student s Assessment Data www.ijcsi.org 211 Mining Association Rules in Student s Assessment Data Dr. Varun Kumar 1, Anupama Chadha 2 1 Department of Computer Science and Engineering, MVN University Palwal, Haryana, India 2 Anupama

More information

*Net Perceptions, Inc West 78th Street Suite 300 Minneapolis, MN

*Net Perceptions, Inc West 78th Street Suite 300 Minneapolis, MN From: AAAI Technical Report WS-98-08. Compilation copyright 1998, AAAI (www.aaai.org). All rights reserved. Recommender Systems: A GroupLens Perspective Joseph A. Konstan *t, John Riedl *t, AI Borchers,

More information

How to read a Paper ISMLL. Dr. Josif Grabocka, Carlotta Schatten

How to read a Paper ISMLL. Dr. Josif Grabocka, Carlotta Schatten How to read a Paper ISMLL Dr. Josif Grabocka, Carlotta Schatten Hildesheim, April 2017 1 / 30 Outline How to read a paper Finding additional material Hildesheim, April 2017 2 / 30 How to read a paper How

More information

Predicting Students Performance with SimStudent: Learning Cognitive Skills from Observation

Predicting Students Performance with SimStudent: Learning Cognitive Skills from Observation School of Computer Science Human-Computer Interaction Institute Carnegie Mellon University Year 2007 Predicting Students Performance with SimStudent: Learning Cognitive Skills from Observation Noboru Matsuda

More information

Bug triage in open source systems: a review

Bug triage in open source systems: a review Int. J. Collaborative Enterprise, Vol. 4, No. 4, 2014 299 Bug triage in open source systems: a review V. Akila* and G. Zayaraz Department of Computer Science and Engineering, Pondicherry Engineering College,

More information

Ensemble Technique Utilization for Indonesian Dependency Parser

Ensemble Technique Utilization for Indonesian Dependency Parser Ensemble Technique Utilization for Indonesian Dependency Parser Arief Rahman Institut Teknologi Bandung Indonesia 23516008@std.stei.itb.ac.id Ayu Purwarianti Institut Teknologi Bandung Indonesia ayu@stei.itb.ac.id

More information

Universiteit Leiden ICT in Business

Universiteit Leiden ICT in Business Universiteit Leiden ICT in Business Ranking of Multi-Word Terms Name: Ricardo R.M. Blikman Student-no: s1184164 Internal report number: 2012-11 Date: 07/03/2013 1st supervisor: Prof. Dr. J.N. Kok 2nd supervisor:

More information

UMass at TDT Similarity functions 1. BASIC SYSTEM Detection algorithms. set globally and apply to all clusters.

UMass at TDT Similarity functions 1. BASIC SYSTEM Detection algorithms. set globally and apply to all clusters. UMass at TDT James Allan, Victor Lavrenko, David Frey, and Vikas Khandelwal Center for Intelligent Information Retrieval Department of Computer Science University of Massachusetts Amherst, MA 3 We spent

More information

The stages of event extraction

The stages of event extraction The stages of event extraction David Ahn Intelligent Systems Lab Amsterdam University of Amsterdam ahn@science.uva.nl Abstract Event detection and recognition is a complex task consisting of multiple sub-tasks

More information

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents

More information

Indian Institute of Technology, Kanpur

Indian Institute of Technology, Kanpur Indian Institute of Technology, Kanpur Course Project - CS671A POS Tagging of Code Mixed Text Ayushman Sisodiya (12188) {ayushmn@iitk.ac.in} Donthu Vamsi Krishna (15111016) {vamsi@iitk.ac.in} Sandeep Kumar

More information

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering

More information

Learning Methods for Fuzzy Systems

Learning Methods for Fuzzy Systems Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8

More information

A Bayesian Learning Approach to Concept-Based Document Classification

A Bayesian Learning Approach to Concept-Based Document Classification Databases and Information Systems Group (AG5) Max-Planck-Institute for Computer Science Saarbrücken, Germany A Bayesian Learning Approach to Concept-Based Document Classification by Georgiana Ifrim Supervisors

More information

USER ADAPTATION IN E-LEARNING ENVIRONMENTS

USER ADAPTATION IN E-LEARNING ENVIRONMENTS USER ADAPTATION IN E-LEARNING ENVIRONMENTS Paraskevi Tzouveli Image, Video and Multimedia Systems Laboratory School of Electrical and Computer Engineering National Technical University of Athens tpar@image.

More information

As a high-quality international conference in the field

As a high-quality international conference in the field The New Automated IEEE INFOCOM Review Assignment System Baochun Li and Y. Thomas Hou Abstract In academic conferences, the structure of the review process has always been considered a critical aspect of

More information

The taming of the data:

The taming of the data: The taming of the data: Using text mining in building a corpus for diachronic analysis Stefania Degaetano-Ortlieb, Hannah Kermes, Ashraf Khamis, Jörg Knappen, Noam Ordan and Elke Teich Background Big data

More information

P. Belsis, C. Sgouropoulou, K. Sfikas, G. Pantziou, C. Skourlas, J. Varnas

P. Belsis, C. Sgouropoulou, K. Sfikas, G. Pantziou, C. Skourlas, J. Varnas Exploiting Distance Learning Methods and Multimediaenhanced instructional content to support IT Curricula in Greek Technological Educational Institutes P. Belsis, C. Sgouropoulou, K. Sfikas, G. Pantziou,

More information

Team Formation for Generalized Tasks in Expertise Social Networks

Team Formation for Generalized Tasks in Expertise Social Networks IEEE International Conference on Social Computing / IEEE International Conference on Privacy, Security, Risk and Trust Team Formation for Generalized Tasks in Expertise Social Networks Cheng-Te Li Graduate

More information

Constructing Parallel Corpus from Movie Subtitles

Constructing Parallel Corpus from Movie Subtitles Constructing Parallel Corpus from Movie Subtitles Han Xiao 1 and Xiaojie Wang 2 1 School of Information Engineering, Beijing University of Post and Telecommunications artex.xh@gmail.com 2 CISTR, Beijing

More information

Multivariate k-nearest Neighbor Regression for Time Series data -

Multivariate k-nearest Neighbor Regression for Time Series data - Multivariate k-nearest Neighbor Regression for Time Series data - a novel Algorithm for Forecasting UK Electricity Demand ISF 2013, Seoul, Korea Fahad H. Al-Qahtani Dr. Sven F. Crone Management Science,

More information

Conversational Framework for Web Search and Recommendations

Conversational Framework for Web Search and Recommendations Conversational Framework for Web Search and Recommendations Saurav Sahay and Ashwin Ram ssahay@cc.gatech.edu, ashwin@cc.gatech.edu College of Computing Georgia Institute of Technology Atlanta, GA Abstract.

More information

Performance Analysis of Optimized Content Extraction for Cyrillic Mongolian Learning Text Materials in the Database

Performance Analysis of Optimized Content Extraction for Cyrillic Mongolian Learning Text Materials in the Database Journal of Computer and Communications, 2016, 4, 79-89 Published Online August 2016 in SciRes. http://www.scirp.org/journal/jcc http://dx.doi.org/10.4236/jcc.2016.410009 Performance Analysis of Optimized

More information

Automatic document classification of biological literature

Automatic document classification of biological literature BMC Bioinformatics This Provisional PDF corresponds to the article as it appeared upon acceptance. Copyedited and fully formatted PDF and full text (HTML) versions will be made available soon. Automatic

More information

Article A Novel, Gradient Boosting Framework for Sentiment Analysis in Languages where NLP Resources Are Not Plentiful: A Case Study for Modern Greek

Article A Novel, Gradient Boosting Framework for Sentiment Analysis in Languages where NLP Resources Are Not Plentiful: A Case Study for Modern Greek Article A Novel, Gradient Boosting Framework for Sentiment Analysis in Languages where NLP Resources Are Not Plentiful: A Case Study for Modern Greek Vasileios Athanasiou and Manolis Maragoudakis * Artificial

More information

Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape

Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape Koshi Odagiri 1, and Yoichi Muraoka 1 1 Graduate School of Fundamental/Computer Science and Engineering, Waseda University,

More information

Customized Question Handling in Data Removal Using CPHC

Customized Question Handling in Data Removal Using CPHC International Journal of Research Studies in Computer Science and Engineering (IJRSCSE) Volume 1, Issue 8, December 2014, PP 29-34 ISSN 2349-4840 (Print) & ISSN 2349-4859 (Online) www.arcjournals.org Customized

More information

NCU IISR English-Korean and English-Chinese Named Entity Transliteration Using Different Grapheme Segmentation Approaches

NCU IISR English-Korean and English-Chinese Named Entity Transliteration Using Different Grapheme Segmentation Approaches NCU IISR English-Korean and English-Chinese Named Entity Transliteration Using Different Grapheme Segmentation Approaches Yu-Chun Wang Chun-Kai Wu Richard Tzong-Han Tsai Department of Computer Science

More information

Calibration of Confidence Measures in Speech Recognition

Calibration of Confidence Measures in Speech Recognition Submitted to IEEE Trans on Audio, Speech, and Language, July 2010 1 Calibration of Confidence Measures in Speech Recognition Dong Yu, Senior Member, IEEE, Jinyu Li, Member, IEEE, Li Deng, Fellow, IEEE

More information

Analysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier

Analysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 10, Issue 2, Ver.1 (Mar - Apr.2015), PP 55-61 www.iosrjournals.org Analysis of Emotion

More information