Cross Corpus Speech Emotion Classification - An Effective Transfer Learning Technique

Size: px
Start display at page:

Download "Cross Corpus Speech Emotion Classification - An Effective Transfer Learning Technique"

Transcription

1 Cross Corpus Speech Emotion Classification - An Effective Transfer Learning Technique Siddique Latif 1,3, Rajib Rana 2, Shahzad Younis 1, Junaid Qadir 3, and Julien Epps 4 1 National University of Sciences and Technology (NUST), Pakistan 2 University of Southern Queensland, Australia 3 Information Technology University (ITU)-Punjab, Pakistan 4 University of New South Wales, Sydney, Australia arxiv: v2 [cs.cv] 22 Jan 18 Abstract Cross-corpus speech emotion recognition can be a useful transfer learning technique to build a robust speech emotion recognition system by leveraging information from various speech datasets - cross-language and cross-corpus. However, more research needs to be carried out to understand the effective operating scenarios of cross-corpus speech emotion recognition, especially with the utilization of the powerful deep learning techniques. In this paper, we use five different corpora of three different languages to investigate the cross-corpus and cross-language emotion recognition using Deep Belief Networks (s). Experimental results demonstrate that s with generalization power offers better accuracy than a discriminative method based on Sparse Auto Encoder and SVM. Results also suggest that using a large number of languages for training and using a small fraction of target data in training can significantly boost accuracy compared to using the same language for training and testing. I. INTRODUCTION In recent years, speech emotion recognition has received an increasing amount of interest. Speech emotion recognition focus on using linguistic and acoustic attributes as input features and machine learning models as classifiers to predict the emotions of the speaker [1]. These systems achieve promising results when training and testing are performed from the same corpus. However, for real applications, such system does not perform well when speech utterances exist in different languages and collected from different age groups in quite different conditions. At present, various emotional corpora exist, but they are dissimilar based on the spoken language, type of emotion (i.e., naturalistic, elicited, or acted ) and labeling scheme (i.e., dimensional or categorical) [2]. There are more than 5, spoken languages around the world, but only 389 languages account for 94% of the worlds population 1. Even for 389 languages, very few adequate resources (speech corpus) are available for language and speech processing research. It means that the research in language and speech analysis confront with the problem of data scarcity. This imbalance, variation, diversity, and dynamics in speech and language databases make almost impossible to learn a model from a single corpus and put it on the shelf. 1 In automatic speech emotion recognition, most of the studies focus on single corpus without considering the linguistic difference. However, ever since transfer learning has started solving cross-domain classification and pattern recognition problems, interests are growing in cross-corpus emotion recognition. Transfer learning focuses on adapting knowledge from available auxiliary resources to transfer this learning to a target domain, where a very few or even no labeled data is available [3], [4]. Deep neural networks (DNNs) based transfer learning has improved image classification by using a very large dataset as source domain and small data as a target domain [5]. Some studies also exploited DNNs for transfer learning in speech analysis. For example, the performance of sound event classification is improved by training DNNs on very large speech data [6]. In [7], authors used a single DNNs for language and speaker recognition with a large gain on performance by training the model on speech recognition data. Because, most of previous studies do not provide extensive insights on cross-corpus and cross-language speech emotion recognition. We therefore investigate this across multiple languages (English, German, Italian) using different databases. We have used five publicly available databases and performed pairwise experiments using comparatively large dataset as training domain and other small datasets as a target domain to explore the feasibility of transfer learning for various scenarios. We believe that our exploratory research will help researchers gather valuable knowledge about using cross-corpus and crosslanguage speech emotion recognition as a transfer learning technique and apply it in their relevant area of research. II. RELATED WORK Although cross-language and cross-corpus speech emotion recognition is an interesting topic, very few studies have exploited this concept. The existing studies have mostly studied the preliminary feasibility of cross-corpus learning and warranted for further in-depth research. For example, Schuller et al. [2] used six different corpora to analyze cross-corpora emotion recognition using SVM and highlighted the limitation of the current system for cross-corpus emotion recognition. Eyben et al. [8] used four corpora to evaluate some pilot experiments on cross corpus emotion recognition while using

2 support vector machines (SVM). They used three datasets for training and forth for testing and showed that the cross-corpus emotion recognition is feasible. To explore the universal cue of emotions regardless of language, Xia et al. [9] investigated cross-language emotion recognition for Mandarin vs. Western Languages (i.e., German, and Danish). The authors focused on gender-specific speech emotion recognition and achieved the classification rates higher than the chance level. Albornoz et al. [] developed an ensemble SVM for emotion detection with a focus on emotion recognition in never seen languages. In this paper we use deep leaning within transfer learning for speech emotion recognition. Deep learning based transfer learning has recently been used for speech analysis and recognition. However, the existing research has focused on basic DNNs, but the impact of using complex DNN models suitable for cross-corpus/cross-language setting is yet to be explored. We use s and demonstrate that it performs better than a popular DNN model - autoencoders. The key reason to employ is its power of generalisation, which is not present in most conventional DNN models. Intuitively, for cross-corpus and cross-language emotion recognition, generalisation power of a model is crucial. Example of some existing research are as follows. In [7], authors used a single DNN for speaker and language recognition with a large gain on performance by training the model on speech recognition data. Deng et al. [11] used sparse autoencoders for feature transfer learning in speech emotion recognition. They used six standard databases and use single-layer sparse autoencoder and train this model on classspecific instances from the target domain and then apply this representation to source domain for reconstruction of those data. This experimental approach improves the performance of the model as compared to the independent learning from every source domain. Lim et al. [6] proposed cross-acoustic transfer learning framework by using DNNs. After a series of experiments, the obtained results showed that the crossacoustic transfer learning can significantly enhance the classification rate. Apart from DNNs, researchers have also used interesting deep architectures for transfer learning. In [12], the authors focused on using Progressive Neural Networks to transfer knowledge for three paralinguistic tasks, i.e., emotion, speaker, and gender detection. Progressive Networks are useful for conducting multitasking in a network, however, we focus on a single task of emotion recognition as speaker and gender recognition are not the focus of this paper. A. Speech Databases III. EXPERIMENTAL SETUP Five corpora in three languages are covered in this paper for computational experiments on cross-corpora and crosslanguage emotion detection. These databases are annotated differently, therefore, one of the only consistent ways to investigate transfer learning is by looking at positive/negative valence. We adopt the binary valence mapping per emotion category from [2], [11], [18], [19]. The name of the datasets used in our experiment and the categorical mappings to binary valence are provided in Table I. These databases are chosen to span a wide variety of languages and they are widely used by the researchers. B. Speech Features In this study, we use egemaps feature set that is a widely used benchmark features set for speech emotion recognition studies [12]. The feature set includes Low-Level Descriptor (LLD) features of the speech signal that have been proposed as the most relevant to emotions by Paralinguistic studies [19]. The egemaps feature set contains 88 features including frequency, energy, spectral, cepstral, and dynamic information. The overall components are the arithmetic mean and coefficient of variation of 18 LLDs, 6 temporal features, 4 statistics over the unvoiced segments, 8 functionals applied to loudness and pitch, and 26 additional dynamic and cepstral components. C. Deep belief Networks We have used Deep Belief Networks (s) for emotion recognition from speech. s are very popular deep architectures that consist of the stack of Restricted Boltzmann Machines (RBMs) to make a powerful probabilistic generative model by using layer-wise training in a greedy manner. RBM is an undirected stochastic neural network consisting of a visible layer, a hidden layer, and a bias unit. Each visible unit of the visible layer is fully connected to hidden units in the hidden layer, and the bias is connected to all the visible units and the hidden units. There is no connection between a visible to visible and hidden to hidden units. RBM can also be used as classifiers. It is trained on the joint distribution of input data and corresponding labels, then it assigns the label to new input which has the highest probability under the model. Deep belief networks (s) widely used for speech analysis and they are proved to be very successful for highlevel feature learning and emotion classification [], [21]. In particular, can learn more powerful and effective discriminative long-range of features [22] that are helpful in the speech-related problem like emotion recognition [23]. These abilities of have not been exploited for crosscorpus emotion recognition, therefore, we choose for this task. In this experiment, we use having three RBM layers, where the first two RBMs have hidden unit each, and the third RBM have hidden units with learning rate of 3 and epochs. This implementation is adopted from [24], [25]. We used layer-by-layer pre-training in, and backpropagation technique through the whole network to fine-tune the weights to maximise classification accuracy. IV. EXPERIMENTATION In this section, we explore various scenarios for crosscorpus and cross-language speech emotion recognition and conduct experiments to test the scenarios.

3 TABLE I: Corpora information and the mapping of class labels onto Negative/Positive valence. Corpus Language Age Utterances Negative Valance Positive Valance References FAU-AIBO German Children Angry, Touchy, Emphatic, Reprimanding Motherese, Joyful, Neutral, Rest [13] IEMOCAP English Adults 5531 Angry, Sadness Neutral, Happy, Excited [14] EMO-DB German Adults 494 Anger, Sadness, Fear, Disgust, Boredom Neutral, Happiness [15] English Adults 4 Anger, Sadness, Fear, Disgust Neutral, Happiness, Surprise [16] Italian Adults 588 Anger, Sadness, Fear, Disgust Neutral, Joy, Surprise [17] A. Baseline Comparison In order to obtain the baseline comparison results, we compare the performance of with a popular approach of using sparse autoencoder (AE) with SVM [11]. For baseline experiments 75% of randomly selected data is used for training and remaining 25% is used for testing. Figure 1 shows the comparison results, where outperforms sparse AE for all databases FAU-AIBO IEMOCAP EMO-DB Fig. 1: Comparison of baseline accuracy using and sparse AE on different databases. B. Language Tests In this experiment, we use one language dataset for training and use the rest of the language datasets for testing. For brevity, we just use FAU-AIBO and IEMOCAP datasets for training. In order to evaluate the model on IEMOCAP, we used two sessions out of five with two fold cross validation because overall data is large. The other databases are small comparative to IEMOCAP, therefore, we used them completely. Figure 2 shows the achieved recognition rate in these experiments and its comparison with previous technique using sparse autoencoder and SVM for cross-corpus transfer learning. When IEMOCAP database is used for training the, we performed pair wise testing by using OHM and MONT separately for FAU-AIBO. It can be noted from Figure 2 that outperforms sparse AE for all scenarios. Beyond this we do not present the accuracy of sparse AE anymore, as we observe that s consistently outperform sparse AE. C. Multi-language Training In this experiment, we use multiple languages jointly for training to observe if that improves the performance of using languages individually for training. We use both FAU-AIBO and IEMOCAP for training and remaining for testing. We also evaluate the model within the corpora. For IEMOCAP, we used three sessions (plus FAU-AIBO) for training and testing is performed using remaining two sessions with two-fold cross validation. Similarly, for FAU-AIBO, a similar two fold crossvalidation is used, i.e., training on OHM (plus IEMOCAP) and evaluating on MONT and the inverse. Further, we also performed training in the leave-one-dataout scheme. For FAU-AIBO, we have performed evaluation by using OHM and MONT independently and take the average results. In case of IEMOCAP, we used two sessions (with two fold cross validation) to evaluate the model. It performs better than baseline and two-language training as shown in Figure 3. D. Percentage of Target Data In this experiment, we use the percentage (% to %) of target dataset for the training of the model. The training was performed using IEMOCAP and FAU-AIBO separately and, EMO-DB and were used for testing. The results have been shown in Figure 4. The straight lines in the figure show the basline recognition rate of respective corpus. These results show that the recognition rate significantly improves (than baseline) by including target domain data with the training data. V. DISCUSSIONS From the experiments, Leave-One-Out seems to be standing out in-terms of obtaining the highest accuracy. This essentially means that training the model using a large range of languages would help learn many intrinsic features from each languages, which can essentially help to achieve high accuracy in an unknown language - even higher than when the same language is used for training and testing (baseline). The performance of the Leave-one-out (see Figure 3) on database is a prime example of this. Both German and English language have two datasets each, i.e., in leave one out scheme there will at least one of these language in the training set. But for there will be a situation that emotions in the Italian language are predicted simply based on emotions in German and English language. Although this is an useful finding, it warrants further investigation to pinpoint the underlying reasons for this improved performance. Another interesting aspect we learned from the experiments that using fraction of the target data into training can help improve the performance and help achieve better results than baseline. Based on our experiments around % of data from the target database can help achieve better than the baseline accuracy. However, this is worse while using FAU-AIBO for training. Interestingly, IEMOCAP performs well on EMO-DB that is in the German language as compared to FAU-AIBO that is also in German. This warrants further investigation if

4 Accuracy (%) Accuracy (%) EMO-DB (Italian) FAU-AIBO EMO-DB (Itaian) IEMOCAP (a) Recognition rate using IEMOCAP for training and other databases for testing. Fig. 2: Comparison of language tests using and sparse AE. (b) Recognition rate using FAU-AIBO for training and other databases for testing. 9 FAU-AIBO IEMOCAP EMODB Baseline FAU+IEMOCAP Leave One Out Fig. 3: Comparison of baseline results and transfer learning using FAU-AIBO+IEMOCAP and leave-one-language-out scheme. (Italian) this is due to age difference as FAU-AIBO consists of children speech whereas EMO-DB database contains adult speech. Even more interestingly, the language test results in Figure 2 show that performance of IEMOCAP and FAU- AIBO on both and EMO-DB are almost the same. This raise the question if the age factor as discussed before be only applicable while using a fraction of data from the target domain. Finally, based on our experimental results, deep Learning model selection is also important to achieve high accuracy. We observe from Figure 1 and Figure 3 that networks with generalisation power like Deep Belief Networks are more preferable than conventional discriminitive networks like sparse auto encoders. More experiments need to be conducted to genaralise this findings. VI. CONCLUSION We conclude that cross-corpus and cross-language speech emotion recognition is definitely a very useful transfer learning technique. Information from multiple languages or even different datasets in the same language can be leveraged to achieve high accuracy in even an unknown language. For practical applications, this would be very helpful to build a robust speech emotion recognition system using data from multiple languages. Also, this would be equally useful for emotion recognition in languages with very limited or no datasets. REFERENCES [1] A. Batliner, B. Schuller, D. Seppi, S. Steidl, L. Devillers, L. Vidrascu, T. Vogt, V. Aharonson, and N. Amir, The automatic recognition of emotions in speech, in Emotion-Oriented Systems. Springer, 11, pp [2] B. Schuller, B. Vlasenko, F. Eyben, M. Wollmer, A. Stuhlsatz, A. Wendemuth, and G. Rigoll, Cross-corpus acoustic emotion recognition: Variances and strategies, IEEE Transactions on Affective Computing, vol. 1, no. 2, pp ,. [3] S. J. Pan and Q. Yang, A survey on transfer learning, IEEE Transactions on knowledge and data engineering, vol. 22, no., pp ,. [4] J. Lu, V. Behbood, P. Hao, H. Zuo, S. Xue, and G. Zhang, Transfer learning using computational intelligence: a survey, Knowledge-Based Systems, vol., pp , 15. [5] Y. Sawada and K. Kozuka, Transfer learning method using multiprediction deep boltzmann machines for a small scale dataset, in Machine Vision Applications (MVA), 15 14th IAPR International Conference on. IEEE, 15, pp [6] H. Lim, M. J. Kim, and H. Kim, Cross-acoustic transfer learning for sound event classification, in Acoustics, Speech and Signal Processing (ICASSP), 16 IEEE International Conference on. IEEE, 16, pp [7] F. Richardson, D. Reynolds, and N. Dehak, Deep neural network approaches to speaker and language recognition, IEEE Signal Processing Letters, vol. 22, no., pp , 15. [8] F. Eyben, A. Batliner, B. Schuller, D. Seppi, and S. Steidl, Crosscorpus classification of realistic emotions-some pilot experiments, in Proc. LREC workshop on Emotion Corpora, Valettea, Malta,, pp [9] Z. Xiao, D. Wu, X. Zhang, and Z. Tao, Speech emotion recognition cross language families: Mandarin vs. western languages, in Progress in Informatics and Computing (PIC), 16 International Conference on. IEEE, 16, pp [] E. M. Albornoz and D. H. Milone, Emotion recognition in never-seen languages using a novel ensemble method with emotion profiles, IEEE Transactions on Affective Computing, vol. 8, no. 1, pp , 17. [11] J. Deng, Z. Zhang, E. Marchi, and B. Schuller, Sparse autoencoderbased feature transfer learning for speech emotion recognition, in Affective Computing and Intelligent Interaction (ACII), 13 Humaine Association Conference on. IEEE, 13, pp [12] J. Gideon, S. Khorram, Z. Aldeneh, D. Dimitriadis, and E. M. Provost, Progressive neural networks for transfer learning in emotion recognition, arxiv preprint arxiv: , 17. [13] B. Schuller, S. Steidl, and A. Batliner, The interspeech 9 emotion challenge, in Tenth Annual Conference of the International Speech Communication Association, 9. [14] C. Busso, M. Bulut, C.-C. Lee, A. Kazemzadeh, E. Mower, S. Kim, J. N. Chang, S. Lee, and S. S. Narayanan, Iemocap: Interactive emotional dyadic motion capture database, Language resources and evaluation, vol. 42, no. 4, p. 335, 8.

5 % Accuracy % % % % % % % % % of target date with training data EMODB (a) Training using IEMOCAP. Fig. 4: Impact of using a percentage of target date with training data. % Accuracy % % % % % % % % EMODB (b) Training using FAU-AIBO. [15] F. Burkhardt, A. Paeschke, M. Rolfes, W. F. Sendlmeier, and B. Weiss, A database of german emotional speech. in Interspeech, vol. 5, 5, pp [16] P. Jackson and S. Haq, Surrey audio-visual expressed emotion(savee) database, University of Surrey: Guildford, UK, 14. [17] G. Costantini, I. Iaderola, A. Paoloni, and M. Todisco, Emovo corpus: an italian emotional speech database. in LREC, 14, pp [18] H. Sagha, J. Deng, M. Gavryukova, J. Han, and B. Schuller, Cross lingual speech emotion recognition using canonical correlation analysis on principal component subspace, in Acoustics, Speech and Signal Processing (ICASSP), 16 IEEE International Conference on. IEEE, 16, pp [19] F. Eyben, K. R. Scherer, B. W. Schuller, J. Sundberg, E. André, C. Busso, L. Y. Devillers, J. Epps, P. Laukka, S. S. Narayanan et al., The geneva minimalistic acoustic parameter set (gemaps) for voice research and affective computing, IEEE Transactions on Affective Computing, vol. 7, no. 2, pp. 19 2, 16. [] C. Huang, W. Gong, W. Fu, and D. Feng, A research of speech emotion recognition based on deep belief network and svm, Mathematical Problems in Engineering, vol. 14, 14. [21] R. Xia and Y. Liu, A multi-task learning framework for emotion recognition using 2d continuous space, IEEE Transactions on Affective Computing, vol. 8, no. 1, pp. 3 14, 17. [22] G. E. Hinton and R. R. Salakhutdinov, Reducing the dimensionality of data with neural networks, science, vol. 313, no. 5786, pp. 4 7, 6. [23] L. Deng, M. L. Seltzer, D. Yu, A. Acero, A.-r. Mohamed, and G. Hinton, Binary coding of speech spectrograms using a deep auto-encoder, in Eleventh Annual Conference of the International Speech Communication Association,. [24] R. Rana, Emotion classification from noisy speech-a deep learning approach, arxiv preprint arxiv:13.591, 16. [25] M. A. Keyvanrad and M. M. Homayounpour, A brief survey on deep belief networks and introducing a new object oriented toolbox (deebnet), arxiv preprint arxiv: , 14.

Speech Emotion Recognition Using Support Vector Machine

Speech Emotion Recognition Using Support Vector Machine Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,

More information

A study of speaker adaptation for DNN-based speech synthesis

A study of speaker adaptation for DNN-based speech synthesis A study of speaker adaptation for DNN-based speech synthesis Zhizheng Wu, Pawel Swietojanski, Christophe Veaux, Steve Renals, Simon King The Centre for Speech Technology Research (CSTR) University of Edinburgh,

More information

Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction

Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction INTERSPEECH 2015 Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction Akihiro Abe, Kazumasa Yamamoto, Seiichi Nakagawa Department of Computer

More information

Human Emotion Recognition From Speech

Human Emotion Recognition From Speech RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati

More information

Analysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier

Analysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 10, Issue 2, Ver.1 (Mar - Apr.2015), PP 55-61 www.iosrjournals.org Analysis of Emotion

More information

Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration

Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration INTERSPEECH 2013 Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration Yan Huang, Dong Yu, Yifan Gong, and Chaojun Liu Microsoft Corporation, One

More information

PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES

PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES Po-Sen Huang, Kshitiz Kumar, Chaojun Liu, Yifan Gong, Li Deng Department of Electrical and Computer Engineering,

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models

Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Navdeep Jaitly 1, Vincent Vanhoucke 2, Geoffrey Hinton 1,2 1 University of Toronto 2 Google Inc. ndjaitly@cs.toronto.edu,

More information

Modeling function word errors in DNN-HMM based LVCSR systems

Modeling function word errors in DNN-HMM based LVCSR systems Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford

More information

Affective Classification of Generic Audio Clips using Regression Models

Affective Classification of Generic Audio Clips using Regression Models Affective Classification of Generic Audio Clips using Regression Models Nikolaos Malandrakis 1, Shiva Sundaram, Alexandros Potamianos 3 1 Signal Analysis and Interpretation Laboratory (SAIL), USC, Los

More information

A new Dataset of Telephone-Based Human-Human Call-Center Interaction with Emotional Evaluation

A new Dataset of Telephone-Based Human-Human Call-Center Interaction with Emotional Evaluation A new Dataset of Telephone-Based Human-Human Call-Center Interaction with Emotional Evaluation Ingo Siegert 1, Kerstin Ohnemus 2 1 Cognitive Systems Group, Institute for Information Technology and Communications

More information

Python Machine Learning

Python Machine Learning Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled

More information

Calibration of Confidence Measures in Speech Recognition

Calibration of Confidence Measures in Speech Recognition Submitted to IEEE Trans on Audio, Speech, and Language, July 2010 1 Calibration of Confidence Measures in Speech Recognition Dong Yu, Senior Member, IEEE, Jinyu Li, Member, IEEE, Li Deng, Fellow, IEEE

More information

Whodunnit Searching for the Most Important Feature Types Signalling Emotion-Related User States in Speech

Whodunnit Searching for the Most Important Feature Types Signalling Emotion-Related User States in Speech Whodunnit Searching for the Most Important Feature Types Signalling Emotion-Related User States in Speech Anton Batliner a Stefan Steidl a Björn Schuller b Dino Seppi c Thurid Vogt d Johannes Wagner d

More information

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks

System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks System Implementation for SemEval-2017 Task 4 Subtask A Based on Interpolated Deep Neural Networks 1 Tzu-Hsuan Yang, 2 Tzu-Hsuan Tseng, and 3 Chia-Ping Chen Department of Computer Science and Engineering

More information

Distributed Learning of Multilingual DNN Feature Extractors using GPUs

Distributed Learning of Multilingual DNN Feature Extractors using GPUs Distributed Learning of Multilingual DNN Feature Extractors using GPUs Yajie Miao, Hao Zhang, Florian Metze Language Technologies Institute, School of Computer Science, Carnegie Mellon University Pittsburgh,

More information

Word Segmentation of Off-line Handwritten Documents

Word Segmentation of Off-line Handwritten Documents Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department

More information

TRANSFER LEARNING OF WEAKLY LABELLED AUDIO. Aleksandr Diment, Tuomas Virtanen

TRANSFER LEARNING OF WEAKLY LABELLED AUDIO. Aleksandr Diment, Tuomas Virtanen TRANSFER LEARNING OF WEAKLY LABELLED AUDIO Aleksandr Diment, Tuomas Virtanen Tampere University of Technology Laboratory of Signal Processing Korkeakoulunkatu 1, 33720, Tampere, Finland firstname.lastname@tut.fi

More information

ADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION

ADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION ADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION Mitchell McLaren 1, Yun Lei 1, Luciana Ferrer 2 1 Speech Technology and Research Laboratory, SRI International, California, USA 2 Departamento

More information

A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation

A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation SLSP-2016 October 11-12 Natalia Tomashenko 1,2,3 natalia.tomashenko@univ-lemans.fr Yuri Khokhlov 3 khokhlov@speechpro.com Yannick

More information

A Review: Speech Recognition with Deep Learning Methods

A Review: Speech Recognition with Deep Learning Methods Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 4, Issue. 5, May 2015, pg.1017

More information

International Journal of Computational Intelligence and Informatics, Vol. 1 : No. 4, January - March 2012

International Journal of Computational Intelligence and Informatics, Vol. 1 : No. 4, January - March 2012 Text-independent Mono and Cross-lingual Speaker Identification with the Constraint of Limited Data Nagaraja B G and H S Jayanna Department of Information Science and Engineering Siddaganga Institute of

More information

Learning Methods in Multilingual Speech Recognition

Learning Methods in Multilingual Speech Recognition Learning Methods in Multilingual Speech Recognition Hui Lin Department of Electrical Engineering University of Washington Seattle, WA 98125 linhui@u.washington.edu Li Deng, Jasha Droppo, Dong Yu, and Alex

More information

Unvoiced Landmark Detection for Segment-based Mandarin Continuous Speech Recognition

Unvoiced Landmark Detection for Segment-based Mandarin Continuous Speech Recognition Unvoiced Landmark Detection for Segment-based Mandarin Continuous Speech Recognition Hua Zhang, Yun Tang, Wenju Liu and Bo Xu National Laboratory of Pattern Recognition Institute of Automation, Chinese

More information

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model

Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Unsupervised Learning of Word Semantic Embedding using the Deep Structured Semantic Model Xinying Song, Xiaodong He, Jianfeng Gao, Li Deng Microsoft Research, One Microsoft Way, Redmond, WA 98052, U.S.A.

More information

WHEN THERE IS A mismatch between the acoustic

WHEN THERE IS A mismatch between the acoustic 808 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 14, NO. 3, MAY 2006 Optimization of Temporal Filters for Constructing Robust Features in Speech Recognition Jeih-Weih Hung, Member,

More information

Speech Synthesis in Noisy Environment by Enhancing Strength of Excitation and Formant Prominence

Speech Synthesis in Noisy Environment by Enhancing Strength of Excitation and Formant Prominence INTERSPEECH September,, San Francisco, USA Speech Synthesis in Noisy Environment by Enhancing Strength of Excitation and Formant Prominence Bidisha Sharma and S. R. Mahadeva Prasanna Department of Electronics

More information

Assignment 1: Predicting Amazon Review Ratings

Assignment 1: Predicting Amazon Review Ratings Assignment 1: Predicting Amazon Review Ratings 1 Dataset Analysis Richard Park r2park@acsmail.ucsd.edu February 23, 2015 The dataset selected for this assignment comes from the set of Amazon reviews for

More information

Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification

Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification Tomi Kinnunen and Ismo Kärkkäinen University of Joensuu, Department of Computer Science, P.O. Box 111, 80101 JOENSUU,

More information

BUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING

BUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING BUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING Gábor Gosztolya 1, Tamás Grósz 1, László Tóth 1, David Imseng 2 1 MTA-SZTE Research Group on Artificial

More information

INVESTIGATION OF UNSUPERVISED ADAPTATION OF DNN ACOUSTIC MODELS WITH FILTER BANK INPUT

INVESTIGATION OF UNSUPERVISED ADAPTATION OF DNN ACOUSTIC MODELS WITH FILTER BANK INPUT INVESTIGATION OF UNSUPERVISED ADAPTATION OF DNN ACOUSTIC MODELS WITH FILTER BANK INPUT Takuya Yoshioka,, Anton Ragni, Mark J. F. Gales Cambridge University Engineering Department, Cambridge, UK NTT Communication

More information

On the Formation of Phoneme Categories in DNN Acoustic Models

On the Formation of Phoneme Categories in DNN Acoustic Models On the Formation of Phoneme Categories in DNN Acoustic Models Tasha Nagamine Department of Electrical Engineering, Columbia University T. Nagamine Motivation Large performance gap between humans and state-

More information

DOMAIN MISMATCH COMPENSATION FOR SPEAKER RECOGNITION USING A LIBRARY OF WHITENERS. Elliot Singer and Douglas Reynolds

DOMAIN MISMATCH COMPENSATION FOR SPEAKER RECOGNITION USING A LIBRARY OF WHITENERS. Elliot Singer and Douglas Reynolds DOMAIN MISMATCH COMPENSATION FOR SPEAKER RECOGNITION USING A LIBRARY OF WHITENERS Elliot Singer and Douglas Reynolds Massachusetts Institute of Technology Lincoln Laboratory {es,dar}@ll.mit.edu ABSTRACT

More information

A NOVEL SCHEME FOR SPEAKER RECOGNITION USING A PHONETICALLY-AWARE DEEP NEURAL NETWORK. Yun Lei Nicolas Scheffer Luciana Ferrer Mitchell McLaren

A NOVEL SCHEME FOR SPEAKER RECOGNITION USING A PHONETICALLY-AWARE DEEP NEURAL NETWORK. Yun Lei Nicolas Scheffer Luciana Ferrer Mitchell McLaren A NOVEL SCHEME FOR SPEAKER RECOGNITION USING A PHONETICALLY-AWARE DEEP NEURAL NETWORK Yun Lei Nicolas Scheffer Luciana Ferrer Mitchell McLaren Speech Technology and Research Laboratory, SRI International,

More information

arxiv: v1 [cs.lg] 15 Jun 2015

arxiv: v1 [cs.lg] 15 Jun 2015 Dual Memory Architectures for Fast Deep Learning of Stream Data via an Online-Incremental-Transfer Strategy arxiv:1506.04477v1 [cs.lg] 15 Jun 2015 Sang-Woo Lee Min-Oh Heo School of Computer Science and

More information

Deep Neural Network Language Models

Deep Neural Network Language Models Deep Neural Network Language Models Ebru Arısoy, Tara N. Sainath, Brian Kingsbury, Bhuvana Ramabhadran IBM T.J. Watson Research Center Yorktown Heights, NY, 10598, USA {earisoy, tsainath, bedk, bhuvana}@us.ibm.com

More information

Product Feature-based Ratings foropinionsummarization of E-Commerce Feedback Comments

Product Feature-based Ratings foropinionsummarization of E-Commerce Feedback Comments Product Feature-based Ratings foropinionsummarization of E-Commerce Feedback Comments Vijayshri Ramkrishna Ingale PG Student, Department of Computer Engineering JSPM s Imperial College of Engineering &

More information

Mandarin Lexical Tone Recognition: The Gating Paradigm

Mandarin Lexical Tone Recognition: The Gating Paradigm Kansas Working Papers in Linguistics, Vol. 0 (008), p. 8 Abstract Mandarin Lexical Tone Recognition: The Gating Paradigm Yuwen Lai and Jie Zhang University of Kansas Research on spoken word recognition

More information

DNN ACOUSTIC MODELING WITH MODULAR MULTI-LINGUAL FEATURE EXTRACTION NETWORKS

DNN ACOUSTIC MODELING WITH MODULAR MULTI-LINGUAL FEATURE EXTRACTION NETWORKS DNN ACOUSTIC MODELING WITH MODULAR MULTI-LINGUAL FEATURE EXTRACTION NETWORKS Jonas Gehring 1 Quoc Bao Nguyen 1 Florian Metze 2 Alex Waibel 1,2 1 Interactive Systems Lab, Karlsruhe Institute of Technology;

More information

Rule Learning With Negation: Issues Regarding Effectiveness

Rule Learning With Negation: Issues Regarding Effectiveness Rule Learning With Negation: Issues Regarding Effectiveness S. Chua, F. Coenen, G. Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX Liverpool, United

More information

SUPRA-SEGMENTAL FEATURE BASED SPEAKER TRAIT DETECTION

SUPRA-SEGMENTAL FEATURE BASED SPEAKER TRAIT DETECTION Odyssey 2014: The Speaker and Language Recognition Workshop 16-19 June 2014, Joensuu, Finland SUPRA-SEGMENTAL FEATURE BASED SPEAKER TRAIT DETECTION Gang Liu, John H.L. Hansen* Center for Robust Speech

More information

Speech Recognition at ICSI: Broadcast News and beyond

Speech Recognition at ICSI: Broadcast News and beyond Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI

More information

Segmental Conditional Random Fields with Deep Neural Networks as Acoustic Models for First-Pass Word Recognition

Segmental Conditional Random Fields with Deep Neural Networks as Acoustic Models for First-Pass Word Recognition Segmental Conditional Random Fields with Deep Neural Networks as Acoustic Models for First-Pass Word Recognition Yanzhang He, Eric Fosler-Lussier Department of Computer Science and Engineering The hio

More information

Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models

Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models Learning Structural Correspondences Across Different Linguistic Domains with Synchronous Neural Language Models Stephan Gouws and GJ van Rooyen MIH Medialab, Stellenbosch University SOUTH AFRICA {stephan,gvrooyen}@ml.sun.ac.za

More information

Improvements to the Pruning Behavior of DNN Acoustic Models

Improvements to the Pruning Behavior of DNN Acoustic Models Improvements to the Pruning Behavior of DNN Acoustic Models Matthias Paulik Apple Inc., Infinite Loop, Cupertino, CA 954 mpaulik@apple.com Abstract This paper examines two strategies that positively influence

More information

Speech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines

Speech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines Speech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines Amit Juneja and Carol Espy-Wilson Department of Electrical and Computer Engineering University of Maryland,

More information

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System

QuickStroke: An Incremental On-line Chinese Handwriting Recognition System QuickStroke: An Incremental On-line Chinese Handwriting Recognition System Nada P. Matić John C. Platt Λ Tony Wang y Synaptics, Inc. 2381 Bering Drive San Jose, CA 95131, USA Abstract This paper presents

More information

Exploration. CS : Deep Reinforcement Learning Sergey Levine

Exploration. CS : Deep Reinforcement Learning Sergey Levine Exploration CS 294-112: Deep Reinforcement Learning Sergey Levine Class Notes 1. Homework 4 due on Wednesday 2. Project proposal feedback sent Today s Lecture 1. What is exploration? Why is it a problem?

More information

Twitter Sentiment Classification on Sanders Data using Hybrid Approach

Twitter Sentiment Classification on Sanders Data using Hybrid Approach IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 17, Issue 4, Ver. I (July Aug. 2015), PP 118-123 www.iosrjournals.org Twitter Sentiment Classification on Sanders

More information

A Web Based Annotation Interface Based of Wheel of Emotions. Author: Philip Marsh. Project Supervisor: Irena Spasic. Project Moderator: Matthew Morgan

A Web Based Annotation Interface Based of Wheel of Emotions. Author: Philip Marsh. Project Supervisor: Irena Spasic. Project Moderator: Matthew Morgan A Web Based Annotation Interface Based of Wheel of Emotions Author: Philip Marsh Project Supervisor: Irena Spasic Project Moderator: Matthew Morgan Module Number: CM3203 Module Title: One Semester Individual

More information

A Deep Bag-of-Features Model for Music Auto-Tagging

A Deep Bag-of-Features Model for Music Auto-Tagging 1 A Deep Bag-of-Features Model for Music Auto-Tagging Juhan Nam, Member, IEEE, Jorge Herrera, and Kyogu Lee, Senior Member, IEEE latter is often referred to as music annotation and retrieval, or simply

More information

arxiv: v2 [cs.cv] 30 Mar 2017

arxiv: v2 [cs.cv] 30 Mar 2017 Domain Adaptation for Visual Applications: A Comprehensive Survey Gabriela Csurka arxiv:1702.05374v2 [cs.cv] 30 Mar 2017 Abstract The aim of this paper 1 is to give an overview of domain adaptation and

More information

Learning From the Past with Experiment Databases

Learning From the Past with Experiment Databases Learning From the Past with Experiment Databases Joaquin Vanschoren 1, Bernhard Pfahringer 2, and Geoff Holmes 2 1 Computer Science Dept., K.U.Leuven, Leuven, Belgium 2 Computer Science Dept., University

More information

Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks

Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Predicting Student Attrition in MOOCs using Sentiment Analysis and Neural Networks Devendra Singh Chaplot, Eunhee Rhim, and Jihie Kim Samsung Electronics Co., Ltd. Seoul, South Korea {dev.chaplot,eunhee.rhim,jihie.kim}@samsung.com

More information

AUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION

AUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 11/2007, ISSN 1642-6037 Marek WIŚNIEWSKI *, Wiesława KUNISZYK-JÓŹKOWIAK *, Elżbieta SMOŁKA *, Waldemar SUSZYŃSKI * HMM, recognition, speech, disorders

More information

Lecture 1: Machine Learning Basics

Lecture 1: Machine Learning Basics 1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3

More information

DIRECT ADAPTATION OF HYBRID DNN/HMM MODEL FOR FAST SPEAKER ADAPTATION IN LVCSR BASED ON SPEAKER CODE

DIRECT ADAPTATION OF HYBRID DNN/HMM MODEL FOR FAST SPEAKER ADAPTATION IN LVCSR BASED ON SPEAKER CODE 2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) DIRECT ADAPTATION OF HYBRID DNN/HMM MODEL FOR FAST SPEAKER ADAPTATION IN LVCSR BASED ON SPEAKER CODE Shaofei Xue 1

More information

Speech Translation for Triage of Emergency Phonecalls in Minority Languages

Speech Translation for Triage of Emergency Phonecalls in Minority Languages Speech Translation for Triage of Emergency Phonecalls in Minority Languages Udhyakumar Nallasamy, Alan W Black, Tanja Schultz, Robert Frederking Language Technologies Institute Carnegie Mellon University

More information

SEMI-SUPERVISED ENSEMBLE DNN ACOUSTIC MODEL TRAINING

SEMI-SUPERVISED ENSEMBLE DNN ACOUSTIC MODEL TRAINING SEMI-SUPERVISED ENSEMBLE DNN ACOUSTIC MODEL TRAINING Sheng Li 1, Xugang Lu 2, Shinsuke Sakai 1, Masato Mimura 1 and Tatsuya Kawahara 1 1 School of Informatics, Kyoto University, Sakyo-ku, Kyoto 606-8501,

More information

THE world surrounding us involves multiple modalities

THE world surrounding us involves multiple modalities 1 Multimodal Machine Learning: A Survey and Taxonomy Tadas Baltrušaitis, Chaitanya Ahuja, and Louis-Philippe Morency arxiv:1705.09406v2 [cs.lg] 1 Aug 2017 Abstract Our experience of the world is multimodal

More information

Semi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17.

Semi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17. Semi-supervised methods of text processing, and an application to medical concept extraction Yacine Jernite Text-as-Data series September 17. 2015 What do we want from text? 1. Extract information 2. Link

More information

arxiv: v1 [cs.lg] 7 Apr 2015

arxiv: v1 [cs.lg] 7 Apr 2015 Transferring Knowledge from a RNN to a DNN William Chan 1, Nan Rosemary Ke 1, Ian Lane 1,2 Carnegie Mellon University 1 Electrical and Computer Engineering, 2 Language Technologies Institute Equal contribution

More information

Softprop: Softmax Neural Network Backpropagation Learning

Softprop: Softmax Neural Network Backpropagation Learning Softprop: Softmax Neural Networ Bacpropagation Learning Michael Rimer Computer Science Department Brigham Young University Provo, UT 84602, USA E-mail: mrimer@axon.cs.byu.edu Tony Martinez Computer Science

More information

Rule Learning with Negation: Issues Regarding Effectiveness

Rule Learning with Negation: Issues Regarding Effectiveness Rule Learning with Negation: Issues Regarding Effectiveness Stephanie Chua, Frans Coenen, and Grant Malcolm University of Liverpool Department of Computer Science, Ashton Building, Ashton Street, L69 3BX

More information

arxiv: v1 [cs.cl] 2 Apr 2017

arxiv: v1 [cs.cl] 2 Apr 2017 Word-Alignment-Based Segment-Level Machine Translation Evaluation using Word Embeddings Junki Matsuo and Mamoru Komachi Graduate School of System Design, Tokyo Metropolitan University, Japan matsuo-junki@ed.tmu.ac.jp,

More information

A Case Study: News Classification Based on Term Frequency

A Case Study: News Classification Based on Term Frequency A Case Study: News Classification Based on Term Frequency Petr Kroha Faculty of Computer Science University of Technology 09107 Chemnitz Germany kroha@informatik.tu-chemnitz.de Ricardo Baeza-Yates Center

More information

POS tagging of Chinese Buddhist texts using Recurrent Neural Networks

POS tagging of Chinese Buddhist texts using Recurrent Neural Networks POS tagging of Chinese Buddhist texts using Recurrent Neural Networks Longlu Qin Department of East Asian Languages and Cultures longlu@stanford.edu Abstract Chinese POS tagging, as one of the most important

More information

Australian Journal of Basic and Applied Sciences

Australian Journal of Basic and Applied Sciences AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean

More information

Attributed Social Network Embedding

Attributed Social Network Embedding JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, MAY 2017 1 Attributed Social Network Embedding arxiv:1705.04969v1 [cs.si] 14 May 2017 Lizi Liao, Xiangnan He, Hanwang Zhang, and Tat-Seng Chua Abstract Embedding

More information

HIERARCHICAL DEEP LEARNING ARCHITECTURE FOR 10K OBJECTS CLASSIFICATION

HIERARCHICAL DEEP LEARNING ARCHITECTURE FOR 10K OBJECTS CLASSIFICATION HIERARCHICAL DEEP LEARNING ARCHITECTURE FOR 10K OBJECTS CLASSIFICATION Atul Laxman Katole 1, Krishna Prasad Yellapragada 1, Amish Kumar Bedi 1, Sehaj Singh Kalra 1 and Mynepalli Siva Chaitanya 1 1 Samsung

More information

THE enormous growth of unstructured data, including

THE enormous growth of unstructured data, including INTL JOURNAL OF ELECTRONICS AND TELECOMMUNICATIONS, 2014, VOL. 60, NO. 4, PP. 321 326 Manuscript received September 1, 2014; revised December 2014. DOI: 10.2478/eletel-2014-0042 Deep Image Features in

More information

Phonetic- and Speaker-Discriminant Features for Speaker Recognition. Research Project

Phonetic- and Speaker-Discriminant Features for Speaker Recognition. Research Project Phonetic- and Speaker-Discriminant Features for Speaker Recognition by Lara Stoll Research Project Submitted to the Department of Electrical Engineering and Computer Sciences, University of California

More information

Model Ensemble for Click Prediction in Bing Search Ads

Model Ensemble for Click Prediction in Bing Search Ads Model Ensemble for Click Prediction in Bing Search Ads Xiaoliang Ling Microsoft Bing xiaoling@microsoft.com Hucheng Zhou Microsoft Research huzho@microsoft.com Weiwei Deng Microsoft Bing dedeng@microsoft.com

More information

Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski

Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Training a Neural Network to Answer 8th Grade Science Questions Steven Hewitt, An Ju, Katherine Stasaski Problem Statement and Background Given a collection of 8th grade science questions, possible answer

More information

Learning to Schedule Straight-Line Code

Learning to Schedule Straight-Line Code Learning to Schedule Straight-Line Code Eliot Moss, Paul Utgoff, John Cavazos Doina Precup, Darko Stefanović Dept. of Comp. Sci., Univ. of Mass. Amherst, MA 01003 Carla Brodley, David Scheeff Sch. of Elec.

More information

arxiv: v1 [cs.lg] 3 May 2013

arxiv: v1 [cs.lg] 3 May 2013 Feature Selection Based on Term Frequency and T-Test for Text Categorization Deqing Wang dqwang@nlsde.buaa.edu.cn Hui Zhang hzhang@nlsde.buaa.edu.cn Rui Liu, Weifeng Lv {liurui,lwf}@nlsde.buaa.edu.cn arxiv:1305.0638v1

More information

A Case-Based Approach To Imitation Learning in Robotic Agents

A Case-Based Approach To Imitation Learning in Robotic Agents A Case-Based Approach To Imitation Learning in Robotic Agents Tesca Fitzgerald, Ashok Goel School of Interactive Computing Georgia Institute of Technology, Atlanta, GA 30332, USA {tesca.fitzgerald,goel}@cc.gatech.edu

More information

Learning Methods for Fuzzy Systems

Learning Methods for Fuzzy Systems Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8

More information

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should

More information

LOW-RANK AND SPARSE SOFT TARGETS TO LEARN BETTER DNN ACOUSTIC MODELS

LOW-RANK AND SPARSE SOFT TARGETS TO LEARN BETTER DNN ACOUSTIC MODELS LOW-RANK AND SPARSE SOFT TARGETS TO LEARN BETTER DNN ACOUSTIC MODELS Pranay Dighe Afsaneh Asaei Hervé Bourlard Idiap Research Institute, Martigny, Switzerland École Polytechnique Fédérale de Lausanne (EPFL),

More information

Cultivating DNN Diversity for Large Scale Video Labelling

Cultivating DNN Diversity for Large Scale Video Labelling Cultivating DNN Diversity for Large Scale Video Labelling Mikel Bober-Irizar mikel@mxbi.net Sameed Husain sameed.husain@surrey.ac.uk Miroslaw Bober m.bober@surrey.ac.uk Eng-Jon Ong e.ong@surrey.ac.uk Abstract

More information

IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH

IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH 2009 423 Adaptive Multimodal Fusion by Uncertainty Compensation With Application to Audiovisual Speech Recognition George

More information

OCR for Arabic using SIFT Descriptors With Online Failure Prediction

OCR for Arabic using SIFT Descriptors With Online Failure Prediction OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,

More information

Image based Static Facial Expression Recognition with Multiple Deep Network Learning

Image based Static Facial Expression Recognition with Multiple Deep Network Learning Image based Static Facial Expression Recognition with Multiple Deep Network Learning ABSTRACT Zhiding Yu Carnegie Mellon University 5000 Forbes Ave Pittsburgh, PA 1521 yzhiding@andrew.cmu.edu We report

More information

Deep Facial Action Unit Recognition from Partially Labeled Data

Deep Facial Action Unit Recognition from Partially Labeled Data Deep Facial Action Unit Recognition from Partially Labeled Data Shan Wu 1, Shangfei Wang,1, Bowen Pan 1, and Qiang Ji 2 1 University of Science and Technology of China, Hefei, Anhui, China 2 Rensselaer

More information

TRANSFER LEARNING IN MIR: SHARING LEARNED LATENT REPRESENTATIONS FOR MUSIC AUDIO CLASSIFICATION AND SIMILARITY

TRANSFER LEARNING IN MIR: SHARING LEARNED LATENT REPRESENTATIONS FOR MUSIC AUDIO CLASSIFICATION AND SIMILARITY TRANSFER LEARNING IN MIR: SHARING LEARNED LATENT REPRESENTATIONS FOR MUSIC AUDIO CLASSIFICATION AND SIMILARITY Philippe Hamel, Matthew E. P. Davies, Kazuyoshi Yoshii and Masataka Goto National Institute

More information

The NICT/ATR speech synthesis system for the Blizzard Challenge 2008

The NICT/ATR speech synthesis system for the Blizzard Challenge 2008 The NICT/ATR speech synthesis system for the Blizzard Challenge 2008 Ranniery Maia 1,2, Jinfu Ni 1,2, Shinsuke Sakai 1,2, Tomoki Toda 1,3, Keiichi Tokuda 1,4 Tohru Shimizu 1,2, Satoshi Nakamura 1,2 1 National

More information

Knowledge Transfer in Deep Convolutional Neural Nets

Knowledge Transfer in Deep Convolutional Neural Nets Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract

More information

Generative models and adversarial training

Generative models and adversarial training Day 4 Lecture 1 Generative models and adversarial training Kevin McGuinness kevin.mcguinness@dcu.ie Research Fellow Insight Centre for Data Analytics Dublin City University What is a generative model?

More information

The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X

The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, 2013 10.12753/2066-026X-13-154 DATA MINING SOLUTIONS FOR DETERMINING STUDENT'S PROFILE Adela BÂRA,

More information

Vowel mispronunciation detection using DNN acoustic models with cross-lingual training

Vowel mispronunciation detection using DNN acoustic models with cross-lingual training INTERSPEECH 2015 Vowel mispronunciation detection using DNN acoustic models with cross-lingual training Shrikant Joshi, Nachiket Deo, Preeti Rao Department of Electrical Engineering, Indian Institute of

More information

Using dialogue context to improve parsing performance in dialogue systems

Using dialogue context to improve parsing performance in dialogue systems Using dialogue context to improve parsing performance in dialogue systems Ivan Meza-Ruiz and Oliver Lemon School of Informatics, Edinburgh University 2 Buccleuch Place, Edinburgh I.V.Meza-Ruiz@sms.ed.ac.uk,

More information

Proceedings of Meetings on Acoustics

Proceedings of Meetings on Acoustics Proceedings of Meetings on Acoustics Volume 19, 2013 http://acousticalsociety.org/ ICA 2013 Montreal Montreal, Canada 2-7 June 2013 Speech Communication Session 2aSC: Linking Perception and Production

More information

Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape

Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape Lip reading: Japanese vowel recognition by tracking temporal changes of lip shape Koshi Odagiri 1, and Yoichi Muraoka 1 1 Graduate School of Fundamental/Computer Science and Engineering, Waseda University,

More information

UNIDIRECTIONAL LONG SHORT-TERM MEMORY RECURRENT NEURAL NETWORK WITH RECURRENT OUTPUT LAYER FOR LOW-LATENCY SPEECH SYNTHESIS. Heiga Zen, Haşim Sak

UNIDIRECTIONAL LONG SHORT-TERM MEMORY RECURRENT NEURAL NETWORK WITH RECURRENT OUTPUT LAYER FOR LOW-LATENCY SPEECH SYNTHESIS. Heiga Zen, Haşim Sak UNIDIRECTIONAL LONG SHORT-TERM MEMORY RECURRENT NEURAL NETWORK WITH RECURRENT OUTPUT LAYER FOR LOW-LATENCY SPEECH SYNTHESIS Heiga Zen, Haşim Sak Google fheigazen,hasimg@google.com ABSTRACT Long short-term

More information

Probabilistic Latent Semantic Analysis

Probabilistic Latent Semantic Analysis Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview

More information

Using EEG to Improve Massive Open Online Courses Feedback Interaction

Using EEG to Improve Massive Open Online Courses Feedback Interaction Using EEG to Improve Massive Open Online Courses Feedback Interaction Haohan Wang, Yiwei Li, Xiaobo Hu, Yucong Yang, Zhu Meng, Kai-min Chang Language Technologies Institute School of Computer Science Carnegie

More information

INPE São José dos Campos

INPE São José dos Campos INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA

More information

Comment-based Multi-View Clustering of Web 2.0 Items

Comment-based Multi-View Clustering of Web 2.0 Items Comment-based Multi-View Clustering of Web 2.0 Items Xiangnan He 1 Min-Yen Kan 1 Peichu Xie 2 Xiao Chen 3 1 School of Computing, National University of Singapore 2 Department of Mathematics, National University

More information