Celebrity Voices. Paulo Eduardo dos Santos Veloso Braga. Instituto Superior Técnico Av. Rovisco Pais, Lisboa, Portugal
|
|
- Tyrone Green
- 5 years ago
- Views:
Transcription
1 1 Celebrity Voices Paulo Eduardo dos Santos Veloso Braga Instituto Superior Técnico Av. Rovisco Pais, Lisboa, Portugal Abstract This paper described a text-independent speaker verification system applied to finding voices of well-known persons in broadcast news shows. Two different classifiers were trained and tested with test segments manually defined by annotators. In these conditions, the SVM-GSV classifier performed better than the GMM-UBM one, particularly for longer segments. The performance difference for short and long segments led us to create a GMM-UBM+SVM-GSV system which classifies a test segment using one of two classifiers, depending on the duration of the test segment. This system was used to identify target speakers in recent news shows, for which segments were automatically defined by an Audio Pre-Processing module. The performance of the GMM- UBM+SVM-GSV system was lower, which led to new successful experiments with further tuning. The results obtained are integrated into the existing media monitoring system and presented in a web page, where it is possible to view a video of each segment assigned to each speaker identified by the system. Keywords Speaker Recognition, Text-independent Verification, Celebrity Voices, Gaussian Mixture Models, Support Vector Machines, Supervector, News Shows I. INTRODUCTION With the increase of applications that take advantage of recent developments in telecommunications and Internet areas, there is also an increasing need to recognize someone by his/her physical characteristics as a way to uniquely identify a person. This interest spans different areas, such as access control systems [1], authentication for long distance calls or banking access [2], personalized answers by answering machines [3], automatic recognition of speakers in large numbers of recorded files [4], forensics [5], etc. The voice is one of the features that can be used to identify a human being since each person has unique characteristics. Depending on the application, speaker recognition is usually divided into two areas: identification and verification. The goal in speaker identification is to determine who among a group of known speakers matches the segment analyzed. This is also referred to as closed-set speaker identification. In the second area, speaker verification, the goal is to determine whether a segment belongs to a speaker or not. This is sometimes referred to as the open-set problem. Input Speech Audio Pre-Processing Feature Extraction Classification System Normalization Accept or Reject Fig. 1. Basic block diagram of a speaker verification system. A speaker recognition system may also be text-dependent or text-independent depending on the type of data used for training and testing the system. In a text-independent system, different speech materials can be used for training and testing. A text-dependent system, on the other hand, assumes that the speech materials used in the test are the same as the ones used during the enrollment or training phase (e.g. keywords, digits, predetermined sentences, etc.). Text-independent speaker verification is the basis of most speaker recognition applications, with the additional difficulty of not controlling what the speakers say. The goal of this work was to develop a text-independent speaker verification system applied to finding famous speakers in broadcast news shows. Figure 1 shows the block diagram of a generic speaker verification system. The first module tries to segment the
2 2 incoming signal into homogeneous segments, from the point of view of acoustic background conditions, and speakers. The second module extracts relevant features from the segments classified as speech. These features are used for training and testing classifiers typically based on statistical machine learning methods. The last modules perform score normalization and provide an accept/reject decision. Collecting a large corpus for training and testing the celebrity voices recognizer is of primary importance, and will be described in Chapter II. The next chapter covers the main abovementioned modules. Chapter IV describes the experimental results. The paper also includes a short summary of the web interface before concluding. TABLE II Training time of speakers identified by the system Speaker Training Time (s) Almeida Santos António Guterres Durão Barroso Ferreira do Amaral Freitas do Amaral Jaime Gama João Vale e Azevedo Jorge Coelho Jorge Sampaio José Mourinho II. CORPORA The corpus used in this work consists mainly of broadcast news shows collected from the Portuguese public television (RTP) [6, 7, 8]. It is divided into eight sets, one for training (Train), two for development (Devel and Pilot) and five for testing (Eval, Jeval, 11march, Rtp07 and Rtp08). Table I provides an overview of the different subsets, and corresponding purpose. TABLE I Corpus Sets Set Year News Shows Audio (h) Purpose Train Training Devel Development Pilot Development Eval Evaluate Jeval Evaluate 11march Evaluate Rtp Evaluate Rtp Evaluate José Saramago José Sócrates Mário Soares Paulo Portas Santana Lopes Xanana Gusmão A final test set of news shows was used to test the system in real conditions. This set was collected in the Spoken Language Systems Laboratory, INESC-ID, through a cable television service, during This set consists of 4 news shows, as shown in Table III, which include at least 3 different target speakers. TABLE III Final test set News Show Segments Average Duration (s) 2011_04_04-Telejornal _05_06-Telejornal _05_12-Telejornal _05_25-Telejornal For the sake of illustrating the potential of the system, 16 celebrity speakers have been selected. The information about the speakers and the corresponding training time is shown in Table II. These sets were manually annotated and provide word level transcription and speaker characterization (gender, identification). Using this information a set of target speakers and a set of training segments was defined, as well a set of test segments. An additional 200 speakers were chosen in order to carry out normalization of results obtained by the speaker models. These speakers were chosen based on their training time, with a total average of about 8 minutes. The test set consists of 6407 imposter segments, with an average of seconds, and 180 authentic segments, with an average of seconds. The number and average duration of the segments by target speakers for each news show is indicated in Table IV. TABLE IV Segments by target speakers in the final test set News Show Segments Average Duration (s) 2011_04_04-Telejornal _05_06-Telejornal _05_12-Telejornal _05_25-Telejornal III. SPEAKER VERIFICATION BLOCKS A. Audio Pre-Processing The audio pre-processing module [11] is part of the Audimus framework, and involves blocks for acoustic change
3 3 detection, speech/no-speech classification, gender classification, and speaker clustering. B. Feature extraction For feature extraction, a 19-dimensional PLP coefficients [10] plus energy are extracted from speech signal every 10ms using a 20ms Hamming window. First order delta and deltadelta are then appended, resulting in a 60-dimensional final vector for every frame. C. GMM-UBM The Gaussian Mixture Model (GMM) [11] is one of the reference methods in speaker recognition, and hence had to be included in the set of classifiers that were integrated in our system. The Universal Background Model (UBM) was trained with the Expectation-Maximization (EM) algorithm from features extracted from the entire training set, with a total of 47 hours. The 16 speaker models and the 200 imposter models, necessary for the score normalization, were derived by adapting only the mean parameters of the mixtures of the UBM, using the speaker's training speech and a maximum a posteriori (MAP) estimation. The speaker and imposter models included 1024 mixtures. Only the diagonal covariance matrices where used. D. SVM-GSV The second type of classifier is based on Gaussian supervectors (GSV) [12]. The linear kernel was derived by bounding the Kullback-Leibler (KL) divergence measure between GMMs. The supervector of each speaker model is represented only by the concatenation of all the means of the Gaussian mixtures model obtained in the GMM-UBM classifier, resulting in a supervector with dimensions (1024 x 60). The kernel is linear in the supervector, i.e., the mapping from the supervector to SVM expansion space is a diagonal linear transform. For SVM training, every supervector model was used, that is, the data from the target speaker is used as positive examples, and the data from the other 15 speakers and the 200 imposters is used as negative examples. Given a test segment, the GMM training is performed by MAP adaptation of the means (similar to the GMM-UBM classifier). A supervector is formed from this adapted model. The output score is obtained by computing a single inner product between the speaker model and the supervector of a test segment. E. GMM-UBM+SVM-GSV The third classifier was implemented to optimize the performance obtained by the two previous classifiers, depending on the duration of the test segment. The result of the GMM-UBM+SVM-GSV system is a combination of results obtained by individual GMM-UBM and SVM-GSV systems. This combination is done depending on the duration of the test segment. The GMM-UBM classifier was used for the test segments with duration less than 8 seconds. The SVM-GSV classifier is used for the longer segments. This threshold was optimized in the development set. The GMM-UBM and SVM-GSV modules maintain all the features previously implemented and are used without changing the way the results are calculated. F. Score normalization Score normalization is used to enhance the performance of the system and relies on 200 imposter models to perform ZT score normalization [13]. A. Evaluation metrics IV. RESULTS The evaluation metrics are the detection error tradeoff (DET), equal error rate (EER), and minimum decision cost function (DCF min ) [14]. The latter is defined as where and are the probability of miss and false alarm, respectively, at the threshold. B. Results with manually corpora The first set of results was obtained by first concatenating all the adjacent segments which were manually classified as belonging to the same speaker, whenever the gap between segments was less than 1 second. This was done in order to increase the average duration of each test segment. The time boundaries were manually defined. The systems were tested using 6407 imposter segments, with an average duration of seconds, and 180 target speaker segments with an average duration of seconds Results for the three systems are shown in Figure 2. The SVM-GSV outperforms the GMM-UBM classifier, and the best performance is obtained by the GMM-UBM+SVM-GSV classifier. The results in terms of EER and DCF min for the individual systems (GMM-UBM, SVM-GSV) and for the combination of both (GMM-UBM+SVM-GSV) are shown in Figure 3. C. Results with automatically segmented corpora The second set of results corresponds to automatically segmented corpora, in which the start and end times are obtained by the Audio Pre-Processing module, and adjacent segments by the same speaker are concatenated whenever the gap between segments was less than 2.5 seconds. The results involve only the GMM-UBM+SVM-GSV classifier. The threshold of the system that defines whether a segment (1)
4 4 belongs to a speaker or not was calculated based on the value of EER. Thus, a segment is assigned to a speaker if the score obtained by his model is greater than 1.5. If a segment is identified as belonging to two or more speakers, it is assigned to the speaker for which a higher score is obtained. TABLE V Performance in terms of DCFmin and EER News Show EER DCF min 2011_04_04-Telejornal _05_06-Telejornal _05_12-Telejornal _05_25-Telejornal Fig. 2. Comparison between DET curves for GMM-UBM, SVM-GSV and GMM-UBM+SVM-GSV systems. 0,1 0,08 0,06 0,04 0,02 0 0,095 0,083 0,034 0,033 0,067 0,030 GMM-UBM SVM-GSV GMM-UBM+SVM-GSV ERR DCFmin Fig. 3. Performance in terms of DCFmin and EER for GMM-UBM, SVM- GSV and GMM-UBM+SVM-GSV systems. Figure 4 presents the DET curve of GMM-GSV+SVM- GSV system when tested with the segments obtained by the Audio Pre-Processing module for the four news shows. The EER and DCF min obtained by each news show are shown in Table V. In this case the GMM-UBM+SVM-GSV system presents an EER of 8.7% and a DCF min of For a decision threshold of 1.5 this system has a false positive rate of 7.0% and a false negative rate of 15.2%. 2011_05_06- Telejornal-1 and 2011_05_12-Telejornal-1 news show present a higher EER due to insufficient authentic segments. Fig. 4 DET curve of GMM-UBM+SVM-GSV system. The performance of the GMM-UBM+SVM-GSV system in this test set of 2011 was lower than the one obtained with the previous test sets, as expected. This greater difficulty in detecting the segments by the target speakers was mainly attributed to the following reasons: Speaker models were trained with characteristics of the year 2000 and tested with recent segments, collected during the year It is well known that voices change with age, and so do recording conditions. The decision threshold was chosen on the basis of results obtained by speaker models, tested with segments collected during year 2001, 2004, 2007 and 2008, representing respectively 56%, 17%, 15% and 12% of the useful duration of the test set. The segments of the 2011 test set were obtained using the Audio Pre-Processing module, and therefore, are not perfectly segmented, i.e., the target speaker segments also now and then contain other speakers. This analysis led us to tuning the threshold of the GMM- UBM+SVM-GSV system with results obtained when tested with segments from the APP module. After this tuning, the false negative rate was reduced from 15.2% to 8.7%, at the cost of increasing the rate of false positives by 1.7 %.
5 5 V. WEB INTERFACE The results obtained by the GMM-UBM+SVM-GSV system for each news show analyzed are displayed in a web page, using the same style of the web interface designed for selective dissemination of multimedia information [6, 9]. This interface, illustrated in Figure 5, makes it possible to view all segments assigned to a given speaker, as well as information about the segment duration and the score obtained by the speaker model. The correct attribution of a segment to a speaker can be confirmed visually, since it is possible to see the video of each segment or of the entire television news show. [5] W. Campbell, D. Reynolds, J. Campbell and K. Brandy, Estimating and evaluating confidence for forensic speaker recognition, Proc. ICASSP 05, pp [6] J. Neto, H. Meinedo, R. Amaral and I. Trancoso, A System for Selective Dissemination of Multimedia Information, Proceedings of the ISCA MSDR [7] H. Meinedo, D. Caseiro, J. P. Neto and I. Trancoso, AUDIMUS.media: A Broadcast News Speech Recognition System for the European Portuguese Language, PROPOR [8] H. Meinedo, A. Abad, T. Pellegrini, I. Trancoso and J. P. Neto, The L2F Broadcast News Speech Recognition System, Fala2010. [9] H. Meinedo, Audio Pre-processing and Speech Recognition for Broadcast News. Lisboa, [10] H. Hermansky, Perceptual linear prediction (PLP) analysis for speech, Journal of the Acoustic Society of America 87, pp , [11] D. Reynolds,T. Quatieri and R. Dunn, Speaker verification using adapted gaussian mixture models, Digital Signal Processing, pp , [12] W. Campbell, D. Sturim and D. Reynolds, Support vector machines using GMM supervectors for speaker verification, IEEE Signal Processing Letteres, pp , [13] R. Zheng, S. Zhang and B. Xu, A Comparative Study of Feature and Score Normalization for Speaker Verification.Springer, [14] The NIST Year 2010 Speaker Recognition Evaluation Plan Fig. 5. HTML page with the segments belonging to a target speaker. VI. CONCLUSIONS This paper described a speaker verification system applied to finding voices of well-known persons in broadcast news shows. Two different classifiers were tested with test segments defined by annotators. In these conditions, the SVM-GSV classifier performed better than the GMM-UBM one, particularly for longer segments. The performance difference for short and long segments led us to create a GMM- UBM+SVM-GSV system which classifies a test segment depending on its duration. This system was used to identify target speakers in recent news shows, for which segments were automatically defined by an Audio Pre-Processing module. The performance of the GMM-UBM+SVM-GSV system was lower, which led to new successful experiments with further tuning. VII. REFERENCES [1] J. Naik and G. Doddington, Evaluation of a high performance speaker verification system for access control, Proc. ICASSP 1987, pp [2] J. Naik, L.Netsch, G.Dodding, Speaker verification over long distance telephone lines, Proc. ICASSP 1989, pp [3] C. Schmandt and B. Arons, A conversational telephone messaging system, IEEE Trans. Consumer Electron. 30(3), xxi-xxiv, [4] L. Wilcox, F. Chen, D.Kimber and V. Balasubramanian, Segmentation of speech using speaker identification, Proc. ICASSP 1994, pp. l.161- l.164.
Support Vector Machines for Speaker and Language Recognition
Support Vector Machines for Speaker and Language Recognition W. M. Campbell, J. P. Campbell, D. A. Reynolds, E. Singer, P. A. Torres-Carrasquillo MIT Lincoln Laboratory, 244 Wood Street, Lexington, MA
More informationPhonetic- and Speaker-Discriminant Features for Speaker Recognition. Research Project
Phonetic- and Speaker-Discriminant Features for Speaker Recognition by Lara Stoll Research Project Submitted to the Department of Electrical Engineering and Computer Sciences, University of California
More informationA NOVEL SCHEME FOR SPEAKER RECOGNITION USING A PHONETICALLY-AWARE DEEP NEURAL NETWORK. Yun Lei Nicolas Scheffer Luciana Ferrer Mitchell McLaren
A NOVEL SCHEME FOR SPEAKER RECOGNITION USING A PHONETICALLY-AWARE DEEP NEURAL NETWORK Yun Lei Nicolas Scheffer Luciana Ferrer Mitchell McLaren Speech Technology and Research Laboratory, SRI International,
More informationDOMAIN MISMATCH COMPENSATION FOR SPEAKER RECOGNITION USING A LIBRARY OF WHITENERS. Elliot Singer and Douglas Reynolds
DOMAIN MISMATCH COMPENSATION FOR SPEAKER RECOGNITION USING A LIBRARY OF WHITENERS Elliot Singer and Douglas Reynolds Massachusetts Institute of Technology Lincoln Laboratory {es,dar}@ll.mit.edu ABSTRACT
More informationA study of speaker adaptation for DNN-based speech synthesis
A study of speaker adaptation for DNN-based speech synthesis Zhizheng Wu, Pawel Swietojanski, Christophe Veaux, Steve Renals, Simon King The Centre for Speech Technology Research (CSTR) University of Edinburgh,
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationSpeech Emotion Recognition Using Support Vector Machine
Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION
ADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION Mitchell McLaren 1, Yun Lei 1, Luciana Ferrer 2 1 Speech Technology and Research Laboratory, SRI International, California, USA 2 Departamento
More informationSpeech Recognition at ICSI: Broadcast News and beyond
Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI
More informationAutomatic Speaker Recognition: Modelling, Feature Extraction and Effects of Clinical Environment
Automatic Speaker Recognition: Modelling, Feature Extraction and Effects of Clinical Environment A thesis submitted in fulfillment of the requirements for the degree of Doctor of Philosophy Sheeraz Memon
More informationHuman Emotion Recognition From Speech
RESEARCH ARTICLE OPEN ACCESS Human Emotion Recognition From Speech Miss. Aparna P. Wanare*, Prof. Shankar N. Dandare *(Department of Electronics & Telecommunication Engineering, Sant Gadge Baba Amravati
More informationCalibration of Confidence Measures in Speech Recognition
Submitted to IEEE Trans on Audio, Speech, and Language, July 2010 1 Calibration of Confidence Measures in Speech Recognition Dong Yu, Senior Member, IEEE, Jinyu Li, Member, IEEE, Li Deng, Fellow, IEEE
More informationLearning Methods in Multilingual Speech Recognition
Learning Methods in Multilingual Speech Recognition Hui Lin Department of Electrical Engineering University of Washington Seattle, WA 98125 linhui@u.washington.edu Li Deng, Jasha Droppo, Dong Yu, and Alex
More informationSpoofing and countermeasures for automatic speaker verification
INTERSPEECH 2013 Spoofing and countermeasures for automatic speaker verification Nicholas Evans 1, Tomi Kinnunen 2 and Junichi Yamagishi 3,4 1 EURECOM, Sophia Antipolis, France 2 University of Eastern
More informationInternational Journal of Computational Intelligence and Informatics, Vol. 1 : No. 4, January - March 2012
Text-independent Mono and Cross-lingual Speaker Identification with the Constraint of Limited Data Nagaraja B G and H S Jayanna Department of Information Science and Engineering Siddaganga Institute of
More informationUTD-CRSS Systems for 2012 NIST Speaker Recognition Evaluation
UTD-CRSS Systems for 2012 NIST Speaker Recognition Evaluation Taufiq Hasan Gang Liu Seyed Omid Sadjadi Navid Shokouhi The CRSS SRE Team John H.L. Hansen Keith W. Godin Abhinav Misra Ali Ziaei Hynek Bořil
More informationReducing Features to Improve Bug Prediction
Reducing Features to Improve Bug Prediction Shivkumar Shivaji, E. James Whitehead, Jr., Ram Akella University of California Santa Cruz {shiv,ejw,ram}@soe.ucsc.edu Sunghun Kim Hong Kong University of Science
More informationModule 12. Machine Learning. Version 2 CSE IIT, Kharagpur
Module 12 Machine Learning 12.1 Instructional Objective The students should understand the concept of learning systems Students should learn about different aspects of a learning system Students should
More informationINVESTIGATION OF UNSUPERVISED ADAPTATION OF DNN ACOUSTIC MODELS WITH FILTER BANK INPUT
INVESTIGATION OF UNSUPERVISED ADAPTATION OF DNN ACOUSTIC MODELS WITH FILTER BANK INPUT Takuya Yoshioka,, Anton Ragni, Mark J. F. Gales Cambridge University Engineering Department, Cambridge, UK NTT Communication
More informationWHEN THERE IS A mismatch between the acoustic
808 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 14, NO. 3, MAY 2006 Optimization of Temporal Filters for Constructing Robust Features in Speech Recognition Jeih-Weih Hung, Member,
More informationPREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES
PREDICTING SPEECH RECOGNITION CONFIDENCE USING DEEP LEARNING WITH WORD IDENTITY AND SCORE FEATURES Po-Sen Huang, Kshitiz Kumar, Chaojun Liu, Yifan Gong, Li Deng Department of Electrical and Computer Engineering,
More informationNon intrusive multi-biometrics on a mobile device: a comparison of fusion techniques
Non intrusive multi-biometrics on a mobile device: a comparison of fusion techniques Lorene Allano 1*1, Andrew C. Morris 2, Harin Sellahewa 3, Sonia Garcia-Salicetti 1, Jacques Koreman 2, Sabah Jassim
More informationWord Segmentation of Off-line Handwritten Documents
Word Segmentation of Off-line Handwritten Documents Chen Huang and Sargur N. Srihari {chuang5, srihari}@cedar.buffalo.edu Center of Excellence for Document Analysis and Recognition (CEDAR), Department
More informationBUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING
BUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING Gábor Gosztolya 1, Tamás Grósz 1, László Tóth 1, David Imseng 2 1 MTA-SZTE Research Group on Artificial
More informationDigital Signal Processing: Speaker Recognition Final Report (Complete Version)
Digital Signal Processing: Speaker Recognition Final Report (Complete Version) Xinyu Zhou, Yuxin Wu, and Tiezheng Li Tsinghua University Contents 1 Introduction 1 2 Algorithms 2 2.1 VAD..................................................
More informationAnalysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier
IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 10, Issue 2, Ver.1 (Mar - Apr.2015), PP 55-61 www.iosrjournals.org Analysis of Emotion
More informationSpeaker recognition using universal background model on YOHO database
Aalborg University Master Thesis project Speaker recognition using universal background model on YOHO database Author: Alexandre Majetniak Supervisor: Zheng-Hua Tan May 31, 2011 The Faculties of Engineering,
More informationRobust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction
INTERSPEECH 2015 Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction Akihiro Abe, Kazumasa Yamamoto, Seiichi Nakagawa Department of Computer
More informationSpeech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines
Speech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines Amit Juneja and Carol Espy-Wilson Department of Electrical and Computer Engineering University of Maryland,
More informationClass-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification
Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification Tomi Kinnunen and Ismo Kärkkäinen University of Joensuu, Department of Computer Science, P.O. Box 111, 80101 JOENSUU,
More informationAutoregressive product of multi-frame predictions can improve the accuracy of hybrid models
Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Navdeep Jaitly 1, Vincent Vanhoucke 2, Geoffrey Hinton 1,2 1 University of Toronto 2 Google Inc. ndjaitly@cs.toronto.edu,
More informationSemi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
INTERSPEECH 2013 Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration Yan Huang, Dong Yu, Yifan Gong, and Chaojun Liu Microsoft Corporation, One
More informationUnvoiced Landmark Detection for Segment-based Mandarin Continuous Speech Recognition
Unvoiced Landmark Detection for Segment-based Mandarin Continuous Speech Recognition Hua Zhang, Yun Tang, Wenju Liu and Bo Xu National Laboratory of Pattern Recognition Institute of Automation, Chinese
More informationSpeaker Recognition. Speaker Diarization and Identification
Speaker Recognition Speaker Diarization and Identification A dissertation submitted to the University of Manchester for the degree of Master of Science in the Faculty of Engineering and Physical Sciences
More informationA New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation
A New Perspective on Combining GMM and DNN Frameworks for Speaker Adaptation SLSP-2016 October 11-12 Natalia Tomashenko 1,2,3 natalia.tomashenko@univ-lemans.fr Yuri Khokhlov 3 khokhlov@speechpro.com Yannick
More informationEli Yamamoto, Satoshi Nakamura, Kiyohiro Shikano. Graduate School of Information Science, Nara Institute of Science & Technology
ISCA Archive SUBJECTIVE EVALUATION FOR HMM-BASED SPEECH-TO-LIP MOVEMENT SYNTHESIS Eli Yamamoto, Satoshi Nakamura, Kiyohiro Shikano Graduate School of Information Science, Nara Institute of Science & Technology
More informationIEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH
IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH 2009 423 Adaptive Multimodal Fusion by Uncertainty Compensation With Application to Audiovisual Speech Recognition George
More informationGenerative models and adversarial training
Day 4 Lecture 1 Generative models and adversarial training Kevin McGuinness kevin.mcguinness@dcu.ie Research Fellow Insight Centre for Data Analytics Dublin City University What is a generative model?
More informationAUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION
JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 11/2007, ISSN 1642-6037 Marek WIŚNIEWSKI *, Wiesława KUNISZYK-JÓŹKOWIAK *, Elżbieta SMOŁKA *, Waldemar SUSZYŃSKI * HMM, recognition, speech, disorders
More informationarxiv: v2 [cs.cv] 30 Mar 2017
Domain Adaptation for Visual Applications: A Comprehensive Survey Gabriela Csurka arxiv:1702.05374v2 [cs.cv] 30 Mar 2017 Abstract The aim of this paper 1 is to give an overview of domain adaptation and
More informationLecture 1: Machine Learning Basics
1/69 Lecture 1: Machine Learning Basics Ali Harakeh University of Waterloo WAVE Lab ali.harakeh@uwaterloo.ca May 1, 2017 2/69 Overview 1 Learning Algorithms 2 Capacity, Overfitting, and Underfitting 3
More informationOCR for Arabic using SIFT Descriptors With Online Failure Prediction
OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,
More informationPython Machine Learning
Python Machine Learning Unlock deeper insights into machine learning with this vital guide to cuttingedge predictive analytics Sebastian Raschka [ PUBLISHING 1 open source I community experience distilled
More informationHistorical maintenance relevant information roadmap for a self-learning maintenance prediction procedural approach
IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Historical maintenance relevant information roadmap for a self-learning maintenance prediction procedural approach To cite this
More informationSpeech Translation for Triage of Emergency Phonecalls in Minority Languages
Speech Translation for Triage of Emergency Phonecalls in Minority Languages Udhyakumar Nallasamy, Alan W Black, Tanja Schultz, Robert Frederking Language Technologies Institute Carnegie Mellon University
More informationAssignment 1: Predicting Amazon Review Ratings
Assignment 1: Predicting Amazon Review Ratings 1 Dataset Analysis Richard Park r2park@acsmail.ucsd.edu February 23, 2015 The dataset selected for this assignment comes from the set of Amazon reviews for
More informationProbabilistic Latent Semantic Analysis
Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview
More informationBAUM-WELCH TRAINING FOR SEGMENT-BASED SPEECH RECOGNITION. Han Shu, I. Lee Hetherington, and James Glass
BAUM-WELCH TRAINING FOR SEGMENT-BASED SPEECH RECOGNITION Han Shu, I. Lee Hetherington, and James Glass Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology Cambridge,
More informationDIRECT ADAPTATION OF HYBRID DNN/HMM MODEL FOR FAST SPEAKER ADAPTATION IN LVCSR BASED ON SPEAKER CODE
2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) DIRECT ADAPTATION OF HYBRID DNN/HMM MODEL FOR FAST SPEAKER ADAPTATION IN LVCSR BASED ON SPEAKER CODE Shaofei Xue 1
More informationLearning Methods for Fuzzy Systems
Learning Methods for Fuzzy Systems Rudolf Kruse and Andreas Nürnberger Department of Computer Science, University of Magdeburg Universitätsplatz, D-396 Magdeburg, Germany Phone : +49.39.67.876, Fax : +49.39.67.8
More informationUMass at TDT Similarity functions 1. BASIC SYSTEM Detection algorithms. set globally and apply to all clusters.
UMass at TDT James Allan, Victor Lavrenko, David Frey, and Vikas Khandelwal Center for Intelligent Information Retrieval Department of Computer Science University of Massachusetts Amherst, MA 3 We spent
More informationSemi-supervised methods of text processing, and an application to medical concept extraction. Yacine Jernite Text-as-Data series September 17.
Semi-supervised methods of text processing, and an application to medical concept extraction Yacine Jernite Text-as-Data series September 17. 2015 What do we want from text? 1. Extract information 2. Link
More informationEdinburgh Research Explorer
Edinburgh Research Explorer Personalising speech-to-speech translation Citation for published version: Dines, J, Liang, H, Saheer, L, Gibson, M, Byrne, W, Oura, K, Tokuda, K, Yamagishi, J, King, S, Wester,
More informationLikelihood-Maximizing Beamforming for Robust Hands-Free Speech Recognition
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Likelihood-Maximizing Beamforming for Robust Hands-Free Speech Recognition Seltzer, M.L.; Raj, B.; Stern, R.M. TR2004-088 December 2004 Abstract
More informationAustralian Journal of Basic and Applied Sciences
AENSI Journals Australian Journal of Basic and Applied Sciences ISSN:1991-8178 Journal home page: www.ajbasweb.com Feature Selection Technique Using Principal Component Analysis For Improving Fuzzy C-Mean
More informationThe NICT/ATR speech synthesis system for the Blizzard Challenge 2008
The NICT/ATR speech synthesis system for the Blizzard Challenge 2008 Ranniery Maia 1,2, Jinfu Ni 1,2, Shinsuke Sakai 1,2, Tomoki Toda 1,3, Keiichi Tokuda 1,4 Tohru Shimizu 1,2, Satoshi Nakamura 1,2 1 National
More informationExposé for a Master s Thesis
Exposé for a Master s Thesis Stefan Selent January 21, 2017 Working Title: TF Relation Mining: An Active Learning Approach Introduction The amount of scientific literature is ever increasing. Especially
More informationLecture Notes in Artificial Intelligence 4343
Lecture Notes in Artificial Intelligence 4343 Edited by J. G. Carbonell and J. Siekmann Subseries of Lecture Notes in Computer Science Christian Müller (Ed.) Speaker Classification I Fundamentals, Features,
More informationDeep Neural Network Language Models
Deep Neural Network Language Models Ebru Arısoy, Tara N. Sainath, Brian Kingsbury, Bhuvana Ramabhadran IBM T.J. Watson Research Center Yorktown Heights, NY, 10598, USA {earisoy, tsainath, bedk, bhuvana}@us.ibm.com
More informationLearning Optimal Dialogue Strategies: A Case Study of a Spoken Dialogue Agent for
Learning Optimal Dialogue Strategies: A Case Study of a Spoken Dialogue Agent for Email Marilyn A. Walker Jeanne C. Fromer Shrikanth Narayanan walker@research.att.com jeannie@ai.mit.edu shri@research.att.com
More informationOffline Writer Identification Using Convolutional Neural Network Activation Features
Pattern Recognition Lab Department Informatik Universität Erlangen-Nürnberg Prof. Dr.-Ing. habil. Andreas Maier Telefon: +49 9131 85 27775 Fax: +49 9131 303811 info@i5.cs.fau.de www5.cs.fau.de Offline
More informationSpeaker Identification by Comparison of Smart Methods. Abstract
Journal of mathematics and computer science 10 (2014), 61-71 Speaker Identification by Comparison of Smart Methods Ali Mahdavi Meimand Amin Asadi Majid Mohamadi Department of Electrical Department of Computer
More informationSpecification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments
Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Cristina Vertan, Walther v. Hahn University of Hamburg, Natural Language Systems Division Hamburg,
More informationRole of Pausing in Text-to-Speech Synthesis for Simultaneous Interpretation
Role of Pausing in Text-to-Speech Synthesis for Simultaneous Interpretation Vivek Kumar Rangarajan Sridhar, John Chen, Srinivas Bangalore, Alistair Conkie AT&T abs - Research 180 Park Avenue, Florham Park,
More informationAffective Classification of Generic Audio Clips using Regression Models
Affective Classification of Generic Audio Clips using Regression Models Nikolaos Malandrakis 1, Shiva Sundaram, Alexandros Potamianos 3 1 Signal Analysis and Interpretation Laboratory (SAIL), USC, Los
More informationACOUSTIC EVENT DETECTION IN REAL LIFE RECORDINGS
ACOUSTIC EVENT DETECTION IN REAL LIFE RECORDINGS Annamaria Mesaros 1, Toni Heittola 1, Antti Eronen 2, Tuomas Virtanen 1 1 Department of Signal Processing Tampere University of Technology Korkeakoulunkatu
More informationLinking Task: Identifying authors and book titles in verbose queries
Linking Task: Identifying authors and book titles in verbose queries Anaïs Ollagnier, Sébastien Fournier, and Patrice Bellot Aix-Marseille University, CNRS, ENSAM, University of Toulon, LSIS UMR 7296,
More informationUsing dialogue context to improve parsing performance in dialogue systems
Using dialogue context to improve parsing performance in dialogue systems Ivan Meza-Ruiz and Oliver Lemon School of Informatics, Edinburgh University 2 Buccleuch Place, Edinburgh I.V.Meza-Ruiz@sms.ed.ac.uk,
More informationSpeaker Recognition For Speech Under Face Cover
INTERSPEECH 2015 Speaker Recognition For Speech Under Face Cover Rahim Saeidi, Tuija Niemi, Hanna Karppelin, Jouni Pohjalainen, Tomi Kinnunen, Paavo Alku Department of Signal Processing and Acoustics,
More informationMeta Comments for Summarizing Meeting Speech
Meta Comments for Summarizing Meeting Speech Gabriel Murray 1 and Steve Renals 2 1 University of British Columbia, Vancouver, Canada gabrielm@cs.ubc.ca 2 University of Edinburgh, Edinburgh, Scotland s.renals@ed.ac.uk
More informationChapter 10 APPLYING TOPIC MODELING TO FORENSIC DATA. 1. Introduction. Alta de Waal, Jacobus Venter and Etienne Barnard
Chapter 10 APPLYING TOPIC MODELING TO FORENSIC DATA Alta de Waal, Jacobus Venter and Etienne Barnard Abstract Most actionable evidence is identified during the analysis phase of digital forensic investigations.
More informationCROSS-LANGUAGE INFORMATION RETRIEVAL USING PARAFAC2
1 CROSS-LANGUAGE INFORMATION RETRIEVAL USING PARAFAC2 Peter A. Chew, Brett W. Bader, Ahmed Abdelali Proceedings of the 13 th SIGKDD, 2007 Tiago Luís Outline 2 Cross-Language IR (CLIR) Latent Semantic Analysis
More informationImproved Hindi Broadcast ASR by Adapting the Language Model and Pronunciation Model Using A Priori Syntactic and Morphophonemic Knowledge
Improved Hindi Broadcast ASR by Adapting the Language Model and Pronunciation Model Using A Priori Syntactic and Morphophonemic Knowledge Preethi Jyothi 1, Mark Hasegawa-Johnson 1,2 1 Beckman Institute,
More information(Sub)Gradient Descent
(Sub)Gradient Descent CMSC 422 MARINE CARPUAT marine@cs.umd.edu Figures credit: Piyush Rai Logistics Midterm is on Thursday 3/24 during class time closed book/internet/etc, one page of notes. will include
More informationINPE São José dos Campos
INPE-5479 PRE/1778 MONLINEAR ASPECTS OF DATA INTEGRATION FOR LAND COVER CLASSIFICATION IN A NEDRAL NETWORK ENVIRONNENT Maria Suelena S. Barros Valter Rodrigues INPE São José dos Campos 1993 SECRETARIA
More informationSwitchboard Language Model Improvement with Conversational Data from Gigaword
Katholieke Universiteit Leuven Faculty of Engineering Master in Artificial Intelligence (MAI) Speech and Language Technology (SLT) Switchboard Language Model Improvement with Conversational Data from Gigaword
More informationSpeech Recognition using Acoustic Landmarks and Binary Phonetic Feature Classifiers
Speech Recognition using Acoustic Landmarks and Binary Phonetic Feature Classifiers October 31, 2003 Amit Juneja Department of Electrical and Computer Engineering University of Maryland, College Park,
More informationSemi-Supervised Face Detection
Semi-Supervised Face Detection Nicu Sebe, Ira Cohen 2, Thomas S. Huang 3, Theo Gevers Faculty of Science, University of Amsterdam, The Netherlands 2 HP Research Labs, USA 3 Beckman Institute, University
More informationInvestigation on Mandarin Broadcast News Speech Recognition
Investigation on Mandarin Broadcast News Speech Recognition Mei-Yuh Hwang 1, Xin Lei 1, Wen Wang 2, Takahiro Shinozaki 1 1 Univ. of Washington, Dept. of Electrical Engineering, Seattle, WA 98195 USA 2
More informationSegmental Conditional Random Fields with Deep Neural Networks as Acoustic Models for First-Pass Word Recognition
Segmental Conditional Random Fields with Deep Neural Networks as Acoustic Models for First-Pass Word Recognition Yanzhang He, Eric Fosler-Lussier Department of Computer Science and Engineering The hio
More informationOn the Formation of Phoneme Categories in DNN Acoustic Models
On the Formation of Phoneme Categories in DNN Acoustic Models Tasha Nagamine Department of Electrical Engineering, Columbia University T. Nagamine Motivation Large performance gap between humans and state-
More informationA Comparison of Two Text Representations for Sentiment Analysis
010 International Conference on Computer Application and System Modeling (ICCASM 010) A Comparison of Two Text Representations for Sentiment Analysis Jianxiong Wang School of Computer Science & Educational
More informationLearning From the Past with Experiment Databases
Learning From the Past with Experiment Databases Joaquin Vanschoren 1, Bernhard Pfahringer 2, and Geoff Holmes 2 1 Computer Science Dept., K.U.Leuven, Leuven, Belgium 2 Computer Science Dept., University
More informationSoftware Maintenance
1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories
More informationRule discovery in Web-based educational systems using Grammar-Based Genetic Programming
Data Mining VI 205 Rule discovery in Web-based educational systems using Grammar-Based Genetic Programming C. Romero, S. Ventura, C. Hervás & P. González Universidad de Córdoba, Campus Universitario de
More informationDetecting English-French Cognates Using Orthographic Edit Distance
Detecting English-French Cognates Using Orthographic Edit Distance Qiongkai Xu 1,2, Albert Chen 1, Chang i 1 1 The Australian National University, College of Engineering and Computer Science 2 National
More informationThe 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, / X
The 9 th International Scientific Conference elearning and software for Education Bucharest, April 25-26, 2013 10.12753/2066-026X-13-154 DATA MINING SOLUTIONS FOR DETERMINING STUDENT'S PROFILE Adela BÂRA,
More informationCS 446: Machine Learning
CS 446: Machine Learning Introduction to LBJava: a Learning Based Programming Language Writing classifiers Christos Christodoulopoulos Parisa Kordjamshidi Motivation 2 Motivation You still have not learnt
More informationCircuit Simulators: A Revolutionary E-Learning Platform
Circuit Simulators: A Revolutionary E-Learning Platform Mahi Itagi Padre Conceicao College of Engineering, Verna, Goa, India. itagimahi@gmail.com Akhil Deshpande Gogte Institute of Technology, Udyambag,
More informationMULTILINGUAL INFORMATION ACCESS IN DIGITAL LIBRARY
MULTILINGUAL INFORMATION ACCESS IN DIGITAL LIBRARY Chen, Hsin-Hsi Department of Computer Science and Information Engineering National Taiwan University Taipei, Taiwan E-mail: hh_chen@csie.ntu.edu.tw Abstract
More informationOn the Combined Behavior of Autonomous Resource Management Agents
On the Combined Behavior of Autonomous Resource Management Agents Siri Fagernes 1 and Alva L. Couch 2 1 Faculty of Engineering Oslo University College Oslo, Norway siri.fagernes@iu.hio.no 2 Computer Science
More informationCS Machine Learning
CS 478 - Machine Learning Projects Data Representation Basic testing and evaluation schemes CS 478 Data and Testing 1 Programming Issues l Program in any platform you want l Realize that you will be doing
More informationDesign Of An Automatic Speaker Recognition System Using MFCC, Vector Quantization And LBG Algorithm
Design Of An Automatic Speaker Recognition System Using MFCC, Vector Quantization And LBG Algorithm Prof. Ch.Srinivasa Kumar Prof. and Head of department. Electronics and communication Nalanda Institute
More informationSpeech Recognition by Indexing and Sequencing
International Journal of Computer Information Systems and Industrial Management Applications. ISSN 215-7988 Volume 4 (212) pp. 358 365 c MIR Labs, www.mirlabs.net/ijcisim/index.html Speech Recognition
More informationUSER ADAPTATION IN E-LEARNING ENVIRONMENTS
USER ADAPTATION IN E-LEARNING ENVIRONMENTS Paraskevi Tzouveli Image, Video and Multimedia Systems Laboratory School of Electrical and Computer Engineering National Technical University of Athens tpar@image.
More informationKnowledge Transfer in Deep Convolutional Neural Nets
Knowledge Transfer in Deep Convolutional Neural Nets Steven Gutstein, Olac Fuentes and Eric Freudenthal Computer Science Department University of Texas at El Paso El Paso, Texas, 79968, U.S.A. Abstract
More informationConstructing a support system for self-learning playing the piano at the beginning stage
Alma Mater Studiorum University of Bologna, August 22-26 2006 Constructing a support system for self-learning playing the piano at the beginning stage Tamaki Kitamura Dept. of Media Informatics, Ryukoku
More informationTwitter Sentiment Classification on Sanders Data using Hybrid Approach
IOSR Journal of Computer Engineering (IOSR-JCE) e-issn: 2278-0661,p-ISSN: 2278-8727, Volume 17, Issue 4, Ver. I (July Aug. 2015), PP 118-123 www.iosrjournals.org Twitter Sentiment Classification on Sanders
More informationAQUA: An Ontology-Driven Question Answering System
AQUA: An Ontology-Driven Question Answering System Maria Vargas-Vera, Enrico Motta and John Domingue Knowledge Media Institute (KMI) The Open University, Walton Hall, Milton Keynes, MK7 6AA, United Kingdom.
More information