Learning phonetic features from waveforms
|
|
- Hilary York
- 6 years ago
- Views:
Transcription
1 Learning phoneic feaures from waveforms Ying Lin Absrac Unsupervised learning of broad phoneic classes by infans was simulaed using a saisical mixure model. Wih he phoneic labels removed, hand-ranscribed segmens from he TIMIT daabase were used in model-based clusering o obain daa-driven classes. Simple Hidden Markov Models were chosen o be he componens of he mixure, wih Mel-Cepsral coefficiens as he fron-end. The sound classes were found by ieraively pariioning he clusers. The resuls of running his algorihm on he TIMIT segmens sugges ha he pariions may be inerpreed as gradien acousic feaures, and ha o some degree, he resuling clusers correspond o knowledge-based phoneic classes. Thus, he clusers may reflec he preliminary phonological caegories formed during language learning in early childhood. 1 Inroducion An imporan change ha occurs during early phonological developmen is ha an infan changes from a universal perceiver o a language-specific one[7]. I is widely believed ha one of he underlying mechanisms is he abiliy o learn sound prooypes from disribuions of sounds[2]. Alhough unsupervised learning of sound prooypes has been simulaed using connecionis models wih arificial daa, no model is ye available ha akes real speech signals as inpu. The curren sudy is a firs sep in building a compuaional model for he human-like learning of sub-lexical unis from acousic signals, using ools from Auomaic Speech Recogniion and saisical learning. Assuming for his firs sep ha a phone-level segmenaion is given, we sudy he echnical problem of using a saisical mixure model o cluser a se of unlabelled acousic segmens. To handle he challenge ha acousic segmens are non-saionary and have variable duraions, simple Hidden Markov Models (HMM) were chosen o be he componens of he mixure, using Mel-cepsral coefficiens as he parameerized represenaion of speech. 2 Mehod 2.1 Mixure model The basic inuiion behind mixure models is ha he observed daa may be generaed by differen sources, each capured by a separae componen model. The way o decide which componen bes accouns for he daa is by comparing he daa s likelihood given each componen. Under he mixure model assumpion, he likelihood has he general form: p(d M) = p(m i ) p(d m i ) (1) i=1,,n where each m i is ofen a parameric model ha serves as a mixure componen of M, and p(m i ) is he prior probabiliy over all componens {m 1,, m N } of M. The inuiive inerpreaion of p(m i ) is he relaive size of he subse of daa ha is aribued o m i, and p(d m i ) corresponds o likelihood of he daa given m i. Anoher imporan noion is he poserior probabiliy of each mixure componen, defined as: p(m i )p(d m i ) p(m i d) = p(m i ) p(d m i ) i=1,,n (2)
2 Inuiively speaking, he poserior probabiliy represens o wha exen he daa d is explained by componen m i. When his value approaches 1, i means ha almos cerainly, m i is responsible for d. 2.2 Learning algorihm The learning problem of he mixure model is addressed by he well-known Expecaion-Maximizaion algorihm [9]. The EM algorihm ieraes over he following wo seps unil he daa likelihood sops increasing: 1. E-sep: given curren esimaes of {p(m i )} and m i, compue he poserior probabiliies using (2); 2. M-sep: weigh each daum wih he poserior p(m i d), and updae m i and p(m i ) wih he discouned daa. One perspecive on his algorihm is provided by some proposals on exemplar-based caegory learning [4]. E-sep can be viewed as deermining he membership of a new exemplar wih regards o each class using he pre-sored exemplars, while M-sep can be viewed as shifing he ceners of he exemplar clouds by updaing he conribuion of each exemplar. The main difference beween our model and exemplar-based models is in essence similar o he one beween emplae-based and saisical speech recogniion: raher han soring all exemplars and using some emplae-maching echniques o deermine similariy, we assume exemplars are generaed by a mixure of models and use likelihood o measure similariy. 2.3 Mixure of HMMs In principle, any probabilisic model ha can be used o approximae (2) for ime series daa can serve as a componen of he mixure. Therefore, he choice of models was no limied o HMM. We chose HMM because i is relaively easy o implemen, no because we considered i he bes model for acousic segmens. The main challenge in clusering speech segmens was ha segmens may have differen lenghs and are no saionary. Raher han mapping all segmens o a fixed dimension [5], we used a mixure of HMMs o model he whole segmens. The use of HMMs in clusering speech was considered in [3], bu he mixure of HMMs was firs applied o he clusering of moion daa [1]. The algorihm for raining a mixure of HMMs involves some minor modificaions o he regular Baum- Welsh algorihm [6]. Assuming he oupu probabiliy of each sae is compued from a Gaussian mixure, he E-sep includes he following formulae (he use of symbols also follows [6]): p(o (s) λ m ) = i α (i)β (i) (3) ξ (s,m) (i, j) = α (i) a ij b j (o (s) +1 ) β +1(i) p(o (s) λ m ) γ (s,m) (i, k) = γ (s,m) (i) γ (s,m) (i) = α (i)β (i) p(o (s) λ m ) c (m) N(o(s) j c(m) i,j N(o(s) p(λ m O (s) ) = p(λ m)p(o (s) λ m ) j p(λ j)p(o (s) λ j ), µ (m), Σ(m) ) (4) (5), µ (m) i,j, Σ(m) i,j ) (6) α (i), β (i) are he regular forward and backward probabiliies compued from model parameers. a ij are ransiion probabiliies. b j (o (s) ) are oupu probabiliies. N(o (s), µ, Σ ) are he Gaussian componens in he oupu probabiliies. In (4)(5)(6), he exra subscrips m and s indicae ha here is a separae couner for each pair of HMM and observaion sequence. (7) calculaes he poserior probabiliy. (7)
3 As menioned in 2.2, he M-sep uses he poserior probabiliy o weigh each sufficien saisics couner in (4)(5)(6), and updaes he parameers of a given model using he weighed sum of all couners associaed wih his model. The formulae include: Σ (m) s a (m) ij = p(λ m O (s) ) ξ(s,m) (i, j) s p(λ m O (s) ) γ(s,m) (i) µ (m) = s p(λ m O (s) ) γ(s,m) (i, k)o (s) s p(λ m O (s) ) = s p(λ m O (s) ) γ(s,m) (i, k)(o (s) µ i )(o (s) µ i ) T s p(λ m O (s) ) c (m) = s p(λ m O (s) ) γ(s,m) (i, k) j s p(λ m O (s) ) γ(s,m) (i, j) s p(λ m ) = p(λ m O (s) ) s j p(λ j O (s) ) (8)(9)(10)(11) updaes he corresponding parameers (ransiion probabiliies a (m) ij beween saes, he means µ (m), covariances Σ(m) and weighs of he Gaussian mixure c(m) ) for each HMM componen in he mixure, and (12) updaes he prior probabiliy over he mixure componens. Noe ha running he algorihm for he firs ime requires an iniial esimae for he HMM parameers and for he prior probabiliy. The K-Means algorihm based on he Iakura-Saio disorion [6] was used for such purpose. Using his mehod, every acousic segmen was mapped o he LPC vecor of is cenroid specrum and he iniial clusering was done on all he LPC vecors. (8) (9) (10) (11) (12) K-means: I n ô i A ô waer she ask HMM mixure: I n ô i A ô waer she ask Table 1: Comparisons of clusering mehods Table 1 shows wo comparisons of he clusering mehods, using 3 diphones and 3 words respecively. Columns 1, 2, 3 represen he cluser indices. We can see ha when he unis conain significan dynamics, he HMM mixure achieves a much beer separaion of differen unis han he K-Means algorihm. 2.4 Ieraive refinemen of he mixure model Due o he complex form of he likelihood funcion, finding he global maximum in he likelihood space can be very difficul. The heurisic ha we used o approximae he global maximum is o sar wih a small number of clusers, and hen spli hem successively o obain he desired number of clusers. The crierion for choosing which cluser o spli is again based on likelihood. The inuiion of Algorihm 1 is ha new caegories firs emerge from he larges or he mos heerogeneous subse of daa. Thus i may be viewed as a sraegy for inducively learning he sound caegories from unlabelled daa. Our clusering experimen was conduced on he manually ranscribed TIMIT daabase. The raining of he HMM mixure was implemened by modifying he HTK source code, and he successive spliing
4 Algorihm 1 Successive cluser spliing 1: Train a mixure of k HMM s 2: repea 3: for each cluser C i do 4: Spli C i ino n clusers and obain a new mixure model, record he gain in likelihood 5: end for 6: Choose he spli ha maximally increases he likelihood 7: Rerain he new mixure model on all daa 8: unil sopping condiion is saisfied algorihm was implemened in Malab. All HMMs are 3-sae, lef-o-righ, wih a 2-Gaussian mixure modelling he oupu disribuion of each sae. Mel-cepsral coefficiens (13) [8] ogeher wih he dela feaures (13) [6] were used as he parameerized represenaion of speech signals. This represenaion allowed us o focus on he specral envelope insead of he speaker informaion. Wih he phoneic labels removed, 7166 acousic segmens from 22 speakers in TIMIT were clusered. Saring wih 2 clusers, 5 pariions were found. Each pariion replaced he old cluser wih 2 new clusers, hereby resuling in a oal of 6 clusers. The disribuion of phoneic labels over he clusers was calculaed afer each pariion and reraining. 3 Resuls Figures 1 5 illusrae how he phoneic segmens are divided ino wo new clusers a each pariioning sep. The phoneic labels use symbols from he TIMIT phoneic alphabe. For each phoneic label, he posiion of he verical bar indicaes he percenages of he acousic segmens ha were assigned o he lef and righ cluser. For example in Figure 1, he bars corresponding o he voiced inerdenal fricaive dh represen he resul ha 95% of acousic segmens labelled dh were assigned o cluser 1 ( obsruen ) and 5% were assigned o cluser 2 ( sonoran ). The clusers were named using prefix coding. For example, a paren cluser named 12 was spli ino daugher clusers 121 and 122. To save space, each figure displays he subse of labels wih more han half of he segmens falling in he paren cluser. For example, labels included in Figure 3 (cluser 21 and 22) were hose ha have been mosly assigned o cluser 2 ( sonorans ) in Figure 1. 1 Some phoneic labels are consolidaed for beer display. s,sh,z,zh,jh,ch h f p,,k,b,d,g hh dh n v m ng hv dx q nx w y l Vowels el r Cluser 1: obsruen 50% Cluser 2: sonoran Figure 1. The firs pariion 1 : [sonoran]
5 zh z sh s f ch h v jh dh d n m k p ng g b nx Cluser 11: fricaive 50% Cluser 12: sop Figure 2. The second pariion of obsruens: [fricaive] el w uw l r ao er ow ax axr oy ah aa aw ay uh eh ux ae ih ix ey iy y Cluser 21: back 50% Cluser 22: fron Figure 3. The hird pariion of sonorans: [back] y iy ix ih ey eh ae Cluser 221: high 50% Cluser 222: low Figure 4. The fourh pariion of fron sonorans: [high]
6 k p d g b n m ng nx Cluser 121: oral 50% Cluser 122: nasal Figure 5. The fifh pariion of sops: [nasal] The division of phoneic segmens a each spli suggess ha he splis may be inerpreed as gradien, disincive acousic feaures ha disinguish wo classes of sounds by he general shapes of heir specral envelopes. For convenience, hese feaures were named using linguisic erms. The percenages may depend on he disribuion of sounds in he raining daa se, bu hey reflec some general paerns of conexual variaion in phoneic segmens. Take he voiced labiodenal fricaive [v] as an example. The fac ha in coninuous speech, [v] is ofen produced as an approximan wihou significan fricaion noise is refleced by he ambiguous saus of [v] in Figure 1 and Figure 2. Anoher example is he disribuion of [w],[ô],[l] and [l " ]. They all fall ino he caegory of sonorans ha have a low F2, which may coincide wih a primiive phoneic caegory in early child language. To furher invesigae he naure of hese classes, an evaluaion was also conduced by creaing 6 reference labels for he 6 broad phoneic classes obained above: fricaive/affricae, plosive, nasal, back sonoran, high fron sonoran and cenral sonoran. These reference labels were compleely based on linguisic knowledge. The percenage of he daa-driven labels ha mach he knowledge-based labels was calculaed. Moreover, a es se was consruced from 7 speakers from he same TIMIT dialec area. The resuls are repored in Table 2. Considering ha he mixure model was learned in a compleely unsupervised manner, is performance on he phone classificaion ask was, as expeced, reasonable. The similariy beween he raining and es se suggess ha our resuls reflec general paerns raher han hose specific o he raining se. Daa se Speakers Phones Percenage Train Tes Table 2: Percenage of phones ha mach he knowledge-based reference labels 4 Discussion and fuure work The curren sudy demonsraes he possibiliy of using saisical ASR ools for he purpose of modelling acquisiion of phoneic caegories. This work will be exended in wo direcions. Firs, insead of using manually-ranscribed segmens, we would like o segmen he word signals and learn sound caegories a he same ime. Second, we would also like o replace phone-level opimizaion wih lexicon-level opimizaion, and highligh he connecion beween lexical growh and sub-lexical unis. 5 Acknowledgemens The auhor would like o hank Pa Keaing, Abeer Alwan and Yingnian Wu for heir commens.
7 References [1] J. Alon e al. Discovering clusers in moion ime-series daa, in Proc. CVPRC, [2] J. Maye, J. F. Werker, and L. Gerken, Infan sensiiviy o disribuional informaion can affec phoneic discriminaion, Cogniion, vol. 3, no. 82, pp. B101 B111, [3] B. Raj, R. Singh, and R. Sern, Auomaic generaion of subword unis for speech recogniion sysems, IEEE Trans. Speech and Audio Proc., vol. 10, no. 2, pp , Feb [4] K. Johnson, Speech percepion wihou speaker normalizaion: An exemplar model, in Talker Variabiliy in Speech Processing, K. Johnson and J. W. Mullennix, ed [5] F. Korkmazskiy, B. H. Juang, and F. Soong, Generalized mixure of HMM s for coninuous speech recogniion, in Proc. ICASSP97, pp , 1997 [6] L. Rabiner and B. H. Juang, Fundamenals of Speech Recogniion. Prenice Hall, 1993 [7] J. F. Werker and R. C. Tees, Cross-language speech percepion: Evidence for percepual reorganizaion during he firs year of life, Infan Behavior and Developmen, no. 7, pp , [8] S. Davis and P. Mermelsein, Comparison of parameric represenaions for monosyllabic word recogniion in coninuously spoken senence, IEEE Trans. ASSP, vol. 28, pp , [9] A. P. Dempser, N. M. Laird, and D. B. Rubin, Maximum liklihood from incomplee daa via he EM algorihm, J. Royal Sa. Soc., vol. B, no. 39, pp. 1 38, 1977.
Neural Network Model of the Backpropagation Algorithm
Neural Nework Model of he Backpropagaion Algorihm Rudolf Jakša Deparmen of Cyberneics and Arificial Inelligence Technical Universiy of Košice Lená 9, 4 Košice Slovakia jaksa@neuron.uke.sk Miroslav Karák
More informationFast Multi-task Learning for Query Spelling Correction
Fas Muli-ask Learning for Query Spelling Correcion Xu Sun Dep. of Saisical Science Cornell Universiy Ihaca, NY 14853 xusun@cornell.edu Anshumali Shrivasava Dep. of Compuer Science Cornell Universiy Ihaca,
More informationAn Effiecient Approach for Resource Auto-Scaling in Cloud Environments
Inernaional Journal of Elecrical and Compuer Engineering (IJECE) Vol. 6, No. 5, Ocober 2016, pp. 2415~2424 ISSN: 2088-8708, DOI: 10.11591/ijece.v6i5.10639 2415 An Effiecien Approach for Resource Auo-Scaling
More informationMore Accurate Question Answering on Freebase
More Accurae Quesion Answering on Freebase Hannah Bas, Elmar Haussmann Deparmen of Compuer Science Universiy of Freiburg 79110 Freiburg, Germany {bas, haussmann}@informaik.uni-freiburg.de ABSTRACT Real-world
More informationChannel Mapping using Bidirectional Long Short-Term Memory for Dereverberation in Hands-Free Voice Controlled Devices
Z. Zhang e al.: Channel Mapping using Bidirecional Long Shor-Term Memory for Dereverberaion in Hands-Free Voice Conrolled Devices 525 Channel Mapping using Bidirecional Long Shor-Term Memory for Dereverberaion
More informationOn the Formation of Phoneme Categories in DNN Acoustic Models
On the Formation of Phoneme Categories in DNN Acoustic Models Tasha Nagamine Department of Electrical Engineering, Columbia University T. Nagamine Motivation Large performance gap between humans and state-
More information1 Language universals
AS LX 500 Topics: Language Uniersals Fall 2010, Sepember 21 4a. Anisymmery 1 Language uniersals Subjec-erb agreemen and order Bach (1971) discusses wh-quesions across SO and SO languages, hypohesizing:...
More informationInformation Propagation for informing Special Population Subgroups about New Ground Transportation Services at Airports
Downloaded from ascelibrary.org by Basil Sephanis on 07/13/16. Copyrigh ASCE. For personal use only; all righs reserved. Informaion Propagaion for informing Special Populaion Subgroups abou New Ground
More informationMyLab & Mastering Business
MyLab & Masering Business Efficacy Repor 2013 MyLab & Masering: Business Efficacy Repor 2013 Edied by Michelle D. Speckler 2013 Pearson MyAccouningLab, MyEconLab, MyFinanceLab, MyMarkeingLab, and MyOMLab
More informationBAUM-WELCH TRAINING FOR SEGMENT-BASED SPEECH RECOGNITION. Han Shu, I. Lee Hetherington, and James Glass
BAUM-WELCH TRAINING FOR SEGMENT-BASED SPEECH RECOGNITION Han Shu, I. Lee Hetherington, and James Glass Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology Cambridge,
More informationLecture 9: Speech Recognition
EE E6820: Speech & Audio Processing & Recognition Lecture 9: Speech Recognition 1 Recognizing speech 2 Feature calculation Dan Ellis Michael Mandel 3 Sequence
More informationLearning Methods in Multilingual Speech Recognition
Learning Methods in Multilingual Speech Recognition Hui Lin Department of Electrical Engineering University of Washington Seattle, WA 98125 linhui@u.washington.edu Li Deng, Jasha Droppo, Dong Yu, and Alex
More informationA Comparison of DHMM and DTW for Isolated Digits Recognition System of Arabic Language
A Comparison of DHMM and DTW for Isolated Digits Recognition System of Arabic Language Z.HACHKAR 1,3, A. FARCHI 2, B.MOUNIR 1, J. EL ABBADI 3 1 Ecole Supérieure de Technologie, Safi, Morocco. zhachkar2000@yahoo.fr.
More informationSpeech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines
Speech Segmentation Using Probabilistic Phonetic Feature Hierarchy and Support Vector Machines Amit Juneja and Carol Espy-Wilson Department of Electrical and Computer Engineering University of Maryland,
More informationSpeech Recognition using Acoustic Landmarks and Binary Phonetic Feature Classifiers
Speech Recognition using Acoustic Landmarks and Binary Phonetic Feature Classifiers October 31, 2003 Amit Juneja Department of Electrical and Computer Engineering University of Maryland, College Park,
More informationUnvoiced Landmark Detection for Segment-based Mandarin Continuous Speech Recognition
Unvoiced Landmark Detection for Segment-based Mandarin Continuous Speech Recognition Hua Zhang, Yun Tang, Wenju Liu and Bo Xu National Laboratory of Pattern Recognition Institute of Automation, Chinese
More informationLikelihood-Maximizing Beamforming for Robust Hands-Free Speech Recognition
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Likelihood-Maximizing Beamforming for Robust Hands-Free Speech Recognition Seltzer, M.L.; Raj, B.; Stern, R.M. TR2004-088 December 2004 Abstract
More informationSpeech Recognition at ICSI: Broadcast News and beyond
Speech Recognition at ICSI: Broadcast News and beyond Dan Ellis International Computer Science Institute, Berkeley CA Outline 1 2 3 The DARPA Broadcast News task Aspects of ICSI
More informationAn Online Handwriting Recognition System For Turkish
An Online Handwriting Recognition System For Turkish Esra Vural, Hakan Erdogan, Kemal Oflazer, Berrin Yanikoglu Sabanci University, Tuzla, Istanbul, Turkey 34956 ABSTRACT Despite recent developments in
More informationSemi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration
INTERSPEECH 2013 Semi-Supervised GMM and DNN Acoustic Model Training with Multi-system Combination and Confidence Re-calibration Yan Huang, Dong Yu, Yifan Gong, and Chaojun Liu Microsoft Corporation, One
More informationProbabilistic Latent Semantic Analysis
Probabilistic Latent Semantic Analysis Thomas Hofmann Presentation by Ioannis Pavlopoulos & Andreas Damianou for the course of Data Mining & Exploration 1 Outline Latent Semantic Analysis o Need o Overview
More informationA NOVEL SCHEME FOR SPEAKER RECOGNITION USING A PHONETICALLY-AWARE DEEP NEURAL NETWORK. Yun Lei Nicolas Scheffer Luciana Ferrer Mitchell McLaren
A NOVEL SCHEME FOR SPEAKER RECOGNITION USING A PHONETICALLY-AWARE DEEP NEURAL NETWORK Yun Lei Nicolas Scheffer Luciana Ferrer Mitchell McLaren Speech Technology and Research Laboratory, SRI International,
More informationCharacterizing and Processing Robot-Directed Speech
Characterizing and Processing Robot-Directed Speech Paulina Varchavskaia, Paul Fitzpatrick, Cynthia Breazeal AI Lab, MIT, Cambridge, USA [paulina,paulfitz,cynthia]@ai.mit.edu Abstract. Speech directed
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationA study of speaker adaptation for DNN-based speech synthesis
A study of speaker adaptation for DNN-based speech synthesis Zhizheng Wu, Pawel Swietojanski, Christophe Veaux, Steve Renals, Simon King The Centre for Speech Technology Research (CSTR) University of Edinburgh,
More informationNatural Language Processing. George Konidaris
Natural Language Processing George Konidaris gdk@cs.brown.edu Fall 2017 Natural Language Processing Understanding spoken/written sentences in a natural language. Major area of research in AI. Why? Humans
More informationErkki Mäkinen State change languages as homomorphic images of Szilard languages
Erkki Mäkinen State change languages as homomorphic images of Szilard languages UNIVERSITY OF TAMPERE SCHOOL OF INFORMATION SCIENCES REPORTS IN INFORMATION SCIENCES 48 TAMPERE 2016 UNIVERSITY OF TAMPERE
More informationBUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING
BUILDING CONTEXT-DEPENDENT DNN ACOUSTIC MODELS USING KULLBACK-LEIBLER DIVERGENCE-BASED STATE TYING Gábor Gosztolya 1, Tamás Grósz 1, László Tóth 1, David Imseng 2 1 MTA-SZTE Research Group on Artificial
More informationLEARNING A SEMANTIC PARSER FROM SPOKEN UTTERANCES. Judith Gaspers and Philipp Cimiano
LEARNING A SEMANTIC PARSER FROM SPOKEN UTTERANCES Judith Gaspers and Philipp Cimiano Semantic Computing Group, CITEC, Bielefeld University {jgaspers cimiano}@cit-ec.uni-bielefeld.de ABSTRACT Semantic parsers
More informationBooks Effective Literacy Y5-8 Learning Through Talk Y4-8 Switch onto Spelling Spelling Under Scrutiny
By the End of Year 8 All Essential words lists 1-7 290 words Commonly Misspelt Words-55 working out more complex, irregular, and/or ambiguous words by using strategies such as inferring the unknown from
More informationModeling function word errors in DNN-HMM based LVCSR systems
Modeling function word errors in DNN-HMM based LVCSR systems Melvin Jose Johnson Premkumar, Ankur Bapna and Sree Avinash Parchuri Department of Computer Science Department of Electrical Engineering Stanford
More informationAnalysis of Emotion Recognition System through Speech Signal Using KNN & GMM Classifier
IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p- ISSN: 2278-8735.Volume 10, Issue 2, Ver.1 (Mar - Apr.2015), PP 55-61 www.iosrjournals.org Analysis of Emotion
More informationInvestigation on Mandarin Broadcast News Speech Recognition
Investigation on Mandarin Broadcast News Speech Recognition Mei-Yuh Hwang 1, Xin Lei 1, Wen Wang 2, Takahiro Shinozaki 1 1 Univ. of Washington, Dept. of Electrical Engineering, Seattle, WA 98195 USA 2
More informationSpeech Emotion Recognition Using Support Vector Machine
Speech Emotion Recognition Using Support Vector Machine Yixiong Pan, Peipei Shen and Liping Shen Department of Computer Technology Shanghai JiaoTong University, Shanghai, China panyixiong@sjtu.edu.cn,
More informationProceedings of Meetings on Acoustics
Proceedings of Meetings on Acoustics Volume 19, 2013 http://acousticalsociety.org/ ICA 2013 Montreal Montreal, Canada 2-7 June 2013 Speech Communication Session 2aSC: Linking Perception and Production
More informationA Neural Network GUI Tested on Text-To-Phoneme Mapping
A Neural Network GUI Tested on Text-To-Phoneme Mapping MAARTEN TROMPPER Universiteit Utrecht m.f.a.trompper@students.uu.nl Abstract Text-to-phoneme (T2P) mapping is a necessary step in any speech synthesis
More informationInternational Journal of Advanced Networking Applications (IJANA) ISSN No. :
International Journal of Advanced Networking Applications (IJANA) ISSN No. : 0975-0290 34 A Review on Dysarthric Speech Recognition Megha Rughani Department of Electronics and Communication, Marwadi Educational
More informationMalicious User Suppression for Cooperative Spectrum Sensing in Cognitive Radio Networks using Dixon s Outlier Detection Method
Malicious User Suppression for Cooperative Spectrum Sensing in Cognitive Radio Networks using Dixon s Outlier Detection Method Sanket S. Kalamkar and Adrish Banerjee Department of Electrical Engineering
More informationThe NICT/ATR speech synthesis system for the Blizzard Challenge 2008
The NICT/ATR speech synthesis system for the Blizzard Challenge 2008 Ranniery Maia 1,2, Jinfu Ni 1,2, Shinsuke Sakai 1,2, Tomoki Toda 1,3, Keiichi Tokuda 1,4 Tohru Shimizu 1,2, Satoshi Nakamura 1,2 1 National
More informationADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION
ADVANCES IN DEEP NEURAL NETWORK APPROACHES TO SPEAKER RECOGNITION Mitchell McLaren 1, Yun Lei 1, Luciana Ferrer 2 1 Speech Technology and Research Laboratory, SRI International, California, USA 2 Departamento
More informationSpeaker recognition using universal background model on YOHO database
Aalborg University Master Thesis project Speaker recognition using universal background model on YOHO database Author: Alexandre Majetniak Supervisor: Zheng-Hua Tan May 31, 2011 The Faculties of Engineering,
More informationClass-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification
Class-Discriminative Weighted Distortion Measure for VQ-Based Speaker Identification Tomi Kinnunen and Ismo Kärkkäinen University of Joensuu, Department of Computer Science, P.O. Box 111, 80101 JOENSUU,
More informationWHEN THERE IS A mismatch between the acoustic
808 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 14, NO. 3, MAY 2006 Optimization of Temporal Filters for Constructing Robust Features in Speech Recognition Jeih-Weih Hung, Member,
More informationAtypical Prosodic Structure as an Indicator of Reading Level and Text Difficulty
Atypical Prosodic Structure as an Indicator of Reading Level and Text Difficulty Julie Medero and Mari Ostendorf Electrical Engineering Department University of Washington Seattle, WA 98195 USA {jmedero,ostendor}@uw.edu
More informationSyntax Parsing 1. Grammars and parsing 2. Top-down and bottom-up parsing 3. Chart parsers 4. Bottom-up chart parsing 5. The Earley Algorithm
Syntax Parsing 1. Grammars and parsing 2. Top-down and bottom-up parsing 3. Chart parsers 4. Bottom-up chart parsing 5. The Earley Algorithm syntax: from the Greek syntaxis, meaning setting out together
More informationEli Yamamoto, Satoshi Nakamura, Kiyohiro Shikano. Graduate School of Information Science, Nara Institute of Science & Technology
ISCA Archive SUBJECTIVE EVALUATION FOR HMM-BASED SPEECH-TO-LIP MOVEMENT SYNTHESIS Eli Yamamoto, Satoshi Nakamura, Kiyohiro Shikano Graduate School of Information Science, Nara Institute of Science & Technology
More informationRobust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction
INTERSPEECH 2015 Robust Speech Recognition using DNN-HMM Acoustic Model Combining Noise-aware training with Spectral Subtraction Akihiro Abe, Kazumasa Yamamoto, Seiichi Nakagawa Department of Computer
More informationEffect of Word Complexity on L2 Vocabulary Learning
Effect of Word Complexity on L2 Vocabulary Learning Kevin Dela Rosa Language Technologies Institute Carnegie Mellon University 5000 Forbes Ave. Pittsburgh, PA kdelaros@cs.cmu.edu Maxine Eskenazi Language
More informationDOMAIN MISMATCH COMPENSATION FOR SPEAKER RECOGNITION USING A LIBRARY OF WHITENERS. Elliot Singer and Douglas Reynolds
DOMAIN MISMATCH COMPENSATION FOR SPEAKER RECOGNITION USING A LIBRARY OF WHITENERS Elliot Singer and Douglas Reynolds Massachusetts Institute of Technology Lincoln Laboratory {es,dar}@ll.mit.edu ABSTRACT
More informationUnsupervised Acoustic Model Training for Simultaneous Lecture Translation in Incremental and Batch Mode
Unsupervised Acoustic Model Training for Simultaneous Lecture Translation in Incremental and Batch Mode Diploma Thesis of Michael Heck At the Department of Informatics Karlsruhe Institute of Technology
More informationEdinburgh Research Explorer
Edinburgh Research Explorer Personalising speech-to-speech translation Citation for published version: Dines, J, Liang, H, Saheer, L, Gibson, M, Byrne, W, Oura, K, Tokuda, K, Yamagishi, J, King, S, Wester,
More informationPHONETIC DISTANCE BASED ACCENT CLASSIFIER TO IDENTIFY PRONUNCIATION VARIANTS AND OOV WORDS
PHONETIC DISTANCE BASED ACCENT CLASSIFIER TO IDENTIFY PRONUNCIATION VARIANTS AND OOV WORDS Akella Amarendra Babu 1 *, Ramadevi Yellasiri 2 and Akepogu Ananda Rao 3 1 JNIAS, JNT University Anantapur, Ananthapuramu,
More informationInternational Journal of Computational Intelligence and Informatics, Vol. 1 : No. 4, January - March 2012
Text-independent Mono and Cross-lingual Speaker Identification with the Constraint of Limited Data Nagaraja B G and H S Jayanna Department of Information Science and Engineering Siddaganga Institute of
More informationIn Workflow. Viewing: Last edit: 10/27/15 1:51 pm. Approval Path. Date Submi ed: 10/09/15 2:47 pm. 6. Coordinator Curriculum Management
1 of 5 11/19/2015 8:10 AM Date Submi ed: 10/09/15 2:47 pm Viewing: Last edit: 10/27/15 1:51 pm Changes proposed by: GODWINH In Workflow 1. BUSI Editor 2. BUSI Chair 3. BU Associate Dean 4. Biggio Center
More informationSpeech Synthesis in Noisy Environment by Enhancing Strength of Excitation and Formant Prominence
INTERSPEECH September,, San Francisco, USA Speech Synthesis in Noisy Environment by Enhancing Strength of Excitation and Formant Prominence Bidisha Sharma and S. R. Mahadeva Prasanna Department of Electronics
More informationUNIDIRECTIONAL LONG SHORT-TERM MEMORY RECURRENT NEURAL NETWORK WITH RECURRENT OUTPUT LAYER FOR LOW-LATENCY SPEECH SYNTHESIS. Heiga Zen, Haşim Sak
UNIDIRECTIONAL LONG SHORT-TERM MEMORY RECURRENT NEURAL NETWORK WITH RECURRENT OUTPUT LAYER FOR LOW-LATENCY SPEECH SYNTHESIS Heiga Zen, Haşim Sak Google fheigazen,hasimg@google.com ABSTRACT Long short-term
More informationACTIVITY: Comparing Combination Locks
5.4 Compound Events outcomes of one or more events? ow can you find the number of possible ACIVIY: Comparing Combination Locks Work with a partner. You are buying a combination lock. You have three choices.
More informationStatistical Parametric Speech Synthesis
Statistical Parametric Speech Synthesis Heiga Zen a,b,, Keiichi Tokuda a, Alan W. Black c a Department of Computer Science and Engineering, Nagoya Institute of Technology, Gokiso-cho, Showa-ku, Nagoya,
More informationIEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH
IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH 2009 423 Adaptive Multimodal Fusion by Uncertainty Compensation With Application to Audiovisual Speech Recognition George
More informationAUTOMATIC DETECTION OF PROLONGED FRICATIVE PHONEMES WITH THE HIDDEN MARKOV MODELS APPROACH 1. INTRODUCTION
JOURNAL OF MEDICAL INFORMATICS & TECHNOLOGIES Vol. 11/2007, ISSN 1642-6037 Marek WIŚNIEWSKI *, Wiesława KUNISZYK-JÓŹKOWIAK *, Elżbieta SMOŁKA *, Waldemar SUSZYŃSKI * HMM, recognition, speech, disorders
More informationPhonetic- and Speaker-Discriminant Features for Speaker Recognition. Research Project
Phonetic- and Speaker-Discriminant Features for Speaker Recognition by Lara Stoll Research Project Submitted to the Department of Electrical Engineering and Computer Sciences, University of California
More informationUniversityy. The content of
WORKING PAPER #31 An Evaluation of Empirical Bayes Estimation of Value Added Teacher Performance Measuress Cassandra M. Guarino, Indianaa Universityy Michelle Maxfield, Michigan State Universityy Mark
More informationBODY LANGUAGE ANIMATION SYNTHESIS FROM PROSODY AN HONORS THESIS SUBMITTED TO THE DEPARTMENT OF COMPUTER SCIENCE OF STANFORD UNIVERSITY
BODY LANGUAGE ANIMATION SYNTHESIS FROM PROSODY AN HONORS THESIS SUBMITTED TO THE DEPARTMENT OF COMPUTER SCIENCE OF STANFORD UNIVERSITY Sergey Levine Principal Adviser: Vladlen Koltun Secondary Adviser:
More informationBody-Conducted Speech Recognition and its Application to Speech Support System
Body-Conducted Speech Recognition and its Application to Speech Support System 4 Shunsuke Ishimitsu Hiroshima City University Japan 1. Introduction In recent years, speech recognition systems have been
More informationSmall-Vocabulary Speech Recognition for Resource- Scarce Languages
Small-Vocabulary Speech Recognition for Resource- Scarce Languages Fang Qiao School of Computer Science Carnegie Mellon University fqiao@andrew.cmu.edu Jahanzeb Sherwani iteleport LLC j@iteleportmobile.com
More informationSegmental Conditional Random Fields with Deep Neural Networks as Acoustic Models for First-Pass Word Recognition
Segmental Conditional Random Fields with Deep Neural Networks as Acoustic Models for First-Pass Word Recognition Yanzhang He, Eric Fosler-Lussier Department of Computer Science and Engineering The hio
More informationOn-the-Fly Customization of Automated Essay Scoring
Research Report On-the-Fly Customization of Automated Essay Scoring Yigal Attali Research & Development December 2007 RR-07-42 On-the-Fly Customization of Automated Essay Scoring Yigal Attali ETS, Princeton,
More informationSelf-Supervised Acquisition of Vowels in American English
Self-Supervised Acquisition of Vowels in American English Michael H. Coen MIT Computer Science and Artificial Intelligence Laboratory 32 Vassar Street Cambridge, MA 2139 mhcoen@csail.mit.edu Abstract This
More informationCS 598 Natural Language Processing
CS 598 Natural Language Processing Natural language is everywhere Natural language is everywhere Natural language is everywhere Natural language is everywhere!"#$%&'&()*+,-./012 34*5665756638/9:;< =>?@ABCDEFGHIJ5KL@
More informationRANKING AND UNRANKING LEFT SZILARD LANGUAGES. Erkki Mäkinen DEPARTMENT OF COMPUTER SCIENCE UNIVERSITY OF TAMPERE REPORT A ER E P S I M S
N S ER E P S I M TA S UN A I S I T VER RANKING AND UNRANKING LEFT SZILARD LANGUAGES Erkki Mäkinen DEPARTMENT OF COMPUTER SCIENCE UNIVERSITY OF TAMPERE REPORT A-1997-2 UNIVERSITY OF TAMPERE DEPARTMENT OF
More informationNCU IISR English-Korean and English-Chinese Named Entity Transliteration Using Different Grapheme Segmentation Approaches
NCU IISR English-Korean and English-Chinese Named Entity Transliteration Using Different Grapheme Segmentation Approaches Yu-Chun Wang Chun-Kai Wu Richard Tzong-Han Tsai Department of Computer Science
More information11/29/2010. Statistical Parsing. Statistical Parsing. Simple PCFG for ATIS English. Syntactic Disambiguation
tatistical Parsing (Following slides are modified from Prof. Raymond Mooney s slides.) tatistical Parsing tatistical parsing uses a probabilistic model of syntax in order to assign probabilities to each
More informationLetter-based speech synthesis
Letter-based speech synthesis Oliver Watts, Junichi Yamagishi, Simon King Centre for Speech Technology Research, University of Edinburgh, UK O.S.Watts@sms.ed.ac.uk jyamagis@inf.ed.ac.uk Simon.King@ed.ac.uk
More informationDigital Signal Processing: Speaker Recognition Final Report (Complete Version)
Digital Signal Processing: Speaker Recognition Final Report (Complete Version) Xinyu Zhou, Yuxin Wu, and Tiezheng Li Tsinghua University Contents 1 Introduction 1 2 Algorithms 2 2.1 VAD..................................................
More informationCorrective Feedback and Persistent Learning for Information Extraction
Corrective Feedback and Persistent Learning for Information Extraction Aron Culotta a, Trausti Kristjansson b, Andrew McCallum a, Paul Viola c a Dept. of Computer Science, University of Massachusetts,
More informationTEAM NEWSLETTER. Welton Primar y School SENIOR LEADERSHIP TEAM. School Improvement
Welton Primar y School February 2016 SENIOR LEADERSHIP TEAM NEWSLETTER SENIOR LEADERSHIP TEAM Nikki Pidgeon Head Teacher Sarah Millar Lead for Behaviour, SEAL and PE Laura Leitch Specialist Leader in Education,
More informationComparison of network inference packages and methods for multiple networks inference
Comparison of network inference packages and methods for multiple networks inference Nathalie Villa-Vialaneix http://www.nathalievilla.org nathalie.villa@univ-paris1.fr 1ères Rencontres R - BoRdeaux, 3
More informationSegregation of Unvoiced Speech from Nonspeech Interference
Technical Report OSU-CISRC-8/7-TR63 Department of Computer Science and Engineering The Ohio State University Columbus, OH 4321-1277 FTP site: ftp.cse.ohio-state.edu Login: anonymous Directory: pub/tech-report/27
More informationVowel mispronunciation detection using DNN acoustic models with cross-lingual training
INTERSPEECH 2015 Vowel mispronunciation detection using DNN acoustic models with cross-lingual training Shrikant Joshi, Nachiket Deo, Preeti Rao Department of Electrical Engineering, Indian Institute of
More informationReinforcement Learning by Comparing Immediate Reward
Reinforcement Learning by Comparing Immediate Reward Punit Pandey DeepshikhaPandey Dr. Shishir Kumar Abstract This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate
More informationACOUSTIC EVENT DETECTION IN REAL LIFE RECORDINGS
ACOUSTIC EVENT DETECTION IN REAL LIFE RECORDINGS Annamaria Mesaros 1, Toni Heittola 1, Antti Eronen 2, Tuomas Virtanen 1 1 Department of Signal Processing Tampere University of Technology Korkeakoulunkatu
More informationParsing of part-of-speech tagged Assamese Texts
IJCSI International Journal of Computer Science Issues, Vol. 6, No. 1, 2009 ISSN (Online): 1694-0784 ISSN (Print): 1694-0814 28 Parsing of part-of-speech tagged Assamese Texts Mirzanur Rahman 1, Sufal
More information2/15/13. POS Tagging Problem. Part-of-Speech Tagging. Example English Part-of-Speech Tagsets. More Details of the Problem. Typical Problem Cases
POS Tagging Problem Part-of-Speech Tagging L545 Spring 203 Given a sentence W Wn and a tagset of lexical categories, find the most likely tag T..Tn for each word in the sentence Example Secretariat/P is/vbz
More informationMandarin Lexical Tone Recognition: The Gating Paradigm
Kansas Working Papers in Linguistics, Vol. 0 (008), p. 8 Abstract Mandarin Lexical Tone Recognition: The Gating Paradigm Yuwen Lai and Jie Zhang University of Kansas Research on spoken word recognition
More informationYear 4 National Curriculum requirements
Year National Curriculum requirements Pupils should be taught to develop a range of personal strategies for learning new and irregular words* develop a range of personal strategies for spelling at the
More informationUsing Synonyms for Author Recognition
Using Synonyms for Author Recognition Abstract. An approach for identifying authors using synonym sets is presented. Drawing on modern psycholinguistic research, we justify the basis of our theory. Having
More informationAutoregressive product of multi-frame predictions can improve the accuracy of hybrid models
Autoregressive product of multi-frame predictions can improve the accuracy of hybrid models Navdeep Jaitly 1, Vincent Vanhoucke 2, Geoffrey Hinton 1,2 1 University of Toronto 2 Google Inc. ndjaitly@cs.toronto.edu,
More informationMARK 12 Reading II (Adaptive Remediation)
MARK 12 Reading II (Adaptive Remediation) The MARK 12 (Mastery. Acceleration. Remediation. K 12.) courses are for students in the third to fifth grades who are struggling readers. MARK 12 Reading II gives
More informationINVESTIGATION OF UNSUPERVISED ADAPTATION OF DNN ACOUSTIC MODELS WITH FILTER BANK INPUT
INVESTIGATION OF UNSUPERVISED ADAPTATION OF DNN ACOUSTIC MODELS WITH FILTER BANK INPUT Takuya Yoshioka,, Anton Ragni, Mark J. F. Gales Cambridge University Engineering Department, Cambridge, UK NTT Communication
More informationUsing Articulatory Features and Inferred Phonological Segments in Zero Resource Speech Processing
Using Articulatory Features and Inferred Phonological Segments in Zero Resource Speech Processing Pallavi Baljekar, Sunayana Sitaram, Prasanna Kumar Muthukumar, and Alan W Black Carnegie Mellon University,
More informationLecture 10: Reinforcement Learning
Lecture 1: Reinforcement Learning Cognitive Systems II - Machine Learning SS 25 Part III: Learning Programs and Strategies Q Learning, Dynamic Programming Lecture 1: Reinforcement Learning p. Motivation
More informationSEMI-SUPERVISED ENSEMBLE DNN ACOUSTIC MODEL TRAINING
SEMI-SUPERVISED ENSEMBLE DNN ACOUSTIC MODEL TRAINING Sheng Li 1, Xugang Lu 2, Shinsuke Sakai 1, Masato Mimura 1 and Tatsuya Kawahara 1 1 School of Informatics, Kyoto University, Sakyo-ku, Kyoto 606-8501,
More informationA new Dataset of Telephone-Based Human-Human Call-Center Interaction with Emotional Evaluation
A new Dataset of Telephone-Based Human-Human Call-Center Interaction with Emotional Evaluation Ingo Siegert 1, Kerstin Ohnemus 2 1 Cognitive Systems Group, Institute for Information Technology and Communications
More informationPhonology Revisited: Sor3ng Out the PH Factors in Reading and Spelling Development. Indiana, November, 2015
Phonology Revisited: Sor3ng Out the PH Factors in Reading and Spelling Development Indiana, November, 2015 Louisa C. Moats, Ed.D. (louisa.moats@gmail.com) meaning (semantics) discourse structure morphology
More informationNon intrusive multi-biometrics on a mobile device: a comparison of fusion techniques
Non intrusive multi-biometrics on a mobile device: a comparison of fusion techniques Lorene Allano 1*1, Andrew C. Morris 2, Harin Sellahewa 3, Sonia Garcia-Salicetti 1, Jacques Koreman 2, Sabah Jassim
More informationThe Perception of Nasalized Vowels in American English: An Investigation of On-line Use of Vowel Nasalization in Lexical Access
The Perception of Nasalized Vowels in American English: An Investigation of On-line Use of Vowel Nasalization in Lexical Access Joyce McDonough 1, Heike Lenhert-LeHouiller 1, Neil Bardhan 2 1 Linguistics
More informationOn Developing Acoustic Models Using HTK. M.A. Spaans BSc.
On Developing Acoustic Models Using HTK M.A. Spaans BSc. On Developing Acoustic Models Using HTK M.A. Spaans BSc. Delft, December 2004 Copyright c 2004 M.A. Spaans BSc. December, 2004. Faculty of Electrical
More informationWHY SOLVE PROBLEMS? INTERVIEWING COLLEGE FACULTY ABOUT THE LEARNING AND TEACHING OF PROBLEM SOLVING
From Proceedings of Physics Teacher Education Beyond 2000 International Conference, Barcelona, Spain, August 27 to September 1, 2000 WHY SOLVE PROBLEMS? INTERVIEWING COLLEGE FACULTY ABOUT THE LEARNING
More informationOCR for Arabic using SIFT Descriptors With Online Failure Prediction
OCR for Arabic using SIFT Descriptors With Online Failure Prediction Andrey Stolyarenko, Nachum Dershowitz The Blavatnik School of Computer Science Tel Aviv University Tel Aviv, Israel Email: stloyare@tau.ac.il,
More informationAMULTIAGENT system [1] can be defined as a group of
156 IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS PART C: APPLICATIONS AND REVIEWS, VOL. 38, NO. 2, MARCH 2008 A Comprehensive Survey of Multiagent Reinforcement Learning Lucian Buşoniu, Robert Babuška,
More information