Production of filled pauses in concatenative speech synthesis based on the underlying fluent sentence. Adell, J., Escudero, D., & Bonafonte, A. Speech Communication, 54(3):459–476, 2012. doi abstract bibtex Until now, speech synthesis has mainly involved reading-style speech. Today, however, text-to-speech systems must provide a variety of styles because users expect these interfaces to do more than just read information. If synthetic voices must be integrated into future technology, they must simulate the way people talk instead of the way people read. Existing knowledge about how disfluencies occur has made it possible to propose a general framework for synthesising disfluencies. We propose a model based on the definition of disfluency and the concept of underlying fluent sentences. The model incorporates the parameters of standard prosodic models for fluent speech with local modifications of prosodic parameters near the interruption point. The constituents of the local models for filled pauses are derived from the analysis corpus, and constituent's prosodic parameters are predicted via linear regression analysis. We also discuss the implementation details of the model when used in a real speech synthesis system. Objective and perceptual evaluations showed that the proposed models outperformed the baseline model. Perceptual evaluations of the system showed that it is possible to synthesise filled pauses without decreasing the overall naturalness of the system, and users stated that the speech produced is even more natural than the one produced without filled pauses.
@article{adell_production_2012,
Author = {Adell, Jordi and Escudero, David and Bonafonte, Antonio},
Date = {2012},
Date-Modified = {2018-05-13 21:55:54 +0000},
Doi = {10.1016/j.specom.2011.10.010},
Journal = {Speech Communication},
Keywords = {disfluencies, f0, filled pauses, pause duration, pauses, phonetics, prosody, repetitions, Spanish, speaking styles, speech synthesis, speech technology, temporal factors, text-to-speech},
Number = {3},
Pages = {459--476},
Title = {Production of filled pauses in concatenative speech synthesis based on the underlying fluent sentence},
Volume = {54},
Year = {2012},
Abstract = {Until now, speech synthesis has mainly involved reading-style speech. Today, however, text-to-speech systems must provide a variety of styles because users expect these interfaces to do more than just read information. If synthetic voices must be integrated into future technology, they must simulate the way people talk instead of the way people read. Existing knowledge about how disfluencies occur has made it possible to propose a general framework for synthesising disfluencies. We propose a model based on the definition of disfluency and the concept of underlying fluent sentences. The model incorporates the parameters of standard prosodic models for fluent speech with local modifications of prosodic parameters near the interruption point. The constituents of the local models for filled pauses are derived from the analysis corpus, and constituent's prosodic parameters are predicted via linear regression analysis. We also discuss the implementation details of the model when used in a real speech synthesis system. Objective and perceptual evaluations showed that the proposed models outperformed the baseline model. Perceptual evaluations of the system showed that it is possible to synthesise filled pauses without decreasing the overall naturalness of the system, and users stated that the speech produced is even more natural than the one produced without filled pauses.},
Bdsk-File-1 = {YnBsaXN0MDDUAQIDBAUGJCVYJHZlcnNpb25YJG9iamVjdHNZJGFyY2hpdmVyVCR0b3ASAAGGoKgHCBMUFRYaIVUkbnVsbNMJCgsMDxJXTlMua2V5c1pOUy5vYmplY3RzViRjbGFzc6INDoACgAOiEBGABIAFgAdccmVsYXRpdmVQYXRoWWFsaWFzRGF0YV8QWi4uLy4uLy4uL0JpYmxpb2dyYWZpYS9QYXBlcnMvQWRlbGwvUHJvZHVjdGlvbiBvZiBmaWxsZWQgcGF1c2VzIGluIGNvbmNhdGVuYXRpdmUgc3BlZWNoLnBkZtIXCxgZV05TLmRhdGFPEQJIAAAAAAJIAAIAAAxNYWNpbnRvc2ggSEQAAAAAAAAAAAAAAAAAAADL9h/OSCsAABCGZaofUHJvZHVjdGlvbiBvZiBmaWxsIzEwODY2NUFELnBkZgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEIZlrdQJ0uUAAAAAAAAAAAADAAQAAAkgAAAAAAAAAAAAAAAAAAAABUFkZWxsAAAQAAgAAMv2A64AAAARAAgAANQJtsUAAAABABQQhmWqEIZljgAF/EcABfuYAADARgACAGNNYWNpbnRvc2ggSEQ6VXNlcnM6AGpvYXF1aW1fbGxpc3RlcnJpOgBCaWJsaW9ncmFmaWE6AFBhcGVyczoAQWRlbGw6AFByb2R1Y3Rpb24gb2YgZmlsbCMxMDg2NjVBRC5wZGYAAA4AcAA3AFAAcgBvAGQAdQBjAHQAaQBvAG4AIABvAGYAIABmAGkAbABsAGUAZAAgAHAAYQB1AHMAZQBzACAAaQBuACAAYwBvAG4AYwBhAHQAZQBuAGEAdABpAHYAZQAgAHMAcABlAGUAYwBoAC4AcABkAGYADwAaAAwATQBhAGMAaQBuAHQAbwBzAGgAIABIAEQAEgBpVXNlcnMvam9hcXVpbV9sbGlzdGVycmkvQmlibGlvZ3JhZmlhL1BhcGVycy9BZGVsbC9Qcm9kdWN0aW9uIG9mIGZpbGxlZCBwYXVzZXMgaW4gY29uY2F0ZW5hdGl2ZSBzcGVlY2gucGRmAAATAAEvAAAVAAIAGP//AACABtIbHB0eWiRjbGFzc25hbWVYJGNsYXNzZXNdTlNNdXRhYmxlRGF0YaMdHyBWTlNEYXRhWE5TT2JqZWN00hscIiNcTlNEaWN0aW9uYXJ5oiIgXxAPTlNLZXllZEFyY2hpdmVy0SYnVHJvb3SAAQAIABEAGgAjAC0AMgA3AEAARgBNAFUAYABnAGoAbABuAHEAcwB1AHcAhACOAOsA8AD4A0QDRgNLA1YDXwNtA3EDeAOBA4YDkwOWA6gDqwOwAAAAAAAAAgEAAAAAAAAAKAAAAAAAAAAAAAAAAAAAA7I=},
Bdsk-Url-1 = {http://dx.doi.org/10.1016/j.specom.2011.10.010}}
Downloads: 0
{"_id":"BwL7Qqpz3o3FBLxYy","bibbaseid":"adell-escudero-bonafonte-productionoffilledpausesinconcatenativespeechsynthesisbasedontheunderlyingfluentsentence-2012","downloads":0,"creationDate":"2016-09-21T09:08:37.890Z","title":"Production of filled pauses in concatenative speech synthesis based on the underlying fluent sentence","author_short":["Adell, J.","Escudero, D.","Bonafonte, A."],"year":2012,"bibtype":"article","biburl":"https://joaquimllisterri.cat/phonetics/ESTIVOZ/ESTIVOZ.bib","bibdata":{"bibtype":"article","type":"article","author":[{"propositions":[],"lastnames":["Adell"],"firstnames":["Jordi"],"suffixes":[]},{"propositions":[],"lastnames":["Escudero"],"firstnames":["David"],"suffixes":[]},{"propositions":[],"lastnames":["Bonafonte"],"firstnames":["Antonio"],"suffixes":[]}],"date":"2012","date-modified":"2018-05-13 21:55:54 +0000","doi":"10.1016/j.specom.2011.10.010","journal":"Speech Communication","keywords":"disfluencies, f0, filled pauses, pause duration, pauses, phonetics, prosody, repetitions, Spanish, speaking styles, speech synthesis, speech technology, temporal factors, text-to-speech","number":"3","pages":"459–476","title":"Production of filled pauses in concatenative speech synthesis based on the underlying fluent sentence","volume":"54","year":"2012","abstract":"Until now, speech synthesis has mainly involved reading-style speech. Today, however, text-to-speech systems must provide a variety of styles because users expect these interfaces to do more than just read information. If synthetic voices must be integrated into future technology, they must simulate the way people talk instead of the way people read. Existing knowledge about how disfluencies occur has made it possible to propose a general framework for synthesising disfluencies. We propose a model based on the definition of disfluency and the concept of underlying fluent sentences. The model incorporates the parameters of standard prosodic models for fluent speech with local modifications of prosodic parameters near the interruption point. The constituents of the local models for filled pauses are derived from the analysis corpus, and constituent's prosodic parameters are predicted via linear regression analysis. We also discuss the implementation details of the model when used in a real speech synthesis system. Objective and perceptual evaluations showed that the proposed models outperformed the baseline model. Perceptual evaluations of the system showed that it is possible to synthesise filled pauses without decreasing the overall naturalness of the system, and users stated that the speech produced is even more natural than the one produced without filled pauses.","bdsk-file-1":"YnBsaXN0MDDUAQIDBAUGJCVYJHZlcnNpb25YJG9iamVjdHNZJGFyY2hpdmVyVCR0b3ASAAGGoKgHCBMUFRYaIVUkbnVsbNMJCgsMDxJXTlMua2V5c1pOUy5vYmplY3RzViRjbGFzc6INDoACgAOiEBGABIAFgAdccmVsYXRpdmVQYXRoWWFsaWFzRGF0YV8QWi4uLy4uLy4uL0JpYmxpb2dyYWZpYS9QYXBlcnMvQWRlbGwvUHJvZHVjdGlvbiBvZiBmaWxsZWQgcGF1c2VzIGluIGNvbmNhdGVuYXRpdmUgc3BlZWNoLnBkZtIXCxgZV05TLmRhdGFPEQJIAAAAAAJIAAIAAAxNYWNpbnRvc2ggSEQAAAAAAAAAAAAAAAAAAADL9h/OSCsAABCGZaofUHJvZHVjdGlvbiBvZiBmaWxsIzEwODY2NUFELnBkZgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEIZlrdQJ0uUAAAAAAAAAAAADAAQAAAkgAAAAAAAAAAAAAAAAAAAABUFkZWxsAAAQAAgAAMv2A64AAAARAAgAANQJtsUAAAABABQQhmWqEIZljgAF/EcABfuYAADARgACAGNNYWNpbnRvc2ggSEQ6VXNlcnM6AGpvYXF1aW1fbGxpc3RlcnJpOgBCaWJsaW9ncmFmaWE6AFBhcGVyczoAQWRlbGw6AFByb2R1Y3Rpb24gb2YgZmlsbCMxMDg2NjVBRC5wZGYAAA4AcAA3AFAAcgBvAGQAdQBjAHQAaQBvAG4AIABvAGYAIABmAGkAbABsAGUAZAAgAHAAYQB1AHMAZQBzACAAaQBuACAAYwBvAG4AYwBhAHQAZQBuAGEAdABpAHYAZQAgAHMAcABlAGUAYwBoAC4AcABkAGYADwAaAAwATQBhAGMAaQBuAHQAbwBzAGgAIABIAEQAEgBpVXNlcnMvam9hcXVpbV9sbGlzdGVycmkvQmlibGlvZ3JhZmlhL1BhcGVycy9BZGVsbC9Qcm9kdWN0aW9uIG9mIGZpbGxlZCBwYXVzZXMgaW4gY29uY2F0ZW5hdGl2ZSBzcGVlY2gucGRmAAATAAEvAAAVAAIAGP//AACABtIbHB0eWiRjbGFzc25hbWVYJGNsYXNzZXNdTlNNdXRhYmxlRGF0YaMdHyBWTlNEYXRhWE5TT2JqZWN00hscIiNcTlNEaWN0aW9uYXJ5oiIgXxAPTlNLZXllZEFyY2hpdmVy0SYnVHJvb3SAAQAIABEAGgAjAC0AMgA3AEAARgBNAFUAYABnAGoAbABuAHEAcwB1AHcAhACOAOsA8AD4A0QDRgNLA1YDXwNtA3EDeAOBA4YDkwOWA6gDqwOwAAAAAAAAAgEAAAAAAAAAKAAAAAAAAAAAAAAAAAAAA7I=","bdsk-url-1":"http://dx.doi.org/10.1016/j.specom.2011.10.010","bibtex":"@article{adell_production_2012,\n\tAuthor = {Adell, Jordi and Escudero, David and Bonafonte, Antonio},\n\tDate = {2012},\n\tDate-Modified = {2018-05-13 21:55:54 +0000},\n\tDoi = {10.1016/j.specom.2011.10.010},\n\tJournal = {Speech Communication},\n\tKeywords = {disfluencies, f0, filled pauses, pause duration, pauses, phonetics, prosody, repetitions, Spanish, speaking styles, speech synthesis, speech technology, temporal factors, text-to-speech},\n\tNumber = {3},\n\tPages = {459--476},\n\tTitle = {Production of filled pauses in concatenative speech synthesis based on the underlying fluent sentence},\n\tVolume = {54},\n\tYear = {2012},\n\tAbstract = {Until now, speech synthesis has mainly involved reading-style speech. Today, however, text-to-speech systems must provide a variety of styles because users expect these interfaces to do more than just read information. If synthetic voices must be integrated into future technology, they must simulate the way people talk instead of the way people read. Existing knowledge about how disfluencies occur has made it possible to propose a general framework for synthesising disfluencies. We propose a model based on the definition of disfluency and the concept of underlying fluent sentences. The model incorporates the parameters of standard prosodic models for fluent speech with local modifications of prosodic parameters near the interruption point. The constituents of the local models for filled pauses are derived from the analysis corpus, and constituent's prosodic parameters are predicted via linear regression analysis. We also discuss the implementation details of the model when used in a real speech synthesis system. Objective and perceptual evaluations showed that the proposed models outperformed the baseline model. Perceptual evaluations of the system showed that it is possible to synthesise filled pauses without decreasing the overall naturalness of the system, and users stated that the speech produced is even more natural than the one produced without filled pauses.},\n\tBdsk-File-1 = {YnBsaXN0MDDUAQIDBAUGJCVYJHZlcnNpb25YJG9iamVjdHNZJGFyY2hpdmVyVCR0b3ASAAGGoKgHCBMUFRYaIVUkbnVsbNMJCgsMDxJXTlMua2V5c1pOUy5vYmplY3RzViRjbGFzc6INDoACgAOiEBGABIAFgAdccmVsYXRpdmVQYXRoWWFsaWFzRGF0YV8QWi4uLy4uLy4uL0JpYmxpb2dyYWZpYS9QYXBlcnMvQWRlbGwvUHJvZHVjdGlvbiBvZiBmaWxsZWQgcGF1c2VzIGluIGNvbmNhdGVuYXRpdmUgc3BlZWNoLnBkZtIXCxgZV05TLmRhdGFPEQJIAAAAAAJIAAIAAAxNYWNpbnRvc2ggSEQAAAAAAAAAAAAAAAAAAADL9h/OSCsAABCGZaofUHJvZHVjdGlvbiBvZiBmaWxsIzEwODY2NUFELnBkZgAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAEIZlrdQJ0uUAAAAAAAAAAAADAAQAAAkgAAAAAAAAAAAAAAAAAAAABUFkZWxsAAAQAAgAAMv2A64AAAARAAgAANQJtsUAAAABABQQhmWqEIZljgAF/EcABfuYAADARgACAGNNYWNpbnRvc2ggSEQ6VXNlcnM6AGpvYXF1aW1fbGxpc3RlcnJpOgBCaWJsaW9ncmFmaWE6AFBhcGVyczoAQWRlbGw6AFByb2R1Y3Rpb24gb2YgZmlsbCMxMDg2NjVBRC5wZGYAAA4AcAA3AFAAcgBvAGQAdQBjAHQAaQBvAG4AIABvAGYAIABmAGkAbABsAGUAZAAgAHAAYQB1AHMAZQBzACAAaQBuACAAYwBvAG4AYwBhAHQAZQBuAGEAdABpAHYAZQAgAHMAcABlAGUAYwBoAC4AcABkAGYADwAaAAwATQBhAGMAaQBuAHQAbwBzAGgAIABIAEQAEgBpVXNlcnMvam9hcXVpbV9sbGlzdGVycmkvQmlibGlvZ3JhZmlhL1BhcGVycy9BZGVsbC9Qcm9kdWN0aW9uIG9mIGZpbGxlZCBwYXVzZXMgaW4gY29uY2F0ZW5hdGl2ZSBzcGVlY2gucGRmAAATAAEvAAAVAAIAGP//AACABtIbHB0eWiRjbGFzc25hbWVYJGNsYXNzZXNdTlNNdXRhYmxlRGF0YaMdHyBWTlNEYXRhWE5TT2JqZWN00hscIiNcTlNEaWN0aW9uYXJ5oiIgXxAPTlNLZXllZEFyY2hpdmVy0SYnVHJvb3SAAQAIABEAGgAjAC0AMgA3AEAARgBNAFUAYABnAGoAbABuAHEAcwB1AHcAhACOAOsA8AD4A0QDRgNLA1YDXwNtA3EDeAOBA4YDkwOWA6gDqwOwAAAAAAAAAgEAAAAAAAAAKAAAAAAAAAAAAAAAAAAAA7I=},\n\tBdsk-Url-1 = {http://dx.doi.org/10.1016/j.specom.2011.10.010}}\n\n","author_short":["Adell, J.","Escudero, D.","Bonafonte, A."],"key":"adell_production_2012","id":"adell_production_2012","bibbaseid":"adell-escudero-bonafonte-productionoffilledpausesinconcatenativespeechsynthesisbasedontheunderlyingfluentsentence-2012","role":"author","urls":{},"keyword":["disfluencies","f0","filled pauses","pause duration","pauses","phonetics","prosody","repetitions","Spanish","speaking styles","speech synthesis","speech technology","temporal factors","text-to-speech"],"metadata":{"authorlinks":{}},"downloads":0,"html":""},"search_terms":["production","filled","pauses","concatenative","speech","synthesis","based","underlying","fluent","sentence","adell","escudero","bonafonte"],"keywords":["disfluencies","f0","filled pauses","pause duration","pauses","phonetics","prosody","repetitions","spanish","speaking styles","speech synthesis","speech technology","temporal factors","text-to-speech"],"authorIDs":[],"dataSources":["qBn3jEfYwFvzHJsYh","BrMmNtBqG9aDvpsZn"]}