Assessing the prosody of non-native speakers of English: Measures and feature sets

Assessing the prosody of non-native speakers of English: Measures and feature sets. Coutinho, E., Hönig, F., Zhang, Y., Hantke, S., Batliner, A., Nöth, E., & Schuller, B. In Calzolari, N., Choukri, K., Declerck, T., Goggi, S., Grobelnik, M., Maegaard, B., Mariani, J., Mazo, H., Moreno, A., Odijk, J., & Piperidis, S., editors, Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016, volume 645378, pages 1328-1332, 1, 2016. European Language Resources Association (ELRA).

Paper abstract bibtex

In this paper, we describe a new database with audio recordings of non-native (L2) speakers of English, and the perceptual evaluation experiment conducted with native English speakers for assessing the prosody of each recording. These annotations are then used to compute the gold standard using different methods, and a series of regression experiments is conducted to evaluate their impact on the performance of a regression model predicting the degree of naturalness of L2 speech. Further, we compare the relevance of different feature groups modelling prosody in general (without speech tempo), speech rate and pauses modelling speech tempo (fluency), voice quality, and a variety of spectral features. We also discuss the impact of various fusion strategies on performance. Overall, our results demonstrate that the prosody of non-native speakers of English as L2 can be reliably assessed using supra-segmental audio features; prosodic features seem to be the most important ones.

@inproceedings{
 title = {Assessing the prosody of non-native speakers of English: Measures and feature sets},
 type = {inproceedings},
 year = {2016},
 keywords = {article,conference},
 pages = {1328-1332},
 volume = {645378},
 issue = {645378},
 month = {1},
 publisher = {European Language Resources Association (ELRA)},
 institution = {Paris, France},
 id = {7d90838d-4b8a-30db-92b1-ccb7fa5a714b},
 created = {2024-08-09T12:19:57.850Z},
 file_attached = {true},
 profile_id = {ffa9027c-806a-3827-93a1-02c42eb146a1},
 group_id = {da2a8249-fdf4-3036-ba56-7358198a1600},
 last_modified = {2024-08-09T12:20:31.000Z},
 read = {false},
 starred = {false},
 authored = {false},
 confirmed = {true},
 hidden = {false},
 citation_key = {coutinho2016assessingsets},
 source_type = {CONF},
 private_publication = {false},
 abstract = {In this paper, we describe a new database with audio recordings of non-native (L2) speakers of English, and the perceptual evaluation experiment conducted with native English speakers for assessing the prosody of each recording. These annotations are then used to compute the gold standard using different methods, and a series of regression experiments is conducted to evaluate their impact on the performance of a regression model predicting the degree of naturalness of L2 speech. Further, we compare the relevance of different feature groups modelling prosody in general (without speech tempo), speech rate and pauses modelling speech tempo (fluency), voice quality, and a variety of spectral features. We also discuss the impact of various fusion strategies on performance. Overall, our results demonstrate that the prosody of non-native speakers of English as L2 can be reliably assessed using supra-segmental audio features; prosodic features seem to be the most important ones.},
 bibtype = {inproceedings},
 author = {Coutinho, Eduardo and Hönig, Florian and Zhang, Yue and Hantke, Simone and Batliner, Anton and Nöth, Elmar and Schuller, Björn},
 editor = {Calzolari, N and Choukri, K and Declerck, T and Goggi, S and Grobelnik, M and Maegaard, B and Mariani, J and Mazo, H and Moreno, A and Odijk, J and Piperidis, S},
 booktitle = {Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016}
}

Downloads: 0

{"_id":"YgxyA8z5XTMpQERNM","bibbaseid":"coutinho-hnig-zhang-hantke-batliner-nth-schuller-assessingtheprosodyofnonnativespeakersofenglishmeasuresandfeaturesets-2016","downloads":0,"creationDate":"2017-04-06T12:03:59.099Z","title":"Assessing the prosody of non-native speakers of English: Measures and feature sets","author_short":["Coutinho, E.","Hönig, F.","Zhang, Y.","Hantke, S.","Batliner, A.","Nöth, E.","Schuller, B."],"year":2016,"bibtype":"inproceedings","biburl":"https://bibbase.org/service/mendeley/ffa9027c-806a-3827-93a1-02c42eb146a1","bibdata":{"title":"Assessing the prosody of non-native speakers of English: Measures and feature sets","type":"inproceedings","year":"2016","keywords":"article,conference","pages":"1328-1332","volume":"645378","issue":"645378","month":"1","publisher":"European Language Resources Association (ELRA)","institution":"Paris, France","id":"7d90838d-4b8a-30db-92b1-ccb7fa5a714b","created":"2024-08-09T12:19:57.850Z","file_attached":"true","profile_id":"ffa9027c-806a-3827-93a1-02c42eb146a1","group_id":"da2a8249-fdf4-3036-ba56-7358198a1600","last_modified":"2024-08-09T12:20:31.000Z","read":false,"starred":false,"authored":false,"confirmed":"true","hidden":false,"citation_key":"coutinho2016assessingsets","source_type":"CONF","private_publication":false,"abstract":"In this paper, we describe a new database with audio recordings of non-native (L2) speakers of English, and the perceptual evaluation experiment conducted with native English speakers for assessing the prosody of each recording. These annotations are then used to compute the gold standard using different methods, and a series of regression experiments is conducted to evaluate their impact on the performance of a regression model predicting the degree of naturalness of L2 speech. Further, we compare the relevance of different feature groups modelling prosody in general (without speech tempo), speech rate and pauses modelling speech tempo (fluency), voice quality, and a variety of spectral features. We also discuss the impact of various fusion strategies on performance. Overall, our results demonstrate that the prosody of non-native speakers of English as L2 can be reliably assessed using supra-segmental audio features; prosodic features seem to be the most important ones.","bibtype":"inproceedings","author":"Coutinho, Eduardo and Hönig, Florian and Zhang, Yue and Hantke, Simone and Batliner, Anton and Nöth, Elmar and Schuller, Björn","editor":"Calzolari, N and Choukri, K and Declerck, T and Goggi, S and Grobelnik, M and Maegaard, B and Mariani, J and Mazo, H and Moreno, A and Odijk, J and Piperidis, S","booktitle":"Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016","bibtex":"@inproceedings{\n title = {Assessing the prosody of non-native speakers of English: Measures and feature sets},\n type = {inproceedings},\n year = {2016},\n keywords = {article,conference},\n pages = {1328-1332},\n volume = {645378},\n issue = {645378},\n month = {1},\n publisher = {European Language Resources Association (ELRA)},\n institution = {Paris, France},\n id = {7d90838d-4b8a-30db-92b1-ccb7fa5a714b},\n created = {2024-08-09T12:19:57.850Z},\n file_attached = {true},\n profile_id = {ffa9027c-806a-3827-93a1-02c42eb146a1},\n group_id = {da2a8249-fdf4-3036-ba56-7358198a1600},\n last_modified = {2024-08-09T12:20:31.000Z},\n read = {false},\n starred = {false},\n authored = {false},\n confirmed = {true},\n hidden = {false},\n citation_key = {coutinho2016assessingsets},\n source_type = {CONF},\n private_publication = {false},\n abstract = {In this paper, we describe a new database with audio recordings of non-native (L2) speakers of English, and the perceptual evaluation experiment conducted with native English speakers for assessing the prosody of each recording. These annotations are then used to compute the gold standard using different methods, and a series of regression experiments is conducted to evaluate their impact on the performance of a regression model predicting the degree of naturalness of L2 speech. Further, we compare the relevance of different feature groups modelling prosody in general (without speech tempo), speech rate and pauses modelling speech tempo (fluency), voice quality, and a variety of spectral features. We also discuss the impact of various fusion strategies on performance. Overall, our results demonstrate that the prosody of non-native speakers of English as L2 can be reliably assessed using supra-segmental audio features; prosodic features seem to be the most important ones.},\n bibtype = {inproceedings},\n author = {Coutinho, Eduardo and Hönig, Florian and Zhang, Yue and Hantke, Simone and Batliner, Anton and Nöth, Elmar and Schuller, Björn},\n editor = {Calzolari, N and Choukri, K and Declerck, T and Goggi, S and Grobelnik, M and Maegaard, B and Mariani, J and Mazo, H and Moreno, A and Odijk, J and Piperidis, S},\n booktitle = {Proceedings of the 10th International Conference on Language Resources and Evaluation, LREC 2016}\n}","author_short":["Coutinho, E.","Hönig, F.","Zhang, Y.","Hantke, S.","Batliner, A.","Nöth, E.","Schuller, B."],"editor_short":["Calzolari, N.","Choukri, K.","Declerck, T.","Goggi, S.","Grobelnik, M.","Maegaard, B.","Mariani, J.","Mazo, H.","Moreno, A.","Odijk, J.","Piperidis, S."],"urls":{"Paper":"https://bibbase.org/service/mendeley/ffa9027c-806a-3827-93a1-02c42eb146a1/file/5c7dd783-c795-f897-0b01-4ea271fd8c4f/2016___Coutinho_et_al___Assessing_the_prosody_of_non_native_speakers_of_English_Measures_and_feature_sets.pdf.pdf"},"biburl":"https://bibbase.org/service/mendeley/ffa9027c-806a-3827-93a1-02c42eb146a1","bibbaseid":"coutinho-hnig-zhang-hantke-batliner-nth-schuller-assessingtheprosodyofnonnativespeakersofenglishmeasuresandfeaturesets-2016","role":"author","keyword":["article","conference"],"metadata":{"authorlinks":{"coutinho, e":"https://bibbase.org/service/mendeley/ffa9027c-806a-3827-93a1-02c42eb146a1"}},"downloads":0},"search_terms":["assessing","prosody","non","native","speakers","english","measures","feature","sets","coutinho","hönig","zhang","hantke","batliner","nöth","schuller"],"keywords":["article","conference"],"authorIDs":["58e62eafe417243f58000008","58e63ebe8f93a1ae58000053","59b68df3dcf5fb104c000037","6Z276FjCJdxu2qttA","7HsugpwDMrLzay5kC","FShD3dRw9yuvcgPCs","HmyGQqdmpxNriPHXS","LxZfJ4SZafxuJzeKG","S2CzJg64apkJsPsHA","gSef4eEL8c5wuNF7w","hzjyyz7CdSRZyRptY","mo4CFXJ7ukAMT9nho","nxyiocLrG567rGYAm","oenDqaFMmkBMZtjuK","tE6ysWmRvSH5uoPFW","tvZgz2JnB9BN8znPF"],"dataSources":["Tcd3cXtdQsiKHPZsW","YqW8pMoihb7JazZcx","ya2CyA73rpZseyrZ8","HEzruaK9ZuLGaJrsP","jDf6YRbdcAMnNSFh6","2252seNhipfTmjEBQ"]}