Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts. Takmaz, E., Giulianelli, M., Pezzelle, S., Sinclair, A., & Fernández, R. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 4350–4368, Online, November, 2020. Association for Computational Linguistics.
Paper
Dataset doi abstract bibtex 25 downloads Dialogue participants often refer to entities or situations repeatedly within a conversation, which contributes to its cohesiveness. Subsequent references exploit the common ground accumulated by the interlocutors and hence have several interesting properties, namely, they tend to be shorter and reuse expressions that were effective in previous mentions. In this paper, we tackle the generation of first and subsequent references in visually grounded dialogue. We propose a generation model that produces referring utterances grounded in both the visual and the conversational context. To assess the referring effectiveness of its output, we also implement a reference resolution system. Our experiments and analyses show that the model produces better, more effective referring utterances than a model not grounded in the dialogue context, and generates subsequent references that exhibit linguistic patterns akin to humans.
@inproceedings{takmaz-etal-2020-refer,
title = "{R}efer, {R}euse, {R}educe: {G}enerating {S}ubsequent {R}eferences in {V}isual and {C}onversational {C}ontexts",
author = "Takmaz, Ece and
Giulianelli, Mario and
Pezzelle, Sandro and
Sinclair, Arabella and
Fern{\'a}ndez, Raquel",
booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)",
month = nov,
year = "2020",
address = "Online",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2020.emnlp-main.353.pdf",
url_dataset = "https://dmg-photobook.github.io",
doi = "10.18653/v1/2020.emnlp-main.353",
pages = "4350--4368",
abstract = "Dialogue participants often refer to entities or situations repeatedly within a conversation, which contributes to its cohesiveness. Subsequent references exploit the common ground accumulated by the interlocutors and hence have several interesting properties, namely, they tend to be shorter and reuse expressions that were effective in previous mentions. In this paper, we tackle the generation of first and subsequent references in visually grounded dialogue. We propose a generation model that produces referring utterances grounded in both the visual and the conversational context. To assess the referring effectiveness of its output, we also implement a reference resolution system. Our experiments and analyses show that the model produces better, more effective referring utterances than a model not grounded in the dialogue context, and generates subsequent references that exhibit linguistic patterns akin to humans.",
}
Downloads: 25
{"_id":"4PdiezrKbPBqKTdFx","bibbaseid":"takmaz-giulianelli-pezzelle-sinclair-fernndez-referreusereducegeneratingsubsequentreferencesinvisualandconversationalcontexts-2020","author_short":["Takmaz, E.","Giulianelli, M.","Pezzelle, S.","Sinclair, A.","Fernández, R."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","title":"Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts","author":[{"propositions":[],"lastnames":["Takmaz"],"firstnames":["Ece"],"suffixes":[]},{"propositions":[],"lastnames":["Giulianelli"],"firstnames":["Mario"],"suffixes":[]},{"propositions":[],"lastnames":["Pezzelle"],"firstnames":["Sandro"],"suffixes":[]},{"propositions":[],"lastnames":["Sinclair"],"firstnames":["Arabella"],"suffixes":[]},{"propositions":[],"lastnames":["Fernández"],"firstnames":["Raquel"],"suffixes":[]}],"booktitle":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","month":"November","year":"2020","address":"Online","publisher":"Association for Computational Linguistics","url":"https://aclanthology.org/2020.emnlp-main.353.pdf","url_dataset":"https://dmg-photobook.github.io","doi":"10.18653/v1/2020.emnlp-main.353","pages":"4350–4368","abstract":"Dialogue participants often refer to entities or situations repeatedly within a conversation, which contributes to its cohesiveness. Subsequent references exploit the common ground accumulated by the interlocutors and hence have several interesting properties, namely, they tend to be shorter and reuse expressions that were effective in previous mentions. In this paper, we tackle the generation of first and subsequent references in visually grounded dialogue. We propose a generation model that produces referring utterances grounded in both the visual and the conversational context. To assess the referring effectiveness of its output, we also implement a reference resolution system. Our experiments and analyses show that the model produces better, more effective referring utterances than a model not grounded in the dialogue context, and generates subsequent references that exhibit linguistic patterns akin to humans.","bibtex":"@inproceedings{takmaz-etal-2020-refer,\n title = \"{R}efer, {R}euse, {R}educe: {G}enerating {S}ubsequent {R}eferences in {V}isual and {C}onversational {C}ontexts\",\n author = \"Takmaz, Ece and\n Giulianelli, Mario and\n Pezzelle, Sandro and\n Sinclair, Arabella and\n Fern{\\'a}ndez, Raquel\",\n booktitle = \"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)\",\n month = nov,\n year = \"2020\",\n address = \"Online\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2020.emnlp-main.353.pdf\",\n url_dataset = \"https://dmg-photobook.github.io\",\n doi = \"10.18653/v1/2020.emnlp-main.353\",\n pages = \"4350--4368\",\n abstract = \"Dialogue participants often refer to entities or situations repeatedly within a conversation, which contributes to its cohesiveness. Subsequent references exploit the common ground accumulated by the interlocutors and hence have several interesting properties, namely, they tend to be shorter and reuse expressions that were effective in previous mentions. In this paper, we tackle the generation of first and subsequent references in visually grounded dialogue. We propose a generation model that produces referring utterances grounded in both the visual and the conversational context. To assess the referring effectiveness of its output, we also implement a reference resolution system. Our experiments and analyses show that the model produces better, more effective referring utterances than a model not grounded in the dialogue context, and generates subsequent references that exhibit linguistic patterns akin to humans.\",\n}\n\n","author_short":["Takmaz, E.","Giulianelli, M.","Pezzelle, S.","Sinclair, A.","Fernández, R."],"key":"takmaz-etal-2020-refer","id":"takmaz-etal-2020-refer","bibbaseid":"takmaz-giulianelli-pezzelle-sinclair-fernndez-referreusereducegeneratingsubsequentreferencesinvisualandconversationalcontexts-2020","role":"author","urls":{"Paper":"https://aclanthology.org/2020.emnlp-main.353.pdf"," dataset":"https://dmg-photobook.github.io"},"metadata":{"authorlinks":{}},"downloads":25},"bibtype":"inproceedings","biburl":"https://raw.githubusercontent.com/dmg-illc/dmg/master/bibbase/dmg-publications.bib","dataSources":["QzguzWy2fZZbXuFSd","8c2d6EwyPFHuHGcFK","42BzLCGMaDCpG5rq2","sXg85ARyqxCxh4Dnn","6kPjQnETwFh79T4cD","9oqC5Gf3cYbHHXtTa"],"keywords":[],"search_terms":["refer","reuse","reduce","generating","subsequent","references","visual","conversational","contexts","takmaz","giulianelli","pezzelle","sinclair","fernández"],"title":"Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts","year":2020,"downloads":25}