NewsEdits: A News Article Revision Dataset and a Novel Document-Level Reasoning Challenge. Spangher, A., Ren, X., May, J., & Peng, N. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 127–157, Seattle, United States, July, 2022. Association for Computational Linguistics. Paper abstract bibtex News article revision histories provide clues to narrative and factual evolution in news articles. To facilitate analysis of this evolution, we present the first publicly available dataset of news revision histories, NewsEdits. Our dataset is large-scale and multilingual; it contains 1.2 million articles with 4.6 million versions from over 22 English- and French-language newspaper sources based in three countries, spanning 15 years of coverage (2006-2021).We define article-level edit actions: Addition, Deletion, Edit and Refactor, and develop a high-accuracy extraction algorithm to identify these actions. To underscore the factual nature of many edit actions, we conduct analyses showing that added and deleted sentences are more likely to contain updating events, main content and quotes than unchanged sentences. Finally, to explore whether edit actions are predictable, we introduce three novel tasks aimed at predicting actions performed during version updates. We show that these tasks are possible for expert humans but are challenging for large NLP models. We hope this can spur research in narrative framing and help provide predictive tools for journalists chasing breaking news.
@inproceedings{spangher-etal-2022-newsedits,
title = "{N}ews{E}dits: A News Article Revision Dataset and a Novel Document-Level Reasoning Challenge",
author = "Spangher, Alexander and
Ren, Xiang and
May, Jonathan and
Peng, Nanyun",
booktitle = "Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies",
month = jul,
year = "2022",
address = "Seattle, United States",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2022.naacl-main.10",
pages = "127--157",
abstract = "News article revision histories provide clues to narrative and factual evolution in news articles. To facilitate analysis of this evolution, we present the first publicly available dataset of news revision histories, NewsEdits. Our dataset is large-scale and multilingual; it contains 1.2 million articles with 4.6 million versions from over 22 English- and French-language newspaper sources based in three countries, spanning 15 years of coverage (2006-2021).We define article-level edit actions: Addition, Deletion, Edit and Refactor, and develop a high-accuracy extraction algorithm to identify these actions. To underscore the factual nature of many edit actions, we conduct analyses showing that added and deleted sentences are more likely to contain updating events, main content and quotes than unchanged sentences. Finally, to explore whether edit actions are predictable, we introduce three novel tasks aimed at predicting actions performed during version updates. We show that these tasks are possible for expert humans but are challenging for large NLP models. We hope this can spur research in narrative framing and help provide predictive tools for journalists chasing breaking news.",
}
Downloads: 0
{"_id":"H6RQ2dbarAwhwR9Ao","bibbaseid":"spangher-ren-may-peng-newseditsanewsarticlerevisiondatasetandanoveldocumentlevelreasoningchallenge-2022","author_short":["Spangher, A.","Ren, X.","May, J.","Peng, N."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","title":"NewsEdits: A News Article Revision Dataset and a Novel Document-Level Reasoning Challenge","author":[{"propositions":[],"lastnames":["Spangher"],"firstnames":["Alexander"],"suffixes":[]},{"propositions":[],"lastnames":["Ren"],"firstnames":["Xiang"],"suffixes":[]},{"propositions":[],"lastnames":["May"],"firstnames":["Jonathan"],"suffixes":[]},{"propositions":[],"lastnames":["Peng"],"firstnames":["Nanyun"],"suffixes":[]}],"booktitle":"Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","month":"July","year":"2022","address":"Seattle, United States","publisher":"Association for Computational Linguistics","url":"https://aclanthology.org/2022.naacl-main.10","pages":"127–157","abstract":"News article revision histories provide clues to narrative and factual evolution in news articles. To facilitate analysis of this evolution, we present the first publicly available dataset of news revision histories, NewsEdits. Our dataset is large-scale and multilingual; it contains 1.2 million articles with 4.6 million versions from over 22 English- and French-language newspaper sources based in three countries, spanning 15 years of coverage (2006-2021).We define article-level edit actions: Addition, Deletion, Edit and Refactor, and develop a high-accuracy extraction algorithm to identify these actions. To underscore the factual nature of many edit actions, we conduct analyses showing that added and deleted sentences are more likely to contain updating events, main content and quotes than unchanged sentences. Finally, to explore whether edit actions are predictable, we introduce three novel tasks aimed at predicting actions performed during version updates. We show that these tasks are possible for expert humans but are challenging for large NLP models. We hope this can spur research in narrative framing and help provide predictive tools for journalists chasing breaking news.","bibtex":"@inproceedings{spangher-etal-2022-newsedits,\n title = \"{N}ews{E}dits: A News Article Revision Dataset and a Novel Document-Level Reasoning Challenge\",\n author = \"Spangher, Alexander and\n Ren, Xiang and\n May, Jonathan and\n Peng, Nanyun\",\n booktitle = \"Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies\",\n month = jul,\n year = \"2022\",\n address = \"Seattle, United States\",\n publisher = \"Association for Computational Linguistics\",\n url = \"https://aclanthology.org/2022.naacl-main.10\",\n pages = \"127--157\",\n abstract = \"News article revision histories provide clues to narrative and factual evolution in news articles. To facilitate analysis of this evolution, we present the first publicly available dataset of news revision histories, NewsEdits. Our dataset is large-scale and multilingual; it contains 1.2 million articles with 4.6 million versions from over 22 English- and French-language newspaper sources based in three countries, spanning 15 years of coverage (2006-2021).We define article-level edit actions: Addition, Deletion, Edit and Refactor, and develop a high-accuracy extraction algorithm to identify these actions. To underscore the factual nature of many edit actions, we conduct analyses showing that added and deleted sentences are more likely to contain updating events, main content and quotes than unchanged sentences. Finally, to explore whether edit actions are predictable, we introduce three novel tasks aimed at predicting actions performed during version updates. We show that these tasks are possible for expert humans but are challenging for large NLP models. We hope this can spur research in narrative framing and help provide predictive tools for journalists chasing breaking news.\",\n}\n\n\n\n ","author_short":["Spangher, A.","Ren, X.","May, J.","Peng, N."],"key":"spangher-etal-2022-newsedits","id":"spangher-etal-2022-newsedits","bibbaseid":"spangher-ren-may-peng-newseditsanewsarticlerevisiondatasetandanoveldocumentlevelreasoningchallenge-2022","role":"author","urls":{"Paper":"https://aclanthology.org/2022.naacl-main.10"},"metadata":{"authorlinks":{}}},"bibtype":"inproceedings","biburl":"https://jonmay.github.io/webpage/cutelabname/cutelabname.bib","dataSources":["BnZgtH7HDESgbxKxt","hbZSwot2msWk92m5B","j3Qzx9HAAC6WtJDHS","5eM3sAccSEpjSDHHQ"],"keywords":[],"search_terms":["newsedits","news","article","revision","dataset","novel","document","level","reasoning","challenge","spangher","ren","may","peng"],"title":"NewsEdits: A News Article Revision Dataset and a Novel Document-Level Reasoning Challenge","year":2022}