Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech. Huang, F., Kwak, H., & An, J. arXiv.org, February, 2023. Place: Ithaca Publisher: Cornell University Library, arXiv.org
Paper abstract bibtex Recent studies have alarmed that many online hate speeches are implicit. With its subtle nature, the explainability of the detection of such hateful speech has been a challenging problem. In this work, we examine whether ChatGPT can be used for providing natural language explanations (NLEs) for implicit hateful speech detection. We design our prompt to elicit concise ChatGPT-generated NLEs and conduct user studies to evaluate their qualities by comparison with human-generated NLEs. We discuss the potential and limitations of ChatGPT in the context of implicit hateful speech research.
@article{huang_is_2023,
title = {Is {ChatGPT} better than {Human} {Annotators}? {Potential} and {Limitations} of {ChatGPT} in {Explaining} {Implicit} {Hate} {Speech}},
url = {https://www.proquest.com/working-papers/is-chatgpt-better-than-human-annotators-potential/docview/2777169330/se-2},
abstract = {Recent studies have alarmed that many online hate speeches are implicit. With its subtle nature, the explainability of the detection of such hateful speech has been a challenging problem. In this work, we examine whether ChatGPT can be used for providing natural language explanations (NLEs) for implicit hateful speech detection. We design our prompt to elicit concise ChatGPT-generated NLEs and conduct user studies to evaluate their qualities by comparison with human-generated NLEs. We discuss the potential and limitations of ChatGPT in the context of implicit hateful speech research.},
language = {English},
journal = {arXiv.org},
author = {Huang, Fan and Kwak, Haewoon and An, Jisun},
month = feb,
year = {2023},
note = {Place: Ithaca
Publisher: Cornell University Library, arXiv.org},
keywords = {Chatbots, Business And Economics--Banking And Finance, Computation and Language, Human-Computer Interaction},
annote = {Copyright - © 2023. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.},
annote = {Última actualización - 2023-02-17},
}
Downloads: 0
{"_id":"9SFZBk5HyWfxnEKWX","bibbaseid":"huang-kwak-an-ischatgptbetterthanhumanannotatorspotentialandlimitationsofchatgptinexplainingimplicithatespeech-2023","author_short":["Huang, F.","Kwak, H.","An, J."],"bibdata":{"bibtype":"article","type":"article","title":"Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech","url":"https://www.proquest.com/working-papers/is-chatgpt-better-than-human-annotators-potential/docview/2777169330/se-2","abstract":"Recent studies have alarmed that many online hate speeches are implicit. With its subtle nature, the explainability of the detection of such hateful speech has been a challenging problem. In this work, we examine whether ChatGPT can be used for providing natural language explanations (NLEs) for implicit hateful speech detection. We design our prompt to elicit concise ChatGPT-generated NLEs and conduct user studies to evaluate their qualities by comparison with human-generated NLEs. We discuss the potential and limitations of ChatGPT in the context of implicit hateful speech research.","language":"English","journal":"arXiv.org","author":[{"propositions":[],"lastnames":["Huang"],"firstnames":["Fan"],"suffixes":[]},{"propositions":[],"lastnames":["Kwak"],"firstnames":["Haewoon"],"suffixes":[]},{"propositions":[],"lastnames":["An"],"firstnames":["Jisun"],"suffixes":[]}],"month":"February","year":"2023","note":"Place: Ithaca Publisher: Cornell University Library, arXiv.org","keywords":"Chatbots, Business And Economics–Banking And Finance, Computation and Language, Human-Computer Interaction","annote":"Última actualización - 2023-02-17","bibtex":"@article{huang_is_2023,\n\ttitle = {Is {ChatGPT} better than {Human} {Annotators}? {Potential} and {Limitations} of {ChatGPT} in {Explaining} {Implicit} {Hate} {Speech}},\n\turl = {https://www.proquest.com/working-papers/is-chatgpt-better-than-human-annotators-potential/docview/2777169330/se-2},\n\tabstract = {Recent studies have alarmed that many online hate speeches are implicit. With its subtle nature, the explainability of the detection of such hateful speech has been a challenging problem. In this work, we examine whether ChatGPT can be used for providing natural language explanations (NLEs) for implicit hateful speech detection. We design our prompt to elicit concise ChatGPT-generated NLEs and conduct user studies to evaluate their qualities by comparison with human-generated NLEs. We discuss the potential and limitations of ChatGPT in the context of implicit hateful speech research.},\n\tlanguage = {English},\n\tjournal = {arXiv.org},\n\tauthor = {Huang, Fan and Kwak, Haewoon and An, Jisun},\n\tmonth = feb,\n\tyear = {2023},\n\tnote = {Place: Ithaca\nPublisher: Cornell University Library, arXiv.org},\n\tkeywords = {Chatbots, Business And Economics--Banking And Finance, Computation and Language, Human-Computer Interaction},\n\tannote = {Copyright - © 2023. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.},\n\tannote = {Última actualización - 2023-02-17},\n}\n\n","author_short":["Huang, F.","Kwak, H.","An, J."],"key":"huang_is_2023","id":"huang_is_2023","bibbaseid":"huang-kwak-an-ischatgptbetterthanhumanannotatorspotentialandlimitationsofchatgptinexplainingimplicithatespeech-2023","role":"author","urls":{"Paper":"https://www.proquest.com/working-papers/is-chatgpt-better-than-human-annotators-potential/docview/2777169330/se-2"},"keyword":["Chatbots","Business And Economics–Banking And Finance","Computation and Language","Human-Computer Interaction"],"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://bibbase.org/network/files/22WYpzbBvi3hDHX7Y","dataSources":["cYu6uhMkeFHgRrEty","hLMh7bwHyFsPNWAEL","LKW3iRvnztCpLNTW7","TLD9JxqHfSQQ4r268","X9BvByJrC3kGJexn8","iovNvcnNYDGJcuMq2","NjZJ5ZmWhTtMZBfje","WKomETnBq4AHwocGn"],"keywords":["chatbots","business and economics–banking and finance","computation and language","human-computer interaction"],"search_terms":["chatgpt","better","human","annotators","potential","limitations","chatgpt","explaining","implicit","hate","speech","huang","kwak","an"],"title":"Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speech","year":2023}