GPT-3 Displays Lower Social Intelligence Than Human Children. Chen, Y. National Collegiate Research Conference, Harvard University, January, 2021. abstract bibtex Generative Pre-trained Transformer 3 (GPT-3) [1] is a neural language model with broad language capabilities. It achieves state-of-theart or human-level performance in translation, question answering, and creative writing tasks. It is deployed in commercial products such as companion chatbots [2], however, the existing benchmarks do not specifically test for its level of social intelligence. In this project, we explore GPT-3’s social intelligence by adapting batteries and human baselines from psychology research. We found that: 1) In non-social control questions, GPT-3 performed at near-human level. 2) In social questions, it scored lower than both children and adults. 3) GPT-3’s performance did not significantly increase even when similar example’s solutions are provided.
@article{chen_gpt-3_2021,
title = {{GPT}-3 {Displays} {Lower} {Social} {Intelligence} {Than} {Human} {Children}},
abstract = {Generative Pre-trained Transformer 3 (GPT-3) [1] is a neural language model with broad language capabilities. It achieves state-of-theart or human-level performance in translation, question answering, and creative writing tasks. It is deployed in commercial products such as
companion chatbots [2], however, the existing benchmarks do not specifically test for its level of social intelligence. In this project, we explore
GPT-3’s social intelligence by adapting batteries and human baselines from psychology research. We found that: 1) In non-social control questions,
GPT-3 performed at near-human level. 2) In social questions, it scored lower than both children and adults. 3) GPT-3’s performance did not significantly increase even when similar example’s solutions are provided.},
journal = {National Collegiate Research Conference, Harvard University},
author = {Chen, Yifu},
month = jan,
year = {2021},
}
Downloads: 0
{"_id":"LR3NKsfYaku7qAyrH","bibbaseid":"chen-gpt3displayslowersocialintelligencethanhumanchildren-2021","author_short":["Chen, Y."],"bibdata":{"bibtype":"article","type":"article","title":"GPT-3 Displays Lower Social Intelligence Than Human Children","abstract":"Generative Pre-trained Transformer 3 (GPT-3) [1] is a neural language model with broad language capabilities. It achieves state-of-theart or human-level performance in translation, question answering, and creative writing tasks. It is deployed in commercial products such as companion chatbots [2], however, the existing benchmarks do not specifically test for its level of social intelligence. In this project, we explore GPT-3’s social intelligence by adapting batteries and human baselines from psychology research. We found that: 1) In non-social control questions, GPT-3 performed at near-human level. 2) In social questions, it scored lower than both children and adults. 3) GPT-3’s performance did not significantly increase even when similar example’s solutions are provided.","journal":"National Collegiate Research Conference, Harvard University","author":[{"propositions":[],"lastnames":["Chen"],"firstnames":["Yifu"],"suffixes":[]}],"month":"January","year":"2021","bibtex":"@article{chen_gpt-3_2021,\n\ttitle = {{GPT}-3 {Displays} {Lower} {Social} {Intelligence} {Than} {Human} {Children}},\n\tabstract = {Generative Pre-trained Transformer 3 (GPT-3) [1] is a neural language model with broad language capabilities. It achieves state-of-theart or human-level performance in translation, question answering, and creative writing tasks. It is deployed in commercial products such as\ncompanion chatbots [2], however, the existing benchmarks do not specifically test for its level of social intelligence. In this project, we explore\nGPT-3’s social intelligence by adapting batteries and human baselines from psychology research. We found that: 1) In non-social control questions,\nGPT-3 performed at near-human level. 2) In social questions, it scored lower than both children and adults. 3) GPT-3’s performance did not significantly increase even when similar example’s solutions are provided.},\n\tjournal = {National Collegiate Research Conference, Harvard University},\n\tauthor = {Chen, Yifu},\n\tmonth = jan,\n\tyear = {2021},\n}\n\n","author_short":["Chen, Y."],"key":"chen_gpt-3_2021","id":"chen_gpt-3_2021","bibbaseid":"chen-gpt3displayslowersocialintelligencethanhumanchildren-2021","role":"author","urls":{},"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://api.zotero.org/users/8295825/collections/MG3XR5KT/items?key=Y7rfld8S8JPx6dVsAPoXiFrY&format=bibtex&limit=100","dataSources":["jmbSxJ9M6o4AQrcDM","DE3TKJiMnMnFgFjjE"],"keywords":[],"search_terms":["gpt","displays","lower","social","intelligence","human","children","chen"],"title":"GPT-3 Displays Lower Social Intelligence Than Human Children","year":2021}