Assessing BERT's Syntactic Abilities. Goldberg, Y. 2019.
Assessing BERT's Syntactic Abilities [link]Paper  abstract   bibtex   
I assess the extent to which the recently introduced BERT model captures English syntactic phenomena, using (1) naturally-occurring subject-verb agreement stimuli; (2) "coloreless green ideas" subject-verb agreement stimuli, in which content words in natural sentences are randomly replaced with words sharing the same part-of-speech and inflection; and (3) manually crafted stimuli for subject-verb agreement and reflexive anaphora phenomena. The BERT model performs remarkably well on all cases.
@article{Goldberg2019,
abstract = {I assess the extent to which the recently introduced BERT model captures English syntactic phenomena, using (1) naturally-occurring subject-verb agreement stimuli; (2) "coloreless green ideas" subject-verb agreement stimuli, in which content words in natural sentences are randomly replaced with words sharing the same part-of-speech and inflection; and (3) manually crafted stimuli for subject-verb agreement and reflexive anaphora phenomena. The BERT model performs remarkably well on all cases.},
archivePrefix = {arXiv},
arxivId = {1901.05287},
author = {Goldberg, Yoav},
eprint = {1901.05287},
file = {:Users/shanest/Documents/Library/Goldberg/Unknown/Goldberg - 2019 - Assessing BERT's Syntactic Abilities.pdf:pdf},
keywords = {method: psycholinguistic,phenomenon: number agreement},
pages = {2--5},
title = {{Assessing BERT's Syntactic Abilities}},
url = {http://arxiv.org/abs/1901.05287},
year = {2019}
}

Downloads: 0