Improving Language Understanding with Unsupervised Learning. .
Improving Language Understanding with Unsupervised Learning [link]Paper  abstract   bibtex   
We've obtained state-of-the-art results on a suite of diverse language tasks with a scalable, task-agnostic system, which we're also releasing. Our approach is a combination of two existing ideas: transformers and unsupervised pre-training. These results provide a convincing example that pairing supervised learning methods with unsupervised pre-training works very well;
@online{ImprovingLanguageUnderstanding2018,
  title = {Improving {{Language Understanding}} with {{Unsupervised Learning}}},
  url = {https://blog.openai.com/language-unsupervised/},
  abstract = {We've obtained state-of-the-art results on a suite of diverse language tasks with a scalable, task-agnostic system, which we're also releasing. Our approach is a combination of two existing ideas: transformers and unsupervised pre-training. These results provide a convincing example that pairing supervised learning methods with unsupervised pre-training works very well;},
  journaltitle = {OpenAI Blog},
  urldate = {2018-11-01},
  date = {2018-06-11T18:11:50.000Z},
  file = {/home/dimitri/Nextcloud/Zotero/storage/5Q7P832V/2018 - Improving Language Understanding with Unsupervised.pdf;/home/dimitri/Nextcloud/Zotero/storage/LSPHJAFJ/language-unsupervised.html}
}

Downloads: 0