Exploiting Feature Hierarchy for Transfer Learning in Named Entity Recognition. Arnold, A., Nallapati, R., & Cohen, W., W. Proceedings of ACL08 HLT, Association for Computational Linguistics, 2008.
Exploiting Feature Hierarchy for Transfer Learning in Named Entity Recognition [link]Website  abstract   bibtex   
We present a novel hierarchical prior struc- ture for supervised transfer learning in named entity recognition, motivated by the common structure of feature spaces for this task across natural language data sets. The problem of transfer learning, where information gained in one learning task is used to improve perfor- mance in another related task, is an important new area of research. In the subproblem of do- main adaptation, a model trained over a source domain is generalized to perform well on a re- lated target domain, where the two domains’ data are distributed similarly, but not identi- cally. We introduce the concept of groups of closely-related domains, called genres, and show how inter-genre adaptation is related to domain adaptation. We also examine multi- task learning, where two domains may be re- lated, but where the concept to be learned in each case is distinct. We show that our prior conveys useful information across domains, genres and tasks, while remaining robust to spurious signals not related to the target do- main and concept. We further show that our model generalizes a class of similar hierarchi- cal priors, smoothed to varying degrees, and lay the groundwork for future exploration in this area.
@article{
 title = {Exploiting Feature Hierarchy for Transfer Learning in Named Entity Recognition},
 type = {article},
 year = {2008},
 pages = {245-253},
 websites = {http://www.aclweb.org/anthology/P/P08/P08-1029},
 publisher = {Association for Computational Linguistics},
 id = {1d5127a5-df66-334d-9cea-56b3dda6a63a},
 created = {2012-02-28T00:52:49.000Z},
 file_attached = {false},
 profile_id = {5284e6aa-156c-3ce5-bc0e-b80cf09f3ef6},
 group_id = {066b42c8-f712-3fc3-abb2-225c158d2704},
 last_modified = {2017-03-14T14:36:19.698Z},
 tags = {named entity recognition},
 read = {false},
 starred = {false},
 authored = {false},
 confirmed = {true},
 hidden = {false},
 citation_key = {Arnold2008},
 private_publication = {false},
 abstract = {We present a novel hierarchical prior struc- ture for supervised transfer learning in named entity recognition, motivated by the common structure of feature spaces for this task across natural language data sets. The problem of transfer learning, where information gained in one learning task is used to improve perfor- mance in another related task, is an important new area of research. In the subproblem of do- main adaptation, a model trained over a source domain is generalized to perform well on a re- lated target domain, where the two domains’ data are distributed similarly, but not identi- cally. We introduce the concept of groups of closely-related domains, called genres, and show how inter-genre adaptation is related to domain adaptation. We also examine multi- task learning, where two domains may be re- lated, but where the concept to be learned in each case is distinct. We show that our prior conveys useful information across domains, genres and tasks, while remaining robust to spurious signals not related to the target do- main and concept. We further show that our model generalizes a class of similar hierarchi- cal priors, smoothed to varying degrees, and lay the groundwork for future exploration in this area.},
 bibtype = {article},
 author = {Arnold, Andrew and Nallapati, Ramesh and Cohen, William W},
 journal = {Proceedings of ACL08 HLT},
 number = {June}
}

Downloads: 0