Generalizing from a Few Examples: A Survey on Few-shot Learning. Wang, Y., Yao, Q., Kwok, J. T., & Ni, L. M. ACM Computing Surveys, 53(3):63:1–63:34, June, 2020. ![Generalizing from a Few Examples: A Survey on Few-shot Learning [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small. Recently, Few-shot Learning (FSL) is proposed to tackle this problem. Using prior knowledge, FSL can rapidly generalize to new tasks containing only a few samples with supervised information. In this article, we conduct a thorough survey to fully understand FSL. Starting from a formal definition of FSL, we distinguish FSL from several relevant machine learning problems. We then point out that the core issue in FSL is that the empirical risk minimizer is unreliable. Based on how prior knowledge can be used to handle this core issue, we categorize FSL methods from three perspectives: (i) data, which uses prior knowledge to augment the supervised experience; (ii) model, which uses prior knowledge to reduce the size of the hypothesis space; and (iii) algorithm, which uses prior knowledge to alter the search for the best hypothesis in the given hypothesis space. With this taxonomy, we review and discuss the pros and cons of each category. Promising directions, in the aspects of the FSL problem setups, techniques, applications, and theories, are also proposed to provide insights for future research.1
@article{wang_generalizing_2020,
title = {Generalizing from a {Few} {Examples}: {A} {Survey} on {Few}-shot {Learning}},
volume = {53},
issn = {0360-0300},
shorttitle = {Generalizing from a {Few} {Examples}},
url = {https://doi.org/10.1145/3386252},
doi = {10.1145/3386252},
abstract = {Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small. Recently, Few-shot Learning (FSL) is proposed to tackle this problem. Using prior knowledge, FSL can rapidly generalize to new tasks containing only a few samples with supervised information. In this article, we conduct a thorough survey to fully understand FSL. Starting from a formal definition of FSL, we distinguish FSL from several relevant machine learning problems. We then point out that the core issue in FSL is that the empirical risk minimizer is unreliable. Based on how prior knowledge can be used to handle this core issue, we categorize FSL methods from three perspectives: (i) data, which uses prior knowledge to augment the supervised experience; (ii) model, which uses prior knowledge to reduce the size of the hypothesis space; and (iii) algorithm, which uses prior knowledge to alter the search for the best hypothesis in the given hypothesis space. With this taxonomy, we review and discuss the pros and cons of each category. Promising directions, in the aspects of the FSL problem setups, techniques, applications, and theories, are also proposed to provide insights for future research.1},
number = {3},
urldate = {2022-04-25},
journal = {ACM Computing Surveys},
author = {Wang, Yaqing and Yao, Quanming and Kwok, James T. and Ni, Lionel M.},
month = jun,
year = {2020},
keywords = {Few-shot learning, low-shot learning, meta-learning, one-shot learning, prior knowledge, small sample learning},
pages = {63:1--63:34},
}
Downloads: 0
{"_id":"ACLdsXGY6f6wPbKCB","bibbaseid":"wang-yao-kwok-ni-generalizingfromafewexamplesasurveyonfewshotlearning-2020","author_short":["Wang, Y.","Yao, Q.","Kwok, J. T.","Ni, L. M."],"bibdata":{"bibtype":"article","type":"article","title":"Generalizing from a Few Examples: A Survey on Few-shot Learning","volume":"53","issn":"0360-0300","shorttitle":"Generalizing from a Few Examples","url":"https://doi.org/10.1145/3386252","doi":"10.1145/3386252","abstract":"Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small. Recently, Few-shot Learning (FSL) is proposed to tackle this problem. Using prior knowledge, FSL can rapidly generalize to new tasks containing only a few samples with supervised information. In this article, we conduct a thorough survey to fully understand FSL. Starting from a formal definition of FSL, we distinguish FSL from several relevant machine learning problems. We then point out that the core issue in FSL is that the empirical risk minimizer is unreliable. Based on how prior knowledge can be used to handle this core issue, we categorize FSL methods from three perspectives: (i) data, which uses prior knowledge to augment the supervised experience; (ii) model, which uses prior knowledge to reduce the size of the hypothesis space; and (iii) algorithm, which uses prior knowledge to alter the search for the best hypothesis in the given hypothesis space. With this taxonomy, we review and discuss the pros and cons of each category. Promising directions, in the aspects of the FSL problem setups, techniques, applications, and theories, are also proposed to provide insights for future research.1","number":"3","urldate":"2022-04-25","journal":"ACM Computing Surveys","author":[{"propositions":[],"lastnames":["Wang"],"firstnames":["Yaqing"],"suffixes":[]},{"propositions":[],"lastnames":["Yao"],"firstnames":["Quanming"],"suffixes":[]},{"propositions":[],"lastnames":["Kwok"],"firstnames":["James","T."],"suffixes":[]},{"propositions":[],"lastnames":["Ni"],"firstnames":["Lionel","M."],"suffixes":[]}],"month":"June","year":"2020","keywords":"Few-shot learning, low-shot learning, meta-learning, one-shot learning, prior knowledge, small sample learning","pages":"63:1–63:34","bibtex":"@article{wang_generalizing_2020,\n\ttitle = {Generalizing from a {Few} {Examples}: {A} {Survey} on {Few}-shot {Learning}},\n\tvolume = {53},\n\tissn = {0360-0300},\n\tshorttitle = {Generalizing from a {Few} {Examples}},\n\turl = {https://doi.org/10.1145/3386252},\n\tdoi = {10.1145/3386252},\n\tabstract = {Machine learning has been highly successful in data-intensive applications but is often hampered when the data set is small. Recently, Few-shot Learning (FSL) is proposed to tackle this problem. Using prior knowledge, FSL can rapidly generalize to new tasks containing only a few samples with supervised information. In this article, we conduct a thorough survey to fully understand FSL. Starting from a formal definition of FSL, we distinguish FSL from several relevant machine learning problems. We then point out that the core issue in FSL is that the empirical risk minimizer is unreliable. Based on how prior knowledge can be used to handle this core issue, we categorize FSL methods from three perspectives: (i) data, which uses prior knowledge to augment the supervised experience; (ii) model, which uses prior knowledge to reduce the size of the hypothesis space; and (iii) algorithm, which uses prior knowledge to alter the search for the best hypothesis in the given hypothesis space. With this taxonomy, we review and discuss the pros and cons of each category. Promising directions, in the aspects of the FSL problem setups, techniques, applications, and theories, are also proposed to provide insights for future research.1},\n\tnumber = {3},\n\turldate = {2022-04-25},\n\tjournal = {ACM Computing Surveys},\n\tauthor = {Wang, Yaqing and Yao, Quanming and Kwok, James T. and Ni, Lionel M.},\n\tmonth = jun,\n\tyear = {2020},\n\tkeywords = {Few-shot learning, low-shot learning, meta-learning, one-shot learning, prior knowledge, small sample learning},\n\tpages = {63:1--63:34},\n}\n\n\n\n","author_short":["Wang, Y.","Yao, Q.","Kwok, J. T.","Ni, L. M."],"key":"wang_generalizing_2020","id":"wang_generalizing_2020","bibbaseid":"wang-yao-kwok-ni-generalizingfromafewexamplesasurveyonfewshotlearning-2020","role":"author","urls":{"Paper":"https://doi.org/10.1145/3386252"},"keyword":["Few-shot learning","low-shot learning","meta-learning","one-shot learning","prior knowledge","small sample learning"],"metadata":{"authorlinks":{}},"html":""},"bibtype":"article","biburl":"https://bibbase.org/zotero/mh_lenguyen","dataSources":["iwKepCrWBps7ojhDx","pzyFFGWvxG2bs63zP","xpeFGiChAit2LNnty"],"keywords":["few-shot learning","low-shot learning","meta-learning","one-shot learning","prior knowledge","small sample learning"],"search_terms":["generalizing","few","examples","survey","few","shot","learning","wang","yao","kwok","ni"],"title":"Generalizing from a Few Examples: A Survey on Few-shot Learning","year":2020}