Large language models (LLMs): survey, technical frameworks, and future challenges. Kumar, P. Artificial Intelligence Review, 57(10):260, August, 2024.
Paper doi abstract bibtex Artificial intelligence (AI) has significantly impacted various fields. Large language models (LLMs) like GPT-4, BARD, PaLM, Megatron-Turing NLG, Jurassic-1 Jumbo etc., have contributed to our understanding and application of AI in these domains, along with natural language processing (NLP) techniques. This work provides a comprehensive overview of LLMs in the context of language modeling, word embeddings, and deep learning. It examines the application of LLMs in diverse fields including text generation, vision-language models, personalized learning, biomedicine, and code generation. The paper offers a detailed introduction and background on LLMs, facilitating a clear understanding of their fundamental ideas and concepts. Key language modeling architectures are also discussed, alongside a survey of recent works employing LLM methods for various downstream tasks across different domains. Additionally, it assesses the limitations of current approaches and highlights the need for new methodologies and potential directions for significant advancements in this field.
@article{kumar2024a,
title = {Large language models ({LLMs}): survey, technical frameworks, and future challenges},
volume = {57},
issn = {1573-7462},
shorttitle = {Large language models ({LLMs})},
url = {https://doi.org/10.1007/s10462-024-10888-y},
doi = {10.1007/s10462-024-10888-y},
abstract = {Artificial intelligence (AI) has significantly impacted various fields. Large language models (LLMs) like GPT-4, BARD, PaLM, Megatron-Turing NLG, Jurassic-1 Jumbo etc., have contributed to our understanding and application of AI in these domains, along with natural language processing (NLP) techniques. This work provides a comprehensive overview of LLMs in the context of language modeling, word embeddings, and deep learning. It examines the application of LLMs in diverse fields including text generation, vision-language models, personalized learning, biomedicine, and code generation. The paper offers a detailed introduction and background on LLMs, facilitating a clear understanding of their fundamental ideas and concepts. Key language modeling architectures are also discussed, alongside a survey of recent works employing LLM methods for various downstream tasks across different domains. Additionally, it assesses the limitations of current approaches and highlights the need for new methodologies and potential directions for significant advancements in this field.},
language = {en},
number = {10},
urldate = {2024-11-24},
journal = {Artificial Intelligence Review},
author = {Kumar, Pranjal},
month = aug,
year = {2024},
keywords = {Machine learning, Neural networks, Artificial Intelligence, Artificial intelligence, Generative language models, Large language models, Natural language processing},
pages = {260},
}
Downloads: 0
{"_id":"u6awiAgTaijKu8r2b","bibbaseid":"kumar-largelanguagemodelsllmssurveytechnicalframeworksandfuturechallenges-2024","author_short":["Kumar, P."],"bibdata":{"bibtype":"article","type":"article","title":"Large language models (LLMs): survey, technical frameworks, and future challenges","volume":"57","issn":"1573-7462","shorttitle":"Large language models (LLMs)","url":"https://doi.org/10.1007/s10462-024-10888-y","doi":"10.1007/s10462-024-10888-y","abstract":"Artificial intelligence (AI) has significantly impacted various fields. Large language models (LLMs) like GPT-4, BARD, PaLM, Megatron-Turing NLG, Jurassic-1 Jumbo etc., have contributed to our understanding and application of AI in these domains, along with natural language processing (NLP) techniques. This work provides a comprehensive overview of LLMs in the context of language modeling, word embeddings, and deep learning. It examines the application of LLMs in diverse fields including text generation, vision-language models, personalized learning, biomedicine, and code generation. The paper offers a detailed introduction and background on LLMs, facilitating a clear understanding of their fundamental ideas and concepts. Key language modeling architectures are also discussed, alongside a survey of recent works employing LLM methods for various downstream tasks across different domains. Additionally, it assesses the limitations of current approaches and highlights the need for new methodologies and potential directions for significant advancements in this field.","language":"en","number":"10","urldate":"2024-11-24","journal":"Artificial Intelligence Review","author":[{"propositions":[],"lastnames":["Kumar"],"firstnames":["Pranjal"],"suffixes":[]}],"month":"August","year":"2024","keywords":"Machine learning, Neural networks, Artificial Intelligence, Artificial intelligence, Generative language models, Large language models, Natural language processing","pages":"260","bibtex":"@article{kumar2024a,\n\ttitle = {Large language models ({LLMs}): survey, technical frameworks, and future challenges},\n\tvolume = {57},\n\tissn = {1573-7462},\n\tshorttitle = {Large language models ({LLMs})},\n\turl = {https://doi.org/10.1007/s10462-024-10888-y},\n\tdoi = {10.1007/s10462-024-10888-y},\n\tabstract = {Artificial intelligence (AI) has significantly impacted various fields. Large language models (LLMs) like GPT-4, BARD, PaLM, Megatron-Turing NLG, Jurassic-1 Jumbo etc., have contributed to our understanding and application of AI in these domains, along with natural language processing (NLP) techniques. This work provides a comprehensive overview of LLMs in the context of language modeling, word embeddings, and deep learning. It examines the application of LLMs in diverse fields including text generation, vision-language models, personalized learning, biomedicine, and code generation. The paper offers a detailed introduction and background on LLMs, facilitating a clear understanding of their fundamental ideas and concepts. Key language modeling architectures are also discussed, alongside a survey of recent works employing LLM methods for various downstream tasks across different domains. Additionally, it assesses the limitations of current approaches and highlights the need for new methodologies and potential directions for significant advancements in this field.},\n\tlanguage = {en},\n\tnumber = {10},\n\turldate = {2024-11-24},\n\tjournal = {Artificial Intelligence Review},\n\tauthor = {Kumar, Pranjal},\n\tmonth = aug,\n\tyear = {2024},\n\tkeywords = {Machine learning, Neural networks, Artificial Intelligence, Artificial intelligence, Generative language models, Large language models, Natural language processing},\n\tpages = {260},\n}\n\n","author_short":["Kumar, P."],"bibbaseid":"kumar-largelanguagemodelsllmssurveytechnicalframeworksandfuturechallenges-2024","role":"author","urls":{"Paper":"https://doi.org/10.1007/s10462-024-10888-y"},"keyword":["Machine learning","Neural networks","Artificial Intelligence","Artificial intelligence","Generative language models","Large language models","Natural language processing"],"metadata":{"authorlinks":{}},"downloads":0},"bibtype":"article","biburl":"https://bibbase.org/f/8yBxW5neHauDryu9w/LCNeuro Site.bib","dataSources":["ZHHpjMFTPYP8NqJif"],"keywords":["machine learning","neural networks","artificial intelligence","artificial intelligence","generative language models","large language models","natural language processing"],"search_terms":["large","language","models","llms","survey","technical","frameworks","future","challenges","kumar"],"title":"Large language models (LLMs): survey, technical frameworks, and future challenges","year":2024}