Large Language Model for Qualitative Research - A Systematic Mapping Study. Barros, C. F., Azevedo, B. B., Neto, V. V. G., Kassab, M., Kalinowski, M., Nascimento, H. A. D., & Bandeira, M. C. G. S. P. In Proceedings of the 2nd IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering, of WSESE@ICSE '25, 2025. IEEE. Accepted for publication.
Author version abstract bibtex The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large Language Models (LLMs), powered by advanced generative AI, have emerged as transformative tools capable of automating and enhancing qualitative analysis. This study systematically maps the literature on the use of LLMs for qualitative research, exploring their application contexts, configurations, methodologies, and evaluation metrics. Findings reveal that LLMs are utilized across diverse fields, demonstrating the potential to automate processes traditionally requiring extensive human input. However, challenges such as reliance on prompt engineering, occasional inaccuracies, and contextual limitations remain significant barriers. This research highlights opportunities for integrating LLMs with human expertise, improving model robustness, and refining evaluation methodologies. By synthesizing trends and identifying research gaps, this study aims to guide future innovations in the application of LLMs for qualitative analysis.
@inproceedings{BarrosAGKKNB25,
author = {Barros, Cauã Ferreira and Azevedo, Bruna Borges and Neto, Valdemar Vicente Graciano and Kassab, Mohamad and Kalinowski, Marcos and Nascimento, Hugo Alexandre D. and Bandeira, Michelle C. G. S. P.},
title = {Large Language Model for Qualitative Research - A Systematic Mapping Study},
year = {2025},
isbn = {},
publisher = {IEEE},
urlAuthor_version = {http://www.inf.puc-rio.br/~kalinowski/publications/BarrosAGKKNB25.pdf},
doi = {},
abstract = {The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large Language Models (LLMs), powered by advanced generative AI, have emerged as transformative tools capable of automating and enhancing qualitative analysis. This study systematically maps the literature on the use of LLMs for qualitative research, exploring their application contexts, configurations, methodologies, and evaluation metrics. Findings reveal that LLMs are utilized across diverse fields, demonstrating the potential to automate processes traditionally requiring extensive human input. However, challenges such as reliance on prompt engineering, occasional inaccuracies, and contextual limitations remain significant barriers. This research highlights opportunities for integrating LLMs with human expertise, improving model robustness, and refining evaluation methodologies. By synthesizing trends and identifying research gaps, this study aims to guide future innovations in the application of LLMs for qualitative analysis.},
booktitle = {Proceedings of the 2nd IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering},
pages = {},
numpages = {8},
keywords = {Qualitative Research, Qualitative Analysis, Large Language Model, LLM, Software Engineering},
location = {Ottawa, Canada},
note = {<font color="red">Accepted for publication.</font>},
series = {WSESE@ICSE '25}
}
Downloads: 0
{"_id":"mTesR6S7XiDJDhGHw","bibbaseid":"barros-azevedo-neto-kassab-kalinowski-nascimento-bandeira-largelanguagemodelforqualitativeresearchasystematicmappingstudy-2025","author_short":["Barros, C. F.","Azevedo, B. B.","Neto, V. V. G.","Kassab, M.","Kalinowski, M.","Nascimento, H. A. D.","Bandeira, M. C. G. S. P."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","author":[{"propositions":[],"lastnames":["Barros"],"firstnames":["Cauã","Ferreira"],"suffixes":[]},{"propositions":[],"lastnames":["Azevedo"],"firstnames":["Bruna","Borges"],"suffixes":[]},{"propositions":[],"lastnames":["Neto"],"firstnames":["Valdemar","Vicente","Graciano"],"suffixes":[]},{"propositions":[],"lastnames":["Kassab"],"firstnames":["Mohamad"],"suffixes":[]},{"propositions":[],"lastnames":["Kalinowski"],"firstnames":["Marcos"],"suffixes":[]},{"propositions":[],"lastnames":["Nascimento"],"firstnames":["Hugo","Alexandre","D."],"suffixes":[]},{"propositions":[],"lastnames":["Bandeira"],"firstnames":["Michelle","C.","G.","S.","P."],"suffixes":[]}],"title":"Large Language Model for Qualitative Research - A Systematic Mapping Study","year":"2025","isbn":"","publisher":"IEEE","urlauthor_version":"http://www.inf.puc-rio.br/~kalinowski/publications/BarrosAGKKNB25.pdf","doi":"","abstract":"The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large Language Models (LLMs), powered by advanced generative AI, have emerged as transformative tools capable of automating and enhancing qualitative analysis. This study systematically maps the literature on the use of LLMs for qualitative research, exploring their application contexts, configurations, methodologies, and evaluation metrics. Findings reveal that LLMs are utilized across diverse fields, demonstrating the potential to automate processes traditionally requiring extensive human input. However, challenges such as reliance on prompt engineering, occasional inaccuracies, and contextual limitations remain significant barriers. This research highlights opportunities for integrating LLMs with human expertise, improving model robustness, and refining evaluation methodologies. By synthesizing trends and identifying research gaps, this study aims to guide future innovations in the application of LLMs for qualitative analysis.","booktitle":"Proceedings of the 2nd IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering","pages":"","numpages":"8","keywords":"Qualitative Research, Qualitative Analysis, Large Language Model, LLM, Software Engineering","location":"Ottawa, Canada","note":"<font color=\"red\">Accepted for publication.</font>","series":"WSESE@ICSE '25","bibtex":"@inproceedings{BarrosAGKKNB25,\r\n author = {Barros, Cauã Ferreira and Azevedo, Bruna Borges and Neto, Valdemar Vicente Graciano and Kassab, Mohamad and Kalinowski, Marcos and Nascimento, Hugo Alexandre D. and Bandeira, Michelle C. G. S. P.},\r\n title = {Large Language Model for Qualitative Research - A Systematic Mapping Study},\r\n year = {2025},\r\n isbn = {},\r\n publisher = {IEEE},\r\n urlAuthor_version = {http://www.inf.puc-rio.br/~kalinowski/publications/BarrosAGKKNB25.pdf}, \r\n doi = {},\r\n abstract = {The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large Language Models (LLMs), powered by advanced generative AI, have emerged as transformative tools capable of automating and enhancing qualitative analysis. This study systematically maps the literature on the use of LLMs for qualitative research, exploring their application contexts, configurations, methodologies, and evaluation metrics. Findings reveal that LLMs are utilized across diverse fields, demonstrating the potential to automate processes traditionally requiring extensive human input. However, challenges such as reliance on prompt engineering, occasional inaccuracies, and contextual limitations remain significant barriers. This research highlights opportunities for integrating LLMs with human expertise, improving model robustness, and refining evaluation methodologies. By synthesizing trends and identifying research gaps, this study aims to guide future innovations in the application of LLMs for qualitative analysis.},\r\n booktitle = {Proceedings of the 2nd IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering},\r\n pages = {},\r\n numpages = {8},\r\n keywords = {Qualitative Research, Qualitative Analysis, Large Language Model, LLM, Software Engineering},\r\n location = {Ottawa, Canada},\r\n note = {<font color=\"red\">Accepted for publication.</font>},\r\n series = {WSESE@ICSE '25}\r\n}\r\n\r\n","author_short":["Barros, C. F.","Azevedo, B. B.","Neto, V. V. G.","Kassab, M.","Kalinowski, M.","Nascimento, H. A. D.","Bandeira, M. C. G. S. P."],"key":"BarrosAGKKNB25","id":"BarrosAGKKNB25","bibbaseid":"barros-azevedo-neto-kassab-kalinowski-nascimento-bandeira-largelanguagemodelforqualitativeresearchasystematicmappingstudy-2025","role":"author","urls":{"Author version":"http://www.inf.puc-rio.br/~kalinowski/publications/BarrosAGKKNB25.pdf"},"keyword":["Qualitative Research","Qualitative Analysis","Large Language Model","LLM","Software Engineering"],"metadata":{"authorlinks":{}}},"bibtype":"inproceedings","biburl":"https://bibbase.org/network/files/KuRSiZJF8A6EZiujE","dataSources":["q7rgFjFgwoTSGkm3G","iSfhee4nHcHz4F2WQ"],"keywords":["qualitative research","qualitative analysis","large language model","llm","software engineering"],"search_terms":["large","language","model","qualitative","research","systematic","mapping","study","barros","azevedo","neto","kassab","kalinowski","nascimento","bandeira"],"title":"Large Language Model for Qualitative Research - A Systematic Mapping Study","year":2025}