The Prompt Report: A Systematic Survey of Prompting Techniques

The Prompt Report: A Systematic Survey of Prompting Techniques. Schulhoff, S., Ilie, M., Balepur, N., Kahadze, K., Liu, A., Si, C., Li, Y., Gupta, A., Han, H., Schulhoff, S., Dulepet, P. S., Vidyadhara, S., Ki, D., Agrawal, S., Pham, C., Kroiz, G., Li, F., Tao, H., Srivastava, A., Da Costa, H., Gupta, S., Rogers, M. L., Goncearenco, I., Sarli, G., Galynker, I., Peskoff, D., Carpuat, M., White, J., Anadkat, S., Hoyle, A., & Resnik, P. June, 2024. arXiv:2406.06608 [cs]

Paper abstract bibtex

Generative Artificial Intelligence (GenAI) systems are being increasingly deployed across all parts of industry and research settings. Developers and end users interact with these systems through the use of prompting or prompt engineering. While prompting is a widespread and highly researched concept, there exists conflicting terminology and a poor ontological understanding of what constitutes a prompt due to the area's nascency. This paper establishes a structured understanding of prompts, by assembling a taxonomy of prompting techniques and analyzing their use. We present a comprehensive vocabulary of 33 vocabulary terms, a taxonomy of 58 text-only prompting techniques, and 40 techniques for other modalities. We further present a meta-analysis of the entire literature on natural language prefix-prompting.

@misc{schulhoff_prompt_2024,
	title = {The {Prompt} {Report}: {A} {Systematic} {Survey} of {Prompting} {Techniques}},
	shorttitle = {The {Prompt} {Report}},
	url = {http://arxiv.org/abs/2406.06608},
	abstract = {Generative Artificial Intelligence (GenAI) systems are being increasingly deployed across all parts of industry and research settings. Developers and end users interact with these systems through the use of prompting or prompt engineering. While prompting is a widespread and highly researched concept, there exists conflicting terminology and a poor ontological understanding of what constitutes a prompt due to the area's nascency. This paper establishes a structured understanding of prompts, by assembling a taxonomy of prompting techniques and analyzing their use. We present a comprehensive vocabulary of 33 vocabulary terms, a taxonomy of 58 text-only prompting techniques, and 40 techniques for other modalities. We further present a meta-analysis of the entire literature on natural language prefix-prompting.},
	urldate = {2024-06-13},
	publisher = {arXiv},
	author = {Schulhoff, Sander and Ilie, Michael and Balepur, Nishant and Kahadze, Konstantine and Liu, Amanda and Si, Chenglei and Li, Yinheng and Gupta, Aayush and Han, HyoJung and Schulhoff, Sevien and Dulepet, Pranav Sandeep and Vidyadhara, Saurav and Ki, Dayeon and Agrawal, Sweta and Pham, Chau and Kroiz, Gerson and Li, Feileen and Tao, Hudson and Srivastava, Ashay and Da Costa, Hevander and Gupta, Saloni and Rogers, Megan L. and Goncearenco, Inna and Sarli, Giuseppe and Galynker, Igor and Peskoff, Denis and Carpuat, Marine and White, Jules and Anadkat, Shyamal and Hoyle, Alexander and Resnik, Philip},
	month = jun,
	year = {2024},
	note = {arXiv:2406.06608 [cs]},
}

Downloads: 0

{"_id":"jSQj58S37eJQveZ98","bibbaseid":"schulhoff-ilie-balepur-kahadze-liu-si-li-gupta-etal-thepromptreportasystematicsurveyofpromptingtechniques-2024","author_short":["Schulhoff, S.","Ilie, M.","Balepur, N.","Kahadze, K.","Liu, A.","Si, C.","Li, Y.","Gupta, A.","Han, H.","Schulhoff, S.","Dulepet, P. S.","Vidyadhara, S.","Ki, D.","Agrawal, S.","Pham, C.","Kroiz, G.","Li, F.","Tao, H.","Srivastava, A.","Da Costa, H.","Gupta, S.","Rogers, M. L.","Goncearenco, I.","Sarli, G.","Galynker, I.","Peskoff, D.","Carpuat, M.","White, J.","Anadkat, S.","Hoyle, A.","Resnik, P."],"bibdata":{"bibtype":"misc","type":"misc","title":"The Prompt Report: A Systematic Survey of Prompting Techniques","shorttitle":"The Prompt Report","url":"http://arxiv.org/abs/2406.06608","abstract":"Generative Artificial Intelligence (GenAI) systems are being increasingly deployed across all parts of industry and research settings. Developers and end users interact with these systems through the use of prompting or prompt engineering. While prompting is a widespread and highly researched concept, there exists conflicting terminology and a poor ontological understanding of what constitutes a prompt due to the area's nascency. This paper establishes a structured understanding of prompts, by assembling a taxonomy of prompting techniques and analyzing their use. We present a comprehensive vocabulary of 33 vocabulary terms, a taxonomy of 58 text-only prompting techniques, and 40 techniques for other modalities. We further present a meta-analysis of the entire literature on natural language prefix-prompting.","urldate":"2024-06-13","publisher":"arXiv","author":[{"propositions":[],"lastnames":["Schulhoff"],"firstnames":["Sander"],"suffixes":[]},{"propositions":[],"lastnames":["Ilie"],"firstnames":["Michael"],"suffixes":[]},{"propositions":[],"lastnames":["Balepur"],"firstnames":["Nishant"],"suffixes":[]},{"propositions":[],"lastnames":["Kahadze"],"firstnames":["Konstantine"],"suffixes":[]},{"propositions":[],"lastnames":["Liu"],"firstnames":["Amanda"],"suffixes":[]},{"propositions":[],"lastnames":["Si"],"firstnames":["Chenglei"],"suffixes":[]},{"propositions":[],"lastnames":["Li"],"firstnames":["Yinheng"],"suffixes":[]},{"propositions":[],"lastnames":["Gupta"],"firstnames":["Aayush"],"suffixes":[]},{"propositions":[],"lastnames":["Han"],"firstnames":["HyoJung"],"suffixes":[]},{"propositions":[],"lastnames":["Schulhoff"],"firstnames":["Sevien"],"suffixes":[]},{"propositions":[],"lastnames":["Dulepet"],"firstnames":["Pranav","Sandeep"],"suffixes":[]},{"propositions":[],"lastnames":["Vidyadhara"],"firstnames":["Saurav"],"suffixes":[]},{"propositions":[],"lastnames":["Ki"],"firstnames":["Dayeon"],"suffixes":[]},{"propositions":[],"lastnames":["Agrawal"],"firstnames":["Sweta"],"suffixes":[]},{"propositions":[],"lastnames":["Pham"],"firstnames":["Chau"],"suffixes":[]},{"propositions":[],"lastnames":["Kroiz"],"firstnames":["Gerson"],"suffixes":[]},{"propositions":[],"lastnames":["Li"],"firstnames":["Feileen"],"suffixes":[]},{"propositions":[],"lastnames":["Tao"],"firstnames":["Hudson"],"suffixes":[]},{"propositions":[],"lastnames":["Srivastava"],"firstnames":["Ashay"],"suffixes":[]},{"propositions":[],"lastnames":["Da","Costa"],"firstnames":["Hevander"],"suffixes":[]},{"propositions":[],"lastnames":["Gupta"],"firstnames":["Saloni"],"suffixes":[]},{"propositions":[],"lastnames":["Rogers"],"firstnames":["Megan","L."],"suffixes":[]},{"propositions":[],"lastnames":["Goncearenco"],"firstnames":["Inna"],"suffixes":[]},{"propositions":[],"lastnames":["Sarli"],"firstnames":["Giuseppe"],"suffixes":[]},{"propositions":[],"lastnames":["Galynker"],"firstnames":["Igor"],"suffixes":[]},{"propositions":[],"lastnames":["Peskoff"],"firstnames":["Denis"],"suffixes":[]},{"propositions":[],"lastnames":["Carpuat"],"firstnames":["Marine"],"suffixes":[]},{"propositions":[],"lastnames":["White"],"firstnames":["Jules"],"suffixes":[]},{"propositions":[],"lastnames":["Anadkat"],"firstnames":["Shyamal"],"suffixes":[]},{"propositions":[],"lastnames":["Hoyle"],"firstnames":["Alexander"],"suffixes":[]},{"propositions":[],"lastnames":["Resnik"],"firstnames":["Philip"],"suffixes":[]}],"month":"June","year":"2024","note":"arXiv:2406.06608 [cs]","bibtex":"@misc{schulhoff_prompt_2024,\n\ttitle = {The {Prompt} {Report}: {A} {Systematic} {Survey} of {Prompting} {Techniques}},\n\tshorttitle = {The {Prompt} {Report}},\n\turl = {http://arxiv.org/abs/2406.06608},\n\tabstract = {Generative Artificial Intelligence (GenAI) systems are being increasingly deployed across all parts of industry and research settings. Developers and end users interact with these systems through the use of prompting or prompt engineering. While prompting is a widespread and highly researched concept, there exists conflicting terminology and a poor ontological understanding of what constitutes a prompt due to the area's nascency. This paper establishes a structured understanding of prompts, by assembling a taxonomy of prompting techniques and analyzing their use. We present a comprehensive vocabulary of 33 vocabulary terms, a taxonomy of 58 text-only prompting techniques, and 40 techniques for other modalities. We further present a meta-analysis of the entire literature on natural language prefix-prompting.},\n\turldate = {2024-06-13},\n\tpublisher = {arXiv},\n\tauthor = {Schulhoff, Sander and Ilie, Michael and Balepur, Nishant and Kahadze, Konstantine and Liu, Amanda and Si, Chenglei and Li, Yinheng and Gupta, Aayush and Han, HyoJung and Schulhoff, Sevien and Dulepet, Pranav Sandeep and Vidyadhara, Saurav and Ki, Dayeon and Agrawal, Sweta and Pham, Chau and Kroiz, Gerson and Li, Feileen and Tao, Hudson and Srivastava, Ashay and Da Costa, Hevander and Gupta, Saloni and Rogers, Megan L. and Goncearenco, Inna and Sarli, Giuseppe and Galynker, Igor and Peskoff, Denis and Carpuat, Marine and White, Jules and Anadkat, Shyamal and Hoyle, Alexander and Resnik, Philip},\n\tmonth = jun,\n\tyear = {2024},\n\tnote = {arXiv:2406.06608 [cs]},\n}\n\n\n\n\n\n\n\n\n\n\n\n","author_short":["Schulhoff, S.","Ilie, M.","Balepur, N.","Kahadze, K.","Liu, A.","Si, C.","Li, Y.","Gupta, A.","Han, H.","Schulhoff, S.","Dulepet, P. S.","Vidyadhara, S.","Ki, D.","Agrawal, S.","Pham, C.","Kroiz, G.","Li, F.","Tao, H.","Srivastava, A.","Da Costa, H.","Gupta, S.","Rogers, M. L.","Goncearenco, I.","Sarli, G.","Galynker, I.","Peskoff, D.","Carpuat, M.","White, J.","Anadkat, S.","Hoyle, A.","Resnik, P."],"key":"schulhoff_prompt_2024","id":"schulhoff_prompt_2024","bibbaseid":"schulhoff-ilie-balepur-kahadze-liu-si-li-gupta-etal-thepromptreportasystematicsurveyofpromptingtechniques-2024","role":"author","urls":{"Paper":"http://arxiv.org/abs/2406.06608"},"metadata":{"authorlinks":{}},"html":""},"bibtype":"misc","biburl":"https://bibbase.org/zotero/andreasmartin","dataSources":["jurZeGzSpYdkQ8rm4"],"keywords":[],"search_terms":["prompt","report","systematic","survey","prompting","techniques","schulhoff","ilie","balepur","kahadze","liu","si","li","gupta","han","schulhoff","dulepet","vidyadhara","ki","agrawal","pham","kroiz","li","tao","srivastava","da costa","gupta","rogers","goncearenco","sarli","galynker","peskoff","carpuat","white","anadkat","hoyle","resnik"],"title":"The Prompt Report: A Systematic Survey of Prompting Techniques","year":2024}