A Comprehensive Survey of Prompt Engineering Techniques in Large Language Models
Tonmoy Debnath, Nurul Absar Siddiky, Muhammad Enayetur Rahman, Prosenjit Das, A. Guha, Muhammad Rezaur Rahman, H. M. Dipu Kabir
Abstract
Prompt engineering has arisen as a pivotal discipline in optimizing the performance of Large Language Models (LLMs) by structuring inputs to enhance coherence, accuracy, and task alignment. This paper comprehensively surveys various prompting techniques, systematically categorizing them according to their application domains and methodological foundations. Fundamental approaches like zero-shot and few-shot prompting are examined along with advanced strategies, including chain-of-thought reasoning, retrieval-augmented generation, and self-consistency mechanisms. A rigorous qualitative analysis is conducted to evaluate each technique's strengths, limitations, and optimal use cases, offering a structured framework for selecting the most effective prompting strategies. Theoretical insights and empirical findings are consolidated to provide researchers and practitioners with advanced methodologies for refining prompt design and enhancing LLM capabilities in complex reasoning, decision-making, and knowledge synthesis while improving reliability and factual accuracy in generated outputs.