An Introductory Survey of Entropy Applications to Information Theory, Queuing Theory, Engineering, Computer Science, and Statistical Mechanics
Ismail A Mageed, Qichun Zhang
Abstract
Clausius was the first to coin the term “entropy” roughly 160 years ago. Since then, many scholars from several scientific fields have continued to enhance, develop, and interpret the data. This study describes the concept of entropy and its applications to information theory, queuing theory, engineering systems, computing, and statistical mechanics. The choice of these applications was subjected to the size limitation of the paper. Having said that, entropy has a great applicability to other scientific disciplines. Even more interesting is the nature of entropy as a measurement of uncertainty, dis-order, or turbulence was the main core of attraction to a considerable number of scholars in all academic areas of research expertise to both employ it and make a significant research advancement. Its goal is to present a coherent picture of how classical entropies might be used in engineering and computer science. It is attempted to create a concise exposition that strikes a balance between conceptual importance and instrumental relevance. A representative list of references closes this review.