Information, Representation, and Structure
Subhash Kak
Abstract
This paper investigates the consequences of the information-theoretic result that representations of numbers in base-<i>e</i> are most efficient. Since theories on complex system behavior in both natural and physical systems assume that Nature is optimal, as is done, for example, in the principle of least action, natural representations must be to the base <i>e</i>. Another way to interpret this fact is to take <i>e</i> as the information dimension of the data space. Some implications of this noninteger dimensionality are investigated. The approximate equivalent to such a space is the Menger sponge in which the recursion is taken to be random.
Topics & Concepts
Recursion (computer science)Dimension (graph theory)Space (punctuation)Action (physics)Representation (politics)Curse of dimensionalityBase (topology)MathematicsTheoretical computer scienceNatural (archaeology)Computer scienceDiscrete mathematicsPure mathematicsAlgebra over a fieldAlgorithmArtificial intelligencePhysicsGeographyMathematical analysisOperating systemArchaeologyQuantum mechanicsLawPoliticsPolitical scienceComputability, Logic, AI AlgorithmsStatistical Mechanics and Entropy