Introduction to Information Measurement and Theory

Information is a fundamental quantity that powers our modern digital world, yet measuring it requires clear concepts and mathematical framework. This text-based course guides you through the foundational principles of information theory, enabling you to analyze data volume, uncertainty, and message content. What you'll learn: Understand fundamental units of digital information including bits, bytes, and their higher orders. Explore both alphabetical and probabilistic approaches to measuring information quantity. Calculate information content using core mathematical models such as Hartley's and Shannon's formulas. Examine data compression concepts, message redundancy, and encoding efficiency. Connect theoretical concepts to modern digital storage and communication systems. The course begins with essential terminology, basic definitions, and core principles before guiding you through structured written examples and exercises. Designed for beginners in computer science or data fundamentals, with no advanced prerequisites required. Start reading today to build a solid foundation in quantifying digital information.