FREE
AKTU Information Theory & Coding (BAC062) Syllabus PDF – B.Tech 3rd Year
Information Theory & Coding BAC062
All syllabus, notes, question bank & PYQ for this subject
Free
Download now
- English
- Semester 6
- 0 downloads
- 0 views
Official AKTU syllabus of Information Theory & Coding (BAC062) for B.Tech 3rd Year – 3 credits, L-T-P 3-0-0. Read the unit-wise course content, course outcomes, evaluation pattern and recommended books online, or download the PDF.
Syllabus — Information Theory & Coding
Download PDFBAC062 · 3 credits · L-T-P 3-0-0
| Unit | Topics | Lectures |
|---|---|---|
| I | Entropy: Entropy, Joint Entropy and Conditional Entropy, Relative Entropy and Mutual Information, Relationship Between Entropy and Mutual Information, Chain Rules for Entropy, Relative Entropy and Mutual Information, Jensen’s Inequality and Its Consequences, Log Sum Inequality and Its Applications, Data- Processing Inequality, Fano’s Inequality. | 8 |
| II | Asymptotic Equipartition Property: Asymptotic Equipartition Property Theorem. Consequences of the AEP: Data Compression, High-Probability Sets and the Typical Set Data Compression: Examples of Codes, Kraft Inequality, Optimal Codes, Bounds on the Optimal Code Length, Kraft Inequality for Uniquely Decodable Codes, Huffman Codes, Optimality of Huffman Codes, Shannon - Fano– Elias Coding. | 8 |
| III | Channel Capacity: Channel Capacity for Various Binary Channels, Symmetric Channels, Properties of Channel Capacity, Preview of Channel Coding Theorem, Jointly Typical Sequences, Channel Coding Theorem, Channel capacity Theorem. | 8 |
| IV | Block Codes: Introduction to block codes, Single-parity check codes, Product codes, Repetition codes, Hamming codes, Minimum distance of block codes, Soft decision decoding, Automatic-repeat-request schemes. Linear Block codes: Definition of linear Block Codes, Generator matrices, Standard array, Parity-check matrices, Error detection and correction. | 8 |
| V | Convolution codes: Encoding convolutional codes, Generator matrices for convolutional codes, Generator polynomials for convolutional codes, Graphical representation of convolutional codes, Viterbi Algorithm, Binary Cycle Codes, BCH codes. RS codes, Golay codes. | 8 |
Text Books
- Bose, Information Theory, Coding and Cryptography, McGraw-Hill Education, 3rd Edition, (2016).
- Joy A. Thomas, Thomas M. Cover, “Elements of information theory”, Wiley-Interscience; 2nd edition (July 18, 2006).
- S. Gravano, “Introduction to Error Control Codes” OUP Oxford (24 May 2001).
- Robert B. Ash, “Information Theory”, Dover Publications (November 1, 1990).
- Todd k Moon, “Error Correction Coding: Mathematical Methods and Algorithms ” Wiley, 2005.
Reference Books
- Simon Haykin, “Digital communication”, John Wiley.
- Ranjan Bose, “ITC and Cryptography”, Tata McGraw-Hill.
- Roberto Togneri, Christopher J.S deSilva, “Fundamentals of Information Theory and
- Coding Design”, CRC Press.
Course Outcomes
- Explain each block involved in digital communication thoroughly with applications.
- Apply the knowledge of basic concepts of probability and entropies to analyze the behavior of a communication system.
- Analyze the use of source coding and evaluating all the techniques of source coding.
- Examine the significance of channel coding and evaluating all available techniques of channel coding and decoding with challenges.
- Examine various error control coding techniques.
Ratings & Reviews
No reviews yet — share your experience with this item.