Scribd
Upload
90 views185 pages

18EC54 - Shivarudraiah

This document contains the syllabus for the course "Information Theory and Coding" offered at BMS Institute of Technology and Management. The syllabus is divided into 5 modules covering topics such as information theory, source coding, information channels, error control coding, and convolution codes. The document provides learning objectives, topics covered, and textbook references for each module. It also outlines the exam pattern, including question distribution, duration, and marking scheme.

Uploaded by

rohitrajww4
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
90 views185 pages

18EC54 - Shivarudraiah

This document contains the syllabus for the course "Information Theory and Coding" offered at BMS Institute of Technology and Management. The syllabus is divided into 5 modules covering topics such as information theory, source coding, information channels, error control coding, and convolution codes. The document provides learning objectives, topics covered, and textbook references for each module. It also outlines the exam pattern, including question distribution, duration, and marking scheme.

Uploaded by

rohitrajww4
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 185

BMS

INSTITUTE OF TECHNOLOGY AND MANAGEMENT


Avalahalli, Doddaballapur Main Road, Bengaluru – 560064

DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING

COURSE: INFORMATION THEORY AND CODING

COURSE CODE: 18EC54

SEMESTER: V
BMS
INSTITUTE OF TECHNOLOGY AND MANAGEMENT
Avalahalli, Doddaballapur Main Road, Bengaluru – 560064

INDEX

SYLLABUS PAGE 3 & 4


MODULE-1 Information Theory PAGE 5 TO 44
MODULE-2 Source Coding PAGE 45 TO 87
MODULE-3 Information Channels PAGE 88 TO 104
MODULE-4 Error Control Coding & PAGE 105 TO 165
Binary Cyclic Codes
MODULE-5 Convolution Codes PAGE 166 TO 181
B. E. (EC / TC)
Choice Based Credit System (CBCS) and Outcome Based Education (OBE)
SEMESTER – V
INFORMATION THEORY and CODING
Course Code 18EC54 CIE Marks 40
Number of Lecture Hours/Week 3 SEE Marks 60
Total Number of Lecture Hours 40 (8 Hours / Module) Exam Hours 03
CREDITS – 03
Course Learning Objectives: This course will enable students to
• Understand the concept of Entropy, Rate of information and order of the source with reference to
dependent and independent source.
• Study various source encoding algorithms.
• Model discrete & continuous communication channels.
• Study various error control coding algorithms.
Module-1 RBT
Level
Information Theory: Introduction, Measure of information, Information content of message, L1,
Average Information content of symbols in Long Independent sequences, Average Information L2,L3
content of symbols in Long dependent sequences, Markov Statistical Model for Information
Sources, Entropy and Information rate of Markoff Sources
(Section 4.1, 4.2 of Text 1)
Module-2
Source Coding: Encoding of the Source Output, Shannon’s Encoding Algorithm(Sections 4.3, L1,
4.3.1 of Text 1), Shannon Fano Encoding Algorithm (Section 2.15 of Reference Book 4) L2,L3
Source coding theorem, Prefix Codes, Kraft McMillan Inequality property – KMI, Huffman codes
(Section 2.2 of Text 2)
Module-3
Information Channels: Communication Channels, Discrete Communication channels Channel L1, L2,
Matrix, Joint probabilty Matrix, Binary Symmetric Channel, System Entropies. (Section 4.4, 4.5, L3
4.51,4.5.2 of Text 1)
Mutual Information, Channel Capacity, Channel Capacity of Binary Symmetric Channel, (Section
2.5, 2.6 of Text 2)
Binary Erasure Channel, Muroga,s Theorem (Section 2.27, 2.28 of Reference Book 4)
Module-4
Error Control Coding:
Introduction, Examples of Error control coding, methods of Controlling Errors, Types of Errors,
types of Codes, Linear Block Codes: matrix description of Linear Block Codes, Error detection & L1, L2,
Correction capabilities of Linear Block Codes, Single error correction Hamming code, Table L3
lookup Decoding using Standard Array.
Binary Cyclic Codes: Algebraic Structure of Cyclic Codes, Encoding using an (n-k) Bit Shift
register, Syndrome Calculation, Error Detection and Correction (Sections 9.1,
9.2,9.3,9.3.1,9.3.2,9.3.3 of Text 1)
Module-5
Convolution Codes: Convolution Encoder, Time domain approach, Transform domain approach, L1, L2,
Code Tree, Trellis and State Diagram, The Viterbi Algorithm) (Section 8.5 – Articles 1,2 and 3, L3
8.6- Article 1 of Text 2)
Course Outcomes: After studying this course, students will be able to:
• Explain concept of Dependent & Independent Source, measure of information, Entropy, Rate of
Information and Order of a source
• Represent the information using Shannon Encoding, Shannon Fano, Prefix and Huffman Encoding
Algorithms
• Model the continuous and discrete communication channels using input, output and joint probabilities
• Determine a codeword comprising of the check bits computed using Linear Block codes, cyclic codes
& convolutional codes
• Design the encoding and decoding circuits for Linear Block codes, cyclic codes, convolutional codes,
BCH and Golay codes.
Question paper pattern:
• Examination will be conducted for 100 marks with question paper containing 10 full questions, each of
20 marks.
• Each full question can have a maximum of 4 sub questions.
• There will be 2 full questions from each module covering all the topics of the module.
• Students will have to answer 5 full questions, selecting one full question from each module.
• The total marks will be proportionally reduced to 60 marks as SEE marks is 60.
Text Book:
1. Digital and analog communication systems, K. Sam Shanmugam, John Wiley India Pvt. Ltd, 1996.
2. Digital communication, Simon Haykin, John Wiley India Pvt. Ltd, 2008.
Reference Books:
1. ITC and Cryptography, Ranjan Bose, TMH, II edition, 2007
2. Principles of digital communication, J. Das, S. K. Mullick, P. K. Chatterjee, Wiley, 1986 - Technology
& Engineering
3. Digital Communications – Fundamentals and Applications, Bernard Sklar, Second Edition, Pearson
Education, 2016, ISBN: 9780134724058.
4. Information Theory and Coding, HariBhat, Ganesh Rao, Cengage, 2017.
5. Error Correction Coding by Todd K Moon,Wiley Std. Edition, 2006

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy