Information Theory and Coding
Information Theory and Coding
Sr.
No.
Course Content Reference
Book(s)
1 Basic concept of coding: Source coding- Uniquely Decodable
codes, Instantaneous codes, Constructing instantaneous
codes, Krafts inequality & McMillans inequality, Shannon ano
code, !"ti#al Codes$ %uff#an codes, Second & &hird
'(tension of %uff#an codes
)1
* Entropy Entropy of sources and their e!tension:
Definition of entro"y, +,erage code length li#it theore# ,
Shannons -e##a and Source coding theore# , 'ntro"y of
basic sources, #a(i#u# and #ini#u# entro"y, Mar.o,
Infor#ation source and its state diagra#s, '(a#"les of state
diagra#s of #ar.o, sources, State transition #atri( and
classification of Mar.o, sources
)*
/ "ata compression mode# and $oss #ess compression:
&y"es of redundancies, Coding, "sycho,isual, inter"i(el
redundancy, +rith#etic coding and decoding, 01'2 standard$
a""lication of entro"y coding
)3
3 Channe# Coding: )eliable Co##unication through Unreliable
channels, Infor#ation rates, %a##ing Distance, Correction
and Detection of errors, Channel ca"acity, relationshi" of
channel ca"acity 4ith #utual infor#ation
)1, )/
5 $inear %#ock codes: 2enerator #atri(, 1arity chec. #atri(,
Syndro#e, Detection and corrections of errors, Syndro#e
decoding on sy##etric channels6 Cyclic Codes- 2enerator
"olyno#ials, 'ncoding cyclic codes, 1arity chec. "olyno#ials,
Decoding cyclic codes
)1, )/
7 Con&o#utiona# Codes: Introduction, +n 8n,.9 c on,olutional
coder, Code tree, &he :iterbi decoding algorith#, &rellis
diagra#, ;C% codes, )eed-Solo#on codes, %a##ing codes
)1, )/
< Cryptography: Introduction to Cry"togra"hy, Secret Key
'ncry"tion, 1ublic Key 'ncry"tion, 'ncry"tion based on large
1ri#e =u#bers, 'ncry"tion based on Kna"sac. 1roble#, Data
'ncry"tion Standard
)1, )7
)eference ;oo.s$
1> oundations of Coding,
0iri +da#e., ?iley-Interscience 1ublication
*> Infor#ation &heory
)> ;> +sh, 1rentice %all India
/> Digital Co##unication funda#ental and +""lications
;ernard S.lar, 1earson 'ducation
3> Digital I#age 1rocessing
)> 2on@ale@ and '> ?oods, 1rentice %all India
5> +nalog & Digital Co##unication Syste#s
;> 1> -athi
7> =et4or.ing 1rinci"les
+ndre4 S> &anenbau#
Tentati&e $a%oratory Sessions
Si#ulation using M+&-+; or any other "rogra##ing language>
1> 2i,en a A>4a, file, find the ha##ing distance bet4een successi,e sa#"les of
it>
*> 2enerate the instantaneous codes gi,en the length of the code 4ords>
/> +""ly %uff#an code on the gi,en data set> +lso 4rite a "rogra# to decode it>
3> Si#ulate +rith#etic code>
5> ?rite a "rogra# to a""ly -inear ;loc. codes on gi,en data ,ector> +""ly
rando# noise ,ia rando# "er#utation and decode the data ,ector fro# the
coded data>
7> Si#ulate an entire co##unication syste#$ #eans original data, co#"ression
by any algorith#, a""ly any error correcting code, a""ly any noise, a""ly
error detection or correction and deco#"ression>
<> ?rite a "rogra# to generate 8<,39 Cyclic code using the generator
"olyno#ial
28"9 B 1 C " C "
/
D> Use any C+D soft4are to i#"le#ent the "re,ious 8<,39 Cyclic code using shift
register or any logical circuit>
E> ?rite a "rogra# to a""ly Con,olution coding
1F> ?rite a "rogra# to a""ly :iterbi decoding
+ssign#ent 1G 1roHect 1