Scribd Logo
Upload

Welcome to Scribd!

  • 24 views

    69fc9ITC Assn

    Uploaded by

    RAHUL
    This document contains 6 questions related to information coding and theory. The questions cover topics such as: proving transinformation of a continuous system is non-negative, verifying an expression for conditional entropy, proving the amount of information carried by equally likely and independent messages, calculating the information rate of a telegraph source, finding the information rate and error-free transmission requirements of a sampled and quantized analog signal, and constructing and comparing Shannon-Fano and Huffman codes for a discrete source.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOC, PDF, TXT or read online from Scribd

    69fc9ITC Assn

    Uploaded by

    RAHUL
    24 views1 page
    This document contains 6 questions related to information coding and theory. The questions cover topics such as: proving transinformation of a continuous system is non-negative, verifying an expression for conditional entropy, proving the amount of information carried by equally likely and independent messages, calculating the information rate of a telegraph source, finding the information rate and error-free transmission requirements of a sampled and quantized analog signal, and constructing and comparing Shannon-Fano and Huffman codes for a discrete source.

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    DOC, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document contains 6 questions related to information coding and theory. The questions cover topics such as: proving transinformation of a continuous system is non-negative, verifying an expression for conditional entropy, proving the amount of information carried by equally likely and independent messages, calculating the information rate of a telegraph source, finding the information rate and error-free transmission requirements of a sampled and quantized analog signal, and constructing and comparing Shannon-Fano and Huffman codes for a discrete source.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOC, PDF, TXT or read online from Scribd
    Download as doc, pdf, or txt
    24 views1 page

    69fc9ITC Assn

    Uploaded by

    RAHUL
    This document contains 6 questions related to information coding and theory. The questions cover topics such as: proving transinformation of a continuous system is non-negative, verifying an expression for conditional entropy, proving the amount of information carried by equally likely and independent messages, calculating the information rate of a telegraph source, finding the information rate and error-free transmission requirements of a sampled and quantized analog signal, and constructing and comparing Shannon-Fano and Huffman codes for a discrete source.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOC, PDF, TXT or read online from Scribd
    Download as doc, pdf, or txt
    of 1

    ASSIGNMENT 1

    INFORMATION CODING AND THEORY


    SEM : V / VII

    1. Show that transinformation of a continuous system is non – negative.

    2. Verify the following expression:


    m n
    H(Y/X) = - ∑ ∑ p( xj ,yk ) log p(yk / xj )
    j =1 k =1

    3. If there are M equally likely and independent messages, then prove that amount
    of information carried by each message will be I=N bits.

    4. Consider a telegraph source having two symbols dot and dash. The dot duration
    is 0.2 sec and the dash duration is twice that of dash. Time between the symbols
    is 0.2 seconds. Calculate information rate of the telegraph source.

    5. An analog signal having 4 kHz bandwidth is sampled at 1.25 times the Nyquist
    rate and each sample is quantized into one of 256 equally likely levels.
    (i) Find out information rate of this source?
    (ii) Can the output of this source be transmitted without error over an AWGN channel
    with a bandwidth of 10 kHz and S/N ratio of 20 dB? If not find out the S/N ratio
    required for error free transmission.

    6. A discrete source has five symbols x1, x2, x3, x4 and x5 with probabilities 0.4, 0.19,
    0.16, 0.15 and 0.15 respectively. Construct a Shannon-Fano code for the source
    and calculate code efficiency. Compare the results with that obtained using
    Huffman coding.

    You might also like

    pFad - Phonifier reborn

    Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

    Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


    Alternative Proxies:

    Alternative Proxy

    pFad Proxy

    pFad v3 Proxy

    pFad v4 Proxy