Huffman method for the construction of minimum redundancy codes.

The Huffman code is a source code. It is a prefix code as well. • Here word length of code word
approaches the fundamental limit set by the entropy of discrete memory less source. • This code is
“optimum” as it provides the smallest average code word length for a given discrete memory less
source. • It encodes each message transmitted by DMS with different value of number of bits based
on their probabilities.

The performance of communication system is depends on 3 factors namely: • The available signal
power • The background noise present on the channel. • Limited Bandwidth of the channel

Information Theory is broadly based mathematical discipline and it is applicable to various fields
such as communications, computer science, statistics, and probability.

If r messages are sent per sec, the rate of information is R= rH bits/sec

Channel capacity C depends directly on the bandwidth B, but it depends on the ratio S/ N0B in the
logarithmic manner.

This theorem implies that if the average transmitted power S and channel bandwidth B are constant,
we can transmit information at the rate of C bits per second with a low probability of error by using a
suitable encoding system. • It is not possible to transmit at a rate higher than C bits per seconds by
any encoding system without a definite probability of error.
This shows that in order to increase the (S/N) ratio to 15 from 7 we need to increase the signal
power by a factor of 1.6 • This is 60% increase in the signal power, for a 25% reduction in the
bandwidth (4 KHz to 3 KHz). • Therefore 25% reduction in BW requires a 60% increase in signal
power.

An information source may be viewed as an object which produces an event. The outcome of which
is selected at random according to a probability distribution. • A practical source in a communication
system is a device which produce message • That message can be either analog or discrete.

a discrete information source is a source which has only a finite set of symbols as possible outputs. •
The set of source of set symbols is called the source alphabet. And the elements of the set are called
symbols or letters.

Information theory is a mathematical approach to the study of coding of information along with the
quantification, storage and communication of information.
If the event has just occurred , there is a condition of surprise • If the event has occurred, a time
back , there is a condition of having some information.

The first step in digitizing a signal is called formatting. • It is done in order to ensure that the
message signal becomes compatible with digital processing. • The formatting at the transmitter
converts the information from the source to digital symbols. • This transformation can be achieved
by the process such as character coding, sampling , quantization and PCM. • The digital messages so
obtained are in their logical format (0s and 1s). • Then they are transformed into baseband (pulse)
waveforms at the next step called pulse modulation. • Such waveforms are suitable for transmission
over cable.
The analog input signal is formatted using three processes namely sampling, quantization and coding
to obtain a binary bit stream of 0s and 1s.

The digital signal in the form of binary digits is converted into a pulsed waveforms using the pulse
modulator. • The transmitter transmits these pulsed waveforms over a baseband channel. (coaxial
cable or a pair of wire)

Such pulsed waveforms corresponding to the digital input signal which are compatible to the base
band channel are known as discrete PAM signals or Line codes.

Transmitter transmits line codes on the base band channel. • The receiver receives the line codes,
separate pulses from noise added to them and applies them to a demodulator. • The noise free line
code pulses are converted into digital bit stream by the demodulator / detector block. • The digital
bit stream is then converted to the analog signal by formatting block at the receiver.

• The line coding is the process of converting binary data, a sequence of bits to a digital signal

Line codes are called as digital PAM format.

If such discrete signal is transmitted over a band limited channel, then the signal gets dispersed. •
That means the pulses spread out and overlap each other to cause distortion. • Such distortion is
called as inter symbol interference (ISI). • In order to avoid this we should not transmit the discrete
signal as it is on the transmission medium. • Instead this data is first converted into a PAM format or
line code which is compatible with the base band channel and then transmitted over a baseband
communication channel. • The various pulse format used as per requirement are also called as line
codes.
Unipolar codes use only one voltage level other than zero. So the encoded signal will have either +A
volts value or 0. Unipolar codes use only one voltage level other than zero. So the encoded signal will
have either +A volts value or 0.

Polar coding uses two voltage levels other than zero such as +A/2 and –A/2 volts. This will bring the
dc level for some codes to zero which is a desired characteristics. The polar codes are also further
classified into two types namely RZ and NRZ.

Bipolar coding uses three voltage levels positive negative and zero

Digital Communication can be defined as a mode of communication that encodes analog data to
digital form and sends it to the receiver after demodulation.