Advance Topics in Image Processing – CSC657

Digital Image Fundamentals and

Image Acquisition

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 1
 Image Acquisition

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 2
 Image description

f (x,y): intensity/brightness of the image at spatial coordinates (x,y)

0< f (x,y)<∞ and determined by 2 factors:
illumination component i(x,y): amount of source light incident
reflectance component r(x,y): amount of light reflected by objects
f (x,y) = i(x,y) r(x,y)
where
0< i(x,y)<∞: determined by the light source
0< r(x,y)<1: determined by the characteristics of objects

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 3
 Sampling and Quantization

quantization
sampling sampling
10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 4
 Sampling and Quantization
Sampling: Digitization of the spatial coordinates (x,y)
Quantization: Digitization in amplitude (also called gray-
level quantization)
8 bit quantization: 28 = 256 gray levels (0: black, 255: white)
Binary (1 bit quantization): 2 gray levels (0: black, 1: white)

Commonly used number of samples (resolution)

Digital still cameras: 640x480, 1024x1024, 4064 x 2704 so on
Digital video cameras: 640x480 at 30 frames/second
1920x1080 at 60 f/s (HDTV)

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 5
 Sampling and Quantization

An M x N digital image is expressed as

Columns
 f (0,0) f (0,1) . . . f (0, N  1) 
 f (1,0) f (1,1) . . . f (1, N  1) 
Rows


 . . . . . . 
 
 . . . . . . 
 . . . . . . 
 
 f ( M  1,0) f ( M  1,1) . . . f ( M  1, N  1)

N : No of Columns
M : No of Rows

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 6
 Sampling and Quantization
 Image coordinate convention (not valid for MATLAB!)

There is no universally accepted convention or notation. Always check carefully!

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 7
 Sampling and Quantization
 MATLAB Representation

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 8
 Digital Images

Digital images are 2D arrays (matrices) of numbers:

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 9
 Sampling

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 10
 Sampling

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 11
 Effect of Sampling and Quantization

250 x 210 samples 125 x 105 samples 50 x 42 samples 25 x 21 samples

256 gray levels

16 gray levels 8 gray levels 4 gray levels Binary image

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 12
 Effect of Sampling and Quantization

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 13
 Effect of Sampling and Quantization

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 14
 Effect of Sampling and Quantization

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 15
 Effect of Sampling and Quantization

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 16
 RGB (color) Images

Red + Blue + Green

Red Green Blue

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 17
 RGB (color) Images

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 18
 Image acquisition

Single imaging sensor

Line sensor

Array sensor

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 19
 Image acquisition

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 20
 Image acquisition

Image acquisition through

linear sensor strip

Image acquisition through

circular sensor strip

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 21
 Image Sensors

 Goal: to convert EM energy into electrical signals that

can be processed, displayed and/or interpreted as images.

 Common technologies:
– CCDs (charge-coupled devices)
– CMOS (complementary metal oxide semiconductor)

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 22
 Digital Camera Technologies
 CCD (Charge Coupled Device)
– Capacitive device
– Proper mechanism for charge
transfer
 CMOS (Complementary
magnetic oxide)
– Fabricated in standard
semiconductor production line
– Lower power consumption
CCD: 2–5 W, CMOS: 20–50 mW

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 23
 Digital Camera Technologies

CCD Array Cameras

A CCD sensor is made up of an array of light-sensitive cells
called photosites, manufactured in silicon, each of which
produces a voltage proportional to the intensity of light falling
on them.
Every element in the array is linked (charge coupled) to other
element.
Charges are transferred serially out of the array through shifting
charges from one element to the other.

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 24
 Digital Camera Technologies

CMOS Array Cameras

Standard semiconductor
production line
Active pixel architecture
Photo-detector and amplifier
are both fabricated inside
each pixel.

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 25
 Digital camera technologies comparison
CCD (Charge Coupled Device) CMOS (Complementary Metal
– Specialized fabrication Oxide Semiconductor)
techniques are used so – Cheaper technology
expensive technology – Smaller size
– Larger size – Low power consumption
– Higher power consumption – Readout for selective area of an
because of the capacitive image is possible
architecture – Amplifier and additional
– Always have to read out the circuitry can be fabricated
whole image inside each pixel.
– Resolution is limited by – Higher resolution possible
sensor elements size – Stronger noise due to higher
– Less on-chip circuitry so dark currents because of more
lesser dark currents and on-chip circuitry
noise
10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 26
 Acquisition of color images
Single sensor assembly
For still scenes
Three sensors
with prisms

Sensor arrays
a. Stripe filter pattern
b. Bayers filter pattern

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 27
 Foveon X3 imager
 This sensor uses 3 layers of
CMOS imagers.
 Each layer absorbs different
colours of light at different
depths.
 Single shot camera for three
colors

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 28
 Various commercial sensor sizes

Aspect Width Height

"Name"
Ratio (mm) (mm)
1/3.6" 4:3 4.0 3.0
1/3.2" 4:3 4.5 3.4
1/3" 4:3 4.8 3.6
1/2.7" 4:3 5.3 4.0

 
1/2" 4:3 6.4 4.8
1/1.8" 4:3 7.2 5.3
2/3" 4:3 8.8 6.6
1" 4:3 12.8 9.6
                                                
4/3" 4:3 18.0 13.5
Relative size of various digital camera sensors

EOS 10D 3:2 22.0 15.0

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 29
 Pixel Neighborhood
The pixels surrounding a given pixel.
Most neighborhoods used in image processing algorithms are small square
arrays with an odd number of pixels.

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 30
 Basic relationships between pixels
Arrangement of pixels: 0 1 1
0 1 0
0 0 1
4 neighbours N4(p): 1
0 1 0
0

Diagonal neighbours ND(p): 0 1

1
0 1

8 neighbours N8 (p) = ND(p) U N4(p) : 0 1 1

0 1 0
0 0 1
10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 31
 Basic relationships between Pixels
 Connectivity between pixels:
An important concept used in establishing boundaries of objects
and components of regions
Two pixels p and q are connected if
– They are adjacent in some sense
– If their gray levels satisfy a specified criterion of similarity

V: Set of gray level values used to define the criterion of

similarity

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 32
 Basic relationships between Pixels

4-connectivity:
If gray-level p , q  V, and q  N4(p)

8-connectivity:
If gray-level p , q  V, and q  N8(p)

m-connectivity (mixed connectivity):

Gray-level p , q  V, and q satisfies one of the following:
1) q  N4(p), 2) q  ND(p) and N4(p)∩ N4(q) has no values from V

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 33
 Basic relationships between pixels

Mixed Connectivity:
Note: Mixed connectivity can eliminate the multiple path
connections that often occurs in 8-connectivity

Pixel 8-adjacent to the m-adjacency

arrangement center pixel

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 34
 Basic relationships between pixels
Path
Let coordinates of pixel p: (x, y), and of pixel q: (s, t)
A path from p to q is a sequence of distinct pixels with
coordinates: (x0, y0), (x1, y1), ......, (xn, yn) where
(x0, y0) = (x, y) & (xn, yn) = (s, t),
and (xi, yi) is adjacent to (xi-1, yi-1) 1 i  n
Regions
A set of pixels in an image where all component pixels are
connected
Boundary of a region
A set of pixels of a region R that have one of more neighbors
that are not in R

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 35
 Distance Measures
Given coordinates of pixels p and q: (x,y) and (s,t)
Euclidean distance between p and q:
De ( p, q )  ( x  s) 2  ( y  t ) 2
– De distance  r from (x,y) define a disk of radius r centered at (x,y)
City-block distance between p and q:
D4 ( p, q)  x  s  y  t
– The pixels with D4 distance  r from (x,y) form a diamond centered at (x,y)
– the pixels with D4=1 are the 4-neighbors of (x,y)
Chessboard distance between p and q:
D8 ( p, q )  max(| x  s |, | y  t |)
– The pixels with D8 distance  r from (x,y) form a square centered at (x,y)
– The pixels with D8=1 are the 8-neighbors of (x,y)

10/28/21 COMSATS Institute of Information Technology, Lahore -- Advance Topics in Image Processing -- CSC657 36