10/7/2021

Computer Vision and Image

Processing (CSEL-
(CSEL-393)

Lecture 1: Introduction

Dr. Qurat ul Ain Akram

Assistant Professor
Computer Science Department (New
Campus) KSK, UET, Lahore

1
 10/7/2021

Introduction
• Instructor: Dr. Qurat ul Ain Akram , PhD in Computer Science
• Area of Research: Digital Image Processing, Computer Vision, Natural Language Processing
• Research Projects: 12+ Research Experience
• Teaching Experience:
• E-mail: ainie.akram@uet.edu.pk

Introduction

• Preferred Prior Knowledge: Linear algebra,

calculus, programming in Python/Numpy.
• Text Books:
1. Gonzalez, R. C. and Woods, R. E., Digital
Image Processing, Second Edition, Pearson-
Prentice Hall, Inc., 2002. ISBN 81-7758-168-6.
2. Richard Szeliski, Computer Vision, Algorithms
and Applications, 2nd Ed,
https://szeliski.org/Book/

2
 10/7/2021

Grading
Mid Terms 25%
Quizzes/Assignments 10%
Projects 10%
Final 55%

Learning Outcomes
1. Describe the fundamentals and basic concepts
of image processing related to image
segmentation, compression, enhancement and
camera calibration
2. Explain and test image processing and computer
vision fundamentals for image enhancement,
segmentation and feature extraction.
3. Apply popular machine learning techniques for
computer vision problems

3
 10/7/2021

Course Outline
• Image Processing
– Image Formation
– Image Acquisition
– Image Enhancement
– Image restoration
– Morphological operations
– Color Image Processing
– Image compression
– Image Filtering and Image Segmentation
• Computer Vision
– Image Descriptors and Features Extraction
– Machine Learning
– Object Recognition

Weekly Plan
Week Topics
1 Introduction and Goals of Computer Vision and Image Processing,
Image Formation Concepts
Image acquisition
Display using digital devices
2 Image enhancement in spatial domain
a) Intensity transformations
b) Histogram and its analysis
c) Convolution and spatial filtering
3 Image enhancement in frequency domain
a) Basic concepts related to Fourier transform
b) Sampling in frequency domain and introduction to DFT
c) Filtering in frequency
4 Image restoration
a) Introduction to restoration model
b) Different types of noises and their models
c) Image restoration in spatial and frequency domains

4
 10/7/2021

Weekly Plan
Week Topics
5 Morphological operations for binary and gray images
a) Introduction to morphological operations
b) Morphological operation for binary and gray scale images
6 Color image processing
a) Formation of color image
b) Different color models
c) Analysis of colored images
7 Image compression
a) Compression models, compression ratio, types of redundancy
b) Variable length coding
c) Lossy and lossless compression
d) Image/video communication
8 Image filtering and Image Segmentation

Weekly Plan
Week Topics
9 Midterm Exam
10 Image Descriptors and Features:
edges, corners, texture based features
11 Image Descriptors and Features:
edges, corners, texture based features
12 Fundamentals of Machine Learning

5
 10/7/2021

Weekly Plan
Week Topics
13 Applications of Computer Vision:
Artificial Neural Network for Pattern Classification,
Convolutional Neural Networks, Autoencoders
14 Applications of Computer Vision:
Object Recognition and Image Understanding
15 Applications of Computer Vision:
Object Recognition and Image Understanding
16 Final term Exam

Image Processing and Computer Vision

• Image Processing (IP):
– Subset of Computer Vision (CV)
– Image Processing is the field of enhancing the images
by tuning many parameter and features of the images.
For example, transformations are applied to an input
image and the resultant output image is returned.
Some of these transformations are- sharpening,
smoothing, stretching etc.
– Input: Image
– Output: Image

6
 10/7/2021

Image Processing and Computer Vision

• Computer Vision (CV):
– In Computer Vision, computers or machines are
made to gain high-level understanding from the
input digital images or videos with the purpose of
automating tasks that the human visual system
can do.
– Input: Image/ Videos
– Output: Automation of cognitive functions
associated with vision

Classification of DIP and Computer Vision

Processes

7
 10/7/2021

Applications
• 56 most popular computer vision applications
(https://viso.ai/applications/computer-vision-
applications/)
• Computer Vision In Sports
– Player Pose Tracking
– Stroke Recognition
– Sports Team Behaviors Analysis

Earth viewers (3D modeling)

Image from Microsoft’s Virtual Earth

(see also: Google Earth)

8
 10/7/2021

Optical character recognition (OCR)

Technology to convert scanned docs to text
• If you have a scanner, it probably came with OCR software

Digit recognition, AT&T labs License plate readers

http://www.research.att.com/~yann/ http://en.wikipedia.org/wiki/Automatic_number_plate_recognition

Face detection

• Many new digital cameras now detect faces

– Canon, Sony, Fuji, …

9
 10/7/2021

Smile detection?

Sony Cyber-shot® T70 Digital Still Camera

Object recognition (in supermarkets)

LaneHawk by EvolutionRobotics
“A smart camera is flush-mounted in the checkout lane, continuously watching
for items. When an item is detected and recognized, the cashier verifies the
quantity of items that were found under the basket, and continues to close the
transaction. The item can remain under the basket, and with LaneHawk,you are
assured to get paid for it… “

10
 10/7/2021

Face recognition

Who is she?

Vision-based biometrics

11
 10/7/2021

Login without a password…

Face recognition systems now

Fingerprint scanners on
beginning to appear more widely
many new laptops, http://www.sensiblevision.com/
other devices

Object recognition (in mobile phones)

12
 10/7/2021

Robotics

NASA’s Mars Spirit Rover http://www.robocup.org/

http://en.wikipedia.org/wiki/Spirit_rover

Medical imaging

Image guided surgery

Grimson et al., MIT
3D imaging
MRI, CT

COVID Detection

13
 10/7/2021

Skin Tone Detection

Facial Expression Recognition

14