Image Processing

HUYNH TRUNG TRU

Faculty of Information Technology No. 2
PTIT HCM
Mobile: 098.698.1177

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 1

 Imaging

[Albrecht Dürer, 1525]

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 2

 Imaging
X

y X

[Albrecht Dürer, 1525]

◼ Image: a visual representation in form of a function f (x,y)

where f is related to the brightness (or color) at point (x,y)
◼ Most images are defined over a rectangle
◼ Continuous in amplitude and space
Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 3
 Imaging

Dark chamber with lenses [Kircher 1646]

◼ Image: a visual representation in form of a function f (x,y)

where f is related to the brightness (or color) at point (x,y)
◼ Most images are defined over a rectangle
◼ Continuous in amplitude and space

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 4

 Camera Obscura in San Francisco

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 5

 Digital Images and Pixels
◼ Digital image: discrete samples f [x,y] representing continuous image f (x,y)
◼ Each element of the 2-d array f [x,y] is called a pixel or pel
(from “picture element“)

200x200 100x100 50x50 25x25

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 6

 Color Components
Monochrome image

R[x,y] = G[x,y] = B[x,y]

20 μm

Red R[x,y] Green G[x,y] Blue B[x,y]

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 7

 Why do we process images?
◼ Acquire an image
– Correct aperture and color balance
– Reconstruct image from projections
◼ Prepare for display or printing
– Adjust image size
– Color mapping, gamma-correction, halftoning
◼ Facilitate picture storage and transmission
– Efficiently store an image in a digital camera
– Send an image from space
◼ Enhance and restore images
– Touch up personal photos
– Color enhancement for security screening
◼ Extract information from images
– Read 2-d bar codes
– Character recognition
– Depth estimation
◼ Many more ... image processing is ubiquitous
Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 8
 Image Processing Examples
Mosaic from 33 source
images

Google Jump

facebook 360

Mosaic from 21 source images light.co

source: M. Borgmann, L. Meunier, EE368 class project, spring 2000.

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 9

 Image Processing Examples
Face morphing

Source: Yi-Wen Liu and Yu-Li Hsueh, EE368 class project, spring 2000.

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 10

 Image Processing Examples
Face Detection

source: Henry Chang, Ulises Robles, EE368 class project, spring 2000.

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 11

 Image Processing Examples
Face Detection

source: Michael Bax, Chunlei Liu, and Ping Li, EE368 class project, spring 2003.

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 12

 Image Processing Examples
Face Blurring for Privacy Protection

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 13

 Image Processing Examples

http://cs.stanford.edu/group/roadrunner/stanley.html

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 14

 Image Processing Examples
Visual Code Marker Recognition

EE368 Spring 2006 Project

 Image Processing Examples
Painting Recognition

1 2 3 4

5 6 7 8

9 10 EE368 Spring 2007 Project

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 16

Image Processing Examples
Painting Recognition

EE368 Spring 2007 Project

 Painting Recognition for Augmented Reality
Right-eye Left-eye
LCD LCD

Camera

Android
controller

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 18

 Image Processing Examples
CD Cover Recognition

EE368 Spring 2007 Project

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 19

 CD Cover Recognition on Cameraphone

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 20

Video See-through Augmented Reality on the Phone

Hershed Tilak & Robert Mahieu EE368, 2015/16

 Image Processing Examples: Style Transfer
New art
Style
generated
examples
by algorihm

Original photos

Elias Wang, Nicholas Tan, EE368, 2016/17

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 22

 INT13146 Topics

◼ Point operations/combining images/histograms

◼ Color science
◼ Image thresholding/segmentation
◼ Morphological image processing
◼ Image filtering, deconvolution, template matching
◼ Eigenimages, Fisherimages
◼ Edge detection, keypoint detection
◼ Scale-space image processing
◼ Image matching, image registration

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 23

 Image Processing and Related Fields
Artificial Robotics,
Intelligence Computer Inspection,
Machine
Vision Photogrammetry
Vision
Machine
learning
Statistics, M-d
Information
Theory Image Image Signal
coding Processing
Processing
Visual
Perception Imaging
Computational
Photography

Display Computer
Technology Graphics Optical Engineering

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 24

 INT13146 Weekly Assignments
◼ Weekly problem sets
⚫ Handed out Mondays, correspond to the lectures of that particular week
⚫ About 8-12 hours of work, requires computer + Python
⚫ Discussions among students encouraged, however, individual solution must be submitted
⚫ Due 9 days later (Wednesday 1:30 pm).
⚫ Late submission: 30% penalty if submitted by Friday 1:30 pm. No credit afterwards.
◼ First assignment handed out on January 8 (first day of class)

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 25

 INT13146 Midterm
◼ 24-hour take-home exam
◼ Problems similar to weekly assignments
◼ Typically requires 5-6 hours of work
◼ 3 slots during week after the last lecture, February 28 – March 3

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 26

 INT13146 Final Project
◼ Group project, teams of 3-5 students, exceptions possible.
◼ Plan for about 50-60 hours per person
◼ Develop, implement and test/demonstrate an image processing algorithm
◼ Project proposal due: February 12, 11:59 p.m.
◼ Project presentation: Poster session, March 14, 4:30-6:30 p.m.
◼ Remote SCPD students can alternatively submit a narrated video presentation
◼ Submission of written report and source code: March 16, 11:59 p.m.

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 27

 INT13146 Grading

◼ Online quizzes: 10%

◼ Homework problems: 10%
◼ Midterm: 20%
◼ Final project: 60%
◼ No final exam.

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 28

 Mobile image processing (optional)
◼ Up-to-date tutorials on Android image processing online
◼ Programming in Java (C++ for OpenCV)
◼ Limited number of loaner tablets for students who don‘t have their own device

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 29

 Reading
◼ Slides available as pdf files on the class website (click on for source code and data)
http://e-learning.ptithcm.edu.vn/
◼ Popular text books
⚫ William K. Pratt, „Introduction to Digital Image Processing,“ CRC Press, 2013.
⚫ R. C. Gonzalez, R. E. Woods, „Digital Image Processing,“ 4th edition, Pearson, 2018.
⚫ A. K. Jain, „Fundamentals of Digital Image Processing,“ Addison-Wesley, 1989. (older, more mathematical)
◼ Software-centric books
⚫ R. C. Gonzalez, R. E. Woods, S. L. Eddins, „Digital Image Processing using Matlab,“
2nd edition, Gatesmark Publishing, 2009.
⚫ G. Bradski, A. Kaehler, „Learning OpenCV,“ O‘Reilly Media, 2008.
◼ Comprehensive state-of-the-art compendium
⚫ Al Bovik (ed.), „The Essential Guide to Image Processing,“ Academic Press, 2009.
◼ Journals/Conference Proceedings
⚫ IEEE Transactions on Image Processing
⚫ IEEE International Conference on Image Processing (ICIP)
⚫ IEEE Computer Vision and Pattern Recognition (CVPR)
⚫ ....

Image Processing: Huynh Trung Tru, © 2023 PTIT HCM -- Introduction 30