2023-24

Acropolis Institute of
Technology and
Research, Indore Department of CSE
Submitted To: Prof. Lucky Saxena
(Artificial Intelligence & Machine
Learning)

Deep Learning (AL503)

Submitted By:- ___________________

Enrollment No. : 0827AL2110
AIS-1/3rd Year / 5th Sem

[LAB ASSIGNMENT DL(AL-503)]

T h e Ob ject iv e of th is lab ora tor y w ork i s to en ligh t en the st ud ent w i th k no w led ge b a se in
Deep learning a n d i t s a p p l i c a t i o n s .
 ACROPOLIS INSTITUTE OF TECHNOLOGY & RESEARCH,
INDORE

Department of CSE (Artificial Intelligence & Machine Learning)

CERTIFICATE

This is to certify that the experimental work entered in this journal as per

the B. TECH. III year syllabus prescribed by the RGPV was done by Mr.

____________ B.TECH III year V semester in the Deep Learning

Laboratory of this institute during the academic year 2023- 2024.

Signature of the Faculty

 About the Laboratory

The Deep Learning Laboratory provides students with a comprehensive understanding of deep learning concepts
and applications. It emphasizes both theoretical knowledge and hands-on experience, teaching students to build
and train deep neural networks using popular frameworks like TensorFlow and PyTorch. Students explore
computer vision and natural language processing, delve into advanced techniques such as CNNs and GANs, and
engage in ethical discussions related to AI. The lab encourages collaboration, real-world problem-solving, and
cutting-edge research, fostering innovation in the ever-evolving field of deep learning.
❖ GENERAL INSTRUCTIONS FOR LABORATORY CLASSES

➢ DO’S

✓ Without Prior permission do not enter into the Laboratory.

✓ While entering into the LAB students should wear their ID cards.

✓ The Students should come with proper uniform.

✓ Students should sign in the LOGIN REGISTER before entering into the
laboratory.

✓ Students should come with observation and record note book to the laboratory.

✓ Students should maintain silence inside the laboratory.

✓ After completing the laboratory exercise, make sure to shutdown the system
properly.

➢ DONT’S

✓ Students bringing the bags inside the laboratory.

✓ Students using the computers in an improper way.

✓ Students scribbling on the desk and mishandling the chairs.

✓ Students using mobile phones inside the laboratory.

✓ Students making noise inside the laboratory.

 SYLLABUS
Course: AL503 (Deep Learning)
Branch/Year/Sem: Artificial Intelligence & Machine Learning / III / V

Unit I:Introduction History of Deep Learning, McCulloch Pitts Neuron, Multilayer Perceptions (MLPs),
Representation Power of MLPs, Sigmoid Neurons, Feed Forward Neural Networks, Back propagation, weight
initialization methods, Batch Normalization, Representation Learning, GPU implementation, Decomposition –
PCA and SVD.
Unit II:Deep Feedforward Neural Networks, Gradient Descent (GD), Momentum Based GD, Nesterov
Accelerated GD, Stochastic GD, AdaGrad, Adam, RMSProp, Auto-encoder, Regularization in auto-encoders,
Denoising auto-encoders, Sparse auto-encoders, Contractive auto-encoders,Variational auto-encoder, Auto-
encoders relationship with PCA and SVD, Dataset augmentation.Denoising auto encoders,
Unit III:Introduction to Convolutional neural Networks (CNN) and its architectures, CCN terminologies: ReLu
activation function, Stride, padding, pooling, convolutions operations, Convolutional kernels, types of layers:
Convolutional, pooling, fully connected, Visualizing CNN, CNN examples: LeNet, AlexNet, ZF-Net, VGGNet,
GoogLeNet, ResNet, RCNNetc. Deep Dream, Deep Art. Regularization: Dropout, drop Connect, unit pruning,
stochastic pooling, artificial data, injecting noise in input, early stopping, Limit Number of parameters, Weight
decay etc.
Unit IV:Introduction to Deep Recurrent Neural Networks and its architectures, Backpropagation Through Time
(BPTT), Vanishing and Exploding Gradients, Truncated BPTT, Gated Recurrent Units (GRUs), Long Short
Term Memory (LSTM), Solving the vanishing gradient problem with LSTMs, Encoding and decoding in RNN
network, Attention Mechanism, Attention over images, Hierarchical Attention, Directed Graphical Models.
Applications of Deep RNN in Image Processing, Natural Language Processing, Speech recognition, Video
Analytics.
Unit V:Introduction to Deep Generative Models, Restricted Boltzmann Machines (RBMs), Gibbs Sampling for
training RBMs, Deep belief networks, Markov Networks, Markov Chains, Auto-regressive Models: NADE,
MADE, PixelRNN, Generative Adversarial Networks (GANs), Applications of Deep Learning in Object
detection, speech/ image recognition, video analysis, NLP, medical science etc.

HARDWARE AND SOFTWARE REQUIREMENTS:

S. Name of Item Specification

No.
1 Computer System Hard Disk min 5 GB
RAM: 4 GB / 8 GB
Processor: Intel i3 or above

S. Name of Item Specification

No.
1 Operating system Window XP or 2000
Editor Python3.7 IDLE or Google Colab or
Spyder(Anaconda)
RATIONALE:
The purpose of this subject is to cover the concepts of Deep Learning in terms ofTheory and
Implementation .The syllabus provides all the essential concepts of DL

PREREQUISITE:-

In this section information is provided on the prerequisites for “DL” and the courses
that provide the corresponding contents:
• Programming skills in a high-level language

COURSE OBJECTIVES AND OUTCOMES

➢ Course Objectives

Introduce deep learning fundamentals and major algorithms, the problem

settings, and their applications to solve real world problems

➢ Course Outcomes

After completing the course student should be able to:

• Describe in-depth about theories, fundamentals, and techniques in Deep learning.
• Identify the on-going research in computer vision and multimedia field.
• Evaluate various deep networks using performance parameters.
• Design and validate deep neural network as per requirements.
 Program Outcome (PO)

The engineering graduate of this institute will demonstrate:

a) Apply knowledge of mathematics, science, computing and engineering fundamentals to computer
science engineering problems.
b) Able to identify, formulate, and demonstrate with excellent programming, and problem solving skills.
c) Design solutions for engineering problems including design of experiment and processes to meet
desired needs within reasonable constraints of manufacturability, sustainability, ecological,
intellectual and health and safety considerations.
d) Propose and develop effective investigational solution of complex problems using research
methodology; including design of experiment, analysis and interpretation of data, and combination of
information to provide suitable conclusion. synthesis
e) Ability to create, select and use the modern techniques and various tools to solve engineering
problems and to evaluate solutions with an understanding of the limitations.
f) Ability to acquire knowledge of contemporary issues to assess societal, health and safety, legal and
cultural issues.
g) Ability to evaluate the impact of engineering solutions on individual as well as organization in a
societal and environmental context, and recognize sustainable development, and will be aware of
emerging technologies and current professional issues.
h) Capability to possess leadership and managerial skills, and understand and commit to professional
ethics and responsibilities.
i) Ability to demonstrate the team work and function effectively as an individual, with an ability to
design, develop, test and debug the project, and will be able to work with a multi-disciplinary team.
j) Ability to communicate effectively on engineering problems with the community, such as being able
to write effective reports and design documentation.
k) Flexibility to feel the recognition of the need for, and have the ability to engage in independent and
life- long learning by professional development and quality enhancement programs in context of
technological change.
l) A practice of engineering and management principles and apply these to one’s own work, as a
member and leader in a team, to manage projects and entrepreneurship.