Recurrent Neural Network: SUBMITTED BY: Harmanjeet Singh ROLL NO - 1803448 B.Tech, Cse (7) Ctiemt, Shahpur (Jalandhar)
Recurrent Neural Network: SUBMITTED BY: Harmanjeet Singh ROLL NO - 1803448 B.Tech, Cse (7) Ctiemt, Shahpur (Jalandhar)
NEURAL NETWORK
SUBMITTED BY : Harmanjeet singh
ROLL NO – 1803448
B.TECH , CSE (7)
CTIEMT ,SHAHPUR(JALANDHAR).
WHAT IS RECURRENT NEURAL
NETWORK (RNN)?
RNN are a class of neural networks that are
helpful in modeling sequence data.
RNNs exihibit similar behaviour to how
human brains function.
RNN produce predictive results in sequential
data that other algorithms can’t .
RNN are a type of neural network where the
output from previous step are fed as input
to the current step .
DIAGRAM OF RNN :
WHAT IS SEQUENTIAL DATA ?
Sequential data is basically just ordered data
in which related things follow each other.
Examples are financial data or DNA
sequence, audio clip, video clip .
The most popular type of sequential data is
perhaps time series data, which is just a
series of data points that are listed in time
order.
USE OF RNN
RNN is a type of Artificial Neural Network
commonly used in Speech Recognition and
Natural Language Processing.
RNN are used in deep learning and in the
development of models that simulate neuron
activity in the human brain.
RNN use cases tend to be connected to language
models in which knowing the next letter in a
word or the next word in a sentence is
predicated on the data that comes before it.
RNN is used in software behind Siri and Google
Translate .
TYPES OF RNN
One to one
One to many
Many to one
Many to many.
ADVANTAGES OF RNN
RNN remembers each and every information
through time.
It is useful in time series prediction , because
of the feature to remember previous inputs
as well. This is called Long Short Term
Memory.
RNN are even used with convolutional layers
to extend the effective pixel neighborhood.
DISADVANTAGES OF RNN
Gradient vanishing and exploiding problems.
Training a RNN is a very difficult task.
It cannot process very long sequences if using
tanh or relu as an activation function.
FORMULAS IN RNN
Formula for calculating current state :
ht= f(ht-1,xt)
Where,
ht -> current state
ht-1 -> previous state
xt -> input state
FORMULAS IN RNN
Formula for calculating output :
Yt = Whyht
Yt -> output
Why -> weight at output layer
THANK YOU.