UNIT-4

Crisp Set: Crisp set is a collection of unordered distinct elements, which are derived from a
Universal set. A Universal set consists of all possible elements which take part in any
experiment.
Let X represents a set of natural numbers, so
X = {1, 2, 3, 4 …}
Sets are always defined with respect to some universal set. Let us derive two sets A and B from
this universal set X.
A = Set of even numbers = {2, 4, 6 …}
B = Set of odd number = {1, 3, 5 …}
Elements in the set are unique, i.e. A = {1, 1, 2, 2, 3, 3}, B = {1, 2, 3}, C = {1, 2, 2, 3, 3, 3} all
are the same.
The order of elements in the set is not important, i.e. A = {1, 2, 3}, B = {2, 1, 3}, C = {3, 1,
2}, all correspond to identical set.
The element of the set is called a member of the set. If any element is present in the set then
it is considered a member of the set otherwise it is not a member. In a crisp set, there is no
concept of partial membership. Element is either fully present in the set or it is fully outside the
set.
A crisp set is very important to model or represents many real-world entities, such as a set of
boys, a set of books, a set of elements, a set of employees, a set of colours etc.
The membership function can be used to define a set A given by
ΧA (x) = {1, 0, ifx∈Aifx∉A}
Fuzzy Logic:
The 'Fuzzy' word means the things that are not clear or are vague. Sometimes, we cannot
decide in real life that the given problem or statement is either true or false. At that time, this
concept provides many values between the true and false and gives the flexibility to find the
best solution to that problem.
Example:
Fuzzy logic contains the multiple logical values and these values are the truth values of a
variable or problem between 0 and 1. This concept was introduced by Lofti
Zadeh in 1965 based on the Fuzzy Set Theory. This concept provides the possibilities which
are not given by computers, but similar to the range of possibilities generated by humans.
In the Boolean system, only two possibilities (0 and 1) exist, where 1 denotes the absolute truth
value and 0 denotes the absolute false value. But in the fuzzy system, there are multiple
possibilities present between the 0 and 1, which are partially false and partially true.
The Fuzzy logic can be implemented in systems such as micro-controllers, workstation-based or
large network-based systems for achieving the definite output. It can also be implemented in
both hardware and software.
Characteristics of Fuzzy Logic
 This concept is flexible and we can easily understand and implement it.
 It is used for helping the minimization of the logics created by the human.
 It is the best method for finding the solution of those problems which are suitable for
approximate or uncertain reasoning.
 It always offers two values, which denote the two possible solutions for a problem and
statement.
 It allows users to build or create the functions which are non-linear of arbitrary
complexity.
 In fuzzy logic, everything is a matter of degree.
 In the Fuzzy logic, any system which is logical can be easily fuzzified.
 It is based on natural language processing.
 It is also used by the quantitative analysts for improving their algorithm's execution.
 It also allows users to integrate with the programming.

Architecture of a Fuzzy Logic System

In the architecture of the Fuzzy Logic system, each component plays an important role. The
architecture consists of the different four components which are given below.
1. Rule Base
2. Fuzzification
3. Inference Engine
4. Defuzzification

1. Rule Base: Rule Base is a component used for storing the set of rules and the If-Then
conditions given by the experts are used for controlling the decision-making systems.

2. Fuzzification: Fuzzification is a module or component for transforming the system inputs,

i.e., it converts the crisp number into fuzzy steps. The crisp numbers are those inputs which are
measured by the sensors and then fuzzification passed them into the control systems for further
processing. This component divides the input signals into five states:
1. Large Positive (LP)
2. Medium Positive (MP)
3. Small (S)
 4. Medium Negative (MN)
5. Large negative (LN)

3. Inference Engine: This component is a main component in any Fuzzy Logic system (FLS),
because all the information is processed in the Inference Engine. It allows users to find the
matching degree between the current fuzzy input and the rules. After the matching degree, this
system determines which rule is to be added according to the given input field. When all rules
are fired, then they are combined for developing the control actions.

4. Defuzzification: Defuzzification is a module or component, which takes the fuzzy set inputs,
generated by the Inference Engine, and then transforms them into a crisp value. The crisp value
is a type of value which is acceptable by the user. Various techniques are present to do this, but
the user has to select the best one for reducing the errors.

Applications of Fuzzy Logic:

 It is used in Businesses for decision-making support system.
 It is used in automotive systems for controlling the traffic and speed, and for improving
the efficiency of automatic transmissions.
 This concept is also used in the Defence in various areas. Defence mainly uses the Fuzzy
logic systems for underwater target recognition and the automatic target recognition of
thermal infrared images.
 It is also widely used in the Pattern Recognition and Classification in the form of Fuzzy
logic-based recognition and handwriting recognition. It is also used in the searching of
fuzzy images.
 Fuzzy logic systems also used in Securities.
 It is also used in microwave oven for setting the lunes power and cooking strategy.
 This technique is also used in the area of modern control systems such as expert systems.
 Finance is also another application where this concept is used for predicting the stock
market, and for managing the funds.
 It is also used for controlling the brakes.
 It is also used in the industries of chemicals for controlling the ph, and chemical
distillation process.
 It is also used in the industries of manufacturing for the optimization of milk and cheese
production.
 It is also used in the vacuum cleaners, and the timings of washing machines.
 It is also used in heaters, air conditioners, and humidifiers.

Advantages of Fuzzy Logic

 The methodology of this concept works similarly as the human reasoning.
 Any user can easily understand the structure of Fuzzy Logic.
 It does not need a large memory, because the algorithms can be easily described with
fewer data.
 It is widely used in all fields of life and easily provides effective solutions to the
problems which have high complexity.
 This concept is based on the set theory of mathematics, so that's why it is simple.
  It allows users for controlling the control machines and consumer products.
 The development time of fuzzy logic is short as compared to conventional methods.
 Due to its flexibility, any user can easily add and delete rules in the FLS system.

Disadvantages of Fuzzy Logic

 The run time of fuzzy logic systems is slow and takes a long time to produce outputs.
 Users can understand it easily if they are simple.
 The possibilities produced by the fuzzy logic system are not always accurate.
 Many researchers give various ways for solving a given statement using this technique
which leads to ambiguity.
 Fuzzy logics are not suitable for those problems that require high accuracy.
 The systems of a Fuzzy logic need a lot of testing for verification and validation.

Operations on Fuzzy Set: Given A and B is the two fuzzy sets, and X is the universe of
discourse with the following respective member functions:
The operations of Fuzzy set are as follows:
1. Union Operation: The union operation of a fuzzy set is defined by:
μA∪B(x) = max (μA(x), μB(x))
Example:
Let's suppose A is a set which contains following elements:
A = {( X1, 0.6 ), (X2, 0.2), (X3, 1), (X4, 0.4)}
And, B is a set which contains following elements:
B = {( X1, 0.1), (X2, 0.8), (X3, 0), (X4, 0.9)}
then,
AUB = {( X1, 0.6), (X2, 0.8), (X3, 1), (X4, 0.9)}
Because, according to this operation
For X1
μA∪B(X1) = max (μA(X1), μB(X1))
μA∪B(X1) = max (0.6, 0.1)
μA∪B(X1) = 0.6
For X2
μA∪B(X2) = max (μA(X2), μB(X2))
μA∪B(X2) = max (0.2, 0.8)
μA∪B(X2) = 0.8
For X3
μA∪B(X3) = max (μA(X3), μB(X3))
μA∪B(X3) = max (1, 0)
μA∪B(X3) = 1
For X4
μA∪B(X4) = max (μA(X4), μB(X4))
μA∪B(X4) = max (0.4, 0.9)
μA∪B(X4) = 0.9
2. Intersection Operation:The intersection operation of fuzzy set is defined by:
μA∩B(x) = min (μA(x), μB(x))
Example:
Let's suppose A is a set which contains following elements:
A = {( X1, 0.3 ), (X2, 0.7), (X3, 0.5), (X4, 0.1)}
And, B is a set which contains following elements:
B = {( X1, 0.8), (X2, 0.2), (X3, 0.4), (X4, 0.9)}
then,
A∩B = {( X1, 0.3), (X2, 0.2), (X3, 0.4), (X4, 0.1)}

Classical Set Theory VS Fuzzy Set Theory:

Classical Set Theory Fuzzy Set Theory

1. This theory is a class of those sets 1. This theory is a class of those sets having
having sharp boundaries. un-sharp boundaries.

2. This set theory is defined by exact 2. This set theory is defined by ambiguous
boundaries only 0 and 1. boundaries.

3. In this theory, there is no 3. In this theory, there always exists

uncertainty about the boundary's uncertainty about the boundary's location of
location of a set. a set.

4. This theory is widely used in the 4. It is mainly used for fuzzy controllers.
design of digital systems.

Membership Function:
The membership function is a function which represents the graph of fuzzy sets, and allows
users to quantify the linguistic term. It is a graph which is used for mapping each element of x
to the value between 0 and 1. This function is also known as indicator or characteristics
function.
This function of Membership was introduced in the first papers of fuzzy set by Zadeh. For the
Fuzzy set B, the membership function for X is defined as: μB:X → [0,1]. In this function X,
each element of set B is mapped to the value between 0 and 1. This is called a degree of
membership or membership value.

Fuzzification: Fuzzification may be defined as the process of transforming a crisp set to a

fuzzy set or a fuzzy set to fuzzier set. Basically, this operation translates accurate crisp input
values into linguistic variables. In a number of engineering applications, it is necessary to
defuzzify the result or rather "fuzzy result" so that it must be converted to crisp result.
Fuzzification is done by recognizing various assumed crisp quantities as the non-deterministic
and completely uncertain in nature. This uncertainty may be emerged because of imprecision
and uncertain that lead variables to be presented by a membership function because they can be
fuzzy in nature.
Fuzzification translates the crisp input data into linguistic variables which are represented by
fuzzy sets. After that, it applies the membership functions to measure and determine the degree
of membership.

Defuzzification: Defuzzification may be defined as the process of reducing a fuzzy set into a
crisp set or to convert a fuzzy member into a crisp member. Mathematically, the process of
Defuzzification is also called "rounding it off". Defuzzification basically transforms an
imprecise data into precise data. However, it is a relatively complex to implement
defuzzification as compared to fuzzification.
Defuzzification is basically the reverse process of fuzzification because it converts the fuzzy
data into crisp data. In some practical implementations, the defuzzification process is required
for crisp control actions to operate the control.
Now, let us discuss the differences between fuzzification and defuzzification.

Difference between Fuzzification and Defuzzification

Key Fuzzification Defuzzification

Fuzzification is the process Defuzzification is the process of reducing a

of transforming a crisp set to fuzzy set into a crisp set or converting a fuzzy
Definition
a fuzzy set or a fuzzy set to member into a crisp member.
fuzzier set.

Fuzzification converts a Defuzzification converts an imprecise

Purpose precise data into imprecise data into precise data.
data.

Example Voltmeter. Stepper motor, D/A converter.

Inference, Rank ordering, Maximum membership principle,

Methods
used
Angular fuzzy sets, Neural Centroid method, Weighted average
network. method, Center of sums.

Fuzzification is easy. Defuzzification is quite complex to

Complexity
implement.

Fuzzification uses if-then Defuzzification uses center of gravity

Approach rules to fuzzify the crisp methods to get centroid of sets.
value.
FUZZY INFERENCE SYSTEM:
A fuzzy inference system may be a computer paradigm supported by fuzzy set theory, fuzzy if-
then rules, and fuzzy reasoning. A nonlinear mapping that derives its output from fuzzy
reasoning and a group of fuzzy if-then rules. The mapping domain and range can be
multidimensional spaced fuzzy sets or points.
A fuzzy inference system is a system that uses a fuzzy set theory to map inputs to outputs.

Applications of FIS:
A fuzzy inference system is used in different fields, for example, information order, choice
examination, master system, time arrangement forecasts, advanced mechanics, and example
acknowledgment. It is otherwise called a fuzzy rule-based system, fuzzy model, fuzzy logic
controller, fuzzy expert system, and fuzzy associative memory.
It is the vital unit of a fuzzy logic system that deals with decision-making and choosing
essential tasks. It utilizes the “IF… . At that point” leads alongside the connectors “AND” “OR”
to draw fundamental choice standards.

Characteristics of Fuzzy Inference system

 The yield from FIS is consistently a fuzzy set irrespective of its input which can be fuzzy
or crisp.
 It is necessary to have a fuzzy output when it is used as a controller.
 A defuzzification unit would accompany the FIS to convert the fuzzy variable into a crisp
variable.

Structure of Fuzzy Inference System

 A rule base containing fuzzy rules
 A database (or dictionary), containing the participation functions utilized in the fuzzy
rules.
 A reasoning mechanism performing the induction made upon the guidelines and the facts
given to infer a reasonable output or conclusion.

Fuzzy Logic Control System

 Fuzzy logic control (FLC) is the most active research area in the application of fuzzy set
theory, fuzzy reasoning, and fuzzy logic. The application of FLC extends from industrial
process control to biomedical instrumentation and securities. Compared to conventional
control techniques, FLC has been best utilized in complex ill-defined problems, which
can be controlled by an efficient human operator without knowledge of their underlying
dynamics.
 A control system is an arrangement of physical components designed to alter another
physical system so that this system exhibits certain desired characteristics. There exist
two types of control systems: open-loop and closed-loop control systems. In open-loop
control systems, the input control action is independent of the physical system output. On
the other hand, in a closed-loop control system, the input control action depends on the
physical system output. Closed-Hoop control systems are also known as feedback control
 systems. The first step toward controlling any physical variable is to measure it. A sensor
measures the controlled signal,:
 The output of the physical system under control is adjusted by the help of an error signal.
The difference between the actual response (calculated) of the płant and the desired
response gives the error signal. For obtaining satisfactory responses and characteristics
for the closed-loop control system, an additional system, called as compensator or
controller, can be added to the loop. The basic block diagram of the closed-loop control
system is shown in Figure 1. The fuzzy control rules are basically IE-THEN rules.

Control System Design:

1. Decomposing the large-scale system into a collection of various subsystems.

2. Varying the plant dynamics slowly and linearizing the nonlinear plane dynamics about a
set of operating points.
3. Organizing a set of state variables, control variables, or output features for the system
under consideration.
4. Designing simple P, PD, PID controllers for the subsystems. Optimal controllers can also
be designed.
Apart from the first four steps, there may be uncertainties occurring due to external
environmental conditions. The design of the controller should be made as dose as possible to
the optimal controller design based on the expert knowledge of the control engineer. This may
be done by various numerical observations of the input-output relationship in the form of
linguistic, intuitive, and other kinds of related information related to the dynamics of the plant
and the external environment. Finally, a supervisory control system, either manual operator or
automatic, forms an extra feedback control loop to tune and adjust the parameters of the
controller, for compensating the variation effects caused by nonlinear and remodelled
dynamics. In comparison with a conventional control system design, an FLC system design
should have the following assumptions made, in case it is selected. The plant under
consideration should be observable and controllable. A wide range of knowledge comprising a
set of expert linguistic rules, basic engineering common sense, a set of data for input/output, or
a controller analytic model, which can be fuzzified and from which the fuzzy rule the base can
be formed, should exist. Also, for the problem under consideration, a solution should exist and
it should be such that the control the engineer is working for a “good” solution and not
especially looking for an optimum solution. The controller, in this case, should be designed to
the best of our ability and within an acceptable range of precision. It should be noted that the
problems of stability and optimality are ongoing problems in the fuzzy controller design.
There are four structures of the fuzzy production rule system:
 A set of rules that represents the policies and heuristic strategies of the expert decision-
maker.
 A set of input data that are assessed immediately prior to the actual decision.
 A method for evaluating any proposed action in terms of its conformity to the expressed
rules when there is available data.
 A method for generating promising actions and determining when to stop searching for
better ones.
All the necessary parameters used in the fuzzy logic controller are defined by membership
functions. The rules are evaluated using techniques such as approximate reasoning or
interpolative reasoning. These four structures of fuzzy rules help in obtaining the control
surface that relates the control action to the measured state or output variable. The control
surface can then be sampled down to a finite number of points and based on this information; a
look-up table may be constructed. The look-up table comprises the information about the
control surface which can be downloaded into a read-only memory chip. This chip would
constitute a fixed controller for the plant.

Architecture and Operations of FLC System:

The principal components of an FLC system is a fuzzifier, a fuzzy rule base, a fuzzy knowledge
base, an inference engine, and a defuzz.ifier. It also includes parameters for normalization.
When the output from the defuzzifier is not a control action for a plant, then the system is a
fuzzy logic decision system. The fuzzifier present converts crisp quantities into fuzzy quantities.
The fuzzy rule base stores knowledge about the operation of the process of domain expertise.
The fuzzy knowledge base stores the knowledge about all the input-output fuzzy relationships.
It includes the membership functions defining the input variables to the fuzzy rule base and the
out variables to the plant under control. The inference engine is the kernel of an FLC system,
and it possesses the capability to simulate human decisions by performing approximate
reasoning to achieve the desired control strategy. The defuzzifier converts the fuzzy quantities
into crisp quantities from an inferred fuzzy control action by the inference engine.

The various steps involved in designing a fuzzy logic controller are as follows:
Step 1: Locate the input, output, and state variables of the plane under consideration. I
Step 2: Split the complete universe of discourse spanned by each variable into a number of
fuzzy subsets, assigning each with a linguistic label. The subsets include all the elements in the
universe.
Step 3: Obtain the membership function for each fuzzy subset.
Step 4: Assign the fuzzy relationships between the inputs or states of fuzzy subsets on one side
and the output of fuzzy subsets on the other side, thereby forming the rule base.
Step 5: Choose appropriate scaling factors for the input and output variables for normalizing the
variables between [0, 1] and [-1, I] interval.
Step 6: Carry out the fuzzification process.
Step 7: Identify the output contributed from each rule using fuzzy approximate reasoning.
Step 8: Combine the fuzzy outputs obtained from each rule.
Step 9: Finally, apply defuzzification to form a crisp output.

Applications:
 Traffic Control
 Steam Engine
 Aircraft Flight Control
 Missile Control
 Adaptive Control
 Liquid-Level Control
 Helicopter Model
 Automobile Speed Controller
 Braking System Controller
 Process Control (includes cement kiln control)
 Robotic Control
 Elevator (Automatic Lift) control
 Automatic Running Control
 Cooling Plant Control
 Water Treatment
 Boiler Control
 Nuclear Reactor Control
 Power Systems Control
FUZZY CLUSTERING:
Fuzzy clustering is an unsupervised machine learning technique that divides the given data into
different clusters based on their distances (similarity) from each other.
The unsupervised k-means clustering algorithm gives the values of any point lying in some
particular cluster to be either as 0 or 1 i.e., either true or false. But the fuzzy logic gives the
fuzzy values of any particular data point to be lying in either of the clusters. Here, in fuzzy c-
means clustering, we find out the centroid of the data points and then calculate the distance of
each data point from the given centroids until the clusters formed become constant.
Suppose the given data points are {(1, 3), (2, 5), (6, 8), (7, 9)}
Fuzzy Clustering is a type of clustering algorithm in machine learning that allows a data point
to belong to more than one cluster with different degrees of membership. Unlike traditional
clustering algorithms, such as k-means or hierarchical clustering, which assign each data point
to a single cluster, fuzzy clustering assigns a membership degree between 0 and 1 for each data
point for each cluster.
Applications in several fields of Fuzzy clustering:
1. Image segmentation: Fuzzy clustering can be used to segment images by grouping pixels
with similar properties together, such as color or texture.
2. Pattern recognition: Fuzzy clustering can be used to identify patterns in large datasets by
grouping similar data points together.
3. Marketing: Fuzzy clustering can be used to segment customers based on their preferences
and purchasing behavior, allowing for more targeted marketing campaigns.
4. Medical diagnosis: Fuzzy clustering can be used to diagnose diseases by grouping
patients with similar symptoms together.
5. Environmental monitoring: Fuzzy clustering can be used to identify areas of
environmental concern by grouping together areas with similar pollution levels or other
environmental indicators.
6. Traffic flow analysis: Fuzzy clustering can be used to analyze traffic flow patterns by
grouping similar traffic patterns together, allowing for better traffic management and
planning.
7. Risk assessment: Fuzzy clustering can be used to identify and quantify risks in various
fields, such as finance, insurance, and engineering.
Advantages of Fuzzy Clustering:
 Flexibility: Fuzzy clustering allows for overlapping clusters, which can be useful when
the data has a complex structure or when there are ambiguous or overlapping class
boundaries.
 Robustness: Fuzzy clustering can be more robust to outliers and noise in the data, as it
allows for a more gradual transition from one cluster to another.
 Interpretability: Fuzzy clustering provides a more nuanced understanding of the structure
of the data, as it allows for a more detailed representation of the relationships between
data points and clusters.
Disadvantages of Fuzzy Clustering:
 Complexity: Fuzzy clustering algorithms can be computationally more expensive than
traditional clustering algorithms, as they require optimization over multiple membership
degrees.
 Model selection: Choosing the right number of clusters and membership functions can be
challenging, and may require expert knowledge or trial and error.
 If you’re interested in learning more about fuzzy clustering, you might consider reading
“Fuzzy Clustering and Its Applications” by James C. Bezdek or “An Introduction to
Fuzzy Clustering” by Witold Pedrycz and Fernando Gomide.

PATTERN RECOGNITION:
Pattern recognition aims to imitate the capabilities of the human brain. Think about it this way:
predictions on unseen data are feasible because of a models’ ability to identify recurring
patterns. In the meantime, that may happen with any data format, be it an image, video, text,
audio, etc.
While inherently complex, pattern recognition involves analyzing the input data, extracting
patterns, and comparing them against the stored data. The procedure can be broken down into
two phases: explorative, when the algorithms explore patterns, and descriptive, when algorithms
group and attribute the found patterns to the initial data. If we break this further, pattern
recognition in machine learning encompasses the following path:

Data collection: Using open-source datasets may cut off a great deal of time, as opposed to the
tedious manual data collection. Data quality control should still be your priority. An alternative
scenario is when your data is impossible to collect manually and the only way to go is to
generate or design artificial sets on your own, i.e., synthetic datasets.
Pre-processing: Pre-processing is all about fixing impurities to produce more comprehensive
sets of data and increase the chances of top-notch predictions.
Feature extraction: The input data is transformed into a feature vector, a reduced
representation of a set of features. That is to solve the issue of the high-dimensionality of the
input set, which means that only relevant information, namely selected features should be
extracted, as opposed to a full-size input.
Classification: Extracted features are used to compare them against similar patterns,
associating each one to the relevant class. The learning procedure, as we know, can take place
in two ways: With supervised learning, the classifiers will have prior knowledge of each pattern
category on top of the metrics and relevant parameters to distinguish among different patterns.
With regard to unsupervised learning, the parameters are defined or updated upon the
introduction of the input data. The model here relies on the inherent patterns in data it is capable
of determining to generate the desired output. Final heads-up: pattern recognition doesn’t end
with the raw output. It is usually followed by post-processing, which involves further decision-
making on how to use those results to properly guide the system.

Types of pattern recognition algorithms:

1. Statistical: It uses statistical techniques to learn from examples. This way the model
gathers observations to study and come up with working rules that are can potentially be
implemented for future observations.
2. Structural: The statistical method is not best suited for complex pattern recognition.
This is where structural recognition comes in with its hierarchical approach and
categorization into subclasses. The model describes complex relationships between
multiple elements and serves purposes such as image and shape analyses, where
measurable structures are confirmed.
3. Neural network: This method utilizes artificial neural networks and is more flexible in
comparison with traditional algorithms. Neural networks are efficient in classification,
deploying biological concepts to recognize patterns. When it comes to pattern
 recognition, the most effective method is feed-forward networks, where learning takes
place by giving feedback to the input patterns.
4. Template matching: Template matching is used when dealing with two entities of the
same type. Here, the target pattern is matched with a stored template, where the similarity
is determined between entities such as curves, shapes, etc.
5. Fuzzy-based: In real-world recognition problems, fuzziness (many-valued logic, where
the truth value of variables can be any real number between 0 and 1) is pervasive, which
is greatly attributed to our cognitive system.
6. Hybrid: A hybrid model typically describes a combination of different types of
algorithms to deploy the advantages of all the methods used. It recognizes patterns
through multiple classifiers, where each is trained based on feature spaces. A conclusion
is drawn based on the accumulation of classifier sets, whose accuracy is detected through
a decision function.

RETRIEVAL SYSTEM:
The concept of Information Retrieval System (IRS) is self-explanatory from the terminological
point of view and refers to a ‘system which retrieves information’. IRS is concerned with two
basic aspects:
(i) How to store information, and
(ii) How to retrieve information.
IRS is comprised of a set of interacting components, each of which is designed to serve a
specific function for a specific purpose. All these components are interrelated to achieve a goal.
The concept of IR thus is based on the fact that there are some items of information which have
been organized in a suitable order for easy retrieval. An information retrieval system is
designed to analyze process and store sources of information and retrieve those that match a
particular user’s requirements. Modern information retrieval systems can either retrieve
bibliographic items or the exact text that matches a user’s search criteria from a stored database
of documents. IRS originally meant text retrieval systems as they were dealing with textual
documents. Modern information retrieval systems deal not only with textual information but
also with multimedia information comprising text, audio, images and video. Thus, modern
information retrieval systems deal with storage, organization and access to text, as well as
multimedia information resources. Thus, an IR system is a set of rules and procedures, for
performing some or all of the following operations:
a) Indexing (or constructing of representations of documents);
b) Search formulation (or constructing of representations of information needs);
c) Searching (or matching representations of documents against representations of needs); and
d) Index language construction (or generation of rules of representation) So information
retrieval is collectively defined as a “science of search” or a process, method and procedure
used to select or recall, recorded and/or indexed information from files of data.

Objectives and Functions of IRS:

The major objective of an IRS is to retrieve the required information whenever needed. It is
either the actual information or through the documents containing the information surrogates
that fully or partially match the user’s query. Thus, the search output may contain bibliographic
details of the documents that matches the query, or the actual text, image, video, etc. that
contain the required information. The database in case of an information retrieval system may
contain abstracts or full texts of documents, like newspaper articles, handbooks, dictionaries,
encyclopedias, legal documents, statistics, etc., as well as audio, images, and video information.

The major functions of an IRS are:

1. To analyze the contents of the sources (documents);
2. To represent the contents of the analyzed sources for matching with the users’
queries;
3. To match the search statement with the stored database;
4. To retrieve the information that is relevant; and
5. To make necessary adjustments in the system based on feedback from the users.

Natural language processing

Natural language processing (NLP) is a subset of artificial intelligence, computer science, and
linguistics focused on making human communication, such as speech and text, comprehensible
to computers.
NLP is used in a wide variety of everyday products and services. Some of the most common
ways NLP is used are through voice-activated digital assistants on smartphones, email-scanning
programs used to identify spam, and translation apps that decipher foreign languages.

Natural language techniques:

Sentiment analysis: An NLP technique that analyzes text to identify its sentiments, such as
“positive,” “negative,” or “neutral.” Sentiment analysis is commonly used by businesses to
better understand customer feedback.
Summarization: An NLP technique that summarizes a longer text, in order to make it more
manageable for time-sensitive readers. Some common texts that are summarized include reports
and articles.
Keyword extraction: An NLP technique that analyzes a text to identify the most important
keywords or phrases. Keyword extraction is commonly used for search engine optimization
(SEO), social media monitoring, and business intelligence purposes.
Tokenization: The process of breaking characters, words, or subwords down into “tokens” that
can be analyzed by a program. Tokenization undergirds common NLP tasks like word
modeling, vocabulary building, and frequent word occurrence.

NLP benefits:
o Perform large-scale analysis:.
o Get a more objective and accurate analysis:
o Streamline processes and reduce costs
o Improve customer satisfaction
o Better understand your market
o Empower your employees
o Get real, actionable insights
NLP limitations:
o Contextual words and phrases and homonyms
o Synonyms
o Irony and sarcasm
o Ambiguity
o Errors in text or speech
o Colloquialisms and slang
o Domain-specific language
o Low-resource languages
o Lack of research and development

Natural language processing tools:

 Google Cloud NLP API
 IBM Watson
 Amazon Comprehend

Share Market Analysis:

Predicting the Stock Market has been the goal of investors since its existence. Everyday billions
of dollars are traded on the exchange, and behind each dollar is an investor hoping to profit in
one way or another. Should an investor be able to accurately predict market movements, it
offers tantalizing promises of wealth and influence. It is no wonder that the Stock Market and
its associated challenges find their way into the public imagination every time it misbehaves.
The share market is a compilation of different people buying and selling the shares. Mostly
known as stock (stake) which generally refers to claims of ownerships over a business by an
individual or group of individuals. The way of finding the future valuation of the stock market
prices is called the stock market estimate, expected to be Strong, accurate and effective.

SYSTEM ARCHITECTURE
1. Data Collection: Data is collected from various sources, such as yahoo finance and
google finance, which are in the form of .csv format. For news data gathering system
uses Google News API.
2. Analysis Manipulation and Visualization of data: Analysis Manipulation and
Visualization of Data: Data collected is cleaned and pre mal algorithms and models. And
along with this data visualization is also performed. The cleaned and pre-processed data
is used to create, build and train various machine learning algorithms which can be used
in predictions.
3. Build a Model: After the model has been built successfully, the next thing to do is
predict an outcome pattern for a particular stock and check the accuracy of the
predictions. esults of all Algorithms:
4. Predict Combining Results of all algorithms: After models are built system combines
their results for better prediction and high accuracy and predicts the output based on real
 time data provided to it. Predict an outcome after models are built system combines their
results for better data provided to it.
Artificial Intelligence is shaping the future of stock trading. Using Artificial Intelligence, Robo-
advisers analyze millions of data points and execute trades at the optimal price, analysts
forecast markets with greater accuracy and trading firms efficiently mitigate risk to provide for
higher returns.