OR Part I
OR Part I
OR Part I
1. INTRODUCTION
1.1. Definitions and scope of operations research
1.1.1. Definition
Operations Research (OR) is a science which deals with problem identification, formulation,
solutions and finally appropriate decision making.
OR is the use of mathematical models, statistics and algorithm to aid in decision-making. It is most
often used to analyze complex real life problems typically with the goal of improving or optimizing
performance.
“OR is concerned with scientifically deciding how to best design and operate man-machine system
usually requiring the allocation of scare resources.”
“OR is essentially a collection of mathematical techniques and tools which in conjunction with
system approach, are applied to solve practical decision problems of an economic or engineering
nature’’.
1.1.2. Scope of operations research
1|Page
problems and the need to find a better way to solve them provided the environment for the
emergence of operations research (commonly referred to as OR).
The roots of OR can be traced back many decades, when early attempts were made to use a
scientific approach in the management of organizations. However, the beginning of the activity
called operations research has generally been attributed to the military services early in World War
II. Because of the war effort, there was an urgent need to allocate scarce resources to the various
military operations and to the activities within each operation in an effective manner. Therefore, the
British and then the U.S. military management called upon a large number of scientists to apply a
scientific approach to dealing with this and other strategic and tactical problems. In effect, they were
asked to do research on (military) operations. These teams of scientists were the first OR teams. By
developing effective methods of using the new tool of radar, these teams were instrumental in
winning the Air Battle of Britain. Through their research on how to better manage group and
antisubmarine operations, they also played a major role in winning the Battle of the North Atlantic.
Similar efforts assisted the Island Campaign in the Pacific.
When the war ended, the success of OR in the war effort spurred interest in applying OR outside
the military as well. As the industrial boom following the war was running its course, the problems
caused by the increasing complexity and specialization in organizations were again coming to the
forefront. It was becoming apparent to a growing number of people, including business consultants
who had served on or with the OR teams during the war, that these were basically the same
problems that had been faced by the military but in a different context. By the early 1950s, these
individuals had introduced the use of OR to a variety of organizations in business, industry, and
government. The rapid spread of OR soon followed.
Operations Research has existed since the beginning of recorded history. As far back as World War
II, operations research techniques have been developed to assist the Military during the war. Today,
many organizations employ a staff of operation researcher or management science personnel or
consultants to apply the principles of operations research to management problems.
Pre-World war II: The roots of OR are as old as science and society. Though the roots of OR
extend to even early 1800s, it was in 1885 when Ferderick W. Taylor emphasized the application of
scientific analysis to methods of production, that the real start took place. Another man of early
scientific management era was Henry L. Gantt. Most job scheduling methods at that time were
rather random. A job, for instance, may be processed on a machine without dilemma but then wait
for days for acceptance by the next machine. Gantt mapped each job from machine to machine,
minimizing every delay. Now with the Gantt procedure, it is possible to plan machine loadings
months in advance and still quote delivery dates accurately.
However, it was the First Industrial Revolution which contributed mainly towards the development
of OR. Before this revolution, most of the industries were small scale, employing only a handful of
men. The advent of machine tools-the replacement of man by machine as a source of power and
improved means of transportation and communication resulted in fast flourishing industry. It
became increasingly difficult for a single man to perform all the managerial functions (of planning,
sale, purchase, production, etc.). Consequently, a division of management function took place.
Managers of production, marketing, finance, personnel, research and development etc., began to
appear. With further industrial growth, further subdivisions of management functions took place.
For example, production department was sub-divided into sections like maintenance, quality control,
procurement, production planning, etc.
Through this science of operation research originated in England, the united states soon took the
lead in united states these OR teams helped in developing strategies from mining operations,
inventing new flight patterns and planning of sea mines.
2|Page
Post-world war II: immediately after the war, the success of military teams attracted the attention
of industrial managers who were seeking solutions to their problems. Industrial operation research
in U.K. and U.S.A. developed along different lines. In U.K., the critical economic situation required
drastic increase in production efficiency and creation of new markets. Nationalization of a few key
industries further increased the potential field for OR. Consequently, OR soon spread from military
to government, industrial, social and economic planning.
The progress of operational research in U.S.A. was due to advent of second industrial revolution
which resulted in automation-the replacement of man by machine as a source of control. The new
revolution began around 1940s when electronic computers became commercially available. In 1950,
OR was introduced as a subject for academic study in American universities since then this subject
has been gaining ever increasing importance for the students of Mathematics, Statistics, Commerce,
Economics, Management and Engineering.
A crucial step in formulating an OR model is the construction of the objective function. This
requires developing a quantitative measure of performance relative to each of the decision maker’s
ultimate objectives that were identified while the problem was being defined. If there are multiple
objectives, their respective measures commonly are then transformed and combined into a
composite measure, called the overall measure of performance. This overall measure might be
something tangible (e.g., profit) corresponding to a higher goal of the organization, or it might be
abstract (e.g., utility). In the latter case, the task of developing this measure tends to be a complex
one requiring a careful comparison of the objectives and their relative importance. After the overall
measure of performance is developed, the objective function is then obtained by expressing this
measure as a mathematical function of the decision variables.
3|Page
A common theme in OR is the search for an optimal, or best, solution. Indeed, many procedures
have been developed for finding such solutions for certain kinds of problems. However, it needs to
be recognized that these solutions are optimal only with respect to the model being used. Since the
model necessarily is an idealized rather than an exact representation of the real problem. This step
needs an algorithm (systematic solution procedures) and post-optimality analysis (what would
happen to the optimal solution if different assumptions are made?)
Implementation
Install a well-documented system for applying the model. Include the model, solution procedure,
and operating procedures for implementation. This system is usually computer-based. A
considerable number of computer programs often need to be used and integrated. Databases and
management information systems may provide up-to-date input for the model. The assumptions of
the model continue to be satisfied. Need to revise or re-build models when significant deviations
occur.
1.4. Applications of operations research
It provides a tool for scientific analysis and provides solution for various business problems.
It enables optimum allocation of scarce resources.
It helps in minimizing waiting and servicing costs.
It enables the management to decide when to buy and how much to buy through the
technique of inventory planning.
It helps in evaluating situations involving uncertainty.
It enables experimentation with models, thus eliminating the cost of making errors while
experimenting with reality.
It allows quick and inexpensive examination of large numbers of alternatives.
In general, OR facilitates and improves the decision making process.
4|Page
CHAPTER TWO
LINEAR PROGRAMMING
5|Page
Objective Function: Objective function is the goal or objective of a management, stated as intent
to maximize or to minimize some important quantity such as profits or costs.
The objective function takes the following general form:
n
z ci xi
i 1
Where:
Ci = the objective function coefficient corresponding to the ith variable, and
Xi = the ith decision variable
The coefficients of the objective function indicate the contribution to the value of the objective
function of one unit of the corresponding variable.
Decision Variables: The Variables in a linear program are a set of quantities that need to be
determined in order to solve the problem; i.e., the problem is solved when the best values of the
variables have been identified. Typically, the variables represent the amount of a resource to use or
the level of some activity. Simply, things which produced sold or consumed.
Constraints define the possible values that the variables of a linear programming problem may take.
Factors that affect the production, sale and consumption of goods and services. They typically
represent resource constraints, or the minimum or maximum level of some activity or condition.
They take the following general form:
n
Subject to a x
i 1
i i bi
Non-negativity Constraints: the variables of linear programs must always take non-negative values
(i.e., they must be greater than or equal to zero).
Finally LPP model is represented as follows:
n
Z c x
i 1
i i
n
Subject to a x
i 1
i i bi
Xi > 0
In formulating the LPP as a mathematical model, we shall follow the following four steps
6|Page
1. Identify the decision variables and assign symbols to them (eg x, y, z,. . .or x1, x2, x3, . . .
2. Identify the set if constraints and express them in terms of inequalities involving the decision
variables.
3. Identify the objective function and express it in terms of the decision variables.
4. Add the non-negativity constraints
Before we get too focused on solving linear programs, it is important to review some theory For
instance, several assumptions are implicit in linear programming problems. These assumptions are:
1. Proportionality: deals with the contribution per unit of each decision variable to the
objective function
2. Optimization: Objective function to maximize or minimize
3. Finiteness: A finite number of activities and constraints to consider
4. Determinism: All parameters are assumed to be known constants
5. Continuity: All decision variables should be continuous variables.
6. Homogeneity: All units of the same resource or activity are identical
7. Additivity: When two or more activities are used, the total product is equal to the sum of
the individual products (no interaction effects between activities)
Example: Consider two models of color TV sets; Model A and B, are produced by a company to
maximize profit. The profit realized is $300 from A and $250 from set B. The limitations are
7|Page
a. Availability of only 40hrs of labor each day in the production department.
b. a daily availability of only 45 hrs on machine time
c. Ability to sale 12 set of model A.
How many sets of each model will be produced each day so that the total profit will be as large as
possible?
Resources used per unit
Labor hr. 2 1 40
Machine hr. 1 3 45
Marketing hr. 1 0 12
Profit $300 $250
Solution
1. Formulation of mathematical modeling of LPP
Max Z=300X1+250X2
St: 2X1+X2< 40
X1 < 12
X1,X2 >0
2X1+X2 = 40
X1+3X2= 45
X1 = 12
3. Draw the graph by intercepts
2X1+X2 = 40 ==> (0, 40) and (20, 0)
X1+3X2= 45==> (0, 15) and (45, 0)
X1 = 12==> (12, 0)
X1 X2 = 0
8|Page
2X1+X2 = 40
X2
X1=0
40 X1=12
15
B
X1+X2 = 45
Feasible C (12, 11)
Region X2=0
X1
D
A 12 20 45
9|Page
4. Identify the feasible area of the solution which satisfies all constrains.
5. Identify the corner points in the feasible region
A (0, 0), B (0, 15), C (12, 11) and D (12, 0)
6. Identify the optimal point
7. Interpret the result
Interpretation: 12 units of model A and 11 units of model B should be produced so that the total
profit will be $6350.
B. Minimization Problem
==>Minimize Z with inequalities of constraints in> form
Example: Suppose that a machine shop has two different types of machines; machine 1 and
machine 2, which can be used to make a single product .These machines vary in the amount of
product produced per hr., in the amount of labor used and in the cost of operation.
Assume that at least a certain amount of product must be produced and that we would like to utilize
at least the regular labor force. How much should we utilize each machine in order to utilize total
costs and still meets the requirement?
_____________________________________________________________
Resource used
Constraints Machine 1 (X1) Machine (X2) Minimum required hours
_____________________________________________________________________
Product produced/hr 20 15 100
Labor/hr 2 3 15________
Operation Cost $25 $30_____________________________
Solution
Min.Z 25 X 130 X 2
St :
20 X 115 X 2 100 LPP Model
2 X 13 X 2 15
X1, X 2 0
Constraint equation:
10 | P a g e
2X1+3X2=15 ==> (0, 5) and (7.5, 0)
X1 X2 = 0
X2
X1 =0
A (0, 20/3)
Feasible Region
B (2.5, 3.33)
X2 =0
X1
5 C (7.5, 0)
______________________________________________________________________________
Corners Coordinates MinZ=25 X1 + 30X2
A (0, 20/3) 200
X1 =2.5unit
X2=3.33unit and
MinZ= $162.5
1. Redundant Constraint
If a constraint when plotted on a graph doesn’t form part of the boundary making the feasible
region of the problem that constraint is said to be redundant constraint.
Example: A firm is engaged in producing two products A and B .Each unit of product A
requires 2Kg of raw material and 4 labor-hours for processing; whereas each unit of product B
requires 3Kg of raw materials and 3hrs of labor. Every unit of product A needs 4hrs to
packaging and every unit of product B needs 3.5hrs for packaging. Every week the firm has
availability of 60Kg of raw material, 96 labor-hours and 105 hrs. I the packaging department.1
unit of product A sold yields $40 profit and 1 unit of B sod yields $35 profit.
11 | P a g e
Required:
Solution
_______________________________________________________________
Products Resource available Resources
A B per week
__________________________________________________________________
Labor (hr) 4 3 96
a. LPP Model
Max.Z 40 X 135 X 2
St :
2 X 13 X 2 60
4 X 13 X 2 96
4 X 1 3.5 X 2 105
X1, X 2 0
X2
(0, 32)
Labor: 4X1+3X2= 96
Packaging: 4X1+3.5X2= 105
(0, 30)
Raw material: 2X1+3X2= 60
(0, 20) FR C (18,8)
X1
D (24, 0) (26, 0) (30, 0)
A (0, 0)
12 | P a g e
Corners Coordinates MinZ=40 X1 + 35X2
A (0, 0) 0
C (18, 8) 1000
D (24, 0) 960
X1 =18
X2=8 and
MinZ= 1000
Interpretation:
The company should produce and sale 18 units of product A and 8 units of product B per week
so as to get a maximum profit of 1000.
Note:
The packaging hour’s constraint does not form part of the boundary making the feasible region.
Thus, this constraint is of no consequence and is therefore, redundant. The inclusion or exclusion
of a redundant constraint does not affect the optimal solution of the problem.
==>We have unlimited number of optimal solution without increasing or decreasing the
objective function.
Example:
Max.Z 8 X 116 X 2
St :
3 X 16 X 2 900
X 1 X 2 200
X 2 125
X1, X 2 0
==>Multiple optimal solutions provide more choices for management to reach their objectives.
3. Infeasible Solution
13 | P a g e
A solution is called feasible if it satisfies all the constraints and the constraints and non-
negativity condition. However, it is sometimes possible that the constraints may be inconsistent
so that there is no feasible solution to the problem. Such a situation is called infeasibility.
Example:
MaxZ=20X1+30X2
St:2X1+X2< 40
4X1+X2< 60
X1 > 30
X1, X2 > 0
4. Unbounded Solution It is a solution whose objective function is infinite. If the feasible region
is unbounded then one or more decision variables will increase indefinitely without violating
feasibility, and the value of the objective function can be made arbitrarily large. Consider the
following model:
Example: Minz = 40x1 + 60x2
St: 2x1 + x2 ≥ 70
x1 + x2 ≥ 40
x1 + 3x2 ≥ 90
x1, x2 ≥ 0
SIMPLEX METHOD
The graphical method is useful only for problems involving two decision variables and relatively
few problem constraints. What happens when we need more decision variables and more
constraints? We use an algebraic method called the simplex method, which was developed by
George B. DANTZIG (1914-2005) in 1947 while on assignment with the U.S. Department of the
air force.
MAXIMIZATION PROBLEMS
14 | P a g e
Max.Z=300x1 +250x2
x1< 12 (Marketing)
x1, x2> 0
Solution
I.e. convert constraint inequality into equality form by introducing a variable called Slack variable.
Slack Variables: Slack variables represent the unused resources between the left-hand side and
right-hand side of each inequality. A slack variable(s) is added to the left hand side of a < constraint
to covert the constraint inequality in to equality. The value of the slack variable shows unused
resource.
A slake variable emerges when the LPP is a maximization problem. Slack variables represent unused
resource or idle capacity. Thus, they don’t produce any product and their contribution to profit is
zero. Slack variables are added to the objective function with zero coefficients.
Let that s1, s2, and s3 are unused labor, machine and marketing hrs respectively.
To represent the data, the simplex method uses a table called the simplex table or the simplex
matrix.
==> In constructing the initial simplex tableau, the search for of the optimal solution begins at the
origin. Indicating that nothing can be produced;
15 | P a g e
Thus, first assumption, No production implies that x1 =0 and x2=0
Note:In general, whenever there are n variables and m constraints (excluding the non-negativity),
where m is less than n (m<n), n-m variables must be set equal to zero
before the solution can be solved algebraically.
Therefore, n-m=5-3=2 variables(x1 and x2) are set equal to zero in the 1st simplex tableau. These are
non-basic variables. 3 Variables (s1, s2, and s3) are basic variables (in the 1st simplex tableau) because
they have non-zero solution values.
16 | P a g e
Step 4: Construct the initial simplex tableau
Cj 300 250 0 0 0
SV X1 X2 S1 S2 S3 Q
0 S1 2 1 1 0 0 40 R1
0 S2 1 3 0 1 0 45 R2
0 S3 1 0 0 0 1 12 R3
Zj 0 0 0 0 0 0
Cj - Zj 300 250 0 0 0
Note: The entering variable is the variable that has the most positive value in the Cj – Zj row also
called as indicator row. Or the entering variable is the variable that has the highest contribution to
profit per unit. X1 in our case is the entering variable. The column associated with the entering
variable is called key or pivot column ( X1columnin our case )
Pivot Column: The column of the tableau representing the variable to be entered into the solution
mix.
==> In this step, we determine the variable that will leave the solution for X1 (or entering variable)
Note: The row with the minimum or lowest positive (non-negative) replacement ratio shows the
variable to leave the solution. Pivot Row: The row of the tableau representing the variable to be
replaced in the solution mix.
Note: RR>0
The variable leaving the solution is called leaving variable or outgoing variable.
The row associated with the leaving variable is called key or pivot row (s3 columnin our case)
The element that lies at the intersection of the pivot column and pivot row is called pivot
element(No 1 in our case). Pivot Number: The element in both the pivot column and the pivot row.
17 | P a g e
Step 7: Repeat step 4-6 till optimum basic feasible solution is obtained.
Or: repeat step 3-5 till no positive value occurs in the Cj - Zj row.
Cj 300 250 0 0 0
SV X1 X2 S1 S2 S3 Q
0 S1 0 1 1 0 -2 16 R’1=R1-2R3
0 S2 0 3 0 1 -1 33 R’2=R2-R3
300 X1 1 0 0 0 1 12 R’3=R3
Cj - Zj 0 250 0 0 -300
Cj 300 250 0 0 0
SV X1 X2 S1 S2 S3 Q
0 S1 0 0 1 -1/3 -5/3 5
MINIMIZATION PROBLEMS
18 | P a g e
1. Direct method/Big M-method/
19 | P a g e
Example: Min Z=25x1 +30x2
x1, x 2> 0
Solution
Subject to:
The initial basic feasible solution is obtained by setting x1= x2= s1= s2=0
Cj 25 30 0 0 M M
SV X1 X2 S1 S2 A1 A2 Q
M A1 20 15 -1 0 1 0 100
M A2 2 3 0 -1 0 1 15
Cj - Zj 25 -22M 30- 18 M M 0 0
Note: Once an artificial variable has left the basis, it has served its purpose and can therefore be
removed from the simplex tableau. An artificial variable is never considered for re-entry into the
basis. 2nd Simplex Tableau
20 | P a g e
Cj 25 30 0 0 M
SV X1 X2 S1 S2 A2 Q
25 X1 1 3/4 -1/20 0 0 5
Cj - Zj 0 45/4-3/2M 5/4-1/10 M M 0
R’2=R2-2 R’
X1=5/2
Note: As long as an “A” variable is available in the solution variable column, the solution is
infeasible.
R’’1=R’1-3/4R’’2
Cj 25 30 0 0
SV X1 X2 S1 S2 Q 2/3/2
R’’2=R’
21 | P a g e
SPECIAL CASES IN SIMPLEX METHOD
1. Mixed constraints
Example
Max Z=6x1 +8x2
Subject to: x2< 4
6x1+ 2x2 >24
x1, x2> 0
Standard form
Max.Z=6x1 +8x2 + 0 s1 +0 s2+ 0 s3-M A2- M A3
St: x2+ s1 =4
6x1+2x2 - s3 + A3 =24
In order to break this tie, the selection for the key column (entering variable) can be made
arbitrary. However; the number of solution can be minimized by adopting the following rules:
1. If there is a tie between two decision variables, then the selection can be made arbitrary.
2. If there is a tie between a decision variable and a slack (or surplus) variable, then select the
decision variable to enter into basis first.
3. If there is a tie between slack or surplus variable, then selection can be made arbitrary.
3. Infeasibility
In the simplex method, an infeasible solution is indicated by looking at the final tableau .In it, all
Cj - Zj row entries will be the proper sign to imply optimality, but an artificial variable (A) will
still be in the solution mix.
22 | P a g e
Example: Minimization case
Cj 5 8 0 0 M
SV X1 X2 S1 S2 A2 Q
5 X1 1 1 -2 3 0 200
8 X2 0 1 1 2 0 100
M A2 0 0 0 -1 1 20
Zj 5 8 -2 31-M M 1,800+200M
Cj - Zj 0 0 2 M-31 0
Even though all Cj - Zj are positive or 0(i.e the criterion for an optimal solution in a
minimization case), no feasible solution is possible because an artificial variable (A2) remains
in the solution mix.
4. Unbounded Solutions
No finite solution may exist in problems that are not bounded .This means that a variable can be
infinitely large without violating a constraint. In the simplex method, the condition of
unboundedness will be discovered prior to reaching the final tableau. We will note the problem
when trying to decide which variable to remove from the solution mix. The procedure in
unbounded solution is to divide each quantity column number by the corresponding pivot
column number. The row with the smallest positive ratio is replaced. But if the entire ratios turn
out to be negative or undefined, it indicates that the problem is unbounded. Example:
Maximization case
Cj 6 9 0 0
SV X1 X2 S1 S2 Q
9 X2 -1 1 2 0 30
0 S2 -2 0 -1 1 10
Zj -9 9 18 0 270
Cj - Zj 15 0 -18 0
23 | P a g e
The solution in the above case is not optimal because not all Cj - Zj entries are 0 or negative, as
required in a maximization problem. The next variable to enter the solution should be X1.To
determine which variable will leave the solution, we examine the ratios of the quantity column
numbers to their corresponding numbers in the X1or pivot column. Since both pivot column
numbers are negative, an unbounded solution is indicated.
No unbounded solutions, no outgoing variable will exist.
5. Degeneracy
5 8 2 0 0 0
Cj
SV X1 X2 X3 S1 S2 S3 Q
8 X2 1/4 1 1 -2 0 0 10
0 S2 4 0 1/3 -1 1 0 20
0 S3 2 0 2 2/5 0 1 10
Zj 2 8 8 16 0 0 80
Cj - Zj 3 0 -6 -16 0 0
If there is a tie for the smallest ratio, this is a signal that degeneracy exists. Degeneracy can occur
right in the first (initial tableau). This normally happens when the number of constraints is less
than the number of variables in the objective function. Problem can be overcome by trial and
error method. Degeneracy is shown in the simplex algorithm alternatives back and forth
between the same non-optimal solutions, i.e., it puts a new variable in, then takes it out in the
next tableau, puts it back in ,and so on.
One simple way of dealing with the issue is to select either row (S2 or S3 in this case) arbitrary. If
we are unlucky and cycling does occur, we simply go back and select the other row.
24 | P a g e
6. Multiple Optimal Solutions
Multiple optimal solutions exist when non-basic variable contains zero on its Cj - Zj row.
Cj 3 2 0 0 Max Z=3X1+2X2
Cj - Zj 0 0 -2 0
25 | P a g e