CE601 Num Meth Lecture 7
CE601 Num Meth Lecture 7
Lecture 7
Course Coordinator:
Dr. Suresh A. Kartha,
Associate Professor,
Department of Civil Engineering,
IIT Guwahati.
Drawback in Elimination Methods
There are various drawbacks while using elimination
methods using computers
o Theoretically, the elimination methods should give
actual solution.
o However in computers we declare or assign
variables with only certain precision (say single
precision, double precision, etc.)
Due to this there are drawbacks like:
o Accumulation of round-off errors.
o Failure in solving ill-conditioned systems.
• Round-off Errors
o Round-off errors are generated by
approximating precision numbers by finite
precision numbers.
o Usually in computer you have single precision
numbers (7 significant digits) and double
precision numbers (14 significant digits).
o The case of effect of round-off errors in
elimination method is demonstrated in next
slide.
0.0003 3 x1 1.0002
1 1 x2 1
Using Gauss elimination method,
0.0003 3 1.0002
( R2 R2 (1 / 0.0003) R1 )
1 1 1
0.0003 3 1.0002
0 9999 3333
x2 0.3333333........
x1 0.666666.........
o But while using computer, you need to use finite precision
numbers.
Accuracy of Precision X2 x1
significant Digits
4 4 decimals 0.3333 1.000
5 5 decimals 0.33333 0.70000
6 6 decimals 0.333333 0.670000
7 7 decimals 0.3333333 0.6670000
o You can see from the above table, how based
on the significant digits and precision the
round-off errors creep.
o You can reduce round-off errors by doing
partial pivoting.
• Ill-conditioned System
Consider the system
x1 x2 2
x1 1.0001x2 2.0001
1 1 2
or,
1 1.0001 2.0001
It's solution is x2 1.0 and x1 1.0.
o if we give a slight perturbation on the
coefficient of x2 in the above equation,
i.e., x1 x2 2
x1 0.9999 x2 2.0001
1 1 2
or,
1 0.9999 2.0001
Now the solutions are x2 1 and x1 3.
• Condition Number
o Measure of sensitivity of the system to small
changes in any of its elements.
Recall, [ A]{x} {b}
Now it is clear, b A x (from properties of norm)
Small change { b} in {b} will cause change in {x},say by { x}.
So, new system will be, [ A] {x} { x} {b} { b}
[ A]{ x} { b} ( [ A]{x} {b})
{ x} [ A] 1{ b}
1
x A b
1
b x A x A b ( b A x)
x 1 b
A A
x b
1
where c( A) A A is called condition number.
x b
i.e., c( A)
x b
Smaller values of c(A) -> well conditioning
Larger values of c(A) -> ill conditioning
• Example
1 1
Find condition number of [ A]
1 1.0001
Ae 2.00005