MA12 - Linear Algebra (Unit 1)
MA12 - Linear Algebra (Unit 1)
OBJECTIVES
1. Solve different kinds of linear systems using
elimination method.
Many problems in the natural and social sciences
2. Correctly identify different kinds of matrices. as well as in engineering and the physical sciences
3. Add and multiply vertices. deal with equations relating two sets of variables.
4. Prove the different properties of matrix An equation of the type 𝑎𝑥 = 𝑏, expressing the
addition and matrix multiplication.
variable 𝑏 in terms of the variable 𝑥 and the
5. Solve linear systems using Gaussian
constant 𝑎, is called a linear equation. The word
Elimination, Gauss-Jordan Reduction, and LU
Factorization. linear is used here because the graph of the
equation above is a straight line.
In this unit, let us find why these linear equations are essentials to different fields and
how Linear Algebra differs from the College and Advanced Algebra you encountered
during your sophomore year.
1 2
_____4. If 𝐴 = [ ], then 𝐴2 − 7𝐴 = 21
4 6
______5. If 𝐴 and 𝐵 are invertible matrices, then 𝐴 + 𝐵 is an invertible matrix.
_____6. If 𝐴 and 𝐵 are invertible matrices, then 𝐴𝐵 is an invertible matrix.
2𝑥 + 2𝑦 = 3
_____7. The linear system { is equivalent to the matrix equation
𝑥−𝑦 = 1
2 2 𝑥 3
[ ] [𝑦] = [ ].
1 −1 1
_____8. If the 𝑛 × 𝑛 matrix 𝐴 is idempotent and invertible, then 𝐴 = 𝐼.
_____9. If 𝐴 and 𝐵 commute, then 𝐴𝑡 and 𝐵𝑡 commute.
2 −1 1 1
_____10. The inverse matrix [ ] is [ ].
3 1 −3 2
LINEAR EQUATION AND MATRICES U n i t O n e | 1.2
Many diverse applications are modeled by systems of equations. Systems of equations are
also important in mathematics and in particular in linear algebra. In this unit, we develop
systematic methods for solving systems of linear equations.
3
.
1.1 Linear Systems
Many naturally occurring processes are modeled using more than one equation and can
require many equations in many variables. For example, models of the economy contain
thousands of equations and variables. To develop this idea, consider the set of equations:
2𝑥 − 𝑦 = 2
{
𝑥 + 2𝑦 = 6
There are different methods in order to find the values of x and y. One of the methods
is the substitution method as shown below.
2𝑥 − 𝑦 = 2
In the given example, { , 𝑥 = 2 and 𝑦 = 2 or (2,2) is
𝑥 + 2𝑦 = 6
called the solution. A solution is the value represented by the
variable(s) that simultaneously satisfy each equation. In
graphical explanation, (2,2) is the unique point where the
equations 2𝑥 − 𝑦 = 2 and 𝑥 + 2𝑦 = 6 intersect, as shown in
Figure 1(a). A system of equations is consistent if there is at
least one solution to the system. If there are no solutions, the
system is inconsistent. In the case of systems of two linear
equations with two variables, there are three possibilities.
The two lines have different slopes and hence intersect at a unique point,
1 as shown in Fig. 1(a).
The two lines are identical (one equation is a nonzero multiple of the
2 other), so there are infinitely many solutions, as shown in Fig. 1(b).
The two lines are parallel (have the same slope) and do not intersect, so
3 the system is inconsistent, as shown in Fig. 1(c).
(2,2)
Figure 1
LINEAR EQUATION AND MATRICES U n i t O n e | 1.4
We used two different methods – (1) substitution and (2) elimination – to solve for the
values of the variables but we arrived in same answer. The values are 𝑥 = 2 and 𝑦 = 2 or
(2,2).
1.5 | U n i t O n e LINEAR EQUATION AND MATRICES
𝑥 − 3𝑦 = −7
Example #1 Consider the linear system {
2𝑥 + 6𝑦 = 10
.
Let’s use the elimination method. In order to eliminate 𝑦, let’s multiply
the first equation by 2.
(𝑥 − 3𝑦 = −7)2 2𝑥 − 6𝑦 = −14
{ {
2𝑥 + 6𝑦 = 10 2𝑥 + 6𝑦 = 10
𝑥 − 3𝑦 = −7
Therefore, the solution for { is (-1,2).
2𝑥 + 6𝑦 = 10
Example #2 𝑥+𝑦+ 𝑧= 4
Solve the linear system. {−𝑥 − 2𝑦 + 2𝑧 = −3
2𝑥 − 𝑦 + 2𝑧 = 2
In elimination method, there is no rule which variable will be eliminated
first. But in this example, we will eliminate first the variable 𝑥 in the
first and second equation by adding the two equations.
𝑥+ 𝑦+ 𝑧= 4
−𝑥 − 2𝑦 + 2𝑧 = −3
−𝑦 + 3𝑧 = 1 Eq. #4
We will also eliminate the variable 𝑥 in the second and third equation by
multiplying the second equation by 2.
(−𝑥 − 2𝑦 + 2𝑧 = −3)2 −2𝑥 − 4𝑦 + 4𝑧 = −6
2𝑥 − 𝑦 + 2𝑧 = 2 2𝑥 − 𝑦 + 2𝑧 = 2
Add the two equations to generate the equation #5.
−2𝑥 − 4𝑦 + 4𝑧 = −6
2𝑥 − 𝑦 + 2𝑧 = 2
−5𝑦 + 6𝑧 = −4 Eq. #5
Eliminate the variable 𝑧 in the fourth and fifth equation by multiplying
the fourth equation by -2.
(−𝑦 + 3𝑧 = 1) − 2 2𝑦 − 6𝑧 = −2
−5𝑦 + 6𝑧 = −4 −5𝑦 + 6𝑧 = −4
LINEAR EQUATION AND MATRICES U n i t O n e | 1.6
2𝑦 − 6𝑧 = −2
+ −5𝑦 + 6𝑧 = −4
−3𝑦 = −6
−𝑦 + 3𝑧 = 1
−(2) + 3𝑧 = 1
3𝑧 = 1 + 2
3𝑧 = 3
𝒛=𝟏
𝑥+𝑦+ 𝑧 = 4
Therefore, the solution for {−𝑥 − 2𝑦 + 2𝑧 = −3 is (1,2,1).
2𝑥 − 𝑦 + 2𝑧 = 2
𝑥 − 3𝑦 = −7
Example #3 Consider the linear system {
2𝑥 − 6𝑦 = 7
(𝑥 − 3𝑦 = −7)(−2) −2𝑥 + 6𝑦 = 14
{ {
2𝑥 − 6𝑦 = 7 2𝑥 − 6𝑦 = 7
−2𝑥 + 6𝑦 = 14
+ 2𝑥 − 6𝑦 = 7
0 = 21
𝑥 − 3𝑦 = −7
Consider the linear system {
Example #4 2𝑥 − 6𝑦 = −14
2𝑥 − 6𝑦 = −14
+
2𝑥 − 6𝑦 = −14
0=0
3. 2𝑥 − 3𝑦 + 4𝑧 = −12 4. 2𝑥 + 4𝑦 + 6𝑧 = −12
𝑥 − 2𝑦 + 𝑧 = −5 2𝑥 − 3𝑦 − 4𝑧 = 15
3𝑥 + 𝑦 + 2𝑧 = 1 3𝑥 + 4𝑧 + 5𝑧 = −8
5. 3𝑥 + 2𝑦 + 𝑧 = 2 6. 𝑥+𝑦 = 1
4𝑥 + 2𝑦 + 2𝑧 = 8 2𝑥 − 𝑦 = 5
𝑥−𝑦+𝑧 = 4 3𝑥 + 4𝑦 = 2
7. 𝑥 + 4𝑦 − 𝑧 = 12 8. 3𝑥 + 4𝑦 − 𝑧 = 8
3𝑥 + 8𝑦 − 2𝑧 = 4 6𝑥 + 8𝑦 − 2𝑧 = 3
3
.
1.2 matrices and elementary row operations
But what is
a matrix?
DEFINITION Matrix
An 𝑚 × 𝑛 matrix is a rectangular array of 𝑚𝑛 real
numbers arranged in 𝑚 horizontal rows and 𝑛 vertical
columns.
𝑎11 𝑎12 ⋯ ⋯ 𝑎1𝑛
𝑎21 𝑎22 ⋯ ⋯ 𝑎2𝑛
𝐴= ⋮ ⋮ ⋯ ⋯ ⋮
⋮ ⋮ ⋯ ⋯ ⋮
𝑎
[ 𝑚1 𝑎𝑚2 ⋯ ⋯ 𝑎𝑚𝑛 ]
6 4 3
−1 9 10 This is a 4 × 3 matrix because it
For example: 𝐴 = [ ]
2 5 −2 has 4 rows and 3 columns.
−1 3 7
Note: In matrix, the elements inside the bracket are called an entry. We denote an
entry as 𝑎𝑖𝑗 where 𝑖 is the row number and 𝑗 is the column number. For example,
what is the 𝑎23 in matrix A?
6 4 3
−1 9 10
𝐴=[ ] 𝑎𝑖𝑗 = 𝑎23 = 10 because 10 is the intersection of
2 5 −2
−1 3 7 the 2nd row and 3rd column.
6 4
𝐵=[
−1 9
] This is a 4 × 2 matrix because it
2 5 has 4 rows and 2 columns.
−1 3
6 4 3
𝐶 = [ 2 5 −2] This is a 3 × 3 matrix because it
−1 3 7 has 3 rows and 3 columns.
Note: Matrix C is a special type of matrix because the number of rows and columns are
equal. This is called a square matrix. The square matrix C has simply an order 3.
Special types of matrix are the following.
𝑎 𝑏 𝑐
Square matrix – a matrix with the
𝐶 = [𝑑 𝑒 𝑓]
𝑔 ℎ 𝑖 same number of rows and columns
𝑎 𝑏 𝑐 𝑥
𝐾=[ 𝑑 𝑒 𝑓| 𝑦] Augmented matrix
𝑔 ℎ 𝑖 𝑧
LINEAR EQUATION AND MATRICES U n i t O n e | 1.10
Note: Augmented Matrix has two parts separated by a vertical line. The entries on
the left side are the numerical coefficients of a linear system while the entries
on the right side are the constants.
3𝑥 + 2𝑦 + 7𝑧 = 3 3 2 7 3
4𝑥 + 9𝑦 + 4𝑧 = 6 [4 9 4| 6]
𝑥 + 8𝑦 = −9 1 8 0 −9
There is a missing term Missing terms should
here. be represented by 0.
3𝑥 + 2𝑦 + 7𝑧 = 3 3 2 7 3
4𝑥 + 4𝑧 = 6 [4 0 4| 6]
𝑥 + 8𝑦 = −9 1 8 0 −9
3𝑥 + 2𝑦 = 3 3 2 3
4𝑥 + 4𝑦 = 6 [4 4| 6]
𝑥 + 8𝑦 = −9 1 8 −9
3𝑤 + 2𝑥 + 7𝑦 − 2𝑧 = 3 3 2 7 −2 3
4𝑥 + 9𝑦 + 4𝑧 = 6 [0 4 9 4| 6]
𝑤 + 8𝑥 − 3𝑦 + 2𝑧 = −9 1 8 −3 2 −9
9 −3 −2 −8 1 2 6 −10
[−3 5 2| 12] [0 1 2| −3]
1 1 5 −10 0 0 1 −2
Augmented matrix Row-echelon form
9 −3 −2 −8 4 6 6 16 6 4 −3 27
[−3 5 2| 12] [ 5 −3 −2| −5] [2 4 1| 15]
1 1 5 −10 39 0 6 9 2 −3 −18 13
When we swap or switch the Let’s multiply the first row by 2 Let’s multiply the second row to
first and third rows, the matrix so the matrix will become -3 then add the product to the
will become first row replacing row 1 with
8 12 12 32
1 1 5 −10 [ 5 −3 −2| −5] the result. The matrix will be
[−3 5 2| 12] 39 0 6 9 0 8 −6 −18
9 −3 −2 −8 [2 4 1| 15]
Just indicate this notation.
Just indicate this notation. 2 −3 −18 13
Multiply Row 1 by 2: 2R1 → R1
Swap Row 1 to Row 3: R1 ↔ R3 Just indicate this notation.
Multiple Row 2 by -3 then add to
Row 1: -3R2 + R1 → R1
LINEAR EQUATION AND MATRICES U n i t O n e | 1.12
1 4 6 −7 1 4 6 −7
[0 1 2|−3] [0 1 2|−3]
0 0 −3 −6 0 0 1 2
1
− 3R3→R3
1.13 | U n i t O n e LINEAR EQUATION AND MATRICES
The row echelon form we obtained can be Step 3: Back substitution. Using the row
reverted back to an equivalent linear system.
1 4 6 −7 𝑥 + 4𝑦 + 6𝑧 = −7 echelon form, we can now solve
[0 1 2|−3] { 𝑦 + 2𝑧 = −3 for the values of the unknowns by
0 0 1 2 𝑧=2
utilizing back substitution.
Since we now have a value for z which is 2, we
can substitute this to the second equation to In row echelon form, we obtained
get the value of y.
𝑦 + 2𝑧 = −3 the value of the third variable.
𝑦 + 2(2) = −3 This will be substituted to the
𝑦 + 4 = −3 second equation in order to find
𝑦 = −3 − 4
𝑦 = −7 the value of the second equation.
Lastly, substitute the values of y and z Lastly, we can now get the value
in the first equation. of the first variable by
𝑥 + 4𝑦 + 6𝑧 = −7
𝑥 + 4(−7) + 6(2) = −7
substituting the values of the
𝑥 − 28 + 12 = −7 other unknowns in the first
𝑥 − 16 = −7 equation.
𝑥=9
So the values of the unknowns are
x=9, y=-7, and z=.
1 1 1 4 -R1 + R3 → R3 1 1 1 4
[0 −4 −4|−10] [0 −4 −4|−10]
1 3 3 8 0 2 2 4
1
1 1 1 4 - R2 → R2
4
1 1 1 4
[0 −4 −4|−10] [0 1 1|5/2]
0 2 2 4 0 2 2 4
1 1 1 4 -2R2 + R3 → R3 1 1 1 4
[0 1 1|5/2] [0 1 1|5/2]
0 2 2 4 0 0 0 −1
The third column corresponds to the equation 0=-1, it means that the
given linear system has no solution.
There’s one more method wherein the translation of row echelon form into a linear system
is no longer needed. This is the extension of Gaussian Elimination but without the back
substitution. We just have to translate row echelon form into a reduced row echelon
form.
The difference is in reduced row echelon form, the entries on the left of the vertical
line are all 0’s aside from the entries in the main diagonal which are all 1’s.
1.15 | U n i t O n e LINEAR EQUATION AND MATRICES
1 4 6 −7 1 4 6 −7
[0 1 2|−3] [0 1 2|−3]
0 0 −3 −6 0 0 1 2
1
− 3R3→R3
LINEAR EQUATION AND MATRICES U n i t O n e | 1.16
The row echelon form we obtained can be further Step 3: Reduced Row Echelon form. We can
reduced. First step is to make 2 in the second
row be zero by multiplying the third row by -2 extend the second step by
then add the product to the second row. reducing the row echelon form. We
1 4 6 −7 1 4 6 −7 just have to make all entries on
[0 1 2|−3] [0 1 0|−7] the left side of the vertical
0 0 1 2 0 0 1 2
R2-2R3→R2 line be 0 except from the main
Next, let’s change 6 in the first row to zero diagonals.
by multiplying the third row by -6 then add the
product to the first row.
We can possibly do this by using
1 4 6 −7 1 4 0 −19 elementary row operations.
[0 1 0|−7] [0 1 0| −7]
0 0 1 2 0 0 1 2
R1-6R3→R1
Lastly, let’s make 4 be 0 by multiplying
the second row by -4 then add the result
to first row.
1 4 0 −19 1 0 0 9
[0 1 0| −7] [0 1 0|−7]
0 0 1 2 0 0 1 2
R1-4R2→R1
So the values of the unknowns are
x=9, y=-7, and z=.
I. Solve the given linear system by using Gaussian Elimination and Gauss-
Jordan Reduction.
1. {
𝑥+𝑦 =1 2. 3𝑥 − 3𝑦 = 3
4𝑥 + 3𝑦 = 2 {4𝑥 − 7 − 3𝑧 = 3
−2𝑥 − 2𝑦 = −2
3. 𝑥 + 2𝑦 + 𝑧 = 1 4. 2𝑥 − 4𝑧 = 1
{2𝑥 + 3𝑦 + 2𝑧 = 0 {4𝑥 + 3𝑦 − 2𝑧 = 0
𝑥+𝑦+𝑧 =2 2𝑥 + 2𝑧 = 2
5. −𝑎 + 3𝑐 + 𝑑 = 2 6. −3𝑎 − 𝑏 + 3𝑐 + 3𝑑 = −3
{ 2𝑎 + 3𝑏 − 3𝑐 + 𝑑 = 2 { 𝑎−𝑏+𝑐+𝑑 = 3
2𝑎 − 2𝑏 − 2𝑐 − 𝑑 = −2 −3𝑎 + 3𝑏 − 𝑐 + 2𝑑 = 1