Linear Algebra has become as basic and

as applicable
as calculus, and fortunately it is easier.
--Gilbert Strang, MIT

Linear Algebra
an Introduction

Dr. Asma Rashid Butt

Department of Mathematics
UET, Lahore
Over View
 Linear Equations
 System of linear equations
 Linear Spaces
 Linear Combinations. Linear Independence
 Linear Transformation

3/17/2018 2
Linear Equations
 (General Form)
 ax= b, a≠0 in one variables
 ax+by=c, a,b ≠0 in two variables
 ax+by+cy=d, a,b,c ≠0 in three variables

3/17/2018 3
Linear or non linear

 Sinx –y=0

 lnx-y=1

 2cosx +y= 3

 2x-3y=-3

3/17/2018 4
Linear or non linear

 Sinx –y=0 Non Linear

 lnx-y=1 Non Linear

 2cosx +y= 3 Non Linear

 2x-3y=-3 Linear

3/17/2018 5
3/17/2018 6
Equations of the form ax + by = c are called
linear equations in two variables.
y
This is the graph of the (0,4)
equation 2x + 3y = 12.
(6,0)
x
-2 2

The point (0,4) is the y-intercept.

The point (6,0) is the x-intercept.

7 3/17/2018
3/17/2018 8
System of linear equations
 Example:
Suppose I have a bunch of apples and oranges. Let x be the
number of apples I have, and y be the number of oranges I
have. As everyone knows, apples and oranges don't mix, so if
I want to keep track of the number of apples and oranges I
have, I should put them in a list. We'll call this list a vector,
and write it like this: (x; y). The order here matters!
 I should remember to always write the number of apples
first and then the number of oranges - otherwise if I see
the vector (1; 2), I won't know whether I have two apples
or two oranges.
3/17/2018 9
 This vector in the example is just a list of two numbers, so if we want to, we
can represent it with a point in the plane with the corresponding coordinates,
like so

3/17/2018 10
Example
There are 27 pieces of fruit in a barrel, and twice as many
oranges as apples.
 How many apples and oranges are in the barrel?
 How to solve this conundrum?
 We can re-write the question mathematically as follows:

3/17/2018 11
 First we rewrite the equations tidily:

3/17/2018 12
 We can express this set of equations with a matrix as follows:

3/17/2018 13
 We can multiply the matrix by the vector to get back the
linear system using the following rule for multiplying
matrices by vectors:

 The matrix is an example of a Linear Transformation, because

it takes one vector and turns it into another in a “linear”
way.

3/17/2018 14
Basic concepts
 Vector in Rn is an ordered set of
n real numbers. 1
 
 e.g. v = (1,6,3,4) is in R4 6
 3
A column vector:  
 4
 
A row vector:
 m-by-n matrix is an object in 1 6 3 4
Rmxn with m rows and n columns,
each entry filled with a
(typically) real number: 1 2 8
 
 4 78 6 
9 3 2
 

3/17/2018 15
Questions

 What is the meaning of solution of a system

of linear equations?

 How to solve a system of linear equations?

3/17/2018 16
Examples
 x+y=1
(1)
x-y=0

 x+y=1
(2)
x+y=2

 x+y=1
(3)
2x+2y=2

3/17/2018 17
Possible situation for the solutions

 Unique solution.

 Infinite many solutions.

 No solution,

3/17/2018 18
Unique solution

 Consider
AX=B ………. (1)
system of n equation in n variables with A is
invertible Then (1) has a unique solution.

3/17/2018 19
Infinite solutions

 Consider
AX=B ………. (1)
system of m equation in n variables with m<n Then (1) has
infinite many solutions.
(provided there is no contradiction).
There is a possibility of no solution in this case always )

3/17/2018 20
Question

 Again consider
AX=B ………. (1)
system of m equation in n variables with m>n Then what is
the conclusion about the solution of (1).

No solution?....... False

3/17/2018 21
 Unique solution
y

x
-2 2

22 3/17/2018
Infinite many solution
y

23
No solution

24
3/17/2018 25
solve

x+ y=1
x -y=0
2 x + 2y= 2

3/17/2018 26
Solve

x + 3y = 1
2x + y = -3
2x + 2y = 0
*

3/17/2018 27
Solution Sets for Systems of Linear Equations

 For a system of equations with m equations and n

unknowns, one can have a number of different outcomes.
For example, consider the case of m equations in three
variables.
 Each of these equations is the equation of a plane in
three dimensional space. To find solutions to the system
of equations, we look for the common intersection of the
planes (if an intersection exists).
 Here we have five different possibilities:

3/17/2018 28
1. No solutions. Some of the equations are contradictory, so
no solutions exist.
2. Unique Solution. The planes have a unique point of
intersection.
3. Line. The planes intersect in a common line; any point on
that line then gives a solution to the system of equations.
4. Plane. Perhaps you only had one equation to begin with,
or else all of the equations coincide geometrically. In this
case, you have a plane of solutions, with two free
parameters.
5. All of 𝑅3 . If you start with no information, then any point
in 𝑅3 is a solution. There are three free parameters.

3/17/2018 29
Methods

 Crammer rule
 Block method
 Guassian elimination method(Row Echelon Form
 Guass Jorden method(Row Reduced Echelon Form

3/17/2018 30
Elementary Row Operations

The three elementary row operations are:

 (Row Swap) Exchange any two rows.
 (Scalar Multiplication) Multiply any row by a non-zero
constant.
 (Row Sum) Add a multiple of one row to another row.

3/17/2018 31
Reduced Row Echelon Form(RREF)
 Pivot(leading coefficient) : The first non-zero entry in
each row is called the pivot.

The following properties describe the RREF.

a) In RREF, the pivot of any row is always 1.
b) The pivot of any given row is always to the right of the
pivot of the row above it.
c) Any row of zeroes if exists is at the bottom.
d) The pivot is the only non-zero entry in its column.

3/17/2018 32
Example

3/17/2018 33
Example
 Consider the linear system with the augmented matrix
we've been working with

The system has the following solution set:

3/17/2018 34
Explain why the linear system has no solutions:

3/17/2018 35
Find the solution?

3/17/2018 36
vector space
 A vector space is a nonempty set V , whose objects are
called vectors, equipped with two operations, called
vector addition and scalar multiplication: For any two
vectors u, v in V and a scalar c, there are unique vectors
u + v and cu in V such that the following properties are
satisfed.
 1. u + v = v + u,
 2. (u + v) + w = u + (v + w),
 3. There is a vector 0, called the zero vector, such that u
+ 0 = u,
 4. For any vector u there is a vector -u such that u + ( -u)
= 0; 3/17/2018 37
 5. c(u + v) = cu + cv,
 6. (c + d)u = cu + du,
 7. c(du) = (cd)u,
 8. 1u=u

3/17/2018 38
Examples(vector spaces)

3/17/2018 39
Review problems

3/17/2018 40
Review problems

3/17/2018 41
Subspace
 Let V be a vector space, and W be a subset of V . Then W
is said to be a sub space of V if W itself is a vector space
under the defined operation of V.
That is; If the addition and scalar multiplication in W are the
same as the addition and scalar multiplication in V , then W
is called a subspace of V .

3/17/2018 42
Characterization Theorem
 A subset W of a vector space is said to be a subspace if
and only if
 𝑤1 +𝑤2 𝜖𝑊, for all 𝑤𝑖 ∈ 𝑊, 𝑖 = 1,2.
 𝑐𝑤 ∈ 𝑊 for all w ∈ 𝑊, and for all 𝑐 ∈ 𝐹.

Here F stands for field.

3/17/2018 43
Basis for a vector space

A sub set B = 𝑣1 , 𝑣2 , … , 𝑣𝑘 of a vector space V is said to

be basis set for V if
 B is linearly independent set.
 B spans V.

3/17/2018 44
 Linear independence
• A set of vectors is linearly independent if none of them can be
written as a linear combination of the others.
• Vectors v1,…,vk are linearly independent if c1v1+…+ckvk = 0
implies c1=…=ck=0

| | |  c1   0 
    
 v1 v2 v3  c2    0 
| |  c3   0 
 |

𝑥3 = -2𝑥1 +𝑥2
3/17/2018 45
Linear Independency or dependency

1 2  c1   0 
    
 2 1 c2   0 

1 0 0
  c1   
2 3    0
c 
1 3  2 0
   
3/17/2018 46
Span of a vector space
• If all vectors in a vector space may be expressed as linear
combinations of a set of vectors v1,…,vk, then v1,…,vk spans
the space.
• The cardinality of this set is the dimension of the vector
space.
 2 1 0  0
       
e.g.  2   2 0   2 1   2 0 
 2 0 0 1
(0,0,1)        

(0,1,0)

(1,0,0)

• A basis is a maximal set of linearly independent vectors

and a minimal set of spanning vectors of a vector
3/17/2018
space 47
Dimensions of vector spaces

 A vector space V is said to be finite dimensional if it can

be spanned by a set of finite number of vectors. The
dimension of V, denoted by dim V , is the number of
vectors of a basis of V .
 The dimension of the zero vector space is zero.

 If V cannot be spanned by any finite set of vectors, then V

is said to be infinite dimensional.

3/17/2018 48
Basis for finite dimensional vector
spaces.
Theorem:
Let V be a finite dimensional space with dim (V)=n then the
B = 𝑣1 , 𝑣2 , … , 𝑣𝑛 is the basis for V if
 B is linearly independent
or
 B spans V.

3/17/2018 49
Linear Transformation

 Let V and W be vector spaces. A function 𝑇 ∶ 𝑉 → 𝑊 is called

a linear transformation if for any vectors u, v in V and scalar
c,
 (a) T(u + v) = T(u) + T(v),
 (b) T(cu) = cTu

3/17/2018 50
Example

Consider the transformation 𝑇: 𝑅3 → 𝑅2 defined by

𝑇 𝑥1 , 𝑥2 , 𝑥3 = (𝑥1 +2𝑥2 − 𝑥3 , 𝑥1 − 𝑥2 +𝑥2 )

3/17/2018 51
Example

 Let 𝑇: 𝑅3 → 𝑅2 is defined as
𝑇 𝑥1 , 𝑥2 , 𝑥3 = (𝑥1 𝑥3 , 𝑥1 − 𝑥2 )

3/17/2018 52
Example

 𝑑𝑒𝑡: 𝑀𝑛𝑛 ⟶ 𝑪

 As det 𝐴 + 𝐵 ≠ det 𝐴 + det(𝐵) in general.

 det is not a linear transformation.

3/17/2018 53
Matrix Representation Theorem

 Let 𝑇: 𝑅𝑛 → 𝑅𝑚 be a linear transformation then 𝑇𝑿 =

𝐴𝑚𝑛 𝑿.

3/17/2018 54
Consider a linear Transformation 𝑇: 𝑅3 → 𝑅2 defined
as

𝑥 𝑥
2𝑥 + 𝑦 − 𝑧 2 1 −1 𝑦
 𝑇 𝑦= =
𝑥 + 2𝑦 + 3𝑧 1 2 3 𝑧
𝑧

3/17/2018 55
Biblography
 Elementary linear algebra , Howard Anton, 11th edition,
JhonWiely& Sons, Inc.
 Linear Algebra and Its Applications , Gilbert Strang, 4th
edition, Cengage Learning.
 Linear Algebra with applications , W. keith Nicholson, 5th
edition, McGraw Hill.

3/17/2018 56
Thank you
3/17/2018 57