Eigenvalues
Eigenvalues
Eigenvalues
5
Statue of Italian mathematician
Leonardo of Pisa (1170–1250,
approximate dates), also known as
Fibonacci. Exercise 16 in Section 5.C
shows how linear algebra can be used
to find an explicit formula for the
Fibonacci sequence.
5.1 Notation F, V
F denotes R or C.
invariant subspaces
eigenvalues, eigenvectors, and eigenspaces
each operator on a finite-dimensional complex vector space has an
eigenvalue and an upper-triangular matrix with respect to some
basis
V D U1 ˚ ˚ Um ;
Solution
Must an operator T 2 L.V / have any invariant subspaces other than f0g
and V ? Later we will see that this question has an affirmative answer if V is
finite-dimensional and dim V > 1 (for F D C) or dim V > 2 (for F D R/;
see 5.21 and 9.8.
Although null T and range T are invariant under T, they do not necessarily
provide easy answers to the question about the existence of invariant subspaces
other than f0g and V , because null T may equal f0g and range T may equal
V (this happens when T is invertible).
T v D v:
The equation
T v D v;
which we have just seen is intimately connected with 1-dimensional invariant
subspaces, is important enough that the vectors v and scalars satisfying it
are given special names.
(a) is an eigenvalue of T ;
Recall that I 2 L.V / is the iden-
(b) T I is not injective; tity operator defined by I v D v for
all v 2 V.
(c) T I is not surjective;
Proof Conditions (a) and (b) are equivalent because the equation T v D v
is equivalent to the equation .T I /v D 0. Conditions (b), (c), and (d) are
equivalent by 3.69.
Solution
the existence of k with this property follows from the Linear Dependence
Lemma (2.21). Thus there exist a1 ; : : : ; ak 1 2 F such that
5.12 vk D a1 v1 C C ak 1 vk 1 :
Multiply both sides of 5.12 by k and then subtract the equation above, getting
0 D a1 .k 1 /v1 C C ak 1 .k k 1 /vk 1 :
The corollary below states that an operator cannot have more distinct
eigenvalues than the dimension of the vector space on which it acts.
(b) there does not exist a subspace W of F2 that is invariant under T and
such that F2 D U ˚ W ;
Solution
where the last equality holds because .y; 0/ 2 U. The equation above
shows that T =U is the 0 operator.
EXERCISES 5.A
8 Define T 2 L.F2 / by
T .w; z/ D .z; w/:
Find all eigenvalues and eigenvectors of T.
9 Define T 2 L.F3 / by
10 Define T 2 L.Fn / by
.Tp/.x/ D xp 0 .x/
T .z1 ; z2 ; : : : / D .0; z1 ; z2 ; : : : /
has no eigenvalues.
T .x1 ; : : : ; xn / D .x1 C C xn ; : : : ; x1 C C xn /I
T .z1 ; z2 ; z3 ; : : : / D .z2 ; z3 ; : : : /:
(a) Suppose the sum of the entries in each row of A equals 1. Prove
that 1 is an eigenvalue of T.
(b) Suppose the sum of the entries in each column of A equals 1.
Prove that 1 is an eigenvalue of T.
5.16 Definition Tm
Suppose T 2 L.V / and m is a positive integer.
T m is defined by
Tm D T T… :
„ ƒ‚
m times
5.18 Example Suppose D 2 L P.R/ is the differentiation operator
defined by Dq D q 0 and p is the polynomial defined by p.x/ D 7 3x C5x 2 .
Then p.D/ D 7I 3D C 5D 2 ; thus
p.D/ q D 7q 3q 0 C 5q 00
Proof
Pm j
Pn k
(a) Suppose p.z/ D j D0 aj z and q.z/ D kD0 bk z for z 2 F.
Then
m X
X n
.pq/.z/ D aj bk z j Ck :
j D0 kD0
Thus
m X
X n
.pq/.T / D aj bk T j Ck
j D0 kD0
X m n
X
j
D aj T bk T k
j D0 kD0
D p.T /q.T /:
(b) Part (a) implies p.T /q.T / D .pq/.T / D .qp/.T / D q.T /p.T /.
Existence of Eigenvalues
Now we come to one of the central results about operators on complex vector
spaces.
v; T v; T 2 v; : : : ; T n v
0 D a0 v C a1 T v C C an T n v:
a0 C a1 z C C an z n D c.z 1 / .z m /;
0 D a0 v C a1 T v C C an T n v
D .a0 I C a1 T C C an T n /v
D c.T 1 I / .T m I /v:
Upper-Triangular Matrices
In Chapter 3 we discussed the matrix of a linear map from one vector space
to another vector space. That matrix depended on a choice of a basis of each
of the two vector spaces. Now that we are studying operators, which map a
vector space to itself, the emphasis is on using only one basis.
Note that the matrices of operators are square arrays, rather than the more
general rectangular arrays that we considered earlier for linear maps.
The k th column of the matrix If T is an operator on Fn and no
M.T / is formed from the coeffi- basis is specified, assume that the basis
cients used to write T vk as a linear in question is the standard one (where
combination of v1 ; : : : ; vn . the j th basis vector is 1 in the j th slot
and 0 in all the other slots). You can
then think of the j column of M.T / as T applied to the j th basis vector.
th
For example, the diagonal of the matrix in 5.23 consists of the entries
2; 5; 8.
Proof The equivalence of (a) and (b) follows easily from the definitions and
a moment’s thought. Obviously (c) implies (b). Hence to complete the proof,
we need only prove that (b) implies (c).
Thus suppose (b) holds. Fix j 2 f1; : : : ; ng. From (b), we know that
T v1 2 span.v1 / span.v1 ; : : : ; vj /I
T v2 2 span.v1 ; v2 / span.v1 ; : : : ; vj /I
::
:
T vj 2 span.v1 ; : : : ; vj /:
T v 2 span.v1 ; : : : ; vj /:
The next result does not hold on Now we can prove that for each
real vector spaces, because the first operator on a finite-dimensional com-
vector in a basis with respect to plex vector space, there is a basis of the
which an operator has an upper- vector space with respect to which the
triangular matrix is an eigenvector matrix of the operator has only 0’s be-
of the operator. Thus if an opera- low the diagonal. In Chapter 8 we will
tor on a real vector space has no
improve even this result.
eigenvalues [see 5.8(a) for an ex-
ample], then there is no basis with Sometimes more insight comes from
respect to which the operator has seeing more than one proof of a theo-
an upper-triangular matrix. rem. Thus two proofs are presented of
the next result. Use whichever appeals
more to you.
U D range.T I /:
T u D .T I /u C u:
5.29 T vk 2 span.u1 ; : : : ; um ; v1 ; : : : ; vk /:
From 5.28 and 5.29, we conclude (using 5.26) that T has an upper-
triangular matrix with respect to the basis u1 ; : : : ; um ; v1 ; : : : ; vn of V, as
desired.
.T =U /.vj C U / 2 span.v2 C U; : : : ; vj C U /
How does one determine from looking at the matrix of an operator whether
the operator is invertible? If we are fortunate enough to have a basis with
respect to which the matrix of the operator is upper triangular, then this
problem becomes easy, as the following proposition shows.
We need to prove that T is invertible if and only if all the j ’s are nonzero.
First suppose the diagonal entries 1 ; : : : ; n are all nonzero. The upper-
triangular matrix in 5.31 implies that T v1 D 1 v1 . Because 1 ¤ 0, we have
T .v1 =1 / D v1 ; thus v1 2 range T.
Now
T .v2 =2 / D av1 C v2
for some a 2 F. The left side of the equation above and av1 are both in
range T ; thus v2 2 range T.
Similarly, we see that
for some b; c 2 F. The left side of the equation above and bv1 ; cv2 are all in
range T ; thus v3 2 range T.
Continuing in this fashion, we conclude that v1 ; : : : ; vn 2 range T. Be-
cause v1 ; : : : ; vn is a basis of V, this implies that range T D V. In other words,
T is surjective. Hence T is invertible (by 3.69), as desired.
To prove the other direction, now suppose that T is invertible. This implies
that 1 ¤ 0, because otherwise we would have T v1 D 0.
Let 1 < j n, and suppose j D 0. Then 5.31 implies that T maps
span.v1 ; : : : ; vj / into span.v1 ; : : : ; vj 1 /. Because
As an example of the result above, we see that the operator in Example 5.23
is invertible.
Unfortunately no method exists for Powerful numeric techniques exist
exactly computing the eigenvalues of for finding good approximations to
an operator from its matrix. However, the eigenvalues of an operator from
if we are fortunate enough to find a ba- its matrix.
sis with respect to which the matrix of
the operator is upper triangular, then the
problem of computing the eigenvalues
becomes trivial, as the following propo-
sition shows.
Let 2 F. Then
0 1
1
B 2 C
M.T I / D B C:
B C
::
@ : A
0 n
Thus M.T / is an upper-triangular matrix. Now 5.32 implies that the eigen-
values of T are 2, 5, and 8.
EXERCISES 5.B
12 Show that the result in the previous exercise does not hold if C is replaced
with R.
16 the proof of 5.21 using the linear map that sends p 2 Pn .C/ to
Rewrite
p.T / v 2 V (and use 3.23).
17 Rewrite the proof of 5.21 using the linear map that sends p 2 Pn2 .C/ to
p.T / 2 L.V / (and use 3.23).
5.35 Example 0 1
8 0 0
@ 0 5 0 A
0 0 5
is a diagonal matrix.
E.1 ; T / C C E.m ; T /
(a) T is diagonalizable;
V D U1 ˚ ˚ Un I
Choose a basis of each E.j ; T /; put all these bases together to form a list
v1 ; : : : ; vn of eigenvectors of T, where n D dim V (by 5.42). To show that
this list is linearly independent, suppose
a1 v1 C C an vn D 0;
u1 C C um D 0:
T .w; z/ D .z; 0/
is not diagonalizable.
The next result shows that if an operator has as many distinct eigenvalues
as the dimension of its domain, then the operator is diagonalizable.
T .x; y; z/ D .x; y; z/
for D 2, then for D 5, and then for D 8. These simple equations are
easy to solve: for D 2 we have the eigenvector .1; 0; 0/; for D 5 we have
the eigenvector .1; 3; 0/; for D 8 we have the eigenvector .1; 6; 6/.
Thus .1; 0; 0/; .1; 3; 0/; .1; 6; 6/ is a basis of F3 , and with respect to this
basis the matrix of T is 0 1
2 0 0
@ 0 5 0 A:
0 0 8
The converse of 5.44 is not true. For example, the operator T defined on
the three-dimensional space F3 by
has only two eigenvalues (4 and 5), but this operator has a diagonal matrix
with respect to the standard basis.
In later chapters we will find additional conditions that imply that certain
operators are diagonalizable.
EXERCISES 5.C
4 Give an example to show that the exercise above is false without the
hypothesis that V is finite-dimensional.
5 Suppose V is a finite-dimensional complex vector space and T 2 L.V /.
Prove that T is diagonalizable if and only if
V D null.T I / ˚ range.T I /
for every 2 C.
6 Suppose V is finite-dimensional, T 2 L.V / has dim V distinct eigenval-
ues, and S 2 L.V / has the same eigenvectors as T (not necessarily with
the same eigenvalues). Prove that S T D T S .
7 Suppose T 2 L.V / has a diagonal matrix A with respect to some basis
of V and that 2 F. Prove that appears on the diagonal of A precisely
dim E.; T / times.
8 Suppose T 2 L.F5 / and dim E.8; T / D 4. Prove that T 2I or T 6I
is invertible.