06 Matrix Lie Groups Long
06 Matrix Lie Groups Long
06 Matrix Lie Groups Long
Maani Ghaffari
February 9, 2021
References
3
Matrix Groups
I The shape of the universe. Cosmologists find it far easier to model the
space as a simply connected space under the action of a matrix group.
I In linear algebra the theory of matrix group provides a uniform tools which
are essential in disciplines ranging from topology and geometry to discrete
math and statistics.
4
Group Definition
5
General Linear Groups
6
General Linear Groups
Definition
The general linear group over K is:
GLn (K) = {A ∈ Mn (K) : det(A) 6= 0}.
Theorem
7
Affine Groups
I This is a closed
subgroup of GLn+1 (R). If we identify
x
x ∈ Rn with ∈ Rn+1 , then as a consequence of the
1
formula
A t x Ax + t
=
0 1 1 1
we obtain an action of Aff n (R) on Rn .
8
Affine Groups
9
Affine Groups
10
Orthogonal Groups
Definition
The orthogonal group over R is denoted O(n) and defined as:
O(n) = {A ∈ GLn (R) : A · AT = In },
where ”·” denotes the standard matrix multiplication as the
group operation and is dropped hereafter, i.e., AAT .
11
Orthogonal Groups
12
Orthogonal Groups
13
Orthogonal Groups
14
Special Orthogonal Groups
Remark
The special orthogonal group SO(n) is the simultaneous
rotation of n perpendicular planes! For example, SO(3) is the
rotation group of R3 and defines the simultaneous rotation of
three perpendicular planes which construct the
three-dimensional (3D) Euclidean space.
15
Isometry Groups
16
Isometry Groups
17
Isometry Groups
18
Manifolds
[
Uα = M,
α
2 For each α
ϕα : Uα → Rn
is a diffeomorphism onto an open set,
3 If Uα ∩ Uβ 6= ∅, then
ϕβ ◦ ϕ−1
α : ϕα (Uα ∩ Uβ ) → ϕβ (Uα ∩ Uβ ) ,
is smooth.
19
Manifolds
Figure: https://en.wikipedia.org/wiki/Manifold
20
Manifolds
Many common objects are manifolds.
1 Every Euclidean space, Rn .
2 The 2-sphere, S 2
3 The Torus T 2
https://www.jpl.nasa.gov/edu/teach/activity/ocean-world-earth-globe-toss-game/
https://en.wikipedia.org/wiki/Torus
21
Manifolds
22
Manifolds
is a manifold.
23
Tangent Spaces
24
Tangent Spaces
25
Tangent Space
26
Tangent Space
27
Lie Algebras
I Note that the choice of identity is due to the fact that all
groups contain at least the identity element.
28
Lie Algebras
Proposition
The Lie algebra g of a matrix group G ⊂ GLn (R) is a real
subspace of Mn (R).
Definition
The dimension of a matrix group G means the dimension of its
Lie algebra.
29
Example: Lie Algebras of GLn (R)
Let us consider the Lie algebra of GLn (R), denoted gln (R).
Proposition
gln (R) = Mn (R). In particular, dim(GLn (R)) = n2 .
Proof.
Let A ∈ Mn (R). The path γ(t) = I + t.A in Mn (R) satisfies
γ(0) = I and γ 0 (0) = A. Also, γ restricted to sufficiently small
interval (−, ) lies in GLn (R). To justify this, notice
det(γ(0)) = 1. Since the determinant function is continuous,
det(γ(t)) is close to 1 (and is therefore non-zero) for t close to 0.
This demonstrates that A ∈ gln (R).
30
Example: Lie Algebras of (Real) Orthogonal Group
Theorem
The Lie algebra of O(n) equals so(n).
31
Example: Lie Algebras of (Real) Orthogonal Group
Proof.
Suppose γ : (−, ) → O(n) is differentiable with γ(0) = I. Using the
product rule to differentiate both sides of
γ(t) · γ(t)T = I
gives γ 0 (0) + γ 0T (0) = 0, so γ 0 (0) ∈ so(n). This demonstrates that
g(O(n)) ⊂ so(n).
32
Example: Lie Algebras of (Real) Orthogonal Group
Proof.
The natural basis of so(n) is the set
32
Example: Lie Algebras of (Real) Orthogonal Group
Proof.
The path
γij (t) , I + sin(t)Eij − sin(t)Eji + (−1 + cos(t))(Eii + Ejj )
32
Example: Lie Algebras of (Real) Orthogonal Group
Remark
Suppose x is a row vector. Rγ(t) (x) , x · γ(t) is the right
multiplication of matrix γ(t) with vector x. Similarly,
Lγ(t) , (γ(t) · xT )T is the left multiplication and
Lγ(t) = Rγ T (t) . Unlike the previous example, we often work
with column vectors and left multiplication, i.e.,
Lγ(t) = γ(t) · x.
33
Example: Lie Algebras of (Real) Orthogonal Group
Corollary
n(n−1)
dim(SO(n)) = 2
.
Proof.
Skew-symmetric matrices have zeros on the diagonal, arbitrary
real numbers above, and entries below determined by those
above, so dim(so(n)) = n(n−1)
2
.
34
Examples
35
Examples
35
Examples
Tg SOn = gA : AT = −A = g · son .
36
Matrix Exponentiation; Series in Mn (R)
37
The “Best” Path in a Matrix Group: One-Parameter Groups
38
The “Best” Path in a Matrix Group: One-Parameter Groups
39
The “Best” Path in a Matrix Group: One-Parameter Groups
Proposition
Let A ∈ gln (R). The path γ : R → Mn (R) defined as
γ(t) = exp(tA) is differentiable, and γ 0 (t) = A · γ(t) = γ(t) · A.
The “Best” Path in a Matrix Group: One-Parameter Groups
Proposition
Let A ∈ gln (R). The path γ : R → Mn (R) defined as
γ(t) = exp(tA) is differentiable, and γ 0 (t) = A · γ(t) = γ(t) · A.
Proof.
Each of the n2 entries of
1 1
γ(t) = I + tA + t2 A2 + t3 A3 + · · ·
2 6
is a power series in t, which, from familiar real calculus, can be
termwise differentiated, giving:
1
γ 0 (t) = 0 + A + tA2 + t2 A3 + · · · .
2
This equals γ(t) · A or A · γ(t) depending whether you factor an
A out on the left or right.
The “Best” Path in a Matrix Group: One-Parameter Groups
Proposition
Let A ∈ Mn (R) and let γ(t) = exp(tA).
41
The “Best” Path in a Matrix Group: One-Parameter Groups
Remark
Suppose a left-translation is given via the smooth map
Lg : G → G where h 7→ gh. Its differential gives rise to an
isomorphism of tangent spaces, (Lg )∗ : g → Tg G, i.e.,
Tg G ∼
= (Lg )∗ g. Then we have:
γ(t) = g exp(tA).
A similar argument for the right-translation can be expressed.
γ(t) = exp(tA)g.
42
Body vs. Spatial Velocities
Remark
In γ(t) = g exp(tA), the velocity A is considered to be in the
body frame, whereas in γ(t) = exp(tA)g the velocity A is in
the spatial frame (relative to a fixed (inertial) coordinate
frame). The relation between the body and spatial velocities
motivates us to study the adjoint action in the following.
43
Conjugation, Adjoint, and the Lie Bracket
Cg (a) = gag −1 ,
is a smooth isomorphism. The derivative d(Cg )I : g → g is a
vector space isomorphism, which we denote as Adg (adjoint):
Adg = d(Cg )I
44
Adjoint and the Lie Bracket
45
Adjoint and the Lie Bracket
46
The Lie Bracket
47
The Lie Bracket
Proposition
For all A, B ∈ g, [A, B] = AB − BA.
Proof.
Left as exercise.
48
The Lie Bracket
49
Properties of the Lie Bracket
Proposition
For all A, A1 , A2 , B, B1 , B2 , C ∈ g and λ1 , λ2 ∈ R,
50
Example: Lie Bracket on so(3) and Cross Product
0 0 0 0 0 1 0 −1 0
G1 = 0 0 −1 , G2 = 0 0 0 , G3 = 1 0 0
0 1 0 −1 0 0 0 0 0
[G1 , G2 ] = G3 , [G2 , G3 ] = G1 , [G3 , G1 ] = G2
e1 × e2 = e3 , e2 × e3 = e1 , e3 × e1 = e2
51
The Adjoint Action
52
Baker-Campbell-Hausdorff Series
1 1 1
Z = X+Y+ [X,Y]+ [X,[X,Y]]+ [Y,[Y,X]]+· · · .
2 12 12
53
Baker-Campbell-Hausdorff (BCH) Series
54
Manifolds: Matrix Groups are Manifolds
Definition
A subset X ⊂ Rm is called a manifold of dimension n if for all
p ∈ X there exists a neighborhood V of p in X which is
diffeomorphic to an open set U ⊂ Rn .
Theorem
Any matrix group of dimension n is a manifold of dimension n.
55
Lie Groups
56
Lie Groups
57
Useful Lie Groups in Robotics
58
Group of 3D Rotation Matrices, SO(3)
where θ , ||φ||.
where θ , ||φ||.
60
Group of Direct Spatial Isometries, SE(3)
exp(φ∧ ) Jl (φ)ρ
H = exp(ξ ∧ ) = ∈ SE(3),
01×3 1
where exp(φ∧ ) and Jl (φ) are the exponential map and the
left Jacobian of SO(3).
61
Group of Direct Spatial Isometries, SE(3)
62
Group of K Direct Isometries, SEK (3)
Let ξ ∈ R3(K+1) be a vector identified with an element of the
Lie algebra, ξ ∧ ∈ seK (3). The corresponding group element,
X ∈ SEK (3), is computed using the exponential map:
φ ∧
∧
ρ1 · · · ρK ···
φ R p1 pK
ρ1 01×3 0 ··· 0 01×3 1 ··· 0
∧
ξ = . = . .. .. and X = .. .. ..
. . . . ..
. . . . . . . . .
ρK 01×3 0 ··· 0 01×3 0 ··· 1
exp(φ∧ ) Jl (φ)ρ1 · · · Jl (φ)ρK
01×3 1 ··· 0
X = exp(ξ∧ ) = .. .. .. ∈ SEK (3),
..
. . . .
01×3 0 ··· 1
where exp(φ∧ ) and Jl (φ) are the exponential map and the
left Jacobian of SO(3).
J−1 J−1
log(R) l (log(R)) p1 ··· l (log(R)) pK
01×3 0 ··· 0
ξ∧ = log(H) = . ∈ seK (3)
.. .. ..
.. . . .
01×3 0 ··· 0
63
Group of K Direct Spatial Isometries, SEK (3)
64
First-Order Approximation using BCH
65
First-Order Approximation using BCH
I If both terms are small, by keeping the first two terms ignoring
the higher order terms, we have:
BCH(ξ 1 ∧ , ξ 2 ∧ ) = ξ 1 ∧ + ξ 2 ∧ + HOT,
exp(ξ 1 ∧ ) exp(ξ 2 ∧ ) ≈ exp(ξ 1 ∧ + ξ 2 ∧ ).
66
First-Order Approximation using BCH
I The left and right Jacobians are related through the adjoint
map,
67
Example: Uncertainty Propagation on Matrix Lie Groups
I Suppose a process model on matrix Lie group G where the state at
any two successive keyframes at times-steps k + 1 and k is related
using input such as Uk ∈ G. The deterministic process model is as
follows.
Xk+1 = fui (Xk ) , Xk Uk
I Notice that the noise is defined in the Lie algebra and mapped to the
nonlinear error using the Lie exponential map (matrix exponential).
I We use the left invariant error to track the covariance of the spatial
error as seen in the body-fixed frame: η = exp(ξ ∧ ) = X−1 X̄.
I and using the adjoint to shift all noise terms to the right, we get:
∧
X̄k+1 exp(−ξ k+1 ∧ ) = X̄k Uk exp((−AdU−1 ξ k ) ) exp(wk ∧ )
k
69
Example: Uncertainty Propagation on Matrix Lie Groups
I Since all noise terms are small, after applying the BCH formula and
keeping the first two terms we arrive at the approximate error
dynamics:
ξ k+1 = AdU−1 ξ k − wk .
k
70
Example: Uncertainty Propagation on SE(2)
71
Example: Uncertainty Propagation on SE(3)
72