Typos and Errors In

Linear Algebra and Optimization

with Applications to Machine Learning, Vol. II
by
Jean H. Gallier and Jocelyn Quaintance
December 12, 2024
 1
vii, delete the extra “the” in the paragraph 162, in Problem 5.5(2) and 5.5(3), change
“In Chapter 15 ...” X0 A to AX0 .
6, delete the extra “the” in the paragraph 170, line 4, change “surjective onto” to “in-
“In Chapter 15 ...” jective into”
48, Just after Definition 2.25, change “Def- 170, in Proposition 6.2, line 4, add “x0 =
inition 2.23” to “Definition 2.25” A−1 b” between “solution” and “of”. In the
49, line -9, the first kxn k should be kx1 k. proof, x should be x0 , except in the last
53, middle of page, change “anisometry” to occurrence of Q(x).
“an isometry” 181, line -7, change b> A+ AA+ b to
59, in the Remarks, change “Kormogorov” (1/2)b> A+ AA+ b.
to “Kolmogorov.” 189, Problem 6.2, change “surjective onto”
87, middle of page, (a, b] should be (a, b). to “injective into”
119, middle of page, change 192, bottom matrix, more space needed be-
∇J(u) + λ1 ∇ϕ1 (u) + · · · + λ1 ∇ϕm (u) to tween the columns
∇J(u) + λ1 ∇ϕ1 (u) + · · · + λm ∇ϕm (u) 195, bottom of page, change “semidefinire”
120, at the end of Proposition 4.2, change to “semidefinite”
(u, λ) to (u, µ). 262, near bottom of page, the pivot is not
120, middle of page, change indicated in red, but by a circle
“Indeed dL(u, µ) = 0 if equivalent” to “In- 320, in Proposition 12.4, the first sentence
deed dL(u, µ) = 0 is equivalent” should be “Let E be a Hilbert space and let
121, middle of page, change (Jac(J)(u))> X ⊆ E be any nonempty convex and closed
to (Jac(ϕ)(u))> . subset.” Then in (1), “For any u ∈ E, there
129, In Part (2) of Theorem 4.3, change is a unique”
“centered at v” to “centered at u.” In the 330, in Definition 12.4, line -3, change ϕlu =
proof, change  < α to  < (1/2)α, and ϕru to ϕlu = ϕrv .
change v ∈ (u, w + w) to v ∈ (u, u + w). 337, in Problem 12.4, change (u, v) to hu, vi
132, 2/3 of the page, change “a function if and ΛC = {u ∈ C | h(u) 6= +∞} to ΛC =
convex” to “a function is convex” {u ∈ V | h(u) 6= +∞}.
134, in the proof of Theorem 4.4, line 5, 341, line 6, change LB(X) to U B(X).
change 0 ≤ t ≤ 1 to 0 ≤ t. 341, midle of the page, J(x) = −x should
140, line 6, change “in u” to “at u” be J(x) = x.
140, in Part (3), line 4, change “in needed” 345, line 2, change “billinear” to “bilinear”.
to “is needed” 350, line 3, add = in front of the line
143, in Problem 4.3, line 1, change “in u” 350, in Theorem 13.2, insert “real” in front
to “at u” of “Hilbert space”
143, in Problem 4.4, delete “in a unique 353, in (∗2 ) and (∗3 ), change v ∈ V to v ∈
way” U . Just after (∗4 ), change F : V → V to
145, just above Section 5.1, change “(i) and F: U → U.
(i)” to “(i) and (ii)”. 355, middle of page, change “coercice” to
145, first line of Section 5.1, change “for “coercive”
find” to “to find” 358, in (2), line -4, add “Typically, ρk > 0.”
149, line 9 and 10, change ∆k to ∆xk . 364, in Step 4, line 6, change to “for every
152, last line, change“kb − ak < β kb − ak”  > 0, there is some δ > 0 such that if
to “kb − ak ≤ β kb − ak” kuk − uk+1 k < δ then”
2
364, in Step 4, change kwk ≤ 1 to kwk = 1. 415, top line of the text, change “we only
370, line 4, change u ∈ M to u ∈ V .0 this” to “we only need this”.
370, in Equation (∗), change 416, in Proposition 14.2, change “we only
ρk h∇Juk − ∇Ju i to ρk (∇Juk − ∇Ju ). this” to “we only need this”.
371, line 10, delete “we” in front of α = λ1 . 421, after Proposition 14.3, the third sen-
371, line 10, insert “smallest” in front of tence should be “then the linear system
“eigenvalue” Ax = b has some solution x ≥ 0.”
372, line 5, change b ≤ 2/λn to b < 2/λn . 430, 1/3rd of page, change “where where ”
380, line -9, the right-hand should be to “where”
inf v∈uk +Gk J(v). 469, middle of the page, change “Then any
380, line -3, change i < j to i 6= j. solution” to “Then for any solution”
381, in Proposition 13.7, line 5, change 508, line -8, the inequalities should be
1 ≤ i < j ≤ k to 1 ≤ i 6= j ≤ k + 1. −∞ ≤ α < 0.
381, in the proof of Proposition 13.7, 519, last line, change “cone” to “convex
change “is a vector space” to “is a sub- set”
space”, and “by Theorem 4.4” to “Corol- 522, in Proposition 15.10, line 3, change
lary 4.1”. “linear form” to “affine form” and change
381, in the proof of Proposition 13.7, x to y in “f (x) ≥ ϕ(x) for all x ∈ Rn ”
change lines -4, -6, -8, change ` to ` + 1. 528, in Theorem 15.2, change x to y in
383, line -9, add “where we form these inner f (x) ≥ ϕ(x) for all x ∈ Rn ”
products for j = 0, . . . , k, in that order.”
529, at the end of the proof of Theorem
385, in the proof of Proposition 13.9, sec-
15.2, change x to y in “f (x) ≥ ϕ(x) for all
ond line, change A∇` to Ad` .
x ∈ Rn ”
385, line -2, change ∇Jk to ∇Juk and on
548, line 9, change ∂(h + IC )(x) ⊆ ∂h(x) +
line -1 change ∇J`+1 to ∇Ju`+1 .
∂IC (x) to ∂h(x) + ∂IC (x) ⊆ ∂(h + IC )(x)
386, after (∗5 ), change hAv, ai to hAv, vi.
548, in Part (2) of the proof of Proposition
387, in Example 13.3, line 3, the second
15.26, change “y ∈ ∂(h + ∂IC )(x), and by”
occurrence of (x y) should be (2 − 8).
to “0 ∈ ∂h(x) + ∂IC (x), since by”
388, lines 1 and 4, change ρk Adk to ρ` Ad` .
551, in Theorem 15.10, Clause (2), missing
388, Equation (∗7 ) should be rk = ∇Juk =
comma in j = 1, . . . , p. In Clause (3), ψi
Auk − b.
should be ψj .
388, in (∗8 ), change rk+1 = rk + ρk Adk to
rk+1 = rk − ρk Adk . 593, middle of the page, change “arround”
388, line -1, change dk+1 = rk+1 − βk+1 dk to “around”
to dk+1 = rk+1 + βk+1 dk . 642, the (3, 3) entry in matrix A should be
395, (∗1 ) should be J(u ) ≤ J(u). Ip
397, in Problem 13.1, Part (2), change 650, the (2, 3) entry in matrix A should be
hAu − b, v − u) to hAu − b, v − ui. Ip
397, Problem 13.2, in the equation for J(v), 676, the (3, 3) entry in matrix A should be
change aiij to aij . Ip
408, line 5, change γ 0 (u) to γ 0 (0). 677, the (3, 3) entry in matrix A2 should be
403, bottom of page, change “said to be Ip
active is” to “said to be active if” 692, the (2, 3) entry in matrix A should be
404, line 1, change “KTT” to “KKT”. Ip
 3
728, the (3, 3) entry in matrix A should be 763, line -9, change to λ+ = Kµ+ , λ− =
Ip Kµ−
729, Problem 18.7, the (2, 3) entry in ma- 766, line -5, delete “can” in “can can”
trix A should be Ip
767, line 3, change to “X20 is a 50 × 30
730, Problem 18.8 the (3, 3) entry in matrix
matrix”
A should be Ip
730, Problem 18.8 the (3, 3) entry in matrix 767, middle of page, Change to “K = 0.01
A2 should be Ip and τ = 0.99”, and to “K = 0.99 and τ =
751, middle of the page, change “arround” 0.01.”
to “around” 783, line -12, change b to w