EIM Lecture Notes 2
EIM Lecture Notes 2
(Lecture notes)
i
CONTENTS ii
IV Market Power 29
V Information 30
A Mathematical appendix 32
A.1 Sets and relations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
A.2 Topology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
A.3 Linear algebra . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
A.4 Matrices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
A.5 Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
A.6 Convexity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49
Part I
1
Chapter 1
In this chapter, we study the essence of the market mechanism: the exchange of
goods or services between free agents. Agents can be individual (e.g., consumers)
or collective (e.g., producers, the state).
The agents will be modeled in isolation of the others in Section 1.1 and Section
1.3, for consumers and producers respectively. We model the interaction between
agents in Section 1.2 for the case of a pure exchange economy, and in Section 1.4
in the general case with concumption and production. Section 1.5 illustrates the
material for the important class of quadratic preferences.
Section 1.1 introduces the fundamentals of economic choice by individual agents
(consumers) in isolation of others. It answers to two questions:
How do individual agents assign value to goods and services? The notion of
preferences, and their axiomatic foundations, and the notion of utility that
stems from preferences are presented in subsection 1.1.1.
For two individual agents, in the Edgeworth box, the geometry of net de-
mands of both sides are represented and compared in subsection 1.2.1.
2
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 3
Section 1.4 introduces the general model of exchange between consumers and
producers on a perfect market.
x ≻ x′ ⇐⇒ x ⪰ x′ but x′ ⪰̸ x ,
and an indifference relation (or equivalence relation - see Definition A.2), denoted
∼:
x ∼ x′ ⇐⇒ x ⪰ x′ and x′ ⪰ x.
Based on this claim, the assumptions of completeness and transitivity of the pref-
erence are the essence of rationality. In some cases, they are enough to ensure
existence of a utility function that represents the consumer’s behavior.
Exercise 1.1 Let ⪰ be a preference (complete and transitive binary relation) over
a finite set X ⊆ RL . Prove that there is a utility function u : X → R that represents
it (i.e., such that x ⪰ x′ ⇐⇒ u(x) ≥ u(x′ )).
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 5
In order to have utility functions on the whole consumption set RL , we will also
assume that the preference ⪰ satisfies:
strict monotonicity: x ≥ x′ 1
and x ̸= x′ ⇒ x ≻ x′ .
Under these assumptions, there exists a utility function over RL that represents ⪰.
The strict convexity of preferences translates into concavity of the utility function
that represents it.
Claim 1.2 The preference ⪰ is strictly convex if and only if the utility function u
strictly quasi concave.
Finally, and mainly for the sake of mathematical convenience, we will assume:
From now on, we will represent consumer behavior by utility maximization. But
the above argumentation stresses that this comes as a theorem; what is assumed is
just that agent can relate bundles to one another in ways which satisfy some prop-
erties that characterize economic rationality. The latter properties are thoroughly
discussed in economic science; this is the main object of Behavioral Economics.
where p = (p1 , p2 , . . . , pL ) ∈ RL++ is the price vector. This constraint defines a set,
from which the consumer can choose.
The consumer maximizes her objective function, u, subject to the constraint.
She therefore solves the problem:
Max u(x)
x∈R L (1.1)
s. t. p·x≤w
p·x=w .
Proof: Suppose to the contrary that the maximum x∗ is such that p · x∗ < w. There
exists δ ≫ 0 such that p · x∗ + p · δ = p · (x∗ + δ) < w. Hence x∗ + δ is affordable;
but it brings a strictly higher utility level: u(x∗ + δ) > u(x∗ ) − a contradiction to
x∗ being the maximum. 2
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 7
Given continuity, there exists a solution to the consumer’s problem. Given con-
vexity, this solution is unique. This allows to define the an individual demand
function.
Proposition 1.1 The optimization program of the consumer has a unique solution
x∗ = f (p, w) .
Max u(x)
x∈R L
(
p·x=w
s. t.
x ∈ P (x̄)
Denote B(p, w, x̄) this new budget set and b̄ = b(x̄). Given boundedness from
below, any x ∈ B(p, w, x̄) is such that b(x̄) ≤ x, hence B(p, w, x̄) is bounded from
P
below. Moreover for all ℓ ∈ L, pℓ b̄ℓ ≤ pℓ xℓ hence p1 x1 + ℓ̸=1 pℓ b̄ℓ ≤ p · x ≤
P
w, therefore x1 ≤ (w − ℓ̸=1 pℓ b̄ℓ )/p1 ; and by the same argument xk ≤ (w −
P
ℓ̸=k pℓ b̄ℓ )/pk for all k ∈ L: B(p, w, x̄) is bounded from above. Hence bounded.
We know in addition that B(p, w, x̄) is closed, as it is the intersection of two
closed sets: P (x̄) ∩ {x | p · x = w}. Since u is continuous, by Weierstrass theorem it
has a maximum; since u is strictly quasi-concave this maximum is unique (Theorem
A.14): if there were two distinct maxima x∗ ̸= x′∗ , then necessarily u(x∗ ) = u(x′∗ )
and then the mid-point z = (x∗ + x′∗ )/2 is also in B(p, w, x̄) and by strict quasi-
concavity u(z) > u(x∗ ) = u(x′∗ ) − a contradiction. 2
Remark We have ∀t > 0, f (tp, tw) = f (p, w): f is homogeneous of degree zero with
respect to prices and wealth. We then normalize prices, and choose a numéraire:
p1 = 1.
Proposition 1.2 The bundle x∗ is solution of the optimization program of the con-
sumer if and only if it satisfies the first order conditions: there exists λ∗ > 0 such
that (
∇u(x∗ ) = λ∗ p
(1.2)
p · x∗ = w
where ∇u is the gradient of the utility function:
∂u ∂u ∂u
∇u(x) = (x), (x), . . . , (x) .
∂x1 ∂x2 ∂xL
Proof: These are the necessary first-order conditions of Lagrange’s method to solve
the optimization problem (1.1). See Theorem A.15.
Let us prove that these necessary conditions are sufficient. We know (Proposition
1.1) that the problem has a solution, and it is unique. So it must be the one satisfying
(1.2).
A more direct proof uses the following property of strictly quasiconcave functions:
Now suppose that (x∗ , λ∗ ) satisfies (1.2) but is not a solution of the problem: there
exists x such that p · x = w and u(x) > u(x∗ ). Then for t ∈ [0, 1] sufficiently close
to 1, by continuity of u: p · (tx) < w and u(tx) > u(x∗ ). The above property then
gives: ∇u(x∗ )(tx − x∗ ) ≥ 0; but from (1.2) we get:
a contradiction. 2
Exercise 1.2 Give the expression of the demand function of a consumer whose
utility function is:
1. u(x1 , x2 ) = α1 ln x1 + α2 ln x2 (log-linear).
Min p·x
x ∈ RL (1.3)
s. t. u(x) ≥ ū
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 9
x2
6
w 7
p2 p
budget
line
x∗2
-
O x∗1 w x1
p1
Figure 1.1
Thus, any price p (for good 2, good 1 is the numéraire) posted on the market trig-
gers a demand by the consumer; this defines an offer curve, O(ω), which is the path
followed by the optimal choice x∗ when p varies from 0 to +∞. See Figure 1.2.
The offer curve has two asymptotic directions:
a horizontal one when p tends toward +∞: then good 1 becomes free, the
assumption of monotonicity leads the agent to demand an infinite quantity of
it;
a vertical one when p tends to zero: this corresponds to the case when good 2
becomes free.
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 10
ω O(ω)
•
Iu(ω)
-
O
it goes through ω; when the market price is collinear to ∇u(ω), then ω is the
demand of the consumer; she does not find it beneficial to trade;
it lies above the indifference curve Iu(ω) going through ω; the consumer can
always demand ω and secure a utility level of u(ω); if she demands another
bundle x ̸= ω, it can only be that x brings a higher utility: u(x) > u(ω).
with α ∈]0, 1[. The demand of the consumer is (see Exercise 1.2):
1−α
x(p) = α(ω1 + pω2 ), (ω1 + pω2 )
p
which are the parametric equations of the offer curve O. We have:
The notion of offer curve can be extended to any number of goods (it is an
hypersurface).
xa2 Ob
6 ωb1
xb1
budget
line p
p2
1
ω
ωa2 • ωb2
xa1
-
Oa ωa1
x
?
b2
i.e., when the overall demand in good 1, x∗a1 +x∗b1 , equals the overall supply, ωa1 +ωb1 .
One then observes that the same condition will automatically be fulfilled for good
2. Indeed, given that p · x∗a = p · ωa and p · x∗b = p · ωb , one gets:
x∗a (p, wa )
•
x∗b (p, wb )•
ω
•
-
Oa
?
net supply of agent a
Figure 1.4: Disequilibrium
Definition 1.1 A walrasian equilibrium is a vector (p∗ , x∗a , x∗b ) such that
x∗a = fa (p∗ , p∗ · ωa )
x∗b = fb (p∗ , p∗ · ωb ) (1.4)
x∗ + x∗ = ω + ω
a b a b
One can give a heuristic proof in the Edgeworth box. Both offer curves cross at ω,
where Ob (ω) goes above Oa (ω); but one knows that Oa (ω) has an upward vertical
asymptotic direction and Ob (ω) has a leftward horizontal asymptotic direction; by
continuity and the theorem of intermediate values, they must cross each other at
another point (x∗ on Figure 1.6) than ω. The corresponding equilibrium budget line
is (ω, x∗ ), to which the equilibrium price p∗ is orthogonal.
Exercise 1.3 Compute the walrasian equilibrium of the two consumers–two goods
economy, with utility functions and initial endowments:
ua (xa1 , xa2 ) = α ln xa1 + (1 − α) ln xa2 and ωa = (1, 0) ;
ub (xb1 , xb2 ) = β ln xb1 + (1 − β) ln xb2 and ωb = (0, 1) .
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 14
Ob
6
x∗a (p, wa )
•
x∗b (p, wb ) ω
•
-
Oa ?
Remark There can be several equilibria. But there is almost always (except in
non-generic cases) an odd number of equilibria as Figure 1.7 depicts.
Exercise 1.4 Consider a pure exchange economy with two agents characterized by
the utility functions (said to be quasi-linear):
1 1
ua (xa1 , xa2 ) = xa1 − (xa2 )−8 , ub (xb1 , xb2 ) = − (xb1 )−8 + xb2 ,
8 8
and initial endowments ωa = (2, r) and ωb = (r, 2), where r = 28/9 − 21/9 .
1. Show that the offer curves of the two agents are respectively (good 2 is the
numeraire, p is the price of good 1):
and
OBb (p) = p−1/9 , 2 + rp − p8/9
Ob
6
p∗
x∗
•
Ob (ω) ω Oa (ω)
•
-
Oa ?
(Hints: r has a peculiar form. It should help you find the root of a non-trivial
polynomial expression. For showing that you found all the roots of that expression,
the intermediate value theorem may be useful.)
Exercise 1.4: Compute the walrasian equilibrium of the two consumers, one good
and two dates intertemporal economy, with utility functions ui (xi1 , xi2 ) = ln xi1 +
δ ln xi2 for i = a, b, and arbitrary initial endowments.
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 16
Ob
6
Ob (ω) ω Oa (ω)
•
-
Oa ?
1.3 Producers
There are J firms, indexed from 1 to J, where J = {1, . . . , J}. Each firm faces
different possible ways to transform inputs into outputs.
The set Y is here the disk of radius 1 centered at O, and its frontier ∂Y the circle
of radius 1; they are represented in Figure 1.8.
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 17
Ty ∂Y
y2
6
∂Y
∇
*
•
y
Y
-
y1
It is clear from the assumptions that an optimal choice will be on the frontier ∂Y .
Exercise 1.5 Give the expression, as a function of prices, of the optimal choice
of a producer using goods 2 and 3 to produce good 1, with production function:
√ √
g(y1 , y2 , y3 ) = y1 − y2 − y3 .
Definition 1.2 An allocation (x, y) is a list of bundles and plans such that y ∈ Y
and aggregate supply and demand balance each other out:
X X X
xi = x̄i + yj . (1.5)
i i j
Given the market price vector p in RL , the market value of this return is (taking
the inner product with p):
J
X J
X L
X
p· θij yj = θij pℓ yjℓ , (1.7)
j=1 j=1 ℓ=1
PL
which is the dividends of firms j (share θij of the profit p·yj = ℓ=1 pℓ yjℓ ), summed
over all firms.
P
The expression (1.6) and (1.7) are cumbersome, as they involve multiple ’s. It
is more parsimonious, in terms of notation, and also for computer programming, to
use matricial forms.
Denote Y the L×J matrix of production plans (its J column vectors are the
production plans, hence its entry at row ℓ and column j is the output - or input if
it is negative - of firm j in good ℓ). Check that we have:
J
X
θij yj = Y θi (1.8)
j=1
and that
J
X L
X
θij pℓ yjℓ = p · Y θi (1.9)
j=1 ℓ=1
1.4.3 Equilibrium
Let Y = (y1 . . . yJ ) denote the L×J matrix of production plans. The initial resources
of consumer i are the addition of her endowments in goods plus the product of her
endowment in shares: x̄i + Y θ̄i . For a market price vector p ∈ RL+ , the budget set of
consumer i is therefore
The general equilibrium analysis will only be complete when the choice of pro-
duction plans has been determined endogenously. A crucial point, often discarded
in most textbooks, is to determine whether shareholders or stakeholders agree on
what firms should produce.
Consumers are fully aligned and therefore they all agree on the best plan, i.e.
that which maximizes the value of production based on market prices. The notion
of general equilibrium follows on from this.
Figure 1.8 represents, for a plan y ∈ ∂Y, the value vector ∇ which supports it:
it is orthogonal to the tangent at y of ∂Y, denoted Ty ∂Y.
The following result is important. It demonstrates that in respect of our hy-
potheses there is a bijective relationship between value vectors and optimal plans.
for all yj ∈ ∂Yj there is a unique (up to collinearity) value vector in RL \ {0}
supporting yj ; it is denoted as ∇j (yj );
for all ∇j ∈ RL+ \ {0} there is a unique production plan yj ∈ ∂Yj which is a
solution for ∇j .
and SL+ denotes its interior; π is the vector of weightings attributed to the different
goods (independently of i), and γi ∈ R+ is a parameter.
P P
Let ωi = x̄i +Y θ̄i be the total initial resources of consumer i, and Ω = i x̄i + j ȳj
be the vector for the overall resources in the economy. We assume that for every
CHAPTER 1. PERFECT MARKETS: POSITIVE ANALYSIS 22
i, γi > max{Ωℓ , 1 ≤ ℓ ≤ L} such that the utility function satisfies the required
hypotheses (e.g., monotonicity) on the set of relevant consumptions.
Let ∥ · ∥π denote the π-norm3 on RL . Let 1L (respectively 1J ) be the vector with
L (respectively J) coordinates, all equal to 1. Therefore
1 2 1
ui (xi ) = γ − ∥γi 1L − xi ∥2π .
2 i 2
The indifference (hyper)surfaces of consumer i are (hyper)spheres for the π-distance,
centered on γi 1L , which hence represents the ideal bundle for this consumer, the one
that maximises ui (xi ) and that she would choose if there were no budget constraint.
Figure 1.9 illustrates the configuration in the case of 2 goods and equal weights:
π1 = π2 = 0.5 (Euclidean distance). Indifference curves are arcs of a circle centered
on γi 1L . At the individual optimum x∗i , the indifference curve is tangent to the
budget line, determined by the vector of initial resources x̄i + Y θ̄i and orthogonal
to the price vector p, which bounds the budget set Bi (p, y).
Let Π be the diagonal matrix whose size is L with π on the diagonal, then the
gradient takes the following form:
The indifference surfaces being spheres, the gradient points towards the center of the
hypersphere of indifference, i.e. the ideal bundle. (In Figure 1.9, at the individual
∥
optimum x∗i , the normalized gradient ∇i = p points toward the center of the arcs
of circle γi 1L .)
P
The Walrasian equilibrium price vector is easy to calculate. Define Γ = i γi .
x2
γi 1L(=2)
6
*p
•
x̄∗i
Bi (p, y)
•
ωi
-
x1
Proof: The first-order conditions of the individual optimization problem for con-
sumer i gives: ∃λi ∈ R+ such that ∇ui (xi ) = Π(γi 1L − xi ) = λi p. Hence xi =
γi 1L − λi Π−1 p.
P P
Denote Λ = i λi . Adding up the individual consumptions gives us: i xi =
Γ1L − ΛΠ−1 p = Ω, hence:
1 λi
p= Π(Γ1L − Ω) and xi = γi 1L − (Γ1L − Ω).
Λ Λ
The price vector p is normalized, so that p · 1L = 1. As a consequence Λ = Γ − π · Ω.
Hence the expression of p.
Denote αi = λi /Λ, hence the expression of xi .
The equilibrium values of (αi )i∈I ∈ SI+ are determined by the budget equations.
Denote z̃i = γi 1L − ωi the ideal transaction of i and z̃ = i z̃i = Γ1L − Ω the ideal
P
The results lends itself to a quite simple and intuitive geometrical interpretation.
The bundle γi 1L being the ideal bundle of consumer i, her ideal transaction is
z̃i = γi 1L − ωi ; and the aggregate ideal transaction is z̃ = i z̃i = Γ1L − Ω.
P
The equilibrium bundle x∗i = γi 1L − αi∗ z̃ is therefore the ideal bundle decreased
by a proportion of the ideal aggregate transaction. This proportion is
z̃ ⊙π z̃i
αi∗ = for every i
∥z̃∥2π
(cf. proof of Lemma 1.2). The proportion αi∗ measures the π−projection of the
ideal transaction of i on the ideal aggregate transaction. The less z̃i is collinear to
z̃ (a situation where consumer i’s ideal transaction diversifies the aggregate ideal
transaction) the smaller αi∗ , and thus the larger the equilibrium bundle. In this
model a consumer is rewarded if her transaction diversifies the economy.
In conclusion of this first chapter, we can see that complete alignment between
consumers stems from the hypothesis of a perfect market, thus ridding the decision-
making process in firms of any political content. This is no longer the case when
markets fail. Consumers then disagree about the plan to produce. In our model,
∥
this occurs when the ∇i ’s are different from one agent to another, giving rise to
a problem of a political nature when it comes to taking collective decisions, e.g.
choosing the production plans in firms.
Let Ω = (Ω1 , Ω2 ) be the vector for the overall resources in the economy. We
assume that for every i, γi > max{Ω1 , Ω2 } such that the utility function satisfies
the required hypotheses (e.g., monotonicity) on the set of relevant consumptions.
1. Let ∥ · ∥ denote the Euclidean norm on R2 . Let 12 = (1, 1). Show that
1
ui (xi ) = γi2 − ∥γi 12 − xi ∥2 .
2
What can you infer about the shape of the indifference curves?
4. Check that at equilibrium all gradients are collinear, and that the demand of
consumer i is: (
xi1 = γi − αi (Γ − Ω1 )
(1.15)
xi2 = γi − αi (Γ − Ω2 )
with αi = λi /Λ.
5. We want to find the equilibrium value of αi using the budget equations. The
bundle γi 12 being the ideal bundle of consumer i, define her ideal transaction:
z̃i = γi 12 − ωi
z̃i = Γ12 − Ω.
X
z̃ =
i
xi = γi 12 − αi z̃. (1.16)
(c) Show that given with the budget equation p · xi = p · ωi , Equation (1.16)
yields
1
∀i, αi = (γi − p · ωi ).
p · z̃
(d) Show that
p · z̃i z̃ · z̃i
αi = = for every i.
p · z̃ ∥z̃∥2
(e) Explain why the less z̃i is collinear to z̃ (a situation where consumer i’s
ideal transaction diversifies the aggregate ideal transaction) the smaller
αi , and thus the larger the equilibrium bundle. Interpret.
Part II
27
Part III
28
Part IV
Market Power
29
Part V
Information
30
Part VI
31
Appendix A
Mathematical appendix
∪i∈I Ai = X
Ai ∩ Aj = ∅ for all i, j ∈ I
≥, = and > on R
32
APPENDIX A. MATHEMATICAL APPENDIX 33
reflexive - ∀ x ∈ X : xRx
x ∈ Ca ⇒ Cx = Ca
x∈
/ Ca ⇒ Cx ∩ Ca = ∅
xRa ⇔ ∃ i ∈ I : x, a ∈ Ai
is an equivalence relation.
APPENDIX A. MATHEMATICAL APPENDIX 34
∀ a ∈ X : a ∈ Ca (reflexivity) ⇒ ∀ x ∈ X ∃ a ∈ X : x ∈ Ca
Lemma A.1 ⇒ ∀ x, a ∈ X : either Cx = Ca or Cx ∩ Ca = ∅
A.2 Topology
Definition A.3 A norm on a vector space V over R is a function ∥ · ∥ : V → R
such that:
∀ x ∈ V : ∥x∥ = 0 ⇔ x = 0
∀ x ∈ V : ∥x∥ ≥ 0
∀ x ∈ V, α ∈ R : ∥αx∥ = |α|∥x∥
Xℓ
∥x∥ = ( x2i )1/2
i=1
ℓ
!2 ℓ
! ℓ
!
X X X
xi yi ≤ x2i yi2
i=1 i=1 i=1
Proof: Trivially ∀ λ ∈ R
ℓ
X ℓ
X ℓ
X ℓ
X
0 ≤ (xi − λyi )2 = x2i − 2λ xi y i + λ 2 yi2
i=1 i=1 i=1 i=1
APPENDIX A. MATHEMATICAL APPENDIX 35
x2i − 2 λ xi yi + λ2 yi2
P P P
0 ≤ i i i
( i xi yi ) 2
P P
2 xy
yi2
P P P
Pi i 2 i
= i xi − 2 i xi yi + ( i yi2 )2 i
P
i yi
∥x + y∥2 = 2
P
i (xi + yi )
2
P P P 2
= i xi + 2 i xi y i + i yi
P 2 P 2 P 2 1/2
yi2
P
≤ i xi + 2 [( i xi )( i yi )] + i
2 2
= ∥x∥ + 2∥x∥ ∥y∥ + ∥y∥
= (∥x∥ + ∥y∥)2
The open ball B(x, ε) with center x and radius ε > 0 is defined by
B(x, ε) = { y ∈ X | ∥x − y∥ < ε }
The closed ball Bε [x] with center x and radius ε > 0 is defined by
B[x, ε] = { y ∈ X | ∥x − y∥ ≤ ε }
∀ x ∈ U ∃ ε > 0 : B(x, ε) ⊆ A
x ∈ ∩i∈I Ui
⇒ ∀ i ∈ I ∃ εi > 0 : B(x, ε) ⊆ Ui
⇒ ∀ ε ≤ mini∈I {εi } : B(x, ε) ⊆ ∩i∈I Ui
(1) f is continuous
Definition A.6 A family of sets (Ui )i∈I is an open cover of A ⊆ X if and only if
Ui is open for all i ∈ I and A ⊆ ∪i∈I Ui
Definition A.7 A subset A ⊆ X is compact if and only if for all open covers
(Ui )i∈I there is a finite open subcover (Ui )i∈J with J finite
u(S) = { a ∈ R | ∃ x ∈ S :
Th. A.4
Proof: arg maxS u is non-empty: S is compact ⇒
Heine-Borel
u(x) = a } is compact ⇒ u(S) is closed and bounded ⇒ sup u(S) exists and
u(S) is closed ⇒ sup u(S) ∈ u(S) ⇒ maxS u = sup u(S)
Th A.3
arg maxS u is closed maxS u is closed ⇒ u−1 (max u(S)) is closed. 2
v = α1 v1 + . . . + αn vn
α1 v1 + . . . + αn vn = 0
Any two bases of a vector space have the same cardinality, called dimension.
Theorem A.7 In a vector space of finite dimension, all bases have the same number
of elements. It is the dimension of v: dim V .
u1 is a linear combination of w1 , u2 . . . , un .
Pn
Since U spans V , these vectors also span V , hence w2 = α21 w1 + i=2 α2i ui ,
with one α2i ̸= 0 for i = 2, . . . , n; w.l.o.g. let α22 ̸= 0.
Iterating the argument: {w1 , . . . , wn } spans V ; hence wn+1 is a linear combina-
tion of these vectors - a contradiction. 2
Examples:
The identity 1V : V → V .
1. f (0) = 0.
3. If U is a subspace of V , f (U ) is a subspace of W .
4. If U ′ is a subspace of W , f −1 (U ′ ) is a subspace of V .
5. If (v1 , . . . , vn ) are linearly dependent, then (f (v1 ), . . . , f (vn )) are linearly de-
pendent.
Let f : V → W be a linear mapping. Let Imf denote its image (or range), and let
Kerf denote its kernel:
A.4 Matrices
Definition A.12 An m × n real matrix is a m-tuple of vectors of Rn written as
a a12 . . . a1n
11
a21 a22 . . . a2n
A= .
.. .. .. ..
. . .
am1 am2 . . . amn
The transposed matrix of A = [aij ] is the n × m matrix At = [atij ] where atij = aji .
Example:
1 0
! !
−1 2 0 1 1
1
= 5 0
3 −2 1 0 −3
3
−2 1
4 −2
(AB)t = B t At
In the sequel, we consider the canonical base for each real vector space.
1. For any matrix A ∈ Rmn , the mapping fA : V → W such that for all v ∈ V
fA (v) = Av is linear.
APPENDIX A. MATHEMATICAL APPENDIX 41
such that
1 0 ... 0
0 1 ... 0
A−1 A = A A−1 = In =
.. .. .. ..
. . . .
0 0 ... 1
Example: Let V be n-dimensional and fix a basis. The inner product (or scalar
product) is
n
X
u·v = ui vi
i=1
Proposition A.11 Let V be a real vector space with dim V = n. In the canonical
basis:
u, v ∈ V is a bilinear form;
Proof: 1/ and 3/ are obvious. For 2/,let A = [aij ] with aij = f (ei , ej ). For u =
(αi )ni=1 and v = (βj )nj=1 (in B), bilinearity implies f (u, v) = ni,j=1 αi βj aij = ut Av.
P
Example: The inner product is clearly symmetric. Therefore the mapping q(x) =
x · x = ni=1 x2i is a quadratic form.
P
positive (resp. negative) definite if if aii > 0 (resp. < 0) for all i;
A.5 Optimization
Consider the unconstrained problem
Maximize f (x)
(A.1)
subject to x ∈ X
where the objective function f : X ⊆ Rn → R is real-valued.
Proof: Let us show that the partial derivatives at x∗ are 0. Let ei be the ith vector
in the canonical basis. Define gi (h) = f (x∗ + hei ). By construction, 0 is a local
maximum (say) of gi hence
1 ∂f ∗
0 = gi′ (0) = lim (f (x∗ + hei ) − f (x∗ )) = (x )
h→0 h ∂xi
The points at which ∇f (x∗ ) = 0 are the critical points. 2
∂ 2 x1 ∂x1 ∂x2
. . . ∂x∂1 ∂x 1
n
2
∂ f2 ∂ 2 f2 ∂ 2 f2
∂ 2 x2
. . . ∂x2 ∂xn
Hf (x̄) = ∂x2.∂x1
.. .
.. .. ..
. .
2
∂ fm 2
∂ fm 2
Those definitions are strict when the corresponding inequality is strict whenever
x ̸= y and t ∈]0, 1[.
Proof: (⇒) Take t ∈ [0, 1], and y, z ∈ Uf (x): both f (y), f (z) ≥ f (x), hence
min{f (y), f (z)} ≥ f (x) and by quasiconcavity f (ty + (1 − t)z) ≥ f (x), hence
tx + (1 − t)y ∈ Uf (x).
Beware: Reverse of 2/ does not hold; for example f (x) = −x4 is strictly concave
but Hf (0) is not negative definite.
For concave functions, the FONC of a maximization problem are sufficient.
Proof: (⇐) follows from Th. A.12 and the following lemma. 2
Theorem A.15 (Lagrange’s first order conditions) Consider problem (A.2) where
f and g are C 1 . If
2. rank Jg (x∗ ) = m
and
Jh (z ∗ ) = −[Jg,y (y ∗ , z ∗ )]−1 · Jg,z (y ∗ , z ∗ )
Define λ∗ = −∇fy (x∗ )·[Jg,y (x∗ )]−1 , then ∇fz (x∗ )+λ∗ ·Jg,z (x∗ ) = 0 and by definition
of λ∗ : ∇fy (x∗ ) + λ∗ · Jg,y (x∗ ) = 0 hence ∇f (x∗ ) + λ∗ · Jg (x∗ ) = ∇Lx (x∗ ) = 0 2
In practice:
When the constraint set can be defined implicitely globally (see proof), then
transform the problem into an unconstrained one.
APPENDIX A. MATHEMATICAL APPENDIX 48
Theorem A.16 (Lagrange’s second order conditions) Let problem (A.2) with
f and g C 2 . Consider (x∗ , λ∗ ) a critical point of problem (A.2) such that x∗ ∈ IntX.
Then
Moreover
∀x ∈ U Jg (x) = −Jf,y (x, g(x))−1 Jf,x (x, g(x))
A.6 Convexity
Definition A.23 Let V be a real vector space; a subset C ⊆ V is convex if and
only if ∀ x, y ∈ C, t ∈ [0, 1] : tx + (1 − t)y ∈ C.
A convex combination: x = m
P Pm
i=1 λi xi where ∀i, λi ≥ 0 and i=1 λi = 1.
Lemma A.3 A convex set contains the convex comb. of any finite number of its
elements.
Definition A.24 Let V be a finite dimensional real vector space, p ∈ V \{0} and
α ∈ R. Define:
hyperplane H(p, α) = {x ∈ V | p · x = 0}
(
H + (p, α) = {x ∈ V | p · x ≥ 0}
closed half-spaces
H − (p, α) = {x ∈ V | p · x ≤ 0}
(
intH + (p, α) = {x ∈ V | p · x > 0}
open half-spaces
intH − (p, α) = {x ∈ V | p · x < 0}
Definition A.25 Let V be a real vector space and A ⊆ V . The convex hull of A,
denoted coA, is the set of all convex combinations of finitely many elements of A.
Proof: Let A ̸= ∅ (otherwise: end). Let x ∈ coA; Prop ** 2/, ∃m ∈ N such that x
is the convex comb. of m elements of A: x = m
P
i=1 λi xi ; w.l.o.g. ∀i, λi > 0.
Let m be minimal. If m ≤ n + 1: end. If m > n + 1, the m − 1 vectors x2 − x1 ,
. . . , xm − x1 are necessarily linearly dependent: ∃α2 , . . . αm ∈ R, not all 0, such that
Pm Pm Pm Pm
i=2 αi (x i − x 1 ) = 0. Take α 1 = − i=2 α i : i=1 α i x i = 0, i=1 αi = 0.
λ
Obviously αj > 0 for some j. Let c = min{ αjj | αj > 0} and k such that
= c. Denote βj = λj − cαj : x = m
λk P Pm
αk j=1 βj xj and i=1 βi = 1 with ∀i, βi ≥ 0 and
βk = 0: hence x can be written as a convex comb. of less that m vectors of A - a
contradiction. 2
APPENDIX A. MATHEMATICAL APPENDIX 51
Proof: Pick x1 , . . . , xm ∈ S. They are affinely dep. (there can be at most n + 1 affin.
indep. vectors in Rn ): ∃α ∈ Rm \{0},
Pm Pm
i=1 α i x i = 0 and i=1 αi = 0.
Let I = {i : αi > 0}, J = {i : αi < 0}, A = {xi : i ∈ I} and B = {xi : i ∈ J}.
Define for i ∈ I: βi = Pαiαi , then I βi xi ∈ coA.
P
I
Moreover I βi xi = P 1 αi I αi xi = − P1 αi (− J αi xi ) ∈ coB. 2
P P P
I J
For infinite class, we need compactness. Th **: any nonempty finite subset of the
class C has nonempty intersection. By Prop **: ∩C ̸= ∅.
Proposition A.16 Let (V, ∥ · ∥) be a normed vector space and A ⊆ V be open, then
coA is open.
APPENDIX A. MATHEMATICAL APPENDIX 52
Proof: Since A ⊆ coA and A open, A ⊆ int coA. But int coA is convex ⇒ coA ⊆
int coA, hence coA = int coA. 2
Remark: The convex hull of a closed set is not always closed. Let A = {(x, 0) | x ∈
R} ∪ {(0, 1)} ⊆ R2 . A is closed, but coA = {(x, y) | x ∈ R, 0 ≤ x < 1} ∪ {(0, 1)} ⊆ R2
is not.
Let H(p, α) with p ∈ Rn \{0} and α ∈ R. For any x∗ ∈ H(p, α), H(p, α) is the
hyperplane passing through x∗ :
H(p, x∗ ) = {x ∈ Rn | p · (x − x∗ ) = 0}.
Proof: Since intC nonempty and convex + {x∗ } convex and disjoint from intC, by
Cor ** ∃p ∈ Rn \{0} : p · c ≤ p · x∗ ∀c ∈ cl intC = clC. QED. 2
Lemma A.6 (Farkas’ lemma) Let A ∈ Rmn and c ∈ Rn . Then one and only one
of the following systems has a solution
Ax ≤ 0m
y ≥ 0m
t
cx>0 (I) At y = c (II)
x ∈ Rn y ∈ Rm
Proof: Suppose (II) has a solution y ∗ . For any x ∈ Rn such that Ax ≤ 0m , we have
y t Ax = (At y)t x = ct x. Since y ≥ 0m and Ax ≤ 0m , we get ct x ≤ 0 hence (I) cannot
have a solution.
Suppose now that (II) does not have a solution: c is not in the set
S = {z ∈ Rn | z = At y for some y ∈ Rm , y ≥ 0m }
which is closed, convex, nonempty (it is the cone generated by A’s row vectors).
Cor **: S and {c} can be strongly separated: ∃p ∈ Rn \{0n } and α ∈ R such
that ∀z ∈ S, p · z < α < p · c. Since 0n ∈ S, 0 < α and α < p · c = ct p >.
APPENDIX A. MATHEMATICAL APPENDIX 54
We claim: Ap ≤ 0m so that p is a solution of (I). Suppose not: ∃i: (Ap)i > 0. Let
2α
y = (0, . . . , 0, yi , 0, . . . , 0) with yi = (Ap)i
. At y ∈ S and α > p · At y = (Ap)t y = 2α
− a contradiction to α > 0. 2