linear algebra
linear algebra
LE DAI (OWNER)
1 Vector Spaces 4
1.1 The definition of vector spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.2 The linear combination . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.3 The linear independence and dependence . . . . . . . . . . . . . . . . . . . . . . 5
1.4 Vector subspaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.5 Bases and add to the basis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.6 The sum and intersection of two vector subspaces; The subspace generated by set 10
2 Answer 12
2.1 K73 Summer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.2 K71K Official Exam . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
2.3 K72K Midterm test - Even . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
2.4 K72K Midterm test - Odd . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
2
Preface
Linear Algebra is a crucial subject in the university curriculum for the Faculty of Mathe-
matics with serving as the foundation for understanding and applying other relating subjects.
This book is written and presented in a detailed manner to cater to beginners. However, as
this book is written with a subjective perspective, it is inevitable that some mistakes may have
been happen. We kindly ask for your understanding and welcome any responses to make this
book more completely.
Once more, Thank you for reading and studying this book!
3
Chapter 1
Vector Spaces
(x, y, z) + (x′ , y ′ , z ′ ) = (x + x′ , y + y ′ , z + z ′ )
λ(x, y, z) = (λx, y, z)
Is the given set a R vector space ?
Solution.
For λ ̸= 1, we consider (1, 2, 2) then λ(1, 2, 2) = (λ, 2, 2) ̸= (λ, 2λ, 2λ)
This contradicts to the 8th axiom so that it’s not a R vector space.
(x, y) + (x′ , y ′ ) = (x + x′ , y + y ′ )
Problem 3 Consider whether the set of real numbers x ≥ 0 with two operators + and ·
is R vector space.
Solution.
We have that 1 + (−1) = 0 but −1 ∈
/ A then A is not a R vector space.
⃗ = (1, −6, 1)
b) ⃗x = (0, 0, 0), ⃗u = (2, 3, 5), ⃗v = (3, 7, 8), w
4
CHAPTER 1. VECTOR SPACES
1.3. THE LINEAR INDEPENDENCE AND DEPENDENCE
Solution.
a) We consider that ⃗x = a⃗u + b⃗v + cw
⃗ then it will be a system of equations, as follows:
2a + 3b + c = 7
n
3a + 7b − 6c = −2 ⇒ a =
5a + 8b + c = 15
Problem 5 Write X as the linear combination of vectors A and B then point out the corre-
sponding coordinate of X with respect to A and B.
a) X = (1, 0), A = (1, 1), B = (0, 1)
b)
c) We consider that a(2, −3, 1) + b(3, −1, 5) + c(1, −4, 3) = 0 then the following system of
equations is given by
2a + 3b + c = 0
a = 0
−3a − b − 4c = 0 ⇒ b = 0
a + 5b + 3c = 0 c=0
Page 5
1.3. THE LINEAR INDEPENDENCE AND DEPENDENCE
CHAPTER 1. VECTOR SPACES
In other ways, we can find the rank of those. For instance, rank(C) = 3 then it is linearly
independent. Moreover, since rank(D) = 2 < 3 then it is linearly dependent.
Problem 7 (The proposed problem) Show that the followings are linearly independent on
both R and C.
Problem 8 Let (a, b) and (c, d) be two vectors. Show that if ad − bc = 0 then they are
linearly dependent. And if ad − bc ̸= 0 then they are linearly independent.
Solution.
a b
Since ad − bc = 0 then we have = = t ⇒ (a, b) = t(c, d)
c d
It is equivalent to say that (a, b) and (c, d) are linearly dependent.
Conversely, for the case ad − bc ̸= 0 we can write as x(a, b) + y(c, d) = 0 then we have
(
xa + yc = 0
⇒ y(bc − ad) = 0 ⇒ y = 0
xb + yd = 0
Plugging y = 0 and notice that (a, b) ̸= (0, 0) then we obtain that x = y = 0. In other words,
we can say that (a, b) and (c, d) are linearly independent, completes our proof.
Problem 9 Let C[a, b] be the set of continuous functions on [a, b], which of the followings are
linearly independent ?
a) (t − 1)2 , (t − 2)2 , (t − 3)2
b) 1, et , e−t
c) sin x, sin 2x, ... sin kx for positive integer k
d) et , log t
Solution. (Written in the Notebook)
Page 6
CHAPTER 1. VECTOR SPACES 1.4. VECTOR SUBSPACES
Solution.
Thus it is a subspace of R3
Problem 13 Denotes P3 as the set of all 3-degree polynomials with one variable and R
is a vector space. Which subset is the vector subspace of P3 ?
a) The polynomial a0 + a1 x + a2 x2 + a3 x3 ?
Solution.
a) It is a vector subspace of P3 .
Page 7
1.5. BASES AND ADD TO THE BASIS CHAPTER 1. VECTOR SPACES
Problem 15 Which of the following is basis of R4 ? If it is, let’s find the corresponding
coordinate of ⃗v = (1, 9, 8, 1) ?
Solution.
b) We investigate that
0 1 1 1 0 1 1 1
1 1 1 1 1 1
1 1 1 0
0 0 0 −1 1 1
→ → 1+ 0 0 −1 → 1+ 1 1 0 → 2+
→4
1 1 0 1 0 0 −1 0 0 −1
0 −1 0 0 −1 0
1 0 1 1 1 0 1 1
Thus it is a basis of R4 .
Also, we need to consider that a(0, 1, 1, 1) + b(1, 1, 1, 0) + c(1, 1, 0, 1) + d(1, 0, 1, 1) = (1, 9, 8, 1)
Page 8
CHAPTER 1. VECTOR SPACES 1.5. BASES AND ADD TO THE BASIS
λ(x1 , x2 , x3 , x4 ) + µ(y1 , y2 , y3 , y4 ) = (λx1 + µy1 , λx2 + µy2 , λx3 + µy3 , λx4 + µy4 ) ∈ V
We now justify λx1 +µy1 +2(λx2 +µy2 ) = 3(λx3 +µy3 )+4(λx4 +µy4 ). Since, from the condition
as required, x1 + 2x2 = 3x3 + 4x4 then it is completely justified. The first task is shown.
b) We also have x1 = −2x2 + 3x3 + 4x4 hence we can choose {(−2, 1, 0, 0); (4, 0, 0, 1)} as a
”candidate” of the basis of V . And our task is investigating the maximal linearly independent
system of them, as follows:
−2 1 0 0 −2 1 0 0
4 0 0 1 4 −2 0 0 −2 1 0 0
3 0 1 0 −→ 3
−→ 3 0 1 0
0 1 0
0 2 0 1
0 4 0 2 0 4 0 2
Page 9
1.6. THE SUM AND INTERSECTION OF TWO VECTOR SUBSPACES; THE
SUBSPACE GENERATED BY SET CHAPTER 1. VECTOR SPACES
{⃗ ⃗ 1 − 2⃗
α1 , α ⃗ 2 − 3⃗
α2 , α ⃗ n−1 − n⃗
α3 , ..., α αn } is also a basis of V .
Solution.
Firstly, by assumption, since {⃗ α1 , α αn } is a basis of vector space V then rank(W ) = n.
⃗ 2 , ...⃗
1
We need to prove that rank(W ′ ) = n. Indeed, we have that α ⃗ 2 = (β⃗1 − β⃗2 ) and also,
2
1 1 ⃗
α
⃗3 = (β1 − β⃗2 ) − β⃗3 ,... so on. Thus, each vector α ⃗ i can be written as a linear combination
3 2
of the vectors in S. This implies that the set S spans V .
Assume that a linear combination of the vectors in S equals the zero vector:
c1 α α1 − 2⃗
⃗ 1 + c2 (⃗ α2 − 3⃗
α2 ) + c3 (⃗ α3 ) + · · · + cn (⃗ αn ) = ⃗0.
αn−1 − n⃗
(c1 + c2 )⃗
α1 + (−2c2 + c3 )⃗
α2 + (−3c3 + c4 )⃗ αn = ⃗0.
α3 + · · · + (−ncn )⃗
Since {⃗
α1 , α ⃗ n } is a basis then the coefficients must all be zero:
⃗ 2, . . . , α
c 1 + c 2 = 0
−2c2 + c3 = 0
−3c3 + c4 = 0
....................................
..................
−ncn = 0.
From −ncn = 0, we get cn = 0. Substituting backwards, we find cn−1 = 0, cn−2 = 0, and so on,
until c1 = 0. Hence, all the coefficients are zero, implying that the set S is linearly independent.
In other words, we can conclude that it would be a basis of V .
and V be generated by
⟨(1, 2, 2, −2); (2, 3, 2, −3); (1, 3, 4, −3)⟩
Find dim(U ∩ W ).
Solution.
By the theorem of direct sum, we have that dim(U ∩ W ) = dim U + dim W − dim(U + W )
Hence we have to find the rank of U + W , as follows:
1 1 0 −1 1 1 0 −1
1 2 3 0 0 1 3 1
2 3 3 −1
−→ 0 1 3 1 −→ 1 + 1 3 1 → 3
1 2 2 −2 0 1 2 −1 1 2 −1
2 3 2 −3 0 1 2 −1
1 3 4 −3 0 2 4 −2
Page 10
1.6. THE SUM AND INTERSECTION OF TWO VECTOR SUBSPACES; THE
CHAPTER 1. VECTOR SPACES SUBSPACE GENERATED BY SET
Hence we obtain that dim(U ∩ W ) = 3 + 3 − 3 = 3
and V spanned by
(1, 3, 0, 2, 1), (1, 5, −6, 6, 3), (2, 5, 3, 2, 1)
Find a basis for U ∩ V and U + V .
Solution.
Take ⃗u ∈ U ∩ V then the following system of equations is obtain as
a + b + 2c = x + y + 2z
a=0
2a + 4b + 3c = 3x + 5y + 5z
b = 2y − z
−2a − 3b − c = −6y + 3z ⇒
c=0
2a + 4b − 2c = 2x + 6y + 2z
x = y − 3z
3a + 2b + 9c = x + 3y + z
We notice that ⃗u = a(1, 3, −2, 2, 3) + b(1, 4, −3, 4, 2) + c(2, 3, −1, −2, 9) = {(1, 4, −3, 4, 2)}
Page 11
Chapter 2
Answer
Problem 2. (2,0 points) In the vector space R4 , consider the following vector subspaces:
U = ⟨⃗
α1 = (1; 1; 0; 0), α
⃗ 2 = (1; 2; 1; 0), α
⃗ 3 = (1; 1; 1; 1)⟩
and
W = {(x1 , x2 , x3 , x4 ) | x1 + x2 + x3 = 0} .
Solution.
a) We have x1 + x2 + x3 = 0 ⇒ x3 = −x1 − x2
We can choose the set {(1, 0, −1, 1); (0, 1, −1, 1); (0, 0, 0, 1)} that represents a basis of W .
This is linearly independent thus dim W = 3.
12
CHAPTER 2. ANSWER 2.1. K73 SUMMER
Solution.
f (⃗u +⃗v ) = (u1 +v1 +u2 +v2 −2u3 −2v3 , u1 +v1 −2u2 −2v2 +u3 +v3 , −2u1 −2v1 +u2 +v2 +u3 +v3 )
f (⃗u)+f (⃗v ) = (u1 +v1 +u2 +v2 −2u3 −2v3 , u1 +v1 −2u2 −2v2 +u3 +v3 , −2u1 −2v1 +u2 +v2 +u3 +v3 )
Then we have f (⃗u) + f (⃗v ) = f (⃗u + ⃗v ), ∀⃗u, ⃗v ∈ R3 .
For λ ̸= 0 and ∀⃗u(u1 , u2 , u3 ) ∈ R3 then we consider that
Then {(1, 1, −2); (0, −1, 1)} forms to the basis of Imf .
Secondly, we must findthe basis of Kerf .
x1 + x2 − 2x3 = 0
We have ⃗x ∈ Kerf ⇒ x1 − 2x2 + x3 = 0 ⇒ x1 = x2 = x3
−2x1 + x2 + x3 = 0
Therefore {(1, 1, 1)} is a basis of Kerf .
1−λ 1 −2
det(f − λI) = 1 −2 − λ 1 = −λ3 + 9λ = 0 ⇒ λ = 0; ±3
−2 1 1−λ
Page 13
2.1. K73 SUMMER CHAPTER 2. ANSWER
Solution.
Page 14
CHAPTER 2. ANSWER 2.2. K71K OFFICIAL EXAM
n
! n
X X
f (λ⃗u + µ⃗v ) = f λxj ⃗ej + µyj ⃗ej = (λxj + µyj )⃗εj = λf (⃗u) + µf (⃗v )
j=1 j=1
n
! n n
X X X
f ′ (⃗x) = f ′ xj ⃗ej = xj f ′ (⃗ej ) = xj ⃗εj = f (⃗x)
j=1 j=1 j=1
U = ⟨⃗
α1 = (1, 1, 0, 0), α
⃗ 2 = (0, 1, 1, 0), α
⃗ 3 = (0, 0, 1, 1)⟩
and
a) Find a complement of U .
b) Find a basis of U ∩ W .
Solution.
+ Take a basis of U .
Page 15
2.2. K71K OFFICIAL EXAM CHAPTER 2. ANSWER
We can find that rank(U ) = 3 then they are linearly independent. In other ways, they are also
a basis of U .
Therefore we obtain the following result:
1 1 0 0
0 1 1 0 1 1 0 0
0 0 1 1
−→ 0 1 1 0
1 0 1 0 0 0 1 1
0 2 1 1 0 0 0 −2
1 2 1 2
Since dim(U ∩ W ) = 2 then in each pair of the set {(a, b, c); (x, y, z)} there must be exists a
number that equal to 0.
Since a = c so b = 0. In other words, we can say that {(1, 1, 0, 0); (0, 0, 1, 1)} is a basis of U ∩W .
b) We can observe that {(1, 1, 3); (1, −1, −1); (3, −2, 1)} forms to the basis of Imf .
For ⃗x ∈ Kerf then we obtain that
x1 + x2 + 3x3 = 0
x1 − x2 − x3 = 0 ⇒ x2 = 2x1 = −2x3
3x1 − x2 + x3 = 0
Problem 4. (2,0 points) Let R4 be an Euclidean vector space with the usual scalar prod-
uct.
a) Show that R4 is the direct sum of two subspaces U and V , where
U = ⟨⃗
α1 = (1, 0, 0, 0), α
⃗ 2 = (1, 1, 0, 0)⟩, V = ⟨β⃗1 = (0, 0, 1, 1), β⃗2 = (0, 0, 0, 1)⟩
Page 16
CHAPTER 2. ANSWER 2.2. K71K OFFICIAL EXAM
Solution.
det(A + B) = det(A).
(A + B)m (v) = 0,
since each term in the expansion (∗) kills v: for 0 < i < m, we have B m−i (Ai (v)) = B m−i Ai−1 (Av) =
0, and for i = 0, we have B m (v) = 0 since B m = 0. Therefore 0 ̸= v ∈ ker(A + B)m , so
so det(A + B) = 0 = det(A).
Now suppose that det(A) ̸= 0. Let C = A−1 B. It suffices to show that det(I + C) = 1. Let
λ ∈ K̄ be a root of the characteristic polynomial of I + C, so that
Since A commutes with B, so does A−1 , and thus −C = A−1 B is nilpotent. Now since −C is
nilpotent and commutes with (1 − λ)I + C, which has determinant 0, by the above paragraph
we have
Page 17
2.3. K72K MIDTERM TEST - EVEN CHAPTER 2. ANSWER
U = {(x, y, z) ∈ R3 : x + y + z = 0}.
In other words, aij is the coefficient of vi in the linear combination expressing f (vj ) in terms
of the basis vectors v1 , v2 , . . . , vn . Therefore, the j-th column of the matrix A represents the
coordinates of f (vj ) in the basis B.
So how does the matrix of an endomorphism change if we change the basis ?
Let’s us demonstrate the change of the matrix of an endomorphism under a change of basis.
Let f : V → V ∈ End(V ) be a mapping.
We suppose that (⃗e1 , ⃗e2 , ...⃗en ) −→ (f (⃗e1 ), f (⃗e2 ), ...f (⃗en )) = (⃗e1 , ⃗e2 , ...⃗en )A
Also, (e⃗1 ′ , e⃗2 ′ , ...e⃗n ′ ) −→ (f (e⃗1 ′ ), f (e⃗2 ′ ), ...f (e⃗n ′ )) = (e⃗1 ′ , e⃗2 ′ , ...e⃗n ′ )B
We now consider that
f (⃗e1 , ⃗e2 , ...⃗en ) = f (e⃗1 ′ , e⃗2 ′ , ...e⃗n ′ )C ⇒ (f (⃗e1 ), f (⃗e2 ), ...f (⃗en )) = (f (e⃗1 ′ ), f (e⃗2 ′ ), ...f (e⃗n ′ ))C
We can rewrite as (⃗e1 , ⃗e2 , ...⃗en )A = (e⃗1 ′ , e⃗2 ′ , ...e⃗n ′ )BC = (e⃗1 ′ , e⃗2 ′ , ...e⃗n ′ )CA ⇒ CA = BC
Thus we obtain that B = CAC −1 be the illustration of interchange.
Page 18
CHAPTER 2. ANSWER 2.3. K72K MIDTERM TEST - EVEN
Problem 3. (5 points) Give the definition of the sum of two vector subspaces. Let U, W
be subspaces of a finite-dimensional vector space V . Prove that
Then we have a1 α ⃗ 1 + ... + ar α ⃗ r + b1 β⃗s + ... + bs β⃗s = −c1⃗γ1 − ... − ct⃗γt ∈ U ∩ W since the LHS
is in U and the opponent is in W .
Thus we can express as −c1⃗γ1 −...−ct⃗γt = d1 α ⃗ 1 +...+dr α ⃗ r ⇒ c1⃗γ1 +...+ct⃗γt +d1 α ⃗ r = ⃗0
⃗ 1 +...+dr α
Because {⃗ α1 , ...⃗αr , ⃗γ1 , ...⃗γt } is linearly independent so that c1 = ... = ct = d1 = .... = dr = 0
It means that a1 α ⃗ 1 + ... + ar α ⃗ r + b1 β⃗s + ... + bs β⃗s = ⃗0
But {⃗ ⃗ r , β⃗s , ...β⃗s } is also linearly independent thus a1 = ... = ar = b1 = .... = bs = 0
α1 , ..., α
which leads to c1 = .... = ct = 0 and {⃗ αr , β⃗1 , ...βs , ⃗γ1 , ...⃗γt } is linearly independent hence
α1 , ...⃗
it is also a basis of U + W .
Thus we obtain that dim(U +W ) = r+s+t = (r+s)+(r+t)−r = dim U +dim W −dim(U ∩W )
Page 19
2.4. K72K MIDTERM TEST - ODD CHAPTER 2. ANSWER
Consider R2 as a Euclidean vector space with canonical scalar product. Find the matrix of the
conjugate f ∗ in the basis consisting of ε1 = (1, 0); ε2 = (1, 1).
Solution.
We have
Question 2. (5 points) Give the definition of the matrix of a bilinear form. Describe the
change of the matrix of the bilinear form when the basis is changed.
Solution.
The definition of the matrix of a bilinear form is stated as follows:
(The definition via Internet) Let V be a finite-dimensional vector space over a field F, and let
B : V × V → F be a bilinear form. Suppose {v1 , v2 , . . . , vn } is a basis of V . Then, the matrix
of the bilinear form B with respect to this basis is the n × n matrix [B] whose entries are given
by
[B]ij = B(vi , vj )
for 1 ≤ i, j ≤ n.
In other words, each entry of the matrix corresponds to the value of the bilinear form applied
to pairs of basis vectors. This matrix encodes all the information about the bilinear form with
respect to the chosen basis.
(The definition in Notebook) Let φ : E × E → R be a bilinear form and {⃗e1 , ⃗e2 ...⃗en } be a basis
of E. Then (φ(⃗ei , ⃗ej )) ∈ Rn,n , 1 ≤ i, j ≤ n is called the matrix of φ in the basis {⃗e1 , ⃗e2 ...⃗en }.
So how does the matrix of φ change when we change the basis ?
Consider the mapping φ : E × E → R and we suppose that {⃗e1 , ⃗e2 , ...⃗en } is a basis of E and
⃗ε1 , ⃗ε2 , ...⃗εn is another basis of E.
And we endow that A = φ(⃗ei , ⃗ej ), 1 ≤ i, j ≤ n and B = φ(⃗εi , ⃗εj ), 1 ≤ i, j ≤ n
Xn
We consider that (⃗e1 , ⃗e2 , ...⃗en ) = (⃗ε1 , ⃗ε2 , ...⃗εn )C or we can write as ⃗ej = cij ⃗εi
! i=1
Xn n
X Xn X n
On the other hand, we also have A = φ(⃗ei , ⃗ej ) = φ cik ⃗εk , cil ⃗εl = cik φ(⃗εk , ⃗εl )clj
k=1 l=1 k=1 l=1
Thus we obtain A = C T BC which is the illustration of this exchanging.
Question 3. (5 points) Give the definition of a quotient vector space. Let V be a finite-
dimensional vector space and U be a subspace of V . Prove that
b1 β⃗1 + · · · + bs β⃗s = a1 α
⃗ 1 + · · · + ar α
⃗ r,
Page 20
CHAPTER 2. ANSWER 2.4. K72K MIDTERM TEST - ODD
α
⃗ = c1 α ⃗ r + d1 β⃗1 + · · · + ds β⃗s ,
⃗ 1 + · · · + cr α cj , dj ∈ K.
⃗ 1 + · · · + cr α
Since c1 α ⃗ r ∈ W then we have
Page 21