Announcements Monday, October 02 ◮ Please fill out the mid-semester survey under “Quizzes” on Canvas. ◮ WeBWorK 1.8, 1.9 are due Wednesday at 11:59pm. ◮ The quiz on Friday covers §§ 1.7, 1.8, and 1.9. ◮ My office is Skiles 244. Rabinoffice hours are Monday, 1–3pm and Tuesday, 9–11am.
Chapter 2 Matrix Algebra
Section 2.1 Matrix Operations
Motivation Recall: we can turn any system of linear equations into a matrix equation Ax = b . This notation is suggestive. Can we solve the equation by “dividing by A”? = b ?? x A Answer: Sometimes, but you have to know what you’re doing. Today we’ll study matrix algebra : adding and multiplying matrices. These are not so hard to do. The important thing to understand today is the relationship between matrix multiplication and composition of transformations .
More Notation for Matrices Let A be an m × n matrix. We write a ij for the entry in the i th row a 11 · · · a 1 j · · · a 1 n . . . . . . and the j th column. It is called the ij th . . . i th row entry of the matrix. a i 1 · · · a ij · · · a in . . . . . . . . . a m 1 · · · a mj · · · a mn j th column The entries a 11 , a 22 , a 33 , . . . are the diag- a 11 a 12 � � a 11 a 12 a 13 onal entries ; they form the main diag- a 21 a 22 a 21 a 22 a 23 a 31 a 32 onal of the matrix. A diagonal matrix is a square matrix a 11 0 0 whose only nonzero entries are on the 0 a 22 0 main diagonal. 0 0 a 33 The n × n identity matrix I n is the di- 1 0 0 agonal matrix with all diagonal entries I 3 = 0 1 0 equal to 1. It is special because I n v = v 0 0 1 for all v in R n .
More Notation for Matrices Continued The zero matrix (of size m × n ) is the � 0 0 0 � m × n matrix 0 with all zero entries. 0 = 0 0 0 The transpose of an m × n matrix A A T is the n × m matrix A T whose rows are A a 11 a 21 the columns of A . In other words, the ij � � a 11 a 12 a 13 entry of A T is a ji . a 12 a 22 a 21 a 22 a 23 a 13 a 23 flip
Addition and Scalar Multiplication You add two matrices component by component, like with vectors. � a 11 � b 11 � a 11 + b 11 � � � a 12 a 13 b 12 b 13 a 12 + b 12 a 13 + b 13 + = a 21 a 22 a 23 b 21 b 22 b 23 a 21 + b 21 a 22 + b 22 a 23 + b 23 Note you can only add two matrices of the same size . You multiply a matrix by a scalar by multiplying each component, like with vectors. � a 11 � ca 11 � � a 12 a 13 ca 12 ca 13 = c a 21 a 22 a 23 ca 21 ca 22 ca 23 . These satisfy the expected rules, like with vectors:
Matrix Multiplication Beware: matrix multiplication is more subtle than addition and scalar multiplication. must be equal Let A be an m × n matrix and let B be an n × p matrix with columns v 1 , v 2 . . . , v p : | | | B = v 1 v 2 · · · v p . | | | The product AB is the m × p matrix with columns Av 1 , Av 2 , . . . , Av p : | | | The equality is def = · · · AB Av 1 Av 2 Av p a definition . | | | In order for Av 1 , Av 2 , . . . , Av p to make sense, the number of columns of A has to be the same as the number of rows of B . Note the sizes of the product! Example � 1 − 3 � 1 2 3 = 2 − 2 4 5 6 3 − 1
The Row-Column Rule for Matrix Multiplication
The Row-Column Rule for Matrix Multiplication The ij entry of C = AB is the i th row of A times the j th column of B : c ij = ( AB ) ij = a i 1 b 1 j + a i 2 b 2 j + · · · + a in b nj . This is how everybody on the planet actually computes AB . Diagram ( AB = C ): b 11 · · · b 1 j · · · b 1 p c 11 · · · c 1 j · · · c 1 p a 11 · · · a 1 k · · · a 1 n . . . . . . . . . . . . . . . . . . . . . . . . i th row . . . · = a i 1 · · · a ik · · · a in c i 1 · · · c ij · · · c ip b k 1 · · · b kj · · · b kp . . . . . . . . . . . . . . . . . . . . . . . . . . . a m 1 · · · a mk · · · a mn c m 1 · · · c mj · · · c mp b n 1 · · · b nj · · · b np ij entry j th column Example
Composition of Transformations Why is this the correct definition of matrix multiplication? Definition Let T : R n → R m and U : R p → R n be transformations. The composition is the transformation T ◦ U : R p → R m defined by T ◦ U ( x ) = T ( U ( x )) . This makes sense because U ( x ) (the output of U ) is in R n , which is the domain of T (the inputs of T ). [interactive] T ◦ U T ◦ U ( x ) x T U ( x ) U R p R n R m Fact: If T and U are linear then so is T ◦ U . Guess: If A is the matrix for T , and B is the matrix for U , what is the matrix for T ◦ U ?
Composition of Linear Transformations Let T : R n → R m and U : R p → R n be linear transformations. Let A and B be their matrices: | | | | | | A = T ( e 1 ) T ( e 2 ) · · · T ( e n ) B = U ( e 1 ) U ( e 2 ) · · · U ( e p ) | | | | | | Question What is the matrix for T ◦ U ? The matrix of the composition is the product of the matrices!
Composition of Linear Transformations Example Let T : R 3 → R 2 and U : R 2 → R 3 be the matrix transformations � 1 1 0 � − 1 0 x . T ( x ) = U ( x ) = 0 1 x 0 1 1 1 1 Then the matrix for T ◦ U is � 1 � � 1 1 0 � − 1 0 − 1 = 0 1 0 1 1 1 2 1 1 [interactive]
Composition of Linear Transformations Another Example Let T : R 2 → R 2 be rotation by 45 ◦ , and let U : R 2 → R 2 scale the x -coordinate by 1 . 5. Let’s compute their standard matrices A and B : � 1 � 1 . 5 � � 1 − 1 0 = ⇒ A = √ B = 1 1 0 1 2
Composition of Linear Transformations Another example, continued So the matrix C for T ◦ U is Check: [interactive: e 1 ] [interactive: e 2 ] � 1 . 5 � 1 − 1 ✧ = ⇒ C = √ 1 . 5 1 2
Composition of Linear Transformations Another example Let T : R 3 → R 3 be projection onto the yz -plane, and let U : R 3 → R 3 be reflection over the xy -plane. Let’s compute their standard matrices A and B : yz yz yz T ( e 3 ) T ( e 1 ) e 1 T ( e 2 ) xy xy xy yz yz yz e 3 U ( e 1 ) U ( e 2 ) U ( e 3 ) xy xy xy
Composition of Linear Transformations Another example, continued So the matrix C for T ◦ U is Check: we did this last time ✧ [interactive: e 1 ] [interactive: e 2 ] [interactive: e 3 ]
Poll
Properties of Matrix Multiplication Mostly matrix multiplication works like you’d expect. Suppose A has size m × n , and that the other matrices below have the right size to make multiplication work. Most of these are easy to verify. Associativity is A ( BC ) = ( AB ) C . It is a pain to verify using the row-column rule! Much easier: use associativity of linear transformations: S ◦ ( T ◦ U ) = ( S ◦ T ) ◦ U . This is a good example of an instance where having a conceptual viewpoint saves you a lot of work. Recommended: Try to verify all of them on your own.
Properties of Matrix Multiplication Caveats Warnings! ◮ AB is usually not equal to BA . In fact, AB may be defined when BA is not. ◮ AB = AC does not imply B = C , even if A � = 0. ◮ AB = 0 does not imply A = 0 or B = 0.
Other Reading Read about powers of a matrix and multiplication of transposes in § 2.1.
Summary ◮ The product of an m × n matrix and an n × p matrix is an m × p matrix. I showed you two ways of computing the product. ◮ Composition of linear transformations corresponds to multiplication of matrices. ◮ You have to be careful when multiplying matrices together, because things like commutativity and cancellation fail.
Recommend
More recommend