### Basis Change

Understand that there is nothing extremely special about the standard basis vectors [1,0] and [0,1]. All 2D vectors may be represented as linear combinations of these vectors. Thus, the vector [7,24] may be written as:

You may take linear combinations of any other reasonable (linearly independent) set of vectors, and still be able to express the same [7,24] as linear combinations of those. The diagram below shows an example. The vector [1,1] in standard basis can also be represented by an alternate basis [1,1], [-1,1]. Since, in the new basis, the vector lies along the B1 basis vector [1,1] itself, it can simply be expressed as:

In the above example, the new basis vectors are orthogonal; they need not be. Let’s deduce the relation between the point as expressed between two bases. This leads us to the basis matrix, which is simply the matrix composed of the basis vectors of basis B. If a vector expressed in basis B is multiplied with the basis matrix of B, the result is the vector in the standard basis.

We can use the previous example to illustrate this point. In the basis B = {[1,1], [-1,1]}, the vector V_{B} is [1,0]. If we multiply the two, we get:

Then, for a basis matrix B, a vector V_{B} is related to that same vector V_{S} in standard basis as:

Simply multiplying the basis matrix of B with a vector expressed in basis B gives us the vector in standard basis.

### Similarity transformations

Let’s explore basis changes further. We already know how to relate vectors expressed in two different bases. Now we’ll explore how linear transformations can be expressed in different bases.

Roughly, linear transformations map vectors in n-space to other vectors in n-space; I wrote about this here.

Let a transformation T_{S}, applied to a vector x_{S}, produce a vector y_{S} in standard basis S. That is:

Furthermore, let x_{S} be represented in some other basis B by x_{B}, and let them be related by the basis matrix C_{B}(basis matrix of B) as:

Similarly, let y_{S} be represented in some other basis B by y_{B}, and let them be related by the same basis matrix C_{B} as:

The question we ask is a simple one: what is the transformation T_{B} that maps x_{B} to y_{B}? Essentially, if we know a transformation matrix in one basis, what would that same transformation look like in a different basis?

The algebra is pretty simple. We have:

Substituting the expressions for x_{S} and y_{S} in the above, we get:

Now, notice that we have not constrained T_{S} to be anything special, apart from the dimensionality requirements for matrix multiplication. This implies that this identity may be applied to any matrix. T_{B} and T_{S} are said to be similar to each other, because they are essentially the same matrix, only expressed in terms of different bases.

Why did I go to the trouble of introducing these concepts? In the next post, I shall talk about how we tie all these up together to make the calculation of eigenvectors/eigenvalues easier. Hopefully, that will also shed some light on the nature of these beasts.