vectors | Engineersphere.com

Pre-(r)amble

The odds favor that by the time someone has reached this article, myself included, they have spent at least the briefest of moments (frustratedly?) questioning the practical applications for linear combination, linear independence and linear math. In a sentence, these concepts allow us to mathematically understand and represent multidimensional coordinate systems. If you’re looking for a quick explanation for a homework problem feel free to skim through the bolded topics for help in specific areas of concern. Otherwise, here’s something to think about. Imagine maneuvering in three dimensional space. An instantaneous position can be described using a three dimensional coordinate system. When following a consistent pattern of movement, an instantaneous position can be described with a fourth dimension, time. Suppose you have just landed the snowball throw of a lifetime and hit a target moving across your view plane, increasing the distance between you, and uphill. You have properly estimated the intersection of two moving objects in four dimensions. This is not always an easy task to execute. Now make this throw using a fifth dimension. Most people can’t comprehend the existence of a fifth dimension without having to understand how to maneuver in it. With linear math we can attempt to understand and represent the relationships between these dimensions.

Important Definitions

Linear Independence
A set of linearly independent vectors { $V_1, V_2, . . . , V_k$ } has ONLY the zero (trivial) solution < $x_1, x_2, . . . , x_k$ > $=$ < $0, 0, . . . , 0$ > for the equation $x_1 * V_1 + x_2 * V _2 + . . . + x_k * V_k = 0$

Linear Dependence
Alternatively, if $x_1, x_2, . . . ,$ or $x_k \neq 0$ , the set of vectors is said to be linearly dependent.

Determining Linear Independence

By row reducing a coefficient matrix created from our vectors { $V_1, V_2, . . . , V_k$ }, we can determine our < $x_1, x_2, . . . , x_k$ >. Then to classify a set of vectors as linearly independent or dependent, we compare to the definitions above.

Example
Determine if the following set of vectors are linearly independent:

$\begin{bmatrix} 1\\1\\1\end{bmatrix}$ , $\begin{bmatrix} 2\\2\\2\end{bmatrix}$ , $\begin{bmatrix} 0\\0\\5\end{bmatrix}$ , $\begin{bmatrix} 1\\2\\3\end{bmatrix}$

Setting up a Corresponding System of Equations and Finding it’s RREF Matrix

We need to understand that our vectors can be represented with a system of equations all equaling zero to satisfy the equation $x_1 * V_1 + x_2 * V _2 + . . . + x_k * V_k = 0$ from our definition of linear independence. These equations will look something like this:

$1*x_1 + 2*x_2 + 0*x_3 + 1*x_4 = 0$
$1*x_1 + 2*x_2 + 0*x_3 + 2*x_4 = 0$
$1*x_1 + 2*x_2 + 5*x_3 + 3*x_4 = 0$

Notice that I have simply taken the coefficients from the given vectors and multiplied them by four variables (the number of variables will equal the number of vectors in the given set). They have been set equal to zero to allow us to test for linear independence. From here, create a coefficient matrix and perform row operations to reduce the matrix to reduced row echelon form (rref) .

rref $\left[ \begin{array}{cccc|c} 1&2&0&1&0\\1&2&0&2&0\\1&2&5&3&0\end{array}\right]$ = $\left[ \begin{array}{cccc|c} 1&2&0&0&0\\0&0&1&0&0\\0&0&0&1&0\end{array}\right]$

Finding the Solution of the RREF Matrix

Finding the solution of the rref matrix may be the more difficult step in this process. However, it may become trivial following a few simple steps.

1) Identify the free variables in the matrix. Free variables are non-zero and located to the right of pivot variables. Pivot variables are the first non-zero entry in each row and since we have taken the rref of our matrix, all of the pivot variable coefficients are 1. By locating all free variables (or by eliminating all pivot variables) we find that $x_2$ is our only free variable.

2) Write free variables into your solution. The variable $x_2$ can be written into our solution vector as itself but we will represent it with another variable name (i.e. $t$ ) so that our solution is in parametric form. Multiple free variables are represented with multiple variables names (i.e. $s, t$ ). After this step your solution vector should look like this: < $x_1, x_2, x_3 , x_4$ > $=$ < $? , t, ? , ?$ >.

3) Solve for pivot variables. The pivot variables should either be constant (i.e. 0, 6) or a function of your free variables (i.e. $3 t-4$ ). From the rref matrix we can see that $x_1 = -2 t$ , $x_3 = 0$ , and $x_4 = 0$ .

4) Complete the solution vector. Placing the values we just calculated into our solution vector: < $x_1, x_2, x_3 , x_4$ > $=$ < $-2 t , t, 0 , 0$ >

Finally,

Since not all of our $X_i = 0$ , the given set of vectors is said to be linearly dependent. The linear dependence relation is written using our solution vector multiplied by the respective vector from the given set: $-2 t * V_1 + t * V_2 + 0 * V_3 + 0 * V_4 = 0$ . We can also conclude that any vectors with non-zero coefficients are linear combinations of each other. Therefore, $V_1$ and $V_2$ are a linear combination.

Vectors and Matrices what are they?

In Matlab everything is defined as either a vector or a matrix therefore it is imperative that you know what Vectors and Matrices are before you begin using Matlab. The formal definition of a vector is something that has both a direction and a velocity. When using Matlab however, I think it is easier to think of a vector as either a row or a column of values. These values can be names, numbers, or anything you want. There are two kinds of vectors. These are row vectors and column vectors.

A Row Vector is a vector which has only One Row and can have as many columns as one wants. A row vector V with n columns is shown below. (invert the column one below, row vector image missing)

Alternatively, a column vector is a vector which has only ONE Column and can have as many rows as one wants. A column vector V with m rows is shown below.

Matrices

A matrix is a rectangular array of quantities or expressions. I prefer to think of them as 2-D vectors. Matrices have both numerous rows and columns.

The typical representation of a matrix is m x n meaning the matrix has m rows and n columns.

The subscripts of each element refer to its position in the matrix. Matrices come in all different sizes and shapes. A matrix who has the same number of rows as columns is called a Square Matrix.

How to define Vectors and Matrices in MATLAB

Row Vectors

The use of the semicolon at the end of each line ensures that Matlab will not print off the value of V in the Command Window. If you wish to have it display this value when running, remove the semicolon.

Column Vectors

When defining column vectors in Matlab use the semicolon (;) to separate rows.

Accessing Different Vector Indices

To access different indices in a vector the following notation is used.

To access the third index or the value of 7 in both of the vector examples above one uses V(3). This tells Matlab that you are referencing the third value in the vector V.

Lets say you wish to multiply the third and fourth entry of the vector V and store that value in the first entry. You would type

V(1)=V(3)*V(4)

Matrices

Matrices in Matlab are defined by combining both row and column vectors. A 3 by 3 matrix in Matlab would be defined as follows.

MATLAB Examples

1) Define a 4 element row vector and then replace the third element by the product of the first and fourth.

2) Define a 3 element column vector and then put the value of 5 into the second element.

3) Define a 4by5 matrix and then make it so when you run the Matlab script, the element in the 3rd row and 2nd column will be printed.

Practice Problems

1) Define a 3 by 2 matrix and replace the value on the second row second column with the value on the third row first column.

2) Define a row vector with 6 elements.

3) Define a column vector with 2 elements and make sure they both print when you run Matlab (Hint: semicolon)

Tag: vectors

How to Determine if a Vector Set is Linearly Independent

Pre-(r)amble

Important Definitions

Determining Linear Independence

Setting up a Corresponding System of Equations and Finding it’s RREF Matrix

Finding the Solution of the RREF Matrix

Basic Linear Algebra: Defining Vectors and Matrices

Vectors and Matrices what are they?

Matrices

How to define Vectors and Matrices in MATLAB

Row Vectors

Column Vectors

Accessing Different Vector Indices

Matrices

MATLAB Examples

Practice Problems