Linear Algebra

  • Linear Independence

    Linear independence means no vector in a set can be built from the others. Vectors v1, …, vp are linearly independent when the only solution of c1v1 + … + cpvp = 0 is c1 = … = cp = 0. To test, put the vectors in the columns of a matrix and row reduce: they are independent exactly when every column has a pivot.

  • Homogeneous Systems

    A homogeneous system is a linear system Ax = 0, where every constant on the right side is 0. It always has the trivial solution x = 0. It has a nontrivial solution, one with some entry not 0, exactly when the system has at least one free variable. That always happens when there are more unknowns than equations.

  • Span of Vectors

    The span of vectors v₁, v₂, …, vₚ is the set of all their linear combinations c₁v₁ + c₂v₂ + ⋯ + cₚvₚ. A vector b is in the span exactly when the augmented matrix [v₁ ⋯ vₚ | b] is consistent. The vectors span all of ℝⁿ when their matrix has a pivot in every row.

  • Linear Combinations

    A linear combination of vectors v₁, v₂, …, vₚ is any sum c₁v₁ + c₂v₂ + ⋯ + cₚvₚ, with scalar weights c₁, …, cₚ. To find whether a vector b is a linear combination of given vectors, solve the vector equation x₁v₁ + ⋯ + xₚvₚ = b by row reducing the augmented matrix [v₁ ⋯ vₚ | b].

  • Gaussian Elimination

    Gaussian elimination solves a system of linear equations by using row operations to reduce its augmented matrix to row echelon form. The pivot positions in that form show whether the system has no solution, exactly one solution or infinitely many, and back substitution then gives the solutions.