Calculus III: Vectors and Dot Product

Vectors are the fundamental language of spatial reasoning in engineering, physics, and computer graphics. While Calculus I and II dealt with change along a single axis, Calculus III opens up the multidimensional world. Mastering vectors and their operations, especially the dot product, provides the essential toolkit for describing forces, motion in space, optimization, and much more.

Vector Fundamentals: Notation and Operations

In mathematics and engineering, a vector is a quantity possessing both magnitude and direction, such as force, velocity, or displacement. This contrasts with a scalar, which has only magnitude (like mass or temperature). In two or three dimensions, we represent a vector using components, which are its projections onto the coordinate axes.

In 2D, a vector $\vec{v}$ from the origin to point $(a,b)$ is written as $\vec{v}=⟨a,b⟩$. The numbers $a$ and $b$ are its vector components. In 3D, we add a third component: $\vec{v}=⟨a,b,c⟩$. The magnitude (or length) of a vector $\vec{v}=⟨a,b,c⟩$ is found using the generalized Pythagorean theorem: $||\vec{v}||=\sqrt{a^2+b^2+c^2}$.

Two core algebraic operations are vector addition and scalar multiplication. To add vectors geometrically, place the tail of the second vector at the head of the first; the resultant vector connects the first tail to the second head. Algebraically, you simply add corresponding components: $⟨a_1,b_1⟩+⟨a_2,b_2⟩=⟨a_1+a_2,b_1+b_2⟩$. Scalar multiplication involves multiplying each component by a real number (the scalar), which scales the vector's length. For a scalar $k$ and vector $\vec{v}=⟨a,b⟩$, $k\vec{v}=⟨ka,kb⟩$. If $k$ is negative, the vector reverses direction.

Defining and Applying the Dot Product

The dot product (or scalar product) is an operation that takes two vectors and returns a scalar. For vectors $\vec{u}=⟨u_1,u_2,u_3⟩$ and $\vec{v}=⟨v_1,v_2,v_3⟩$, the dot product is defined as: $$\vec{u}\cdot \vec{v}=u_1{v}_1+u_2{v}_2+u_3{v}_3$$ Notice you multiply corresponding components and sum the results. The dot product has several crucial algebraic properties: it is commutative ($\vec{u}\cdot \vec{v}=\vec{v}\cdot \vec{u}$), distributive over addition ($\vec{u}\cdot (\vec{v}+\vec{w})=\vec{u}\cdot \vec{v}+\vec{u}\cdot \vec{w}$), and relates to scalar multiplication as $(c\vec{u})\cdot \vec{v}=c(\vec{u}\cdot \vec{v})$.

Its true power, however, lies in its geometric interpretation. The dot product is intimately connected to the angle $\theta$ between two vectors: $$\vec{u}\cdot \vec{v}=||\vec{u}||||\vec{v}||\cos \theta$$ This formula allows us to calculate the angle between any two non-zero vectors: $\cos \theta =\frac{\vec{u}\cdot \vec{v}}{||\vec{u}||||\vec{v}||}$.

This leads directly to the concept of orthogonality. Two vectors are orthogonal (perpendicular) if and only if their dot product is zero. This is a much easier test than trying to measure a 90-degree angle visually. For example, $⟨2,-3⟩\cdot ⟨6,4⟩=(2)(6)+(-3)(4)=12-12=0$, confirming the vectors are orthogonal, even though they don't appear perpendicular at a casual glance.

Projections, Work, and Direction Cosines

Often in engineering, you need to know how much of one vector "points" in the direction of another. This is called the vector projection of $\vec{u}$ onto $\vec{v}$, denoted ${\text{proj}}_{\vec{v}}\vec{u}$. It is the vector component of $\vec{u}$ parallel to $\vec{v}$. Its length is called the scalar projection (or component) and is given by ${\text{comp}}_{\vec{v}}\vec{u}=\frac{\vec{u}\cdot \vec{v}}{||\vec{v}||}$.

The vector projection itself is this scalar times a unit vector in the direction of $\vec{v}$: $${\text{proj}}_{\vec{v}}\vec{u}=\left(\frac{\vec{u}\cdot \vec{v}}{||\vec{v}|{|}^2}\right)\vec{v}$$ The perpendicular component of $\vec{u}$ relative to $\vec{v}$ is then $\vec{u}-{\text{proj}}_{\vec{v}}\vec{u}$. Decomposing a force into components parallel and perpendicular to a surface is a classic application of this technique.

A prime physical application of the dot product is calculating work. In physics, the work $W$ done by a constant force $\vec{F}$ moving an object through a displacement $\vec{d}$ is $W=\vec{F}\cdot \vec{d}=||\vec{F}||||\vec{d}||\cos \theta$. Only the component of the force in the direction of the displacement contributes to the work. If you push a box at an angle, the dot product automatically accounts for the inefficiency of your push.

Finally, direction cosines provide a precise way to describe a vector's orientation. For a 3D vector $\vec{v}=⟨a,b,c⟩$, the direction cosines are the cosines of the angles $\alpha ,\beta ,\gamma$ that $\vec{v}$ makes with the positive $x$-, $y$-, and $z$-axes, respectively. They are calculated as: $$\cos \alpha =\frac{a}{||\vec{v}||},\cos \beta =\frac{b}{||\vec{v}||},\cos \gamma =\frac{c}{||\vec{v}||}$$ A key identity is ${\cos }^2\alpha +{\cos }^2\beta +{\cos }^2\gamma =1$. Direction cosines are essential in fields like robotics and computer-aided design for specifying orientations.

Common Pitfalls

1. Confusing the Dot Product Result: The dot product yields a scalar, not a vector. A common error is to write an answer like $⟨5⟩$ instead of just $5$. Remember, you are summing products, so the final result has no direction.
2. Misapplying the Angle Formula: When solving $\vec{u}\cdot \vec{v}=||\vec{u}||||\vec{v}||\cos \theta$ for $\theta$, you must use the inverse cosine function. Ensure your calculator is in radian mode if required. More critically, remember this formula only holds for the angle between the vectors when their tails are placed together.
3. Incorrect Orthogonality Condition: Two vectors are orthogonal if their dot product is exactly zero. Do not confuse this with the vectors being the zero vector itself. The zero vector $\vec{0}$ is orthogonal to every other vector, but we typically test non-zero vectors for orthogonality.
4. Projection Component Confusion: Be meticulous about which vector is being projected onto which. The formula ${\text{proj}}_{\vec{v}}\vec{u}$ finds the piece of $\vec{u}$ in $\vec{v}$'s direction. Swapping $\vec{u}$ and $\vec{v}$ gives a completely different result, unless the vectors are parallel.

Summary

• Vectors are defined by their components, magnitude, and direction. Core operations include component-wise addition and scalar multiplication.
• The dot product $\vec{u}\cdot \vec{v}=u_1{v}_1+u_2{v}_2+u_3{v}_3$ geometrically equals $||\vec{u}||||\vec{v}||\cos \theta$, providing a powerful tool for finding angles and testing for orthogonality (a zero dot product).
• Projections decompose a vector into components parallel and perpendicular to another direction, with applications in force analysis. The scalar projection formula is ${\text{comp}}_{\vec{v}}\vec{u}=\frac{\vec{u}\cdot \vec{v}}{||\vec{v}||}$.
• The dot product calculates work in physics, and direction cosines ($\cos \alpha ,\cos \beta ,\cos \gamma$) precisely define a vector's orientation in 3D space relative to the coordinate axes.