Skip to article frontmatterSkip to article content
Tutorial

Inner Products

Abstract

The conditions for a functional of two vectors to be an inner product.

Keywords:VectorsVector SpacesInner Products.

A vector space, VV, with an inner product is called an inner product space.

An inner product, (,)(\cdot, \cdot), is a functional that takes two vectors from the vector space VV, defined over a field Fn\mathbb{F}^{n}, as an input and outputs a scalar, (,):FnFnF1(\cdot, \cdot): \mathbb{F}^{n} \otimes \mathbb{F}^{n} \rightarrow \mathbb{F}^{1}.

Inner Product Conditions

Let ψ, σ  V\psi, ~\sigma ~\in~V and aF1a \in \mathbb{F}^{1}.

To be an inner product the functional (,)(\cdot, \cdot) must obeys the following properties:

  1. (ψ,ψ)0(\psi, \psi) \geq 0 and (ψ,ψ)=0(\psi, \psi) = 0 if and only if ψ=0\psi=0
    • Positive-definiteness
  2. (ψ,ω)=(ω,ψ)(\psi,\omega) = (\omega, \psi)^{*}
    • Conjugate symmetry
    • If VV is defined over R\mathbb{R} then (ψ,ω)=(ω,ψ)(\psi,\omega) = (\omega, \psi)
  3. (ψ,aω)=a(ψ,ω)(\psi, a \omega) = a (\psi, \omega)
    • Linearity in the second argument
    • If VV is defined over C\mathbb{C} then (aψ,ω)=a(ψ,ω)(a \psi,\omega) = \overline{a}(\psi, \omega)
  4. (ψ,ω+σ)=(ψ,ω)+(ψ,σ)(\psi, \omega + \sigma) = (\psi,\omega) + (\psi, \sigma)
    • Additivity

Cauchy–Schwarz inequality

The Cauchy–Schwarz inequality is an upper bound on the inner product between two vectors, in any vector space, in terms of the norms of the vectors, where the norm is defined via the inner product.

Let x,y  V\bm{x}, \bm{y}~\in~V, where VV is a inner product space defined over F\mathbb{F} with inner product (,)F1(\cdot, \cdot) \rightarrow \mathbb{F}^{1}, then

(x,y)2x y,\vert (\bm{x}, \bm{y}) \vert ^{2} \leq \vert \vert \bm{x} \vert \vert ~ \vert \vert \bm{y} \vert \vert,

where \vert \cdot \vert is the absolute value and

x=(x,x).\vert \vert \bm{x} \vert \vert = \sqrt{ (\bm{x}, \bm{x}) }.