Next: 7.2 HJB equation, canonical Up: 7.1 Maximum principle on Previous: 7.1.2 Re-interpreting the maximum   Contents   Index

## 7.1.3 Symplectic geometry and Hamiltonian flows

In our discussion of Hamiltonian mechanics in Section 2.4, the Hamiltonian was given a clear physical interpretation as the total energy of the system. Hamilton's canonical differential equations, on the other hand, were derived formally from the Euler-Lagrange equation and we never paused to consider their intrinsic meaning. We fill this gap here by exposing the important connection between symplectic geometry and Hamiltonian flows, which provides one further insight into the geometric formulation of the maximum principle.

Let us return to the cotangent bundle which, as explained at the end of Section 7.1.1, is a -dimensional manifold equipped with canonical local coordinates. On this manifold there is a natural differential 2-form , called a symplectic form (or symplectic structure). This is a bilinear skew-symmetric form on the tangent space to at each point; in other words, it acts on pairs of tangent vectors to (and, moreover, it depends smoothly on the choice of a point in ). In canonical coordinates on , the symplectic form that we consider here is given by

where the exterior multiplication is defined by

(The exterior product is the oriented area spanned by the vectors and , or the determinant of the corresponding matrix.) Given two tangent vectors to with components and , it is straightforward to check that

 (7.6)

The symplectic form allows us to establish a one-to-one correspondence between tangent vectors to and covectors on , as follows. To a tangent vector (at a fixed point of ) we associate a covector which acts on another tangent vector to according to

 (7.7)

The map is a linear map between vector spaces, whose matrix with respect to the canonical basis is .

Now, we can view our Hamiltonian (7.5) as a function on the cotangent bundle (i.e., a function of the variables and ) parameterized additionally by the controls . Then the differential of the Hamiltonian gives us a covector on at each point. Applying the inverse of the map constructed above to this covector, we obtain a tangent vector at each point of , or a vector field on . This vector field is called the Hamiltonian vector field and is denoted by . In canonical coordinates, the flow along is described by the familiar differential equations

 (7.8)

Indeed, for an arbitrary tangent vector to with components , we can easily check using (7.6) that with defined via (7.8) we have

and the desired conclusion follows from (7.7). Therefore, the statement of the maximum principle about the existence of a costate satisfying the adjoint equation (the second canonical equation) can be reformulated as saying that an optimal state trajectory can be lifted to an integral curve of the Hamiltonian vector field. (The control remains an argument on the right-hand side of (7.8), but the maximum principle is of course applied with an optimal control plugged in.)

Next: 7.2 HJB equation, canonical Up: 7.1 Maximum principle on Previous: 7.1.2 Re-interpreting the maximum   Contents   Index
Daniel 2010-12-20