Next: 3.2 Calculus of variations Up: 3.1 Necessary conditions for Previous: 3.1.1 Weierstrass-Erdmann corner conditions   Contents   Index

3.1.2 Weierstrass excess function

To continue our search for additional conditions (besides being an extremal) which are necessary for a piecewise curve to be a strong minimum, we now introduce a new concept. For a given Lagrangian , the Weierstrass excess function, or -function, is defined as

 (3.6)

The above formula is written to suggest multiple degrees of freedom, but from now on we specialize to the single-degree-of-freedom case for simplicity. Note that is the first-order Taylor approximation of , viewed as a function of , around . This gives the geometric interpretation of the -function as the distance between the Lagrangian and its linear approximation around ; see Figure 3.3.

The Weierstrass necessary condition for a strong minimum states that if is a strong minimum, then

 (3.7)

for all noncorner points and all .
The geometric meaning of this condition is that for each , the graph of the function lies above its tangent line at , which can be interpreted as a local convexity property of this function.

The Weierstrass necessary condition can be proved as follows. Suppose that a curve is a strong minimum. Let be a noncorner point of , let be such that the interval contains no corner points of , and pick some . We construct a family of perturbed curves , parameterized by , which are continuous, coincide with on the complement of , are linear with derivative on , and differ from by a linear function on . The precise definition is

 (3.8)

Such a perturbed curve is shown in Figure 3.4.

It is clear that

 (3.9)

and that for close to 0 the perturbed curve is close to the original curve in the sense of the 0-norm. Therefore, the function must have a minimum at . We will now show that the right-sided derivative of this function at exists and equals . Then, since this derivative must be nonnegative and and are arbitrary, the proof will be complete.

Noting that the behavior of outside the interval does not depend on , we have

 (3.10)

By (3.8), the first integral in (3.10) is and its derivative is simply

 (3.11)

The differentiation of the second integral in (3.10) gives

 (3.12) (3.13)

(it is straightforward to check that the partial derivatives , , exist inside the relevant intervals). Since , we can use integration by parts to bring the integral in (3.13) to the form

 (3.14)

In more detail, the first term in (3.14) is

 (3.15)

We have from (3.8) that for all , hence and so the first term in (3.15) is 0. Another consequence of (3.8) is the relation . Differentiating it with respect to , we obtain , or . When we substitute this expression for into the second term in (3.15), that term becomes

 (3.16)

We see that is given by the sum of (3.11), (3.12), the integral (with the minus sign) in (3.14), and (3.16). Setting and rearranging terms, we arrive at

Now, recall (3.9) which also implies that . The integral on the second line of the previous formula thus equals

because as a strong (hence also weak) minimum must satisfy the Euler-Lagrange equation. We are left with

as desired, and the Weierstrass necessary condition is established. A necessary condition for a strong maximum is analogous but with the reversed inequality sign; this can be verified by passing from to or by modifying the proof in the obvious way. The Weierstrass necessary condition can also be extended to corner points, either by refining the proof or via a limiting argument (cf. Exercise 3.3 below.)

Weierstrass introduced the above necessary condition during his 1879 lectures on calculus of variations. His original proof relied on an additional assumption (normality) which was subsequently removed by McShane in 1939. Let us now take a few moments to reflect on the perturbation used in the proof we just gave. First, it is important to observe that the perturbed curve is close to the original curve in the sense of the 0-norm, but not necessarily in the sense of the 1-norm. Indeed, it is clear that as ; on the other hand, the derivative of for immediately to the right of equals , hence for all , no matter how small. For this reason, the necessary condition applies only to strong minima, unless we restrict to be sufficiently close to . Note also that the first variation was not used in the proof. Thus we have already departed significantly from the variational approach which we followed in Chapter 2. Derived using a richer class of perturbations, the Weierstrass necessary condition turns out to be powerful enough to yield as its corollaries the Weierstrass-Erdmann corner conditions from Section 3.1.1 as well as Legendre's condition from Section 2.6.1.

When solving this exercise, the reader should keep the following points in mind. First, we know from Exercise 3.1 that the first Weierstrass-Erdmann corner condition is necessary for weak extrema as well. This condition should thus follow directly from the fact that is an extremal--i.e., satisfies the integral form (2.23) of the Euler-Lagrange equation--without the need to apply the Weierstrass necessary condition. The second Weierstrass-Erdmann corner condition, on the other hand, is necessary only for strong extrema, and deducing it requires the full power of the Weierstrass necessary condition (including a further analysis of what the latter implies for corner points). As for Legendre's condition, it can be derived from the local version of the Weierstrass necessary condition with restricted to be close to for a given , thus confirming that Legendre's condition is also necessary for weak extrema. Finally, when is a corner point, Legendre's condition should read

The perturbation used in the above proof of the Weierstrass necessary condition is already quite close to the ones we will use later in the proof of the maximum principle. The main difference is that in the proof of the maximum principle, we will not insist on bringing the perturbed curve back to the original curve after the perturbation stops acting. Instead, we will analyze how the effect of a perturbation applied on a small interval propagates up to the terminal point.

There is a very insightful reformulation of the Weierstrass necessary condition which reveals its direct connection to the Hamiltonian maximization property discussed at the end of Section 2.6.1 (and thus to the maximum principle which we are steadily approaching). Let us write our Hamiltonian (2.63) as

Then a simple manipulation of (3.6) allows us to bring the -function and the condition (3.7) to the form

where we used the formula

consistent with our earlier definition of the momentum (see Section 2.4.1). Therefore, the Weierstrass necessary condition simply says that if is an optimal trajectory and is the corresponding momentum, then for every the function , which is the same as the function defined in (2.32), has a maximum at . This interpretation escaped Weierstrass, not just because it requires bringing in the Hamiltonian but because it demands treating and as independent arguments of the Hamiltonian (we already discussed this point at the end of Section 2.4.2).

Combining the Weierstrass necessary condition with the sufficient condition for a weak minimum from Section 2.6.2, one can obtain a sufficient condition for a strong minimum. The precise formulation of this condition requires a new concept (that of a field) and we will not develop it. While sufficient conditions for optimality are theoretically appealing, they tend to be less practical to apply compared to necessary conditions; we already saw this in Section 2.6.2 and will see again in Chapter 5.

Next: 3.2 Calculus of variations Up: 3.1 Necessary conditions for Previous: 3.1.1 Weierstrass-Erdmann corner conditions   Contents   Index
Daniel 2010-12-20