     Next: 4.1.2 Basic variable-endpoint control Up: 4.1 Statement of the Previous: 4.1 Statement of the   Contents   Index

## 4.1.1 Basic fixed-endpoint control problem

We will label as the Basic Fixed-Endpoint Control Problem the optimal control problem from Section 3.3 with the following additional specifications: and , with no -argument (the control system and the running cost are time-independent); , , , and are continuous (in other words, both and satisfy the stronger set of regularity conditions from Section 3.3.1); the target set is (this is a free-time, fixed-endpoint problem); and (the terminal cost is absent). For this special problem, the maximum principle takes the following form.

Maximum Principle for the Basic Fixed-Endpoint Control Problem Let be an optimal control (in the global sense) and let be the corresponding optimal state trajectory. Then there exist a function and a constant satisfying for all and having the following properties:

1. and satisfy the canonical equations (4.1)

with the boundary conditions and , where the Hamiltonian is defined as (4.2)

2. For each fixed , the function has a global maximum at , i.e., 3. for all .

A few clarifications are in order. First, the maximum principle, as stated here, describes necessary conditions for global optimality. However, we announced in Section 3.4.5 that one of our goals is to capture an appropriate notion of local optimality. The proof of the maximum principle will make it clear that the same conditions are indeed necessary for local optimality in the sense outlined in Section 3.4.5. We thus postpone further discussion of this issue until after the proof (see Section 4.3). Second, while the adjoint vector, or costate, is already familiar from Section 3.4, one difference with the necessary conditions derived using the variational approach is the presence of . This nonpositive scalar is called the abnormal multiplier. Similarly to the abnormal multiplier from Section 2.5, it equals 0 in degenerate cases; otherwise and we can recover our earlier definition (3.29) of the Hamiltonian by normalizing so that (note that such scaling does not affect any of the properties listed in statement of the maximum principle). In the future, whenever the abnormal multiplier is not explicitly written, it is assumed to be equal to . Finally, in Section 3.4.4 we saw another scenario where was constant, but the claim that may seem surprising. We will see later (in Section 4.3.1) that this is a special feature of free-time problems. The next exercise provides an early illustration of the usefulness of the above result. Let us now ask ourselves how restricted the Basic Fixed-Endpoint Control Problem really is. Time-independence of and and the absence of the terminal cost do not really introduce a loss of generality. Indeed, we know from Section 3.3 that we can eliminate and from the problem formulation by introducing the extra state variable (although this entails stronger regularity assumptions on the original right-hand side as a function of ) and passing to the new running cost . On the other hand, the target set is not very general, as it does not allow any flexibility in choosing the final state. This motivates us to consider the following refined problem formulation.     Next: 4.1.2 Basic variable-endpoint control Up: 4.1 Statement of the Previous: 4.1 Statement of the   Contents   Index
Daniel 2010-12-20