Stabilizing the Henon Map with the OGY Algorithm Leif Jentoft, Yiyang Li Olin College of Engineering (Dated: October 19, 2008) Chaotic orbits are sometimes an undesirable behavior in real-world systems. However, these orbits can be stabilized in some cases if the system contains a parameter that is accessible to a control scheme. The OGY method is one way to stabilize an orbit using such a parameter. We explain this method and present two such controllers that stabilize a period-one and a period-two orbit for the Henon Map, a simple two-dimensional continuous map. Introduction—Chaotic behavior occurs in many models of real-world systems, from simple one-dimensional maps to complex continuous-time systems with many variables. Sometimes this is a desirable result, for example in the case of random number generators. Often, however, it is not. An erratically oscillating machine may cause significant damage to itself and surrounding infrastructure, and a heart chaotically oscillating in the throes of arrhythmia does not pump blood[3]. Moreover, since the chaotic region for a system may contain many possible orbits, being able to select between several of these by changing control parameters allows multiple responses from the same system[l]. Thus, it is often useful to stabilize a chaotic orbit to one that is regular and predictable. One method to do so involves the feedback-based OGY method. We aim to present an explanation and demonstration of this method targeted towards undergraduate students in engineering and mathematics. We begin by introducing the theory and proceed to implement it for the two-dimensional Henon Map that demonstrates the successful stabilization of a period-1 and a period-2 orbit. Stability—To understand what is involved in stabilizing a chaotic orbit, it is first necessary to lay context in the idea of periodic orbit. A period-n orbit of a map yields the same value after successive n iterations. Stable periodic orbits are surrounded by a region of points that get closer to that orbit with successive iterations, while unstable orbits are surrounded by a region of points that tend to diverge away. Thus, in the latter case, unless such an initial value is exactly on the unstable periodic orbit, it will not stabilize toward the fixed points because the surrounding region will tend to push it away. A chaotic orbit can be interpreted as an unstable period-infinity orbit. The stability of a fixed point in a given map F can be calculated by taking the eigenvalues of the Jacobian of the map at the fixed point. For a periodic orbit, we use the matrix product of the Jacobian at each point in the orbit to calculate the eigenvalues. If all eigenvalues are greater than one, then the periodic orbit is unstable; even if a point starts very close to the periodic orbit, it will tend to move away with successive iterations. If the set of eigenvalues is mixed between values greater and less than 1, the orbit is a saddle point; the orbit will tend to diverge away from the fixed point along the eigenvectors of the eigenvalues greater than 1; hence saddle points are also unstable. If the absolute value of each of the eigenvalues is less then 1, then the periodic orbit is stable. OGY Method— One way to generate such a periodic output from a chaotic system is to use the OGY method, a feedback-based approach published by Ott, Grebogi, and Yorke in 1990[1]. It can be explained as follows: Let F be an iV-dimensional map with an unstable period-1 fixed point P* (the argument can be expanded to period-n orbits by replacing F with Fn). Since we are interested in finding the motion of the orbit relative to the fixed point(s), we define another term, the "error" p"n, equal to Pn — P* where P is the value of the nth iteration of the orbit and P* is the value of the fixed point. Assume that the value of the map at this fixed point is dependent on a system parameter Z that normally has value Q. That is, perturbing this parameter by some small amount z to a new value Q — z results in a change of §^ in the map at this point. Near the fixed point, §^ can be approximated by a linear Taylor series expansion C; hence, changing the parameter z affects the value of the map by Cz. If we strategically modify z in response to the error p, we may be able to use Cz to cancel the effect of J, the tendency of the orbit to move away from the fixed point. Modifying z affects each component of the vector Pn+i] to find a global optimally solution, the change to z must be determined with a mind to its effects on all components of the vector Pn+i- Thus, we define a set of weights {ki, k2 ..., k^} which we can express as a row vector K such that z — KC. In equation 1, we examine the equation for the error of the next value of the orbit in terms of K to solve for the proper values for K. pn+1 = (J - CK)p-n (1) In equation 1, pn+i is the error of the next point in the orbit, Pn+i — P*, pn is the error of the current point in the orbit, Pn — P*. J is the Jacobian of the map which is the local sensitivity of pn+\ to the error p of the previous value of the orbit. C is the sensitivity of the map to some accessible system parameter Z that is displaced by 2 from its normal value. The stability of the map thus depends on the matrix J — CK, which is the Jacobian of the controlled map. Thus if J — CK has eigenvalues with modulus less than 1, the control system can successfully stabilize the system. This requires an appropriate choice of K such that the magnitude of each eigenvalue is less than 1. To determine the range of appropriate values for k\, k2, ■ ■ ■, kjq, one can solve det (J — CK — XI) — 0 for Ai, Ai,..., Ajv (the characteristic equation of the matrix) in terms of ki, k2, • • •, &jv. Then, solving the equations with the boundary conditions for each lambda value (A„ — 1, A„ — — 1) allows us to find the set of boundary conditions for stability. Applying to the Henon map— We can apply the OGY algorithm to a two-dimensional map in the form pn+\ — F{pn), where p is a two-dimensional vector, F is a vector function, and n is the iteration count. One example of a two-dimensional map is the Henon map, defined in equation 2. At certain parameter values, the Henon map presents chaotic behavior [2]. In our examples, we use the parameters a — 1.4 and b — 0.3 because those were the parameters Henon [2] showed demonstrated chaotic behavior, but our analysis is symbolic and should work with any given parameters the has chaotic behavior. b-l + ^(l-b)2 + 4a (4) Characteristic Polynomial and Control Parameters— We proceed to apply the control algorithm, a perturbation in the parameter a when the system is close to the fixed point, defined in general in equation 1. The total perturbation, in this case ao, is proportional to the error. In this specific case, C, the partial derivatives of the map with regards to the controlled system parameter a, equals the column vector (1,0). The row vector K, also written as [ki, k2], is the control parameter that varies according to the map parameters. The chaotic orbit can be controlled only by choosing the correct values for [ki, k2}. With the control algorithm in place, the stability of the fixed point is determined by the eigenvalues of the matrix [J — CK], defined below. J is the Jacobian of the uncontrolled Henon map, defined in equation 3. The error grows if the modulus of the eigenvalues were greater than 1 and decay if the modulus is less than 1. [J - CK] —2x* — k\ b — k2 1 0 F(Pn+l) = Xn+i Yn+i - = 14 bX, Yn — aX„ (2) Boundary for Control Parameters and Time for Stabilization a = 1.4 b = 0.3 We first perform a change of variables such that Xn — \xn and Yn — \yn- By changing the variables, the revised Henon map, in equation 3, has the parameter a which is not attached to either the variable xn or yn, making that system parameter easily adjustable. Our control system consists of creating perturbations ao in the parameter a. F(Pn+l) Vn+l ■ a - byn (3) We can find the fixed points by solving the equation Pn — F(Pn), where F(Pn) is defined in equation 3. The solutions to this system of equation for both x and y are the roots to the polynomial 0 — x2 + (1 — b)x — a. Only one of these fixed points is located in the chaotic attractor [4]. Because the OGY algorithm only makes a fixed point locally stable, the control system work only when the chaotic orbit passes close to that fixed point. Therefore, we want to stabilize the orbit around the fixed point located in the chaotic attractor, which we call the stabilization fixed point x*. In equation 4, we use the quadratic formula to find x*. FIG. 1: The boundary on the k1,k2 plane that can stabilize the chaotic orbit denned in equation 6. If we choose parameters within the region bounded by the triangle and apply the control algorithm, the system will stabilize around the fixed point. In general, control parameters close to the boundary causes the system to stabilize more slowly because the modulus of their eigenvalues is closer to 1, causing a slower rate of decay in the error. The characteristic equation to find the eigenvalues is defined below in equation 5, where x* is the fixed point 3 defined in equation 4 0 = X2 + X(2x* + kx) + k2 - b (5) To stabilize the system about the fixed points through decaying the error, we must choose values of k\ and k2 such that both eigenvalues, Ai and A2 have magnitudes less than 1. Another way to interpret this is that the the product of both eigenvalues must be less than 1, and that Ai < 1 and Ai > —1. To meet the condition that A1A2 < 1, we can factor out the characteristic equation 5 into (A — Ai)(A — A2) — 0. This means A1A2 — k2 — b. Thus, the boundary when A1A2 transitions from below to above 1 equals k2 — 1 + b. We proceed to find conditions to ensure Ai < 1; to do this, we can find the parameter ranges such that Ai — 1, which form the boundary for when Ai transitions from below 1 to above 1. We can locate the boundary by trying to factor out (A — 1) from the characteristic equation 5. Through long division, we can factor out (A — 1) if and only if k2 — b + 2x* + k± + 1 — 0. Thus, the boundary for Ai — 1 on the k\, k2 plane is a line defined by k2 — —k\ — 2x0 — 1 + 6. We use a similar approach in factoring out (A + 1) to find the boundary for Ai — —1. The boundary where Ai transitions from below —1 to above is a line defined by k2 — ki + b + 2x* — 1. Equation 6 states the boundaries. Stabilizing to a Fixed Point a = 1.4 b = 0.3 k =-1 k2 = 1 2 '20 5 10 15 20 25 30 35 40 45 50 '20 5 10 15 20 25 30 35 40 45 50 0.3p 0.2 - Iterations (n) FIG. 2: The top graph represents the chaotic orbit of an uncontrolled Henon map. With the control algorithm activating around the 28th iteration in the middle graph, we see that the map stabilizes around the fixed point. The control parameters fci and &2 is the blue dot inside the teal region in Figure 1, ensuring the system stabilizes within the fixed point. The bottom graph illustrates the size of the perturbations of the control parameter; it is strong when it first starts activating but eventually decreases when the map is stabilized around the fixed point. AiA2 < 1 : k2 = 1 + b Ai < 1 : k2 = - 2x* - 1 + b (6) Ai > -1 : k2 = kx + 2x* - 1 + b Figure 1 plots the three boundary, a triangle defined by equation 6. To stabilize the system about the fixed point, we must choose a value of k\ and k2 within that triangle. A thorough discussion of the inconsistencies is given right before the conclusion. In figure 2, we choose control parameters within the stable region from figure 1 and iterate the controlled map. Because we made linear approximations, our method should work when P is close to the fixed point, or when the error is small. Thus, our control algorithm activates whenever it detects that xn and yn are close to the fixed points. Another reason the control algorithm activates when the error is small is because the power of the control might be limited such that it can only work with small error. Stabilizing on a Period-2 Orbit— We can apply the OGY algorithm to stabilize a chaotic orbit to a period-2 orbit. We find the period-2 orbits by solving the equation P — F2{P), where the function is defined in equation 3. Because we aim to have the system oscillate between two points, we can remove the fixed points from the set of period-2 orbits. The two remaining period-2 orbits are designated as xa and xp. ya and yp equal xa and xp according to equation 3. If a chaotic attractor exists, the period-2 orbit would be located within that attractor because a chaotic attractor contains all periodic orbits. We can apply the OGY algorithm at xa, xp, or both. We chose the final option because applying perturbations to both orbit points stabilizes the system most quickly. Using the chain rule, the stability of a period-2 orbit is governed by the eigenvalues of the product of the respective Jacobian matrix for xa and xp. To find proper control parameters, we try to find the eigenvalues of the matrix product of [J|a;=a.a — C\x=XaK] and [J|a,—a,^ — C\x=Xf3K] since control is applied at both xa and xp. We notice that the characteristic equation for the eigenvalues of is defined below: 0 — — Ax\x2\ — 2kiXiX — 2x2kiX + b2 — 2bk2 + k\- kjX - 2bX + 2k2X + X2 To find control parameters for a stable period-2 orbit, we can again solve for the boundary of the region on the ki,k2 plane such that A1A2 < 1, Ai < 1, and Ai > —1. The approach and logic is the same as the ones used to derive the parameter boundaries in equation 6. Because 4 of various nonlinear terms in the characteristic equation, the boundary is no longer explicitly defined; we can, however, describe the boundary as the roots of the polynomial equations defined in equation 7. Figure 3 plots the boundary for control parameters that can stabilize the chaotic orbit. Figure 4 gives an example of stabilizing a chaotic orbit onto a period-2 orbit by choosing a control parameter within the stable region. AiA2 < 1 : 0 =k% - k2(2b) + b2 - 1 Ai < 1 : 0 - k2(-2b - 2) + kj + 2k1x1 + 2kxx2 + Axxx2 + b2 + 2b + 1 (7) Ai >-1 : 0 =k% - k2(-2b + 2) - k\ - 2klXl - 2kxx2 - 4x1X2 + b2 - 2b + 1 FIG. 3: The boundary of the control parameters, with the boundary denned in equation 7. Choosing parameters within the region stabilizes the Henon map around a period-2 orbit. Inside the region, locations closer to the boundaries in general takes more iterations to stabilize, denned as when the error is reduced by 99%. Figure 3 also plots the number of iterations the system takes to stabilize the chaotic orbit to a period-2 orbit once the control system is activated. The time is calculated through numerical iteration like that shown in figure 4. Locations closer to the boundaries generally take more time to stabilize because the modulus of their eigenvalues are closer to 1. The eigenvalues are an approximate measure the rate of growth or decay of the error from the desired position (the period-2 orbit); eigenvalues closer to 0 means the error decays quicker. In both figure 6 and figure 7, there exists some regions inside the boundary that do not stabilize. This is because the simulation has not run enough iterations for such points to stabilize, defined as when 99% of the error is eliminated. Furthermore, the contours for the number of iterations are not smooth and well-defined. One reason is this occurs because the boundaries do not give direct information about the X2 or their corresponding eigenvector. Even if Ai has a large modulus, X2 may be small, resulting in a faster decay. In addition, there exists roundoff error which amplifies because the results from each iteration affects the results of the next iteration. Stabilizing to o Period-2 Orbit -0 04 - \l W "°OB0 1D 2D 3D 4D 50 6D FIG. 4: The top graph represents the chaotic orbit of an uncontrolled Henon map. With the control algorithm activating around the 90th iteration in the middle graph, we see that the map stabilizes by oscillating around the period-2 orbits. The control parameters k1 and is the blue dot in figure 3. The bottom graph again describes the relative size of the perturbations made to stabilize the system. Conclusion — In many cases, chaotic behavior is not desirable and needs to be controlled to achieve a predictable steady or periodic behavior. The OGY control algorithm is a feedback algorithm that creates small perturbations in system parameters to stabilize the system to periodic orbits. We applied the OGY algorithm to the Henon map with chaotic system parameters. We found parameter ranges that the control algorithm is able to stabilize a system to a fixed point and a periodic orbit. In addition, the amount of "work" the control algorithm must do is directly linked to the eigenvalues of the controlled matrix. We applied the OGY algorithm to stabilize the Henon map about the period-1 and period-2 orbit. Preliminary results show that the same algorithm can be used to stabilize higher-period orbits; a further area of investigation is determining whether the OGY algorithm can stabilize a chaotic Henon map about any period-n orbit. We are also interested in other chaotic maps the OGY algorithm can control. Preliminary investigations into the Baker map have yielded promising results. [1] Ott, Edward and Grebogi, Celso and Yorke, James A. "Controlling Chaos." Phys. Rev. Lett. 64, 2837 (1990) [2] Henon, M. "A Two-dimensional Mapping with a Strange Attractor." Communications in Mathematical Physics. 50, (1976): 69-77. [3] Chen, Guanrong and Yu, Xing Huo " Chaos Control: Theory and Applications" Springer, (2003): v. [4] Lynch, Stepeh. Dynamical Systems with Applications Using Matlab. Birkhauser Boston. 2004, 146-155