Emphasizing Extinction in Evolutionary Programming Garrison W. Greenwood Dept. of Computer Science Western Michigan University Kalamazoo, MI 49008 [email protected] Gary B. Fogel Natural Selection, Inc. 3333 N. Torrey Pines Ct., Suite 200 La Jolla, CA 92037 [email protected] AbstractEvolutionary programming typically uses tournament selection to choose parents for reproduction. Tournaments naturally emphasize survival. However, a natural opposite of survival is extinction, and a study of the fossil record shows extinction plays a key role in the evolutionary process. This paper presents a new evolutionary algorithm that emphasizes extinction to conduct search operations over a tness landscape. 1 Introduction It is now well known that evolutionary programming (EP) can be an eective search technique. Although there are several versions of EP, they are all biologically inspired and generally follow the format depicted in Figure 1. initialize population evaluate fitness select survivors randomly vary individuals Figure 1: The canonical EP. The \select survivors" block includes the selection of parents and the generation of ospring. This paper focuses on methods used for the selection of survivors as parents for the following generation. The most common form of selection used in EP is tournament selection, in which the tness of each individual in the population is compared against the tness of a randomly chosen set of other individuals in the current population. A \win" is recorded for an individual each time an individual's tness exceeds that of another in the tournament set. All individuals are then ranked according to their number of wins. Those individuals with Manuel Ciobanu Dept. of Computer Science Western Michigan University Kalamazoo, MI 49008 [email protected] the highest scores are selected as parents for the next generation and the remainder are discarded [1]. There are several alternative views to the selection process in general, and tournament selection in particular. Suppose we assume each individual in the population represents a distinct species. The selection process chooses some individuals in the current population to be parents while others will be discarded. Under the species abstraction, we can say that selected individuals represent species that survive, while discarded individuals represent species that become extinct. It has been shown that extinction plays a signicant role with respect to evolution in the biological world. It is therefore natural to ask if extinction can be exploited to increase the eciency of EP. Here we review the role of extinction in the fossil record and simulate this process in the context of EP. Our preliminary results suggest that extinction can enhance the performance of EP on a multimodal function. 2 Mass Extinction and the Fossil Record The pace of change of species in ecological systems is closely correlated to the temporal stability of the environments in which they inhabit. During Earth's long history, environmental stresses have been prolonged and/or severe enough to invoke widespread ecological instability. A direct result of this stress is the simultaneous extinction of many species that were not able to adapt in ways suitable to avoid their demise. These events as recorded in the fossil record are known as mass extinctions [2]. Extinction has played a major role in shaping the history of life on Earth. When examining extinction rates for a large portion of the fossil record, Raup and Sepkoski initially noted two modes of extinction: a lowlevel, continuous background extinction or a sporadic mass extinction rate [3]. Although mass extinctions account for only a small percentage of all extinctions, they are singularly important because they remove \resilent" incumbent groups from niches, creating \windows of opportunity" for other species to ourish and establish an ecological niche [4]. Five mass extinctions have been identied: terminal Ordovician (440 Myr ago)1; late Devonian (365 Myr 1 Myr denotes one million years. ago); late Permian (250 Myr ago); terminal Triassic (215 Myr ago); and terminal Cretaceous (65 Myr ago). The severity of these extinction events can be difcult to fully comprehend. For instance, it has been estimated that 96% of all marine species on Earth went extinct by the end of the Permian period [5], representing 52% of all marine vertebrate and invertebrate families [3]. Several causes for these events have been proposed including global cooling, changes in sea level, and the impact of a meteor or comet. Some have suggested that there is a periodicity for mass extinctions with a mean period of 26 Myr [6, 7], although not all researchers agree with this notion (see [8], pg 404-405). Patterns and processes of species extinction and survival appear to be dierent between background and mass extinction events. For instance, Jablonski [9] noted that during background extinction intervals, Cretaceous gastropods and bivalves with planktotrophic (planktonfeeding) larvae had longer species durations than those with nonplanktotrophic larvae. In contrast, larval type was not a factor during the Cretaceous mass extinction event. It is clear that not all species were aected equally across all extinction events. (This fact is a central principle behind our incorporation of extinction into an evolutionary algorithm.) Wolfe and Upchurch [10] noted that one of the major factors in the transition from predominantly evergreen to deciduous biotas around the world was correlated to the cooling during the Cretaceous mass extinction event. This event led to much higher rates of extinction for evergreens relative to deciduous plants. As Newton and Laporte [2] noted, One answer to the question, `How did temperate deciduous forests arise?' is, `Through enhanced survival in the Cretaceous extinction.' Mass extinctions may have been responsible for many such cases of evolutionary replacement in the fossil record. Using the stratigraphical ranges of 17,621 marine genera over the last 600 Myr, Raup noted that the average species duration was 4 Myr. Using this same data, Raup [11] developed a \kill curve", shown in Figure 2, that described the average spacing between extinction events of varying intensity. For example, an extinction event capable of killing 30% of marine species occurs every 10 Myr; an extinction event capable of killing 65% of marine species occurs every 100 Myr. Although many assumptions were used in the development of this curve, it appears that extinctions may be continuously distributed in a logarithmic fashion rather than separated into two discrete categories. 80 species kill (%) 70 60 50 40 30 20 10 0 104 105 106 107 108 109 mean waiting time in years ........ ........ ........ ........ ........ ........ ........ ........ ........ ........ ........ ........ ......... ......... ........ . . . . . . . . . . . . . . . . . . . . . . . . . . ........ ........ ........ ........ ........ ........ ........ ........ ........ ........ ........ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ........ ........ ........ ........ ........ ........ ........ .... . . . . . . . . . . . . . . . . Figure 2: A kill curve showing the average spacing between marine extinction events of specied intensity (adopted from [11]). 3 Adding Extinction into Evolutionary Algorithms Our extinction-based evolutionary algorithm started as a standard evolutionary programming algorithm: reproduction performed only via mutation, a xed strategy parameter, and tournament selection to chose survivors. It became necessary to alter this process when modeling extinction dynamics. For instance, not all members of the population necessarily reproduce each generation; a tournament does not always determine survival; and coevolution aects only a small subset of the population. We consider an ecosystem at time t that contains a species set (t) = fs1 ; s2 ; : : : ; sk g, each of which is characterized by a vector ~x 2 <n . These numbers represent phenotypical traits which change whenever species evolve. All species are subjected to an external environmental stress (t), which may be severe enough to cause some species to become extinct if their tness level is too low. The tness of each si is measured, in part, by an objective function f (~x); minimum values of this function increase the likelihood of survival. But tness is a relative measure, which means f (~x) alone does not completely dene tness unless the mapping function considers the inuence of other species in the same environment. We t (f t ) deused the following mapping scheme. Let fmin max note the minimum (maximum) objective function value of any species si 2 (t). Then the tness of si at time t is given by t (1) (s ; t) = + (1 , ) f (~xi ) , fmax i t , fmax t fmin where 2 [0; 1]. Such a mapping forces f (~x) 7! [; 1]. (The purpose of the lower bound will be discussed shortly.) Other types of mappings could be used; the above method was chosen because of its simplicity. The steps in our extinction-based evolutionary algorithm are shown below: 1. Let t = 0 and randomly initialize population (0). Compute (si ; t) 8 i. 2. Increment t and let (t) = (t , 1). 3. Randomly choose a stress (t) 2 [0; 0:96]. Make all si 2 (t)j(si ; t) < (t) go extinct (i.e., discard them). Let m equal the number of species that went extinct. 4. If (m > 0) then fMutate each species to produce multiple new species. Compute (; t) for all new species. Conduct a tournament among the new species and deterministically choose the m best as replacements for those species that went extinct.g else f Let j = argmin i ((si ; t)). Mutate sj . Randomly choose 5 more individuals from the current population and mutate them also. Compute (; t) for all mutated species. g 5. If computation time not exhausted, go to step 2. Otherwise, exit. During each generation t, three steps take place. A random stress (t) is applied against all species, and all species si with tness (si ; t) < (t) are discarded to simulate extinction. At this point, one generation of a standard EP is conducted to nd replacement species. By restricting the replacements to be selected only from the new species, we model speciation. However, it is entirely possible that all of the species may have suciently high tness so that none go extinct. In this case the poorest t si |i.e., the species with the lowest objective function value|is mutated, which simulates a lowlevel, background evolution in (t). Whenever a species evolves to some new state, it also aects the state and tness other surrounding species. We simulate this coevolution by also mutating ve other randomly chosen species. The stress value (t) is chosen from a uniform distribution over the interval [0,0.96]. All species see the exact same stress level. The upper limit of 0.96 sets the maximum percent of species that can go extinct in any single generation; it is close to extinction levels seen during the Permian mass extinction [5]. There is a rationale for choosing that species with the lowest tness as the rst to evolve. Roberts and Newman [12] attached a \barrier" to all species that must be overcome in order to evolve to a state of higher tness. With respect to an evolutionary algorithm, this barrier is a region of relatively low tness and shows the mutation size necessary to improve phenotypical behavior. Extremely low-t individuals intuitively have very small barriers| even a small mutation could lead to a marked improved phenotype. Roberts and Newman chose the species with the lowest tness to evolve rst in their model; this is the same approach we have adopted. There is no absolute scale of tness that can be consistently applied over all environments; tnesses can therefore lie between zero and one without any loss in generality. Our algorithm maps all tness values to the subinterval [,1], where is a user selectable parameter. The lower bound > 0 serves a useful purpose. Suppose = 0 so tness values can reside anywhere on the unit interval. Furthermore, assume a very simplistic mapping function is used|simple normalization of all tness values to the maximum tness in the current population. If the evolutionary algorithm is working properly, the individuals should eventually evolve to a high state of tness, which means all tness values 1. This makes it very unlikely that an external stress can force species to become extinct|a behavior that directly contradicts evidence found in the fossil record. The parameter creates a lower threshold for extinction that prevents mass extinctions from occurring too frequently, while at the same time not dispensing with them entirely. Reproduction is done only via mutation: x0i = xi + N(0,) ; xi 2 ~x where N(0,) is a normally distributed random variable with zero mean and standard deviation . 3 f 2 1 0.5 0. 1 0 0 1 0.5 x1 -0.5 0 x2 -0.5 -11 -1 Figure 3: The tness landscape dened by Eq. (2). The global minimum is at (0,0). We used our extinction-based evolutionary algorithm to search for the global minimum of the multimodal objective function f (x1 ; x2 ) = x21 + 2x22 , 0:3 cos(3x1 ) ,0:4 cos(4x2 ) + 0:7 (2) with x1 ; x2 2 [,1; 1]. This function is shown in Figure 3. The algorithm was run for 10,000 generations p with N = 100 species and = 0:8. We chose = 0:02 and no self-adaptation was used. The performance of our algorithm is compared against a standard EP that was run with the same population size; the same initial population; a tournament size of 20; and an identical method of reproduction. Our algorithm executes 10,000 generations about three times faster than a standard EP executes 5,000 generations. Nevertheless, our extinction-based evolutionary algorithm consistently outperformed the standard EP in searches conducted over the landscape depicted in Figure 3. The results are given in Table 1. minimum f (~x) mean std. dev. EA (w/extinction) standard EP 9.14010,7 6.70010,5 , 6 8.29410 4.49810,4 , 6 7.95310 3.54610,4 Table 1: Performance comparison between the evolutionary algorithm with extinction and a standard EP. Both algorithms used the same initial population to conduct searches in the landscape shown in Figure 3. The globally minimum value is f (0; 0) = 0. Table entries are based on data recorded from 20 independent runs. 4 Discussion The material from the two previous sections raises some important philosophical issues regarding tournament selection. In order to compute the number of wins for a target individual, a small tournament set is randomly chosen from the current population. Fitness values are then compared in a head-to-head manner. This presumes it is both acceptable and appropriate to compare the tness values of distinct individuals. Tournament selection makes sense in light of a simulation at the individual level, but dierent approaches are required when modeling evolution at the species level. More specically, it may not make sense to conduct head-to-head tness comparisons when individuals in a population are interpreted to be distinct species. Indeed, inter-species tness comparison are valid only in special circumstances. For clarity, let represent the set of all species that co-exist in a given environment. The phenotype of each si 2 ultimately reects the ability of that species to survive in that environment|it is a measure of its tness. But, comparing the phenotypes of two distinct species may not only be dicult, it may be meaningless. For example, in the Caprivi Game Park in northeastern Namibia, one can nd lions, antelopes, and hippos. These species all co-exist but do not necessarily have any direct relationship between each other. Of course lions and antelope will since they have a predator-prey relationship. But there is no obvious|let alone direct| relationship between antelope and hippos nor between lions and hippos. Does it therefore make any sense to compare their phenotypes (equivalently, tnesses)? Yet, that is exactly what happens during conventional tournament selection. Our extinction-based evolutionary algorithm attempts to evolve a population to higher tness values by emulating dynamics derived from the fossil record| extinction must be present and tournaments are conducted among species. Although the exact cause of biotic extinction remains debatable, a number of reasons have been proposed including excessive inbreeding [13] or environmental stresses such as climatic change, volcanic activity, or disease [14]. Our algorithm assumes environmental stress is culpable. Replacement species are created by mutating existing species|emulating speciation|and a tournament among those new candidates determines the new species that survives. This follows Gause's Principle of Competitive Exclusion [15] where new species must compete for the same ecological niche. Note that this tournament does include existing species in the tournament set even though replacements can only come from speciation. Extinctions (%) 100 80 60 40 20 0 7000 7200 7400 7600 Generations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. .. . . . . . . . . .. .. . . . . . .. ... .. .. . . . . . . . .. . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. .. . . . . . . . . . .. . .. . . . . . . . . . . . . . . . . . . . .. . . . .. .. . . . . . . . . . . . . . .. .. .. . .... . . . . . . . . . . . . . . . . . . . ... .. .. . ... . .. . ... .. .. . . . . . . . . . . . . . . . .. .. . . .. . . .. .. .. . . .. .. .. . . . . . . . . . . .. . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . .. . . . . . . . . . . .. .. . . . . . . . . . . . . . . .. .. . ... . . ... . .. . . . . .. . . . . . . . . . . ... . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . .. . . .. .. . . . . . .. .. . .. . . . . . . . . . . .. . .. .. .. . . . . . . . . .. .. .. ... . . . .. . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . .. . . . . . . .. . . . .. . . . . . . . . . . . . . . . . . . . . . . .. .. .. . . . . . . .. . . .. .. .. . . . . . . . . . . . . . . . . . . . . . . . . . .. . . .. . .. . . . . .. .. .. .. .. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. .. . .. . . .. . .. .. . . . . .. . . ... .. .. .. . .. .. . . . . .. . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . .. ..... . . . . . . .. ... . .. .. .. .. .. .. .. .. . .. . .. . .. .. .. . . . . . . . . . . . .. . . . . . . . . .. .. .. . .. . . . . .. . . . . . . .. . . . . . . . . . . . . . . . . . . . .. . . . ... ... . . . .... ... . .. . . . . ... ... . .. .... .. ... . . . . . . ... .. . . ........ .... . . . . . ........ .. ........... . . . . . . . . .......... ...... ................ .. .. . . . . . . .... .... ..... . 7800 ... .. .. ...... ... . ........ ... ...... .... ...... .... ........ ... ...... ...... ...... ...... 8000 Figure 4: Extinctions per generation over a portion of the evolutionary process. Over 25 years ago, Eldredge and Gould [16] sparked a controversy that continues even today. They viewed \phyletic gradualism" as a awed concept that should be replaced by punctuated equilibrium. This concept says that evolutionary activity is characterized by periods of stasis, with little speciation, interspersed with episodes of very intense speciation. Figure 4 shows that our algorithm has periods of stasis interspersed with burst of extinctions. However, this behavior is not exactly punctuated equilibrium|we immediately replace any extinct species whereas punctuated equilibrium does not mandate that a xed number of species be constantly maintained. 5 Conclusions & Future Work Evolutionary change cannot be completely explained by natural selection alone [17]. At the species level, mass extinctions wipe out entire species for reasons unrelated to inter-species struggles for survival. Nevertheless, this does create windows of opportunity for other species to ourish. Our algorithm follows a similar vein to conduct searches: episodic mass extinctions prevent stagnation, and rapid speciation maintains a constant number of solutions. Our results indicate that extinction can enhance the performance of an evolutionary search. Granted, only one multimodal landscape was explored, but the results are certainly encouraging particularly in light of the low execution time with respect to a standard EP. The improved execution time is not unexpected. In the extinction-based algorithm a tournament is not conducted each generation|only background evolution is simulated. In fact, a tournament is conducted only after the onset of a mass extinction. On the other hand, the standard EP conducts a tournament every generation. Our algorithm can easily accommodate searches over dynamic landscapes. This will be the subject of future studies. We have identied some other areas that can deserve further investigation. Specically, 1. Modeling evolution It is important to note that our algorithm, in its present form, is not intended to serve as a model for biotic macro-evolution. Nevertheless, it does incorporate a number of intriguing features that suggest it could be easily modied to perform that function. A rst step would be to monitor the branching and termination of species. Ideally, we should not maintain a constant population size| speciation should be allowed to proceed in a natural way with, perhaps, a maximum number of species that can be supported within the environment. Normally a species can expect to undergo a number of stresses during its lifetime and all species co-existing in that same environment will be subjected to the same stress|but not all species are aected to the same degree by that stress. Newman [18] put it this way: : : : we have assumed that every stress on the system aects every species. This is clearly not realistic. Some stresses will for example be localized in space, or will not reach under the sea, or will only reach under the sea, and so for. The current version applies the stress (t) equally to all species. We could specify|or even evolve| species relationships that permits a stress factor to aect distinct species in dierent ways. One obvious way is to let stress be analogous to a tness penalty and let culling be done by natural selection. 2. Self-adaptive extinction The strategy parameter sets a lower bound on the percent of a species that can go extinct. As ! 0, a large number of mass extinctions become possible|our algorithm then approximates a (; ) evolution strategy. Conversely, as ! 1, virtually no extinctions occur and our algorithm degenerates into a random walk with replacement. It would be interesting to investigate the performance when is allowed to evolve. 3. Self-adaptive mutation The current version of our algorithm used a xed standard deviation () for the normal distribution. Self-adaptation should improve the performance, but no single method is universally applicable [19]. 4. Other mutation distributions A number of recent studies indicate that alternative probability distributions for mutation can improve the performance over some landscapes [20, 21]. It would be a trivial matter to incorporate Cauchy mutations into our algorithm. Acknowledgement The authors would like to thank L.J. Fogel and D.B. Fogel for their valuable comments that helped to improve this paper. Bibliography [1] T. Blickle. Tournament selection, in Handbook of Evolutionary Computation, T. Back, D. B. Fogel, and Z. Michalewicz (eds.). pages C2.3:1{4, 1997. [2] C. Newton and L. Laporte. Ancient Environments. Prentice Hall, New Jersey, 3rd edition, 1989. [3] D. Raup and J. Sepkoski. Mass extinctions in the marine fossil record. Science, 215:1501{1503, 1982. [4] C. Marshall. Mass extinction probed. Nature, 392:17{20, 1998. [5] D. Raup. Biological extinction in earth history. Science, 231:1528{1533, 1986. [6] D. Raup and J. Sepkowski. Periodicity of extinctions in the geological past. Proc. Nat. Acad. Sci. USA, 81:801{805, 1984. [7] ibid. Testing for periodicity of extinction. Science, 241:94{96, 1988. [8] V. Grant. The Evolutionary Process. Columbia University Press, NY, 2nd edition, 1991. [9] D. Jablonski. Background and mass extinctions: the alternation of macro-evolutionary regimes. Science, 231:129{133, 1986. [10] J. Wolfe and G. Upchurch. Vegetation, climatic and oral changes at the Cretaceous-Tertiary boundary. Nature, 324:124{152, 1986. [11] D. Raup. Extinction: Bad Genes or Bad Luck? W. W. Norton, 1991. [12] B. Roberts and M. Newman. A model for evolution and extinction. J. Theor. Biol., 180:39{54, 1996. [13] R. Frankham and K. Ralls. Inbreeding leads to extinction. Nature, 392:441{442, 1998. [14] P. Skelton (editor). Evolution: A Biological and Paleontological Approach. Addison-Wesley, Wokingham, England, 1993. [15] G. F. Gause. The Struggle for Existence. Williams and Wilkins, Baltimore, 1934. [16] N. Eldredge and S. Gould. Punctuated equilibrium: an alternative to phyletic gradualism, in Models in Paleobiology, T. J. Schopf (ed.), Freeman, San Francisco. 1972. [17] S. Gould. The evolution of life on the earth. Sci. Amer., 271:84{91, 1994. [18] M. E. Newman. Self-organized criticality, evolution and the fossil extinction record. Proc. R. Soc. Lond. B, 263:1605{1610, 1996. [19] N. Saravanan, D. B. Fogel, and K. Nelson. A comparison of methods for self-adaptation in evolutionary algorithms. BioSys., 36:157{166, 1995. [20] K. Chellapilla and D. B. Fogel. Two new mutation operators for enhanced search and optimization in evolutionary programming, in Applications of Soft Computing, B. Bosacchi, J. C. Bezdek, and D. B. Fogel (eds.). Proc. SPIE, 3165:260{269, 1997. [21] X. Yao and Y. Liu. Fast evolution strategies. Cont. & Cyber., 26:467{496, 1997.
© Copyright 2026 Paperzz