Overview Overview of of Evolutionary Systems Systems Evolutionary Christian Jacob AI AI Department of Computer Science University of Calgary CPSC 565 — Winter 2003 Emergent Computing — CPSC 565 — Winter 2003 1 Christian Jacob, University of Calgary
In Search for Better “ “Solutions Solutions” ” In Search for Better global maximum local maxima local maxima Emergent Computing — CPSC 565 — Winter 2003 2 Christian Jacob, University of Calgary
Evolutionary Optimization Evolutionary Optimization • Knowledge Reservoir Set of possible solutions – Gleaning a reservoir of knowledge from interactions with the environment. • Selection Fitness-dependent number of offspring – The sieve of selection culls out incorrect / unuseful “knowledge”. • Variation Variations of individual solutions – The learning system invents new variants of its old ideas that are tested against environmental demands. Emergent Computing — CPSC 565 — Winter 2003 3 Christian Jacob, University of Calgary
Genetic Algorithms in Action … … Genetic Algorithms in Action Simulated Genome-Inspired Evolution J. Holland (1975), D. Goldberg (1989) Emergent Computing — CPSC 565 — Winter 2003 4 Christian Jacob, University of Calgary
Dualism in Nature in Nature Dualism Genotype Phenotype Genotype Phenotype Transcription Translation Development Morphogenesis Emergent Computing — CPSC 565 — Winter 2003 5 Christian Jacob, University of Calgary
Sidenote: DNA Is Structured Hierarchically Sidenote: DNA Is Structured Hierarchically Levels of Structure • Double Helix • Histones / Nucleosomes • Solenoid Supercoil • Chromatin • Chromosomes Emergent Computing — CPSC 565 — Winter 2003 6 Christian Jacob, University of Calgary
Evolutionary Computing— —Geno- & Phenotype? Geno- & Phenotype? Evolutionary Computing E Population of organisms Phenotypical feature and behaviour space Gene pool ... S ... Genotypical structure space General genotype-phenotype distinction in evolutionary algorithms Emergent Computing — CPSC 565 — Winter 2003 7 Christian Jacob, University of Calgary
Evolution: Adaptation of Structures Evolution: Adaptation of Structures Environment p (t) E p Structures I E (t) 1 s(t+1) s(t) w (t) ... S 2 5 Environmental signals s(t) a m E (t) w (t) 4 j E (p(s(t))) Adaptive plan 3 (1) Expression, (2) Interaction with the environment, (3) Evaluation, (4) Selection, (5) Variation. Emergent Computing — CPSC 565 — Winter 2003 8 Christian Jacob, University of Calgary
Evolution: Adaptation of Structures Evolution: Adaptation of Structures Environment p (t+2) p (t+1) p (t) E Structures p I E (t) 1 s(t+1) s(t+2) ... s(t) w (t) w (t+1) ... S 2 5 Environmental signals s(t) a m E (t) w (t) 4 j E (p(s(t))) Adaptive plan 3 (1) Expression, (2) Interaction with the environment, (3) Evaluation, (4) Selection, (5) Variation. Emergent Computing — CPSC 565 — Winter 2003 9 Christian Jacob, University of Calgary
Examples of Simple Simple Examples of Evolutionary Processes Evolutionary Processes Cumulative Selection Cumulative Selection Evolutionary Creativity Evolutionary Creativity Emergent Computing — CPSC 565 — Winter 2003 10 Christian Jacob, University of Calgary
Drip by Drip— —Cumulative Selection Cumulative Selection Drip by Drip • A simplified version of the evolutionary principle of adaptation is used to search for a predefined string – starting from an initially random sequence of characters and – Using iterated mutation and cumulative selection. • Random strings are compared to an objective sentence: EVOLUTION OF STRUCTURE, STEP BY STEP (O) (a) ,LPYJK,ZPBGXWKTEKSQ,KLVCFZSJFGVZQWG ETTLXTKOL RF STRZGPURE CSYEPYBY SQEP (b) EVOLUDION OF STRUKTURE STEP BZ,STEB (c) Emergent Computing — CPSC 565 — Winter 2003 11 Christian Jacob, University of Calgary
Algorithm for Selection and Mutation Algorithm for Selection and Mutation 1. Initialization: Generate an initial set S = {s 1 ,…,s n } of n individuals. 2. Initial evaluation: Evaluate all individuals and calculate their fitnesses (using Hamming distance). 3. Selection: Choose the best individual s best Œ S . 4. Mutation: From the best individual, generate a set of n -1 mutants: M = {s i ’ := mut(s best ) | i = 1 ,…,n -1} . 5. Evaluation: Evaluate all mutants and calculate their fitnesses. 6. Termination check: If at least one of the individuals has achieved the maximum fitness, STOP. Otherwise, generate a new selection set: S = {s best } » M. 7. Continue with step 3. Emergent Computing — CPSC 565 — Winter 2003 12 Christian Jacob, University of Calgary
Mutation on Strings Mutation on Strings • We define string mutation on a string s = s 1 …s N as follows: mut(s, r, p) = s 1 ’…s N ’ where s i ’ = s i , if c real (0,1) > p. s i ’ = m(s i , r), otherwise. m( x , r) = t -1 ( t ( x ) + c int (-r, r)). • c (y, z) returns a uniformly distributed, random number from the interval [y, z]. • The character x is translated into its number encoding t ( x ). Emergent Computing — CPSC 565 — Winter 2003 13 Christian Jacob, University of Calgary
String Mutations String Mutations s: EVOLUTION OF STRUCTURE, STEP BY STEP EVOLUTION OF STRUCTURE, STEP BY STEP s: mut(s, 1, 0.1) mut (s,1,0.2): EVNLVTION OF SURUCTURE, STEP BY STEP DVOLUTIONZOF STRUDSUQE, SSEP,CY SSEP : EVOLUTION OF STRUCTURE, STEP BY STEP s: EVOLUTION OF STRUCTURE, STEP BY STEP s: mut(s, 1, 0.2) mut (s,2,0.2): EVOLUTIOM OF STRVCTURE. STEP BZ STEP FVOLUTIONYOF STTUCTURE, QTEP BY STEP : EVOLUTION OF STRUCTURE, STEP BY STEP s: EVOLUTION OF STRUCTURE, STEP BY STEP s: mut(s, 1, 0.5) mut (s,5,0.2): EWNLVUHON,OE SSSUCUVRD.ZSUEP,CY,STEQ EVOLUTNON OFCOTRYFTUME, STEPBB STFP : • Mutation on strings with • Mutation on strings with a mutation radius 1 and different constant mutation rate of 0.2 mutation rates. and varying mutation radii. Emergent Computing — CPSC 565 — Winter 2003 14 Christian Jacob, University of Calgary
String Evolution Examples String Evolution Examples Mutation radius: 1; mutation rate: 0.1 Mutation radius: 1; mutation rate: 0.5 Mutation radius: 5; mutation rate: 0.1 Mutation radius: 5; mutation rate: 0.5 Emergent Computing — CPSC 565 — Winter 2003 15 Christian Jacob, University of Calgary
String Evolution— — Mut String Evolution Mut. Radius: 2, . Radius: 2, Mut Mut. Rate: 0.1 . Rate: 0.1 Emergent Computing — CPSC 565 — Winter 2003 16 Christian Jacob, University of Calgary
String Evolution— —Hamming Distance Plots Hamming Distance Plots String Evolution Mutation radius: 2 Mutation rate: 0.1 Emergent Computing — CPSC 565 — Winter 2003 17 Christian Jacob, University of Calgary
String Evolution— —Hamming Distance Plots (2) Hamming Distance Plots (2) String Evolution Mutation radius: 4 Mutation rate: 0.1 Emergent Computing — CPSC 565 — Winter 2003 18 Christian Jacob, University of Calgary
String Evolution— —Hamming Distance Plots (3) Hamming Distance Plots (3) String Evolution Mutation radius: 2 Mutation rate: 0.2 Emergent Computing — CPSC 565 — Winter 2003 19 Christian Jacob, University of Calgary
String Evolution — — Comparing Results Comparing Results String Evolution Mutation radius: 2 Mutation radius: 4 Mutation radius: 2 Mutation rate: 0.1 Mutation rate: 0.1 Mutation rate: 0.2 Emergent Computing — CPSC 565 — Winter 2003 20 Christian Jacob, University of Calgary
Examples of Simple Simple Examples of Evolutionary Processes Evolutionary Processes Cumulative Selection Cumulative Selection Evolutionary Creativity Evolutionary Creativity Emergent Computing — CPSC 565 — Winter 2003 21 Christian Jacob, University of Calgary
A Biomorph Biomorph … … and Some of Its Mutants and Some of Its Mutants A 3 | 2 3 2 4 7 | 2 2 2 4 7 | 2 2 2 4 7 | 2 2 2 4 7 Emergent Computing — CPSC 565 — Winter 2003 22 Christian Jacob, University of Calgary
A Biomorph Biomorph … … and Some of Its Mutants and Some of Its Mutants A 3 | 2 3 2 4 7 | 2 2 2 4 7 | 2 2 2 4 7 | 2 2 2 4 7 1+ 2+ 3+ 7+ 12+ 13+ 17+ 1- 2- 7- 8- 13- Emergent Computing — CPSC 565 — Winter 2003 23 Christian Jacob, University of Calgary
Evolution of Biomorphs Biomorphs Evolution of Emergent Computing — CPSC 565 — Winter 2003 24 Christian Jacob, University of Calgary
Evolution of Biomorphs Biomorphs Evolution of Emergent Computing — CPSC 565 — Winter 2003 25 Christian Jacob, University of Calgary
Evolved Biomorphs Biomorphs Evolved Gen. 0 Gen. 5 Gen. 10 Gen. 19 Emergent Computing — CPSC 565 — Winter 2003 26 Christian Jacob, University of Calgary
Evolved 3D Biomorphs Biomorphs Evolved 3D Emergent Computing — CPSC 565 — Winter 2003 27 Christian Jacob, University of Calgary
Biomorph Examples Biomorph Examples Emergent Computing — CPSC 565 — Winter 2003 28 Christian Jacob, University of Calgary
ArtFlower Examples ArtFlower Examples Emergent Computing — CPSC 565 — Winter 2003 29 Christian Jacob, University of Calgary
General Evolutionary Algorithm Scheme General Evolutionary Algorithm Scheme Emergent Computing — CPSC 565 — Winter 2003 30 Christian Jacob, University of Calgary
Recommend
More recommend