 |
    |
Extracting Key Gene Regulatory Dynamics for the Direct Control of Mechanical Systems
Jean Krohn and Denise Gorse
Department of Computer Science, UCL (University College London), Gower Street, London WC1E 6BT, UKj.krohn@cs.ucl.ac.uk
d.gorse@cs.ucl.ac.uk
Abstract. Evolution produces gene regulatory networks (GRNs) able to control cells. With this inspiration we evolve artificial GRN (AGRN) genomes for the reinforcement learning control of mechanical systems with unknown dynamics, a problem domain similar in its sparse feedback to that of controlling a biological cell. From the fractal GRN (FGRN), a successful but complex GRN model, we obtain the Input-Merge-Regulate-Output (IMRO) abstraction for GRN-based controllers, in which the FGRN’s complex fractal operations are replaced by simpler ones. Computational experiments on reinforcement learning problems show significant improvements from the use of this simplified approach. We also present the first evolutionary solution to a hardened version of the acrobot problem, which previous evolutionary methods have failed on.
Keywords: Gene regulatory network, IMRO, FGRN, genetic algorithm, ALPS, control, reinforcement learning, pole balancing, acrobot
LNCS 7491, p. 468 ff.
lncs@springer.com
© Springer-Verlag Berlin Heidelberg 2012