Designing Intelligence Why Brains Aren’t Enough

Rolf Pfeifer, Josh Bongard and Don Berry

With a contribution by Simon Grand Illustrations by Shun Iwasawa

Front Cover Design by Hakam El Essaw

Featuring the humanoid robot ‘EDS’ Photo: Patrick Knab Robot construction: The Robot Studio (TRS) ECCE Robot project: EU's 7th Framework Programme, ICT Challenge2, 'Cognitive Systems and Robotics' Motors: maxon motor, Switzerland

© 2011 Rolf Pfeifer, Josh Bongard and Don Berry.

All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher.

2

To my friends in Japan (R.P.) To Toby, Carol, and Ralph (J.B.) To my friends and Family (D.B.)

3

About the Authors

Contents

  Preface  

  7  

1.  Intelligence, Thinking and Cognition  

  10  

In  this chapter we will introduce the concepts intelligence, thinking and cognition, discuss  

  why intelligence has fascinated people from all walks of life throughout history, and introduce  

  the field of artificial intelligence  

2  Prerequisites for a Theory of Intelligence  

  20  

Chapter 3  outlines what type of theory we are looking for and introduces a number of  

important  notions such as diversity-compliance, frames of reference, the synthetic  

  methodology, time perspectives, emergence, and real world agents  

3  The Design Principles  

  29  

In  this chapter we sketch a set of design heuristics what we call the design principles for  

intelligent  systems that can be used to guide us in building new agents and understanding  

  biological ones  

4.  Development: From Locomotion to Cognition  

  39  

  This chapter explores design and analysis issues from a developmental perspective, and asks  

  how high-level cognition can emerge as an agent matures  

5.  Evolution: Cognition from Scratch  

  47  

Chapter 6  looks at how we can harness ideas from biological evolution in order to design  

  agents from scratch  

6.  Collective Intelligence  

  56  

  This chapter discusses phenomena that come about when agents interact in groups  

7.  Ubiquitous computing and Everyday Robotics  

  65  

In  this chapter we discuss ubiquitous computing, a rapidly expanding discipline where the goal  

is  to put computers everywhere’, as well as exploring the development of robots that could  

  enter into and participate in our everyday lives  

8.  Where is Human Memory?  

  75  

Chapter 9  presents a case study on human memory that illustrates how embodiment provides a  

  new perspective on challenging research problems old and new  

9.  Building Intelligent Companies  

  84  

  This chapter, written with management expert Simon Grand, applies the perspective of  

  embodied intelligence to the business world, and in particular to the design and construction of  

  new products, businesses  

10.  Conclusion: Principles and Insights  

  94  

  Lastly we will summarize the main points of our theory, and present a collection of examples  

illustrating  how things can always be seen differently  

  Notes  

  104  

5

Preface

This is a book about how having a physical body contributes towards being intelligent. The idea that the body is required for intelligence has been around since nearly three decades ago, but an awful lot has changed since then. Research labs and leading technology companies around the world have produced a host of sometimes science fiction-like creations: unbelievably realistic humanoids, robot musicians, wearable technology, robots controlled by biological brains, robots that can walk without a brain, real-life cyborgs, robots in homes for the elderly, robots that literally put themselves together, and artificial cells grown automatically. This new breed of technology is the direct result of the embodied approach to intelligence. Along the way, many of the initially vague ideas have been elaborated and the arguments sharpened, and are beginning to form into a coherent structure. Thus, several years ago it seemed a good opportunity to work out the first steps toward a theory of intelligence, which we (Rolf and Josh) did with our previous book, ‘How the Body shapes the way we think’. ¹ Since then we have realized that the ideas contained in the previous book could be helpful to a wider audience: our last book was around 450 pages long and contained lots of technical vocabulary and detail. So we recruited Don Berry, a young Philosophy Research Student from University College London, to write a much shorter, popular version, recycling a lot of material from the previous publication. Science and technology are no longer isolated fields: they closely interact with the corporate, political, and social aspects of our society, and in this book we will not only provide a novel perspective on artificial intelligence but also change how we view ourselves and the world around us. From a personal perspective, I (Rolf) have given many seminars and lectures to nonspecialized audiences, and many of them were able to relate in very direct and natural ways to the ideas presented: they seemed to hold relevance for their own interests and specialties. What most people found intriguing was that this research demonstrates how things can always be seen differently. We all have our strong prejudices and often think, ‘It’s got to be like that, there is no other way!’ For example, if you want to build a fastrunning robot you must have fast electronics; an object-collecting robot must have a means for recognizing the objects it is supposed to gather; or an insect with six legs needs a centralized control program somewhere in its brain to coordinate all its legs while walking. Surprisingly, it turns out that none of these are true, as we will see later. Aims and Scope

The goal of this book is twofold: on the one hand it is to explore the implications of embodiment (how having a body affects intelligence), to work out the first steps toward a theory of intelligence, and finally to demonstrate the wide applicability of these ideas. On the other, we will try to show that things can always be seen differently. So, the book is conceptual, and is geared toward a broad audience in education, business, information technology, engineering, entertainment, the media, as well as academics from virtually all disciplines and levels, including psychology, neuroscience, philosophy, linguistics, and biology. And last but not least, this book is also intended for anyone interested in technology, its future, and its implications for society. No special training or education is

7

required for understanding the ideas presented: we have tried to provide background information, examples, and further reading suggestions for the more difficult concepts. The core of the theory consists of a set of design principles for intelligent systems. The reason for choosing the form of design principles for our theory is that they are a compact way of describing insights about intelligent systems in general and at the same time provide convenient heuristics for actually building artificial systems, like robots in particular. And actually building systems is crucial: we want to design and construct intelligent artificial systems in order to understand intelligent systems in general. This is the synthetic methodology - the basic methodology of artificial intelligence, which can be characterized as understanding by building. As we will show with many examples, by building artificial systems we can learn about biology, as well as about intelligence in general. An exciting prospect is that this enables us not only to study natural forms of intelligence, but to create new forms of intelligence that do not yet exist; ‘intelligence as it could be’, to adapt a quote by one of the founders of the field of artificial life, Chris Langton. So, the book is not so much about the intricacies of engineering or the details of how to build robots, but rather about the insights that arise as a result of these processes. We have tried to show that the ideas developed in this book have broad applicability beyond the field of artificial intelligence proper by providing illustrations from the fields of ubiquitous computing and everyday robotics, human memory, and strategic management (chapters 7, 8 and 9). We hope that the reader will enjoy these case studies and will feel encouraged to apply the ideas to areas of his or her own interest. Also, the website for the book ² contains many links to videos and other supporting material, as well as a discussion forum. We have engaged an artist and computer scientist, Shun Iwasawa of the University of Tokyo, who, with great talent, technical skill, and understanding, created Japanese Manga-style illustrations that, we hope, will stimulate the reader’s interest and communicate the fun, forward-thinking style of this field of study. Acknowledgments

We would like to thank all the members of the Artificial Intelligence Laboratory of the University of Zurich for continued discussions, excellent research, and the many ideas that finally found their way into this book. Big thanks go to our friends Yasuo Kuniyoshi, Olaf Sporns, Akio Ishiguro, Hiroshi Yokoi, Koh Hosoda, Fumio Hara, and Hiroshi Kobayashi who kept the project moving. We would also like to express our thanks to the many funding agencies that have made the research described in this book possible, in particular the Swiss National Science Foundation and the IST Program of the European Union. Moreover, I (Rolf) would like to express my very personal thanks to Yasuo Kuniyoshi, Tomomasa Sato, Hirochika Inoue, Yoshi Nakamura, and all the other members of the Department of Mechano-Informatics, for inviting me to the University of Tokyo to be a twenty-first-century COE (Center of Excellence) professor of Information Science and Technology. Their perspective on intelligent agents as complex dynamical systems has strongly influenced the contents of the book. Our thanks go also to Gabriel Gomez, who has researched many issues concerning the project. Also, we highly appreciate the contributions of Max Lungarella, who, in particular with his PhD thesis but also with many personal discussions, is largely responsible for the quality of chapter 4. Also, the ideas of Fumiya Iida, to whom we owe

8

the title of chapter 4, ‘From Locomotion to Cognition’, have been instrumental. We are also extremely grateful to Shun Iwasawa for his outstanding, inspiring, and instructive illustrations. Thanks go also to all the researchers around the world from many different disciplines for their ideas that have provided inspiration for our arguments. And, of course, to Rodney Brooks, for having started this exciting research field in the first place. There are many, many others - faculty, staff, students, friends, and family - who have provided support one way or another to all three authors: we are deeply in debt to all of you. I (Josh) would like to thank my family - Toby, Carol, and Ralph—for understanding and helping me in my long journey to get to this point. I (Rolf) would like to thank in particular my two sons, Serge and Mischa, who have always encouraged me to continue when times were hard. I (Don) would like to thank the other authors for the opportunity to become involved in this fascinating field, Pascal for making the introductions, and those of my friends and family that have encouraged me along the way.

9

1. Intelligence, Thinking, and Cognition

Figure 2

Two ways of approaching intelligence. (a) The classical approach. The focus is on the brain and central processing. (b) The modern approach. The focus is on the interaction with the environment, as we will see throughout the book.

The idea that the mind controls the body is central to the way we like to think about ourselves. For example, I can decide in my mind to pick up a cup and drink a sip of coffee, and subsequently my arm and hand begin to perform the action. It implies that we are in control of our behaviour, and therefore our lives: this is the ‘Cartesian heritage’ of Western culture. As individuals we make a decision about something - a goal that we want to achieve, such as becoming a doctor, or catching a Frisbee - and then we make plans and go about doing it. Or when at a party, we decide that we would like to meet someone, so we start talking to that person. This picture of things comes very naturally: individualism - the importance of the individual - and a sense of control are two of our most cherished values. But is it correct?

As you may have guessed, our answer is for the most part a resounding ‘no’. While there may be some truth to this way of viewing ourselves, it actually turns out that to a surprising extent it is our bodies that determine our actions and thoughts. Although clearly of great importance, the brain is not the sole and central seat of intelligence: it is instead distributed throughout the organism. This is a major theme that we will explore throughout the book: how the body shapes the way we think. We are convinced that exploration of this relationship between body and thinking - the interaction between the body and the brain - will clarify core aspects of intelligence; indeed, we hope that it will lead to an entirely new view of intelligence itself.

10

1.1 Thinking, Consciousness and Cognition

Before we turn toward elucidating the mystery of intelligence, we must introduce some terminology. First off we will briefly examine the term ‘thinking’. Intuitively, thinking is associated with conscious or deliberate thought, with something high-level or abstract. This conception suggests that a process either is or is not thinking: but perhaps matters are not as clear as they might seem at first sight. For example: do newborns think? We cannot be sure, but perhaps they don’t. What about after a few days or weeks? Clearly after a few months or years, and certainly as adults, we do think, but this raises the difficult question at what age children actually do start thinking. Rather than looking for a black-and-white cutoff, we can view thinking as occurring in varying degrees: it is clear that babies’ skills gradually improve as they grow older; likewise, their ability to think also improves gradually over time as they grow and mature. From this perspective, the question is not whether someone (or something) is thinking or not, but how much thinking is going on. This immediately leads to the question of how we can tell how much thinking is going on: this problem will keep us busy throughout the book. Consciousness is a peculiar, fascinating, but highly elusive phenomenon, and again we can imagine that it also registers on a continuum rather than being an all-or-nothing property. We would suspect that, for example, insects, birds, rats, dogs, chimpanzees, and humans are conscious to an increasingly large extent, rather than being either conscious or not. Because it is tied to subjective experience, it is hard to investigate consciousness scientifically. In this book we will not go much further into the subject: we hope to acquire a deep understanding of intelligence simply by pursuing the ideas of embodiment. However, because we discuss the issue of how cognition can emerge from a physically embodied system - and consciousness is intimately related to cognition - we feel that this way we will contribute to the understanding of consciousness too. ‘Cognition’, closely related to intelligence, is often used to designate those kinds of processes of an agent that are not directly related to sensory or motor (relating to muscles) mechanisms: neither sensing or perceiving things, nor moving about in any way. Examples of cognitive tasks are abstract problem solving, reasoning, memory, attention and language. Later we will see that often cognitive and sensory-motor processes cannot easily be separated out: perception, which is obviously directly related to sensory processes, is an important subfield of cognitive psychology, and even simple activities such as walking or grasping a cup have cognitive aspects. ‘Cognition’ is a more general term than ‘thinking’ because it does not necessarily imply consciousness. However, despite the more abstract connotations of ‘thinking’ as compared to ‘cognition’, we will see that thinking is not a disembodied process: it is also directly linked to sensory-motor and other physiological (i.e., bodily) processes. We will use the term ‘agent’ to indicate that a claim applies not only to humans, but to other animals or robots as well: in this book much of what we have to say is about intelligence in general. Agents differ from other kinds of objects such as a rock or a cup, which are only subject to external forces and cannot act on their own. We are primarily interested in embodied agents: that is, those that have a physical body and can therefore interact with their environments.

Finally, we use the term ‘robot’ in quite a broad sense. The original sense of the word derives from the Czech ‘robota’, meaning something like ‘work’ or ‘forced labor’, and implies that robots were initially meant to do work for humans. However, the term

11

‘robot’ as used here refers to machines that have at least some agent characteristics in the sense discussed above, whether they do useful work for humans or not. 1.2 The Mystery of Intelligence

Intelligence is highly mysterious, and we all wonder what it is: how is it possible that something so sophisticated could have been produced by evolution? How does it develop as a baby grows to become an adult? How can we walk, talk, or solve problems? And how can we, without effort, recognize a face in a crowd, or play a piece of music? Intelligence is obviously of great importance: the fact that there is an enormous literature on the topic is not really surprising. Throughout human history, philosophers, psychologists, artists, teachers, and more recently neuroscientists and artificial intelligence researchers have been fascinated by it, and have devoted much of their lives to its investigation. And many of them have written books about it. Still, we feel it makes sense to write yet another book about this topic because we believe it presents some novel points that previously have not even been considered to be part of the field of intelligence. These novel points all relate, one way or another, to the notion of embodiment, the simple idea that intelligence requires a body. Intelligence is a highly sensitive topic, and we tend to believe that it is what distinguishes us from the other animals. In our societies, Western or Eastern, an enormously high value is attached to intelligence: ‘you are very intelligent’ is one of the highest compliments one can give or receive, and we are constantly reminded that intelligence is positive and desirable. There has been a recent surge of interest in emotional intelligence, which argues that rationality is limited and that we should also take emotions into account. According to this view, outlined in e.g. American neuroscientist Antonio Damasio’s book ‘Descartes’ Error’, intuition and the ability to emotionally judge a situation are considered just as important as the ability to pass high school exams or achieve high scores on intelligence tests. However, regardless of these developments, rational, logical intelligence is still considered to be one of the most enviable characteristics a human being can possess.

There is also the question of why some people are more intelligent than others, which is related to the problem of whether intelligence is ‘in the genes’ or can be acquired - by going to the right schools, for example. This hotly debated topic is called the naturenurture debate. Part of the reason this debate is so emotionally charged is because it is about intelligence: whether a person has an honest character or high moral standards, and how these traits are acquired, is not discussed as much, even though honesty and moral integrity are still considered desirable qualities. For our purposes, the interesting scientific question in this seemingly endless debate is not whether intelligence is inherited or acquired during the lifetime of an individual, but how evolution and development interact such that intelligence arises in an agent. 1.3 Defining Intelligence

So intelligence is important, sensitive, and mysterious. But what is it really? Intelligence closely resembles thinking and cognition, but the term is typically used in an even more general way. Everyone has some intuition of what intelligence is all about: it has to do with consciousness, thinking, and memory (as already mentioned), along with problem

12

solving, intuition, creativity, language, and learning, but also perception and sensory-motor skills, the ability to predict the environment (including the actions of others), the capacity to deal with a complex world (which may result from a combination of other abilities), and performance in school and on IQ tests and the like. Let us consider some different cases. Are ants intelligent? Perhaps only to a limited extent, although they can orient well in their environments and have interesting learning abilities. What about an entire ant colony? Is the intelligence of an ant colony comparable to the intelligence of a human? Ant colonies cannot speak, so if we consider language to be an important part of intelligence then we might conclude that humans are more intelligent. What about rats or dogs? These animals seem more intelligent than ants because they can do things that ants cannot, such as learning to navigate a maze or catching a Frisbee while running.

It seems obvious that humans are more intelligent than dogs, but perhaps dogs are actually more intelligent in certain respects. They cannot do long division or build cars, but when it comes to finding survivors at disaster sites or drugs in luggage at airports they are far superior to humans, which is why they are employed for these tasks. As alluded to earlier, some humans seem to be more intelligent than others - but what do we really mean by this? Is it that they do some things better than others, such as perform better on intelligence tests? Are they more successful in their careers? Or perhaps it is because they can do maths? But then what about those who can sing, or survive alone in the wild? It is very hard to come up with a good definition of intelligence, and many people have tried their luck at it: there is a website with about 70 attempts that are all plausible. But looking for this kind of a formal definition is actually not very helpful. It is not very productive to discuss whether to consider ants as intelligent, because we can find both good reasons why they should (sophisticated orientation behaviour, complex social structures, impressive learning abilities) and should not be (they can’t talk, play chess, build cars or compose music). The more productive question is: given a behaviour that we think interesting, how does it come about? What are the underlying mechanisms? To conclude this initial discussion, let us introduce the ‘diversity/compliance model’: not as a definition, but to characterize in a very general way what we intuitively expect from an intelligent agent. In the world around us, all humans, animals and robots have to comply with certain rules, such as the fact that there is gravity and friction, and that locomotion requires energy. There is simply no way around it. But adapting to these constraints and exploiting them in particular ways opens up the possibility of producing diverse behaviour, such as walking, running, drinking from a cup, putting dishes on a table, or riding a bicycle. Diversity means that the agent can do many different things so that he - or she or it - can react appropriately to a given situation. An agent that only walks, or only plays chess is naturally considered less intelligent than one that can also build toy cars out of a Lego kit, pour beer into a glass, and give a lecture in front of a critical audience. Learning, which is mentioned in many definitions of intelligence, is a powerful means for increasing behavioural diversity over time. In this book we will study these kinds of behaviours by using the method of artificial intelligence, which is especially productive for this purpose. So, let us now get acquainted with it.

13

1.4 Artificial Intelligence

By ‘Artificial Intelligence’ we mean the interdisciplinary research field that has, in essence, three goals: (1) understanding biological systems (i.e., the mechanisms that bring about intelligent behaviour in humans and other animals); (2) the abstraction of general principles of intelligent behaviour; and (3) the application of these principles to the design of useful artefacts. The field was officially launched at the famous Dartmouth conference held in 1956 in the small town of Hanover, New Hampshire, USA) ¹ . It was here that the ‘fathers of AI’ - Marvin Minsky, John McCarthy, Allen Newell, Herbert Simon, and Claude Shannon - first discussed the question of whether or how human thinking could take place in a computer. They were convinced that, by using the notion of computation or abstract symbol manipulation, it would soon become possible to reproduce interesting abilities normally ascribed only to humans, such as playing chess, solving abstract problems, and proving mathematical theorems. What originated from this meeting, and what came to be the guiding principles until the mid-1980s, was what is now known as the classical, symbol-processing paradigm.

According to the classical approach to AI, when we study intelligent systems we should focus only on the programming or software. We can characterize this approach with the slogan ‘cognition as computation’. Thus intelligence can arise not only in biological systems on wet, biological brains, but also in artificial systems and on computers. This is a powerful idea and is one of the main reasons why computing has been so successful: all that matters are the programs that run on your computer; the hardware is irrelevant. Under this classical perspective, human intelligence was placed at centre stage: as a consequence, the favourite areas of investigation were natural language, reasoning, proving mathematical theorems, and playing formal games like checkers or chess. In the 1980s models called ‘expert systems’ became popular and were intended to replace human experts in tasks such as medical diagnosis and loan assessments. By the mid-1980s, the classical approach had grown into a large discipline that could claim many successes: whenever you switch on your laptop computer or use a search engine on the internet you are starting up programs that have their origin in artificial intelligence, and computer games, home electronics, elevators, cars, and trains all abound with AI technology. However, this approach has not worked well when it comes creating more natural forms of intelligence, such as perception, manipulation of objects, walking and running over rough terrain, and other tasks that require direct interaction with the real world. Animals also move around with an astonishing flexibility and elegance: watching a cheetah running at great speed is an aesthetic pleasure; monkeys climb, swing, and run through the rainforest with uncanny talent, and humans can walk up and down stairs whilst looking around and smoking a cigarette. No robot can even come close to these feats of agility, and building a running robot that can move on uneven ground is still considered one of the great challenges in robotics.

Another issue that has attracted a lot of attention is common sense, because it is fundamental to mastering our everyday lives and crucial for understanding natural language. In the classical approach, common sense has often been viewed as ‘propositional’. This means that the building blocks of common-sense knowledge are thought to be statements - propositions - such as ‘cars cannot become pregnant’ or ‘if you drop a glass it will normally break’. But common sense is also about the implicit knowledge of folk physics that enables even small children to drink from a cup, to walk,

14

or to throw a rock - and this crucial type of common-sense knowledge is clearly not propositional in nature.

In this book we will argue that the notion of intelligence as computation is in many ways misleading. Classical artificial intelligence has been successful at those tasks that humans normally consider difficult - playing chess, proving mathematical theorems, or solving abstract problems. However, many actions we experience as very natural and effortless, such as seeing, walking, riding a bicycle, drinking from a glass, or brushing our teeth have proved notoriously hard. In conclusion, the classical approach is simply of no help in deepening our understanding of many aspects of intelligence. ² 1.5 The Embodied Turn

After these issues became clear, it seemed that the field was in dire need of a paradigm shift. In the mid-1980s Rodney Brooks, director of the MIT Computer Science and Artificial Intelligence Laboratory, suggested that all of this focus on logic, problem solving, and reasoning was misguided. Brooks argued in a series of provocative papers entitled ‘Intelligence Without Representation’ and ‘Intelligence Without Reason’ that intelligence always requires a body: we can only ascribe intelligence to real physical systems whose behaviour can be observed as they interact with the environment. Unlike the classical view of intelligence, which is algorithm-based, the embodied approach envisions the intelligent artefact as more than just a computer program: it must perform tasks and behave intelligently in the real world. This perspective is known as embodiment. ‘The world is its own best model’ was another of Brook’s slogans at the time: why build sophisticated models of the world when you can simply look at it? With this change in focus, the nature of the research questions also started to shift. In the second half of the 1980s Brooks started studying insect-like locomotion, and built, for example, the famous six-legged walking robot ‘Ghengis’. He chose to investigate insects because it took evolution so much longer (about 3 billion years) to move from inorganic matter to insects than it took to get from insects to humans (less than 0.5 billion years). He argued that once we understand insect-level intelligence it would be much easier and faster to understand and build human-level intelligence. Because of this interest in insects, walking and locomotion in general became important research topics. Other research topics included orientation, searching for food, bringing food back to the nest, generally exploring an environment, moving toward a light source, and obstacle avoidance. One might wonder what these simple behaviours have to do with intelligence: we hope to establish the link later in this book. We believe that embodiment is the approach that holds the most promise for our future understanding of intelligence. The perspective of embodiment requires working with real-world physical systems such as robots. This is the synthetic methodology, which is characterized by the slogan ‘understanding by building’. For example, if we are trying to understand human walking, we should build an actual walking robot, as this approach will always yield the most new insights - and if you don’t get it completely right, it simply won’t work. A simulation may be employed, but only if it accurately replicates the actual physical processes of walking. It is easy to ‘cheat’ with simulation: a real-world walking agent has to somehow deal with bumps in the ground, whilst in a simulation this problem can easily be ignored. The synthetic methodology thus contrasts with the more analytical ways of proceeding as in biology, psychology, or neuroscience, where an animal or human is analyzed in detail

15

by performing experiments on it.

Robots differ from computers in that they often have complex sensors that provide rich, continuously changing information about the world, rather than just a keyboard or mouse: they learn about the environment through their own sensory systems as they are interacting with the real world. When designing a robot we must deal with many new issues such as deciding which environments it must function in, the kinds of sensors and actuators to use, the energy supply (a notoriously hard problem), and the materials for construction. The physics of the interaction - the forces that the robot will experiencemust also be considered. Most of these considerations are normally not associated with the notion of intelligence, and so the nature of the field changed dramatically when embodiment entered the picture. Researchers following the embodied approach began to move away from computer science and into robotics, engineering, and biology labs. 1.6 The Role of Neuroscience

In the early 1980s a new discipline arose called connectionism, which tries to model cognitive phenomena with artificial neural networks - collections of virtual models of neurons that are connected to each other in large networks, functioning in a massively parallel fashion. Although they had been around since the 1950s, neural networks only started to really take off in the 1980s when artificial intelligence was in a deep crisis and desperately looking for a way out. Because they are inspired by the brain, researchers were hoping that neural networks would be better at describing mental phenomena. Although neural networks relate to brain activity only at a very abstract level and neglect many essential properties of biological neurons, they demonstrate impressive performance and can achieve, for example, difficult classification and pattern-recognition tasks, like deciding from an X-ray image whether some tissue contains a cancerous tumor or not, or distinguishing bags containing plastic explosives from innocuous ones at airports.

In the field of cognitive psychology, artificial neural networks became very popular for modelling a variety of abilities such as perception (e.g. recognizing different types of objects), language learning and memory. An exciting new discipline called connectionist psychology emerged as a result. Massively parallel neural networks have highly desirable properties: just like natural brains they can adapt and learn, they are noise and fault tolerant, i.e. they continue to function even when partially damaged (such as after drinking too much), and they can generalize, meaning they continue to work in similar but different situations.

The main problem with this approach, however, was that the networks were not connected to the outside world: they did not collect their own data from the environment. Autonomous agents such as humans or robots, by contrast, have to acquire data in their physical and social interaction with the environment. We can draw inspiration from nature here: biological systems have evolved to cope precisely with these kinds of interactions because during evolution, there was always a complete organism that had to interact and survive in the environment.

Because of this connection to the real world, researchers in embodied artificial intelligence started to cooperate much more closely with neurobiologists. Around the same time a new breed of scientist started to appear: the computational neuroscientists, who developed detailed models of neurons, neural circuits, or specialized collections of

16

neurons in the brain such, as the cerebellum, which plays a key role in motor control. Although their research topics strongly overlap, most computational neuroscientists would not yet consider themselves to be doing research in AI, and computational neuroscience is only just beginning to investigate embodiment. Finally, engineers have started cooperating with neuroscientists to connect electro-mechanical devices directly to neural tissue, as we shall see when we discuss cyborgs in chapter 7. 1.7 Diversification

AI has always been an interdisciplinary field, combining computer science, psychology, linguistics and philosophy. With the embodied approach, it has become even more so: now engineering, robotics, biology, biomechanics (the study of how humans and other animals move), material science, neuroscience, and sport science (a discipline aimed at using scientific methods to improve sporting performance in humans) have become part of the game. As we shall see, there has been a shift of interest from high-level processesas studied in psychology and linguistics - to more low-level sensory-motor processes. As the disciplines participating in AI have changed, the terms for describing the research areas have also shifted: researchers using the embodied approach no longer refer to themselves as doing artificial intelligence but rather robotics, engineering of adaptive systems, dynamic locomotion, or bio-inspired technology. Likewise, scientists who have their origins in other fields have started to play an important role in the study of intelligence: computational neuroscience is a case in point. So on the one hand the field of artificial intelligence has significantly expanded, while on the other its boundaries have become even fuzzier than they were before. Diversification has resulted in a number of interesting developments, including the appearance of the fields of biorobotics, developmental robotics, evolutionary robotics, artificial life, brain-machine interface technology, and multi-agent systems: we will look into all these areas briefly throughout this book. 1.8 New Approaches in Robotics

Biorobotics is the branch of robotics dedicated to building robots that mimic the behaviours of specific biological organisms. There are a great many examples of successful biorobotics projects that have contributed to our understanding of locomotion and orientation behaviour. A good illustration of bio-robotics is the work done by the mathematician and engineer Dimitri Lambrinos while he was working at the AI Lab at the University of Zurich. In cooperation with the world leader of ant navigation research, Ruediger Wehner, also of the University of Zurich, he built a series of robots called the Sahabots (short for Sahara robot) that mimic behaviours of the desert ant Cataglyphis that lives in a flat, sandy saltpan in southern Tunisia.

The challenge they faced was to create mechanisms that could, in principle, on a robot, reproduce the navigation behaviour of these desert ants. One such mechanism, the ‘snapshot model’, was originally postulated by British insect biologist Tom Collett of Sussex University. In this model, when the ant leaves the nest it takes a snapshot, a picture of the horizon as seen from the nest, which is stored in the ant’s brain. The ant then goes out searching for food, travelling sometimes up to 200 meters away from the nest. It later returns to the vicinity of the nest using another navigation system based on

17

an estimation of the distance and direction to the nest with polarized sunlight. Because this long-term navigation system is inaccurate, when the ant gets near the nest the snapshot method takes over and guides it very precisely to the nest entrance. This model, which has been verified many experiments with real ants, has also been tested on robots in the Sahara desert where the ants live with impressive success. This shows that in principle such a mechanism could work and hence that, contrary to widespread assumption, agents do not need maps or internal models of the environment in order to navigate successfully.

Toward the mid-1990s Brooks argued that we had now achieved insect-level intelligence in robots and we should move ahead toward new frontiers. However, insects can do things like manipulating objects with their legs and mouth, navigating different kinds of environments (even in the desert!), building complex housing, jointly carrying large heavy objects, developing highly organized social structures, and reproducing and caring for their offspring: many of these abilities are far from being realized in robotic systems. Nevertheless, in the early 1990s Brooks started the ‘Cog’ project for the development of a humanoid robot, with the goal of eventually reaching high-level cognition. This was, in a sense, a return to the goals of traditional artificial intelligence, keeping the lessons learned from biorobotics in mind. The term ‘humanoid robot’ is used for robots that look like humans: they typically have two arms and legs, a torso, a movable head with a vision system, and sometimes hearing and a sense of touch. Because of this people often project humanlike properties onto them: David McFarland described this as ‘Anthropomorphization, the incurable disease!’ This phrase expresses how humans have a strong compulsion for attributing human-like properties to animals (e.g., Disney characters) and also to robots, even though these agents are often too simple for this to be justified. 1.9 Summary of key points

 The field of Artificial intelligence is about understanding biological systems, abstracting principles of intelligent behaviour, and designing and building intelligence artefacts

 The classical approach, based on abstract symbol processing, fails to explain many things about intelligence

 Embodied systems are those that have a physical form and can thus be observed interacting with their environment

 We believe that embodiment is the key to understanding intelligence  The body is not controlled by the brain: instead, behaviour arises by interaction between the two systems

 Is it very important to actually build physical systems (which will usually be robots) to derive and test our ideas: this approach is known as the synthetic methodology

18

 In recent years AI has been transformed from a computational to a multidisciplinary field, involving biology, neuroscience, engineering and robotics

19

2. Prerequisites for a Theory of Intelligence

Figure 2

Time scales and emergence. Three times scales must be taken into account when designing or analyzing an agent: ‘here and now’, ontogenetic (developmental), and evolutionary. Bodies, minds and behaviours emerge through the time scales, as shown. The principles governing behaviour are different for the different time scales.

In the following chapters we will take the first steps toward a new theory of intelligence. This chapter will outline what type of theory we are looking for, as well as introducing some key concepts we will need later on, and the next chapter will present the theory itself. Developing a theory of intelligence is a massive endeavor, and many great minds have tried their luck at it - such as the American psychologist and philosopher William James, the Austrian psychologist Sigmund Freud, the British psychologist Charles Spearman, the American psychologists Robert Sternberg (‘Triarchic Theory of Intelligence’), Howard Gardener (‘Theory of Multiple Intelligences’) and John Anderson (‘The Architecture of Cognition’), the Artificial Intelligence researchers Marvin Minsky (‘The Society of Mind’) and Allen Newell (‘Unified Theories of Cognition’), and the linguist and psychologist Steven Pinker (‘How the Mind Works’). Despite all of these distinguished efforts, we feel that we can make a valuable contribution because our ideas have grown from a perspective of embodiment and the synthetic methodology, which is mostly absent from previous attempts.

20

2.1 Form of the Theory

A theory of intelligence should capture our understanding of the field in a compact way, so that the insights can be applied to many different problems and be widely communicated. We want our theory to characterize not only ants and rats, but also humans, robots, and perhaps other kinds of artifacts such as mobile phones, intelligent cars, and wired T-shirts. Because our theory will be so broad we cannot expect to derive specific models or designs from it, but it should provide us with general guidelines on how to proceed. One aspect of these guidelines will be their use of the theory of ‘nonlinear dynamical systems’ as a metaphor. A dynamical system in the real world is one that changes over time according to certain laws: examples include the stock market, the weather, a swinging pendulum, or a society of monkeys. To say that a dynamical system is non-linear means that its future is only predictable on a very short-term basis (weather forecasts are chronically error prone), and also that effects cannot simply be added: take your two favourite songs - by playing them both simultaneously, you don’t get double listening pleasure!

Dynamical systems have generated a lot of hype in the artificial intelligence community as a potential solution for escaping the weaknesses of the cognitivistic approach: at scientific conferences around the world, it has been loudly declaimed from lecterns (if not from the rooftops!) that theories of intelligence (or cognition) will have to be phrased in terms of dynamical systems. A related concept is chaos theory, which is sometimes used synonymously: this discipline achieved cult status in the 1980s and 1990s when professionals from all areas - managers, teachers, journalists, and even politiciansstarted using its terminology. Although this hype has largely faded away, the basic idea is still appealing, and we will make use of concepts from dynamical systems theory as a highly intuitive set of metaphors for thinking about physically embodied agents and groups of agents.

We are looking for a scaffold or structure that will get us somehow the best of all these worlds: the analytic component for understanding natural and artificial agents, the synthetic one for designing and building systems, and the dynamical systems metaphor for developing ideas and getting inspiration about intelligent behaviour in general. We feel that we can combine them all if we formulate the theory as a set of design principles. On the one hand these will represent fundamental ingredients for a general theory of intelligence, and on the other they will provide powerful engineering heuristics for the design of intelligent artifacts. As well as typifying the synthetic methodology of understanding by building and following the engineering flavor of the field, they will also serve to characterize existing natural and artificial systems too. In addition to the design principles, our theory also includes a set of more general concepts and considerations that provide the framework within which design and analysis can take place: these concepts are described in this chapter. The design principles will also be supplemented with further principles relating to evolution, development and collective intelligence in chapters 4, 5 and 6. 2.2 Diversity and Compliance

As mentioned in chapter 1, agents we intuitively consider to be functioning intelligently within an ecological niche usually comply with and exploit the rules of their ecological

21