Rod Brooks and Gary Marcus are, simultaneously, two of the progenitors of modern artificial intelligence and robotics and also among their fields鈥� most persistent critics. Brooks, the cofounder of iRobot and Rethink Robotics, and a former director of MIT鈥檚 Computer Science and Artificial Intelligence Laboratory (CSAIL), has for years stressed the limitations of what robots can do. For all the advances of AI, he that we will need new ideas if we hope to build robots or self-driving cars that navigate the built, human world without our help. Gary Marcus, a professor of cognitive science at New York University and the founder of Geometric Intelligence, which was acquired by Uber, also modern AI 鈥渕ust be supplemented by other techniques if we are to reach artificial general intelligence.鈥� Recently, the two heretics decided to solve the problems that so occupy their imaginations by founding a company, , that will build brains for practical robots. Jason Pontin, 蘑菇视频APP鈥檚 senior advisor, met with Brooks and Marcus in Palo Alto at , the investment firm that is incubating the startup.
A Conversation with Rodney Brooks and Gary Marcus
Jason Pontin: The current boom in artificial intelligence is the result of the remarkable success of a particular technology. What was it, when was it invented, and why has it exploded?
Gary Marcus: The technique is called deep learning. The concept has been around, although not under that name, since the '40s. The basic idea is . How it works is this: A so-called neural network is fed examples of something, those examples are matched to labels that the net has been trained upon, and the procedure repeatedly adjusts the weights of the connections in the network to minimize the difference between the actual output of the net and the desired output: a procedure called . Today, the network has what we call hidden layers鈥攈ence, 鈥渄eep learning鈥濃�攊n between the input and the output layers, which over time get better and better as they are reweighted.
People have been doing this鈥攐r, trying to do this鈥攆or a long time. The main piece of mathematics was developed in the 1960s and '70s and rediscovered in the '80s, but it didn鈥檛 really work well until we had a lot of data and could do a lot of computation really fast. Some people had the intuition in the 鈥�80s that deep learning would be a breakthrough. They couldn鈥檛 prove their case because they didn鈥檛 have enough data and they didn鈥檛 really have fast enough computers. But around 2012 people started using GPUs鈥攇raphics processing units鈥攖hat had been designed for video games, and at the same time data had become cheaper and more available. Smart people figured out how to apply deep learning to artificial intelligence problems.
It was possible for computers to recognize images on Image Net鈥攔oughly a million labels for particular pictures that a lot of researchers used鈥攚ith unprecedented accuracy. With enough data and computing power, deep learning was fast and worked really well for a certain set of problems. Some people insist it works for all problems. That鈥檚 not really the case. But it鈥檚 great for labeling pictures and recognizing the syllables in people鈥檚 sentences, such that you can decode their speech.
"People can rationalize what鈥檚 going on in their thought processes. Deep learning can鈥檛: These systems have no idea how they鈥檙e thinking or how they鈥檙e categorizing themselves."
JP: In the real world of business applications and consumer technologies, what can I do with pattern recognition?
GM: The most common everyday use is for speech recognition. So if you talk to Alexa or Google at Home, you鈥檙e using deep learning; if you have your pictures automatically labeled in something like Google Photos, then you鈥檙e using it, too. People are also using it to some degree and with some success鈥攂ut not complete success鈥攊n driverless cars. People are applying it to all kinds of creative things like colorizing old movies. It has many applications, including in scientific research鈥攂ut it also has many limitations. And the limitations are not always covered enough in the media.
JP: Rod, what are those limitations? What can鈥檛 deep learning do well and why?
Rodney Brooks: At first, it was thought these machine learning systems were deeply mathematical, but more recently people have shown that the algorithms self-driving cars use will perceive a stop sign with a few pieces of electrical tape at critical positions on it as a 45-mile-an hour speed limit sign. To a human it looks like a stop sign with some pieces of electrical tape on it. So this is a little frightening: These deep learning algorithms are not as robust as we might hope.
JP: Are these neural networks so brittle because deep learning has no real understanding?
RB: Deep learning systems do not understand in the same way that we understand. People say to me, 鈥淲ell, how can AI see a stop sign as a 45-mile-an-hour sign, because stop signs are red and 45-mile-an-hour speed-limit signs are white. How could it possibly be that way?鈥� Well, it turns out that red is not really red. In different lighting, the colors of the pixels that are in our eyes are not the same that we label as colors. We do all sorts of things to compensate for variations in lighting. These algorithms are just trained with photos. They haven鈥檛 built what鈥檚 called color constancy, which is fundamental to how we perceive colors. So they just don鈥檛 do the same sorts of things that humans do with their vision. The human world is designed implicitly for human visual systems to work well.
JP: Gary, in addition to being brittle, you鈥檝e said these deep learning systems are 鈥済reedy.鈥� What do you mean by that?
GM: Deep learning needs a lot of data to work properly. So if you have millions of observations of something that doesn鈥檛 change very often, then deep learning can be a great tool for that. If you have a dozen observations of something that鈥檚 changing over time, they don鈥檛 work very well. So they鈥檙e 鈥済reedy鈥� in the sense that they work best if they have tons and tons of data. This is a problem that people recognize in the field but don鈥檛 always talk about. Sometimes you can get the data that you need to make greedy learning work and sometimes you can鈥檛. So, for example, if you want to translate English and French, you can get a huge database from the Canadian parliament of English and French set up in parallel; you鈥檝e got the data that you need. But if you want to translate English into Swahili and you don鈥檛 have that database, then your translation technique doesn鈥檛 work anymore.
JP: As well as being brittle and greedy, in what sense is deep learning 鈥渙paque鈥� and 鈥渟hallow鈥�?
RB: Well, 鈥渙paque鈥� in this sense: meaning there鈥檚 no explanation for a conclusion or a decision. People can rationalize what鈥檚 going on in their thought processes. Deep learning can鈥檛: These systems have no idea how they鈥檙e thinking or how they鈥檙e categorizing themselves. And 鈥渟hallow鈥� because they鈥檙e called deep networks, but that word 鈥渄eep鈥� actually comes from the number of layers that are employed. Remember we used to only have three layers in the networks in the 鈥�80s and then we got to a dozen, and now sometimes it鈥檚 100 layers, or more. People misunderstand that when they hear 鈥渄eep learning,鈥� they think it's deep thought, but in fact it鈥檚 very shallow.
GM: It鈥檚 kind of like the difference between causation and correlation. Deep learning is essentially learning a sophisticated version of correlation. You can have correlation without understanding why two things are related. So deep learning is actually shallow in the sense that it鈥檚 just saying statistically this thing and that thing tend to co-occur, but it doesn鈥檛 mean that the system understands why they co-occur. So if the circumstances change, then those statistics are no longer a very good guide. The system doesn鈥檛 understand what some problem is about.
Remember ? It looks like it can play Breakout, and it does play a very good game of Breakout, but it doesn鈥檛 really understand what a paddle is or what a ball is, or what a set of bricks are. That would be a deep understanding. It just understands these particular statistics. Now if you disrupt that and you move the paddle up a few pixels then the whole system falls apart because what it has learned is so shallow.
"True intelligence is being able to approach a new problem you haven鈥檛 had a lot of direct experience with. A human being can play a game that they鈥檝e never played before and in a matter of minutes figure out something about what鈥檚 going on. Machines still can鈥檛 do that."
JP: Because the system has no common sense understanding of the rules at all? Why has hype so overwhelmed reality? You both make it sound as if 鈥渁rtificial intelligence鈥� itself is misapplied to what deep learning is doing.
GM: Deep learning is a tool that you could use in artificial intelligence, but it鈥檚 not really that intelligent. I think in a lot of fields there鈥檚 a kind of 鈥渟ilver bullet-itis,鈥� where people are looking for one ring to rule them all. In psychology, which is my native discipline, for example, before I was born, we had [B.F.] Skinner and behaviorism; people were looking for one magical equation that would describe all of behavior. Of course that fell apart. People don鈥檛 really think you can capture human behavior that way any longer. But in artificial intelligence right now, they鈥檙e trying to have one set of equations, basically back propagation, about how you tune these neural networks over time, and are trying to use that tool over and over again to do everything. It鈥檚 seductive, and it often works a little bit. It鈥檚 not that hard to get it to work a little bit, and it鈥檚 so much harder to solve problems in a proper way. More people should want to do that. It鈥檚 like the [Bertrand] Russell quote about theft and honest toil. [Editor鈥檚 note: Russell once , 鈥淭he method of 鈥榩ostulating鈥� what we want has many advantages; they are the same as the advantages of theft over honest toil.鈥漖
RB: And it鈥檚 undeniable that deep learning systems are able to do things we didn鈥檛 think we could do 10 years ago. The speech understanding that Amazon Echo, Alexa, or Google at Home display is actually quite a big jump from what we had before. So people see that and then they make the inference that it鈥檚 just going to keep getting better and better exponentially, which is what happened with Moore鈥檚 Law for 50 years. But these sorts of technologies don鈥檛 just get better by themselves. You need new conceptual understandings to get the next improvement. And they鈥檙e very unpredictable, and they only come along every few decades.
GM: Some progress has been genuinely exponential, and [Ray] on those, but in other areas of artificial intelligence we鈥檝e seen more linear progress, or no progress at all. True intelligence is being able to approach a new problem you haven鈥檛 had a lot of direct experience with. A human being can play a game that they鈥檝e never played before and in a matter of minutes figure out something about what鈥檚 going on. Machines still can鈥檛 do that. With the problem of natural language understanding, we鈥檝e had some improvement: Alexa can understand the basic request, but we don鈥檛 have a system that can understand a conversation like the three of us are having right now. We鈥檙e no closer on that, I would argue, in 2019 than we were in 1959.
Story By
If you see an error in this story, contact us.
