VentureBeat: AI feels like it’s a new arms race going on right now, a fresh time of competition.
Keller: It’s fresh in the sense that a set of algorithms started really successfully solving these problems that have pretty general applicability. That’s the fascinating part. I know just enough about AI to know that — how does a neural network project information across these complex information plans, and how do we compute that? It’s an interesting problem set, and it turns out to be computationally intensive.
The style of that computation is a little different from the classic scalar computing or vector computing or graphics computing we were doing. It’s different enough. The application is broad. And of course there’s a little hype to make everything more exciting. Whenever there’s a change like this, especially when it’s visible from hardware all the way up to top-level software stacks, then a lot of people get engaged in that. Obviously Intel has been super engaged in that for a while. Most AI cycles still run on Intel. We’re making pretty big performance improvements on both the software and the hardware. That’s a super interesting problem.
VentureBeat: When you were outside of Intel, what did you think of Intel and what they needed?
Keller: I’d say it’s a little different. I’ve known Intel as a company, as a competitor and as a supplier, for a long time. I was curious to find out what the culture would be like. I have to admit, I’ve been in enough different companies that I try not to come in with too many preconceived notions about how things work, because everybody’s different.
The reason I came here is less to figure out what they needed or supply some ingredient than to participate in the coming computing change at the scale that Intel can do that. We all know the computing world is changing. It’s broadened out. The old mainframes disappeared. Then there were minicomputers, and then PCs and PC servers. Now we’ve gone up to real cloud computing. How long did cloud computing take to really happen? I still remember when IBM came out with the Grid. They didn’t know how to build it or sell it. That transformation took 20 years.
The mobile transformation is working its way through the whole ecosystem. The internet was super wild. AI is a similar scale. I’d say I came here to participate in that next wave of computing. But it wasn’t as if I thought Intel didn’t get it or something like that.
VentureBeat: It could be decades for this to play out as well, on the AI side?
Keller: Yeah, it’s definitely a big one. You can see it when you start seeing people coming out college writing completely different languages than they did four years ago. It’s the wave that’s going to roll through the computing world. AI and neural networks are upending science in a lot of ways. It’s going to be really interesting.
VentureBeat: Intel has a lot of resources now. You’ve been at other big companies, but maybe this is the biggest?
Keller: Yeah, Intel definitely has a lot of engineers. There’s no doubt about it. I quite like the culture. They have a culture of technical excellence and collaboration that’s kind of mind-boggling. I’ve been to lots of meetings where you want to work on a problem and you say, “Let’s get the experts together.” And then 50 people show up and they’re all pretty good. That’s fun.
VentureBeat: They could make you CEO.
Keller: [laughs] I doubt it! There are lots of other smart people here. I’m on the management committee. That staff is pretty good. It’s not as if any one person really sticks out.
VentureBeat: There are other things that could be done [at Intel]. It seems like a ground-up x86 might be a good idea, as well as all the work being done on AI chips. I don’t suppose you can share an opinion on that.
Keller: We have a great big Core line, and that’s pretty differentiated as far as performance and frequency. There’s a whole lot of innovation around data types and application sets that I think is interesting. The team building Atom for the smaller, compact core — I’ve been crawling through exactly where they’re at, and they’ve taken some big steps in recent years.
I don’t know that I look at it and think, “I need a from-scratch x86 core.” There’s a lot of methodology changes that are rolling through the industry as CAD development moves forward. I see it as there’s some methodology stuff that’s interesting to work on, and then there’s the application of some of the processors to new problems that’s interesting. And then whether we do a new core or rewrite something is more of a tactic than a strategy.
Strategically, how to execute what you want when you want — the methodology problem is the first order, and then what problems we solve, that’s shifting over time. The Intel guys already have a couple of pretty cool changes in the pipeline. As we evaluate all the different applications and what the customers are interested in, more things will come up.
VentureBeat: Are you hopeful about chip design in general, that it can still accomplish great things? There are always a lot of stories about Moore’s law coming to an end.
Keller: Yeah, of course. I was at an AI conference and someone asked me, “Is Moore’s law going to end?” They had all these reasons why it was going to end. I said, “I’ve been doing this for 35 years. Moore’s law has been coming to an end in the next five or 10 years that entire time.” I’ve decided not to believe that for the rest of my life. I’m not worried about Moore’s law.
It’s interesting to look back on what happened with silicon, when you go through these challenges. We didn’t really see planarized metal coming. But that really solved a big problem. Copper solved a big problem. Low-k dielectrics solved a big problem. Bigger radicals, 12-inch wafers — current fabs are built in sealed boxes, which is super cool, because then the clean room spec is way lower. Now EUV is coming up. FinFET transistors.
Intel has been a leader on quite a few of the big Moore’s law-level innovations. People say, “What’s happening? We’re running out of gas,” and we say, “Well, you have about a million people working every day who all believe in Moore’s law. They’re all collectively driving this, whether it’s lithography or chemistry or designs or metallurgy or packaging.” It’s a pretty broad palette of changes.
I’m not worried about Moore’s law. It’s gonna keep trucking. It’ll be bumpy. There will be years where a couple of clicks happen pretty smoothly and there will be other times when it’s a little more friction.
VentureBeat: I’ve mentioned that one of the fun things about chip design is that it’s not like designing car engines. You’re able to make a big difference sometimes.
Keller: Well, car engines have gotten a lot more efficient. The technology to design them and analyze them is super interesting. Of course, electric cars are going to make internal combustion engines obsolete, so that’s a different area.
Chip design is funny, because parts of it look just like what I did 30 years ago. And part of it is hilariously different. The first branch predictor I did was two kilobits of SRAM, and now, I don’t know, it’s 10 or 100 megabits. The scale of things changes radically. The number of transistors in a modern core is as many transistors as used to be in entire supercomputing centers. The scale difference is wild.
VentureBeat: Sometimes I like metaphors and their ability to explain things about chip design. Is there anything about where chips are now that lend themselves to a good metaphor that can help people understand something?
Keller: I don’t know. I’m looking for a metaphor. My motto has been bigger, better, faster, and smaller for the entire time.
VentureBeat: I think I remember something about doing your laundry in a washer and a dryer, and then each step that you take is a different part of the processing that happens.
Keller: Did I say that, or was that somebody else?
VentureBeat: I think I heard it at a chip conference a long time ago. It was an interesting notion about pipelines of chips. But sometimes that’s helpful to people in understanding things that have become so complex that they’re incomprehensible if you’re not involved in it.
Keller: Here’s the thing. Humans’ ability to understand things isn’t getting a lot deeper. So how do we make more complicated things? The most important thing is to build the abstraction layers at the right level. Over the years of computer design — you remember there was a debate about the wide person versus the deep, narrow person. Modern computer designers, we’re mostly specialists. For a while somebody could do the architecture, verification, physical design, and we called them a wide person. For the most part, on processor designs, people are specialists. We’ve cut the problem down that way.
Instead of building computers out of transistors, we have the transistor guys building transistors. The library guys make things like flip-flops and logic blocks. We have functional units. We build abstraction layers in both the technical skill level you’re operating at, and also at the design level. The big chips are parallel instances of lots of similar units. If you crawl through a computer, the number of devices is unimaginable. The state space the computer can exist in, with all the different programs running, is more complicated. But the actual span and scope of an engineer’s work — you keep re-factoring the different pieces of it in a way that people can have jobs that are interesting and challenging, but not so stressful that it’s impossible to get it done.
Modern computer designs are more complicated now than they were in the ’80s, but they’re way more predictable. There’s a certain grown-upness to the industry about how to go and build a project. That’s taken quite a while. There’s a craftsmanship to a lot of the steps. There’s art in the choices and art at the edges of new technology, but the actual building of the parts, it’s a craft with experienced practitioners. That dynamic is super interesting, if you’re a philosopher.
VentureBeat: As an architect, are you at the top of the pyramid, of those layers of abstraction? Are there fewer people doing what you do, and then further down there’s a lot more people?
Keller: I try to look across a lot of stuff, and what I see is that there are a lot of expertise domains where the experts there know more about it than I do. I’ve become a kind of generalist. If you thought of it as, there’s a pretty complex array of expertise that’s very deep — it’s not that hierarchical. There are independent things. There are software experts and floating point experts and memory architecture experts and branch predictor experts. They’re arrayed together and then we use some combination of organizational, tribal knowledge, and expertise to put that together.
I’ve had a long enough career and enough opportunities, I’m an expert in enough different areas, that I can sit down and talk turkey with people at a lot of different levels. But it doesn’t feel that hierarchical. There are hierarchical teams in terms of executing. We’re going to build this client part with these IPs and there’s a VP with a staff that goes and does that. But if you get into the technical level, you’ll find a fairly broad collaborative environment. Again, that dynamic is pretty interesting. Intel is quite well-organized that way.
VentureBeat: Does it feel like you’re designing the atomic bomb sometimes, when you’re in charge of organizing all this stuff, like the people who ran the Manhattan Project?
Keller: I don’t know. I used to joke — when I was at Digital we did very custom circuit design, and it was like building a wall. You start laying the bricks down, and then about halfway up you realize you want to change one of the bottom bricks. I felt more like a construction guy than an atomic bomb designer.
The scale of Intel is interesting because of all the different products and the talent and the people. But the technology is in so many real-world places — it doesn’t feel like atomic bomb technology. It feels more like a few thousand people working hard to build computers to make the world a better place. That seems pretty cool.
VentureBeat: Looking from the outside, I think we all expect some strategically important things to come from you.
Keller: [laughs] Well, we’ll see. I get involved in stuff, and at some point you look back and think, “Wow, that was a big move.” But while I’m doing it, it just seems like the next thing to do. The Apple story was just, “Let’s make the best possible phone chips we can.” That seemed great. Here we’re going to make the best possible server, the best possible client. We’re going to build great graphics. We’re participating heavily in the AI revolution. There’s a bunch of interesting problems there. We’re going to do some interesting stuff in that space.
The system architecture is really interesting, especially at Intel. We play in so many different components. We can architect across those boundaries without being beholden to somebody else’s problem or solution. And then at some point we’ll look back and say, “Hey, that was really interesting.” But to be honest, every single day we’re just coming into work and talking about stuff. My wife jokes that I’ve been drawing the same black diagram in my notebook for 30 years. She can’t tell the difference. Just two boxes with an arrow between them.
How startups are scaling communication: The pandemic is making startups take a close look at ramping up their communication solutions. Learn how