Jim Keller - Moore's Law in the age of AI Chips

Matroid · 33K views · 2020 · 31:06

Open on YouTube

Computer architecture & CPUsMachine learning & deep learningTech pioneers & interviewstalk

Why Hacker News recommends it

Cited in hardware threads as a Keller talk on the different ways of doing parallel processing.

What it is

Jim Keller's talk at the 2020 Scaled Machine Learning conference on Moore's Law in the age of AI chips. He compares scalar, vector and GPU-style parallel approaches to computation.

Recommended by 1 HN commenters across 1 different months, 2020 to 2020.

What Hacker News said

Recommends tails4e · 2020-07 · on “Linus Torvalds on AVX512”

Jim Keller had an interesting talk recently [1] about ways of doing parallel processing to better us the billions of transistors we have - assuming the task is parallelizable. There's the scalar core (i.e the basic CPU) which is easy to program realtively. Then a scalar core with vector instructions - difficult to program efficiently. Then there are arrays of scalar cores, i.e. GPUs, so relatively easy to program again, and now a lot of startups with arrays of scalar cores each with vector engines, so expected to be most difficult to program. He didn't go into why vector instructions are hard to use efficiently, and hard for compiler writers, but I'd be interested if anyone here could explai

Cites CalChris · 2020-06 · on “Jim Keller to Depart Intel”

Jim Keller giving a talk on Moore's Law at Berkeley, [LINK] And another [this video] And another [LINK] DEC, PA Semi, Apple, AMD, Tesla, Intel. He's been everywhere. [LINK] The internal announcement memo: [LINK]

Cites cepth · 2020-06 · on “Jim Keller Resigns from Intel, Effective Immediately”

What makes this more bizarre than Keller’s typical short stints at previous companies is that he has done a ton of media in the last year. He’s probably given more time to journalists/interviewers in 2020 than in the previous 3 decades of his career combined. A Fortune piece from May of this year gave some insights into his plans (as well as provided a nice overview of his career) ( [LINK] ). > Keller won’t talk much about the massive chip redesign he’s overseeing—chip designers seldom do—and Intel’s new chip probably won’t be ready for another year or two. Still, both Intel and Keller have scattered some clues about how the chips might work. The new chips will cleanly separate major functio

Cites metrognome · 2020-12 · on “Cameras and Lenses”

The pattern of holes technique in that link (MURA) is also used in UV lithography for IC fabrication (example: [this video] ).