[CVPR'21 WAD] Keynote - Andrej Karpathy, Tesla
Why Hacker News recommends it
HN commenters cite it in Tesla threads as the primary-source explanation of why Tesla removed radar and how its vision depth estimation works.
What it is
Andrej Karpathy, then Tesla's head of AI, gives a CVPR 2021 workshop keynote on how Autopilot's neural networks work. A large part covers the move to a vision-only stack, including why radar was dropped and how vision produces depth estimates.
Recommended by 4 HN commenters across 3 different months, 2021 to 2023.
What Hacker News said
Strong rec fossuser · 2023-05 · on “Waymo doubles service area in Phoenix Metro”
This talk was worth watching (any Karpathy or Carmack talk is imo): [this video] Specifically this is the relevant part: [this video] They removed radar because it was making things worse.
Recommends simondotau · 2021-07 · on “Tesla’s ‘Full Self-Driving’ Beta Software Used on Public Roads Lacks Safeguards”
If you're interested, Tesla's head of AI recently did a public presentation of their new vision based depth system. It's worth a watch if you find this stuff interesting and enjoy learning about the forefront of technology. [this video] A key takeaway is that they've been running this stack in shadow mode (validating output but not controlling the car) on everyone's Tesla for quite some time. Equivalent to 1000 YEARS worth of real world driving. And from this data they've proven it is now superior to radar in all circumstances.
Recommends ggreer · 2022-05 · on “Tesla FSD Beta almost causes a head-on collision [video]”
Radar has poor resolution, which means it can't always differentiate between an object near the car's path and an object in the car's path. The radar can give false positives when there's a truck on the side of the road or a metal sign on an overpass. Then you have to use the vision cameras to figure out what's really going on. Radar also loses its "lock" sometimes, which can be an issue with cars braking quickly. The radar will say "no obstacles detected" when the car in front of you is slamming on the brakes. Again, you have to use the vision cameras to figure out what's actually going on. The people at Tesla decided that the radar was creating more noise than it was helping with, so they
Recommends JoshCole · 2022-05 · on “Tesla FSD Beta almost causes a head-on collision [video]”
> These are the same things that can cause a traffic accident for a human with human eyes, so there's really no logical reason to assume that you can create a more performing and safer computer driver by emulating human vision only. Okay. This is a concrete claim that I think is falsifiable. I'll give not just one, but multiple arguments. Argument 1: Connect Four, Chess, Checkers, Go, Limit Hold'em, No Limit Hold'em, Poker, DOTA, and Starcraft II are all examples of games in which AI outperforms even the best humans despite having equal sensory access. Driving can be reduced to a problem comparable to playing an imperfect information game and we can play imperfect information games at superh
Cites fossuser · 2021-07 · on “Grand jury indicts Trevor Milton, Nikola founder, on three counts of fraud”
FSD was advertised as paying for something that would come in the future - I bought it under that assumption (and so did everyone I know that has it). That was and remains true. They've continued to make progress towards it: [this video] Autopilot is different and isn't advertised as level 5 - 'autopilot' implies fancy lane keeping not turn by turn point to point autonomy. Elon's FSD timelines were wrong - that isn't fraud. People say everything he's trying to do won't work constantly, just because they're occasionally right doesn't validate all of the times they're wrong (e.g. Model 3 is vaporware will never ship, the company is bankrupt and will close in two weeks, the Model S will never ship,
Cites fossuser · 2021-07 · on “Grand jury indicts Trevor Milton, Nikola founder, on three counts of fraud”
They're not just 'tweaking some settings': [this video] What they have today isn't FSD (which they state explicitly), but I'm happy to give them extra money early given the work they're doing on the chance that it works in the future. I think they have the best chance of success of actually shipping something real.
Cites DeBraid · 2021-08 · on “Why Teslas Keep Striking Parked Firetrucks and Police Cars”
IIRC, in this[1] video Andrej Karpathy mentions radar was mostly redundant, and in addition was occasionally harmful (sending conflicting signals vs. video), so they got rid of it to reduce cost and complexity. [1]: [this video]
Cites ggreer · 2021-10 · on “Tesla is outrunning the supply chain crunch”
No. Newer versions of Tesla's software disable the radar on cars that shipped with it.[1] Vision has gotten so much better (thanks in part to training from radar data) that radar adds noise to their model of the outside world. Andrej Karpathy explained the issues in a talk this summer.[2] 1. [LINK] 2. [this video]