Tesla crashes into concrete barrier....ON AUTO PILOT!

What Hacker News said

Cites dahart · 2017-08 · on “How I implemented my own crypto”

I agree crypto is actually hard. But there are lots of domains where details matter and small errors have big consequences. Vehicles, medicine, and manufacturing are all places where errors have killed people. Obviously severity depends on the situation, but generally speaking I'd rather my encryption get broken than die. Software defects in the Therac-25 radiation therapy machine killed several people [1]. Software defects in Toyota's acceleration killed 37 people [2]. "We've demonstrated how as little as a single bit flip can cause the driver to lose control of the engine speed in real cars due to software malfunction that is not reliably detected by any fail-safe," Michael Barr, CTO and c

Critical Animats · 2017-08 · on “Toyota Research Institute head says full autonomous driving is “not even close””

That being said, Toyota's (and Subaru's) approach is the smart way forward - add sensors and capabilities that augment the human, but leave the human always responsible and in control. In order for a crash to happen, the human AND the machine BOTH have to miss it. That's the approach we know won't work. That was Tesla's first-round autopilot, the self-crashing car. The one that would happily run into obstacles protruding into a lane.[1][2][3] There are two big flaws with that approach. First, if it's good enough that people can tune out, they will tune out. Second, if the driver waits until the self-driving system has clearly made a mistake before taking over, they will be slower at reacting

Critical Animats · 2018-04 · on “Tesla issues strongest statement yet blaming driver for deadly crash”

Tesla's system demands more from drivers than manual driving. The driver has to detect automation failures after they occur, but before a crash. This requires faster reaction time than merely avoiding obstacles. Here's a good example - a Tesla on autopilot crashing into a temporary road barrier which required a lane change.[1] This is a view from the dashcam of the vehicle behind the Tesla. At 00:21, things look normal. At 00:22, the Tesla should just be starting to turn to follow the lane and avoid the barrier, but it isn't. By 00:23, it's hit the wall. By the time the driver could have detected that failure, it was too late. Big, solid, obvious orange obstacle. Freeway on a clear day. Tesl

Critical MertsA · 2019-03 · on “After 6 months of working fine, Tesla software update drives at barriers again”

Here's autopilot swerving into oncoming traffic. [LINK] Here's autopilot following a lane straight into a concrete barrier. [this video] You can't assume that autopilot won't screw up lane following and swerve into a large obstacle. In those situations it's not as simple as making sure the lane ahead of you is clear, you might only have a split second warning between Autopilot going into "casual murder mode" and a collision.

Critical StreamBright · 2019-04 · on “Ford CEO says the company 'overestimated' self-driving cars”

He is lucky if we have self driving cars by the end of the next decade. I am sorry but false positive and false negative situations are not ok when it comes to self driving cars and most if not all solution exist today are based on technologies that produce false positives and negatives. [LINK] [this video]

Critical Animats · 2019-04 · on “AI Podcast: Elon Musk on Tesla Autopilot [video]”

I'll be shocked if it's not next year at the latest that having having a human intervene will decrease safety (22:32) For certain interpretations of "intervene", that's true now. See this video of a Tesla hitting a construction barrier.[1] This is a dashcam view from a car behind the Tesla. At 00:21, it's too early for the vehicle to start turning, and at 00:22, the vehicle has already hit the barrier. The driver has to detect the failure and then take over. Much of the driver's allowed reaction time is taken up by having to wait until it's almost too late. Control handoff inherently implies a slower reaction time than manual driving. (Not noticing the lane change warning and orange construc

Critical Animats · 2019-08 · on “Contrary to Musk's claim, Lidar has some advantages in Self Driving technology”

So far, most manufacturers cars have no problem with this. Not Tesla. Tesla hitting construction barricade.[1] Tesla hitting freeway offramp divider.[2] [1] [this video] [2] [LINK]

Critical michaelt · 2020-02 · on “Apple engineer killed in Tesla crash had previously complained about autopilot”

LIDAR would have picked that up dead easily. Just like LIDAR would have picked up [LINK] And just like LIDAR would have picked up [this video] And just like LIDAR would have picked up [LINK] And just like LIDAR would have picked up [LINK] These accidents are 100% due to the decision to use a janky vision system to avoid spending $2000 on lidar; and that janky vision system failing.