In the piece — titled “Can You Fool a Self Driving Car?” — Rober found that a Tesla car on Autopilot was fooled by a Wile E. Coyote-style wall painted to look like the road ahead of it, with the electric vehicle plowing right through it instead of stopping.

The footage was damning enough, with slow-motion clips showing the car not only crashing through the styrofoam wall but also a mannequin of a child. The Tesla was also fooled by simulated rain and fog.

  • comfy@lemmy.ml
    link
    fedilink
    English
    arrow-up
    1
    ·
    14 days ago

    I hope some of you actually skimmed the article and got to the “disengaging” part.

    As Electrek points out, Autopilot has a well-documented tendency to disengage right before a crash. Regulators have previously found that the advanced driver assistance software shuts off a fraction of a second before making impact.

    It’s a highly questionable approach that has raised concerns over Tesla trying to evade guilt by automatically turning off any possibly incriminating driver assistance features before a crash.

    • endeavor@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      13 days ago

      It’s a highly questionable approach that has raised concerns over Tesla trying to evade guilt by automatically turning off any possibly incriminating driver assistance features before a crash.

      That is like writing musk made an awkward, confused gesture during a time a few people might call questionable timing and place.

    • PersnickityPenguin@lemm.ee
      link
      fedilink
      English
      arrow-up
      0
      ·
      13 days ago

      Yeah but that’s milliseconds. Ergo, the crash was already going to happen.

      In any case, the problem with Tesla autopilot is that it doesn’t have radar. It can’t see objects and there have been many instances where a Tesla crashed into a large visible object.

      • sudo@programming.dev
        link
        fedilink
        English
        arrow-up
        0
        arrow-down
        1
        ·
        13 days ago

        That’s what’s confusing me. Rober’s hypothesis is without lidar the Tesla couldn’t detect the wall. But to claim that autopilot shut itself off before impact means that the Tesla detected the wall and decided impact was imminent, which disproves his point.

        If you watch the in car footage, autopilot is on for all of three seconds and by the time its on impact was already going to happen. That said, teslas should have lidar and probably do something other than disengage before hitting the wall but I suspect their cameras were good enough to detect the wall through lack of parallax or something like that.

        • Critical_Thinker@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          ·
          13 days ago

          But to claim that autopilot shut itself off before impact means that the Tesla detected the wall and decided impact was imminent, which disproves his point.

          Completely disagree. You are assuming the same sensors that handle autopilot are the same sensors that disengage it when detecting close proximity. The fact that it happened the instant before he connected kind of shows that at a very close distance something is detecting an impact and cutting it off. If it knew ahead of time it would have stopped well ahead of time.

          The original goal also wasn’t to uncover this, it was just to compare it to lidar per the article. I’m guessing we’re going to see a ton more things pop up testing this claim, and we’re likely to see tesla push an OTA update that changes the behavior so that people can’t easily reproduce it.

    • LemmyFeed@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      0
      ·
      14 days ago

      Don’t get me wrong, autopilot turning itself off right before a crash is sus and I wouldn’t put it past Tesla to do something like that (I mean come on, why don’t they use lidar) but maybe it’s so the car doesn’t try to power the wheels or something after impact which could potentially worsen the event.

      On the other hand, they’re POS cars and the autopilot probably just shuts off cause of poor assembly, standards, and design resulting from cutting corners.

      • T156@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        14 days ago

        Rober seems to think so, since he says in the video that it’s likely disengaging because the parking sensors detect that it’s parked because of the object in front, and it shuts off the cruise control.

      • skuzz@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        1
        ·
        14 days ago

        Normal cars do whatever is in their power to cease movement while facing upright. In a wreck, the safest state for a car is to cease moving.

      • FiskFisk33@startrek.website
        link
        fedilink
        English
        arrow-up
        1
        ·
        13 days ago

        if it can actually sense a crash is imminent, why wouldn’t it be programmed to slam the brakes instead of just turning off?

        Do they have a problem with false positives?