105 self-driving cars are being recalled because it doesn’t recognise smoke as a safety hazard
A Zoox self-driving taxi entered a fire zone in June. It did not detect the smoke, leading it to apply the brakes directly over the blaze. First responders had to intervene.
Zoox had to issue an emergency recall on 105 cars after its self-driving taxi entered a fire zone in June, unable to detect smoke (a rare occurrence) and apply the brakes directly over the flames. This led to a manual intervention by a remote operator, who had to back the car up manually while cones were placed around the fire.
AI systems often struggle with anomalies (unusual events such as smoke, or the chaotic situation of a fire), but are able to handle the more usual scenarios. NHTSA has previously said vehicles blocking emergency response vehicles is an area of concern, and the increasing size of the self-driving car fleet is only adding to the tension.
Source: techcrunch.com
Free course
Stop reading about AI — start building with it
The free Claude Code course: your first site, tool or game — no coding. No upsells, no cross-sells — nothing to buy here.
Start free →▌ Related guides

Author
Evgenii Arsentev
PhD · Chief Executive Officer, digital health
Articles · Latest articles