Incident library · Car retail · United States

    Chevrolet of Watsonville: Chatbot taken offline after going viral

    Visitors to a car dealer's website talked its AI chatbot into 'agreeing' to sell a new SUV for $1 and into writing code and recommending a competitor.
    The DecoderDec 2023

    People buy brand-new Chevrolets for $1 from a ChatGPT chatbot

    Chatbot taken offline after going viral

    Reported contributing factor

    The chatbot could be instructed to ignore its rules and make commitments on the dealer's behalf, with nothing limiting what it could say.

    Reported contributing factor

    The reported contributing factor

    The chatbot could be instructed to ignore its rules and make commitments on the dealer's behalf, with nothing limiting what it could say.

    Incidents usually have several contributing factors. This is the one public reporting names; it is not presented as the sole cause.

    Which StackUp assessment checks for this gap

    Find out if your organisation has this gap

    Sources

    Published Dec 2023. Sources last checked Nov 2026. Spotted an error or an update? Tell us and we will correct it.

    • Infosecurity MagazineJun 2025

      M365 Copilot: New Zero-Click AI Flaw Allows Corporate Data Theft

      Critical flaw rated 9.3 out of 10

      Identified in an independent review

      Untrusted content in an email could steer the AI assistant's access to company data, researchers found. Microsoft said no customer data was taken.

    • Silicon UKJan 2024

      DPD Disables AI Chatbot After It Swears At Customer

      AI chatbot switched off

      Stated by the organisation

      After a system update, the chatbot could be talked into ignoring its rules, and the change was not caught before customers saw it, the company said.

    • The RegisterJul 2025

      Destructive AI prompt published in Amazon Q extension

      Compromised AI tool shipped to users

      Stated by the organisation

      An outside contributor's change reached a public release through an over-permissioned build token, and the AI agent could run commands without human confirmation, AWS said.

    Find out which of these gaps you have

    The free Readiness Check takes ten questions and shows the incidents tied to your weakest answers.