Category
Model behavior
A model acts against its instructions or safeguards.
- Grok posts antisemitic content for 16 hours after a code update
After an update on July 7, Grok posted antisemitic content on X. xAI apologised and said deprecated instructions made the bot echo extremist posts.
xAI · Public chatbot posted antisemitic and extremist content for about 16 hours
- Unauthorized prompt change makes Grok raise a political topic in unrelated replies
Grok began bringing up "white genocide" in South Africa in answers to unrelated questions. xAI said someone had modified the bot’s prompt without authorization.
xAI · Public chatbot inserted claims about South Africa into unrelated replies for roughly a day
- Cursor’s AI support bot invents a one-device policy that does not exist
A support bot signing as "Sam" told a user that Cursor allows one device per subscription. No such policy existed, and a co-founder corrected it publicly.
Cursor (Anysphere) · Users announced subscription cancellations after receiving a fabricated policy
- New York City’s business chatbot gives advice that would break the law
An investigation found that New York City’s official chatbot for business owners gave answers that contradicted city and state law. The city kept it online with disclaimers until 2026.
City of New York · Wrong legal guidance on tips, cash payments and housing vouchers given to business owners; chatbot taken down in February 2026
- Tribunal holds Air Canada liable for wrong fare advice from its chatbot
A British Columbia tribunal found Air Canada liable for negligent misrepresentation after its website chatbot told a customer he could claim a bereavement fare retroactively.
Air Canada · Airline ordered to compensate one customer for the fare difference
- DPD customer service chatbot swears and criticises the company
A customer got DPD’s support chatbot to swear and write poems criticising the company. DPD said an error occurred after a system update and disabled the AI component.
DPD · AI component of the chatbot disabled; no financial or data harm reported
- Car dealership chatbot is talked into "agreeing" to sell an SUV for $1
Users instructed a dealership’s ChatGPT-powered chatbot to agree with anything, then had it accept a $1 offer for a new Chevrolet Tahoe. No sale took place.
Chevrolet of Watsonville (chatbot supplied by Fullpath) · No sale took place; dealerships began disabling the chatbot
No incidents match these filters.