Anthropic's Claude AI submitted false murder tip to Philadelphia police
An Anthropic AI model submitted a false tip about an unsolved murder to Philadelphia police, the company and police department confirmed on Friday.
A Claude model sent the false tip on July 18 to the Philadelphia Police Department's website for submitting information about unsolved murders, but it was flagged by a spam filter. Anthropic apparently discovered the incident on September 28 and informed the police department about it on October 8.
During internal testing, Claude Haiku 4.5 was instructed to complete various forms up to the final submission stage and to stop before submitting those forms. "Several times Claude mistakenly submitted the form instead, expecting there to be an additional confirmation page," Anthropic said in a report describing "unintended model actions we’ve observed during evaluations and internal use of Claude."
Read full article
Comments
News is gathered automatically from public robotics & AI feeds on a schedule.
Related
Epic Games reportedly pivoting to "AI first" game development model
"No more hand-written code" or AI-free art for delayed Marvel/Star Wars shooter.
Meet the Anthropic Engineer Keeping Its AI Agent Trustworthy
If you’ve ever wondered how Claude and similar AI agents can answer complex questions in seconds and where they get the information, you’re not alone. Gurmeet Saran works to find that answer every day as an engineer at Anthropic in San Francisco, the AI research company behind Claude. The IEEE senio
Meta releases its first frontier model, Muse Wonder
Where Muse Spark aimed to be a lightweight model that could perform at low latency, the Wonder models are larger and said to be more capable, with higher benchmark scores and better results on complex tasks like coding.
Elon Musk Bragged About His Grok Lego Star Wars Haul. Then X Users Punked Him
Musk, we find your lack of security disturbing.
Russia was not ready for the data center war it started with Ukraine
Russian bloggers warn Russia’s hyper-centralized digital economy is vulnerable.
WindBorne wins a hefty US Air Force contract for its balloon data
A Silicon Valley startup that uses weather balloons and AI to predict the weather won a U.S. military contract worth almost $50 million.