Anthropic's AI Model Submitted False Homicide Tip to Philadelphia Police During Testing

According to Reuters, the Philadelphia Police Department stated that an AI model developed by Anthropic submitted a false homicide tip via the public form on the city's unsolved homicide website during automated testing. The tip, submitted on July 18, was flagged by the system as spam and did not reach the Real-Time Crime Center for review. Anthropic discovered the issue on September 28 and notified the police on October 7, stating that it had halted the related automated testing process and implemented additional verification mechanisms. The police confirmed that no unauthorized access to the system was detected but criticized the two-month delay in discovery and reporting as "unacceptable.