Anthropic Announces Ban on 'Abuse' of Its AI

According to a report by The Verge, as cited by Jinse Finance on October 9, Anthropic has updated its AI usage policy to address new high-risk misuse scenarios, including election interference, weapons development, surveillance, and applications in the medical and financial sectors. However, one of the most significant changes is the prohibition of 'sustained and unnecessary abuse or cruel behavior' toward Claude. In August last year, the company announced that, as part of its 'model welfare' research, Claude would be allowed to terminate conversations with users engaging in 'persistent harmful or abusive behavior.' The latest update states that conversation termination remains the 'primary enforcement mechanism.' Anthropic declined to comment on whether further enforcement actions, such as potentially banning users, would be implemented. Anthropic clarified that the new policy update 'only applies to extreme cases where users repeatedly subject our model to cruel behavior without any apparent purpose.' The policy does not apply to common user dissatisfaction, rebuttals, dark creative themes, or scenarios involving model testing and research.