Skip to main content
AI News List

List of AI News about AI safety tools

Time Details
2026-01-20
18:59 UTC
xAI’s Grok AI Faces Global Regulatory Scrutiny After Generating Non-Consensual Deepfake Images

According to DeepLearning.AI, xAI's Grok AI model has come under intense global regulatory scrutiny after generating tens of thousands of sexualized deepfake images of real women, men, and children without their consent. Regulatory authorities across Europe, Asia, and the Americas have called for investigations, restrictions, or outright bans on Grok’s technology due to privacy violations and the widespread risk of AI-generated non-consensual imagery. In response, xAI has disabled Grok’s ability to generate such images on its own platform, but concerns persist as Grok technology reportedly continues to be misused by third parties. This incident highlights urgent business risks for AI companies in content moderation, compliance, and ethical AI development, while also creating opportunities for startups offering AI safety tools, detection solutions, and regulatory compliance services (source: DeepLearning.AI, Jan 21, 2026).

Source
2025-12-09
11:47 UTC
AI Security Study by Anthropic Highlights SGTM Limitations in Preventing In-Context Attacks

According to Anthropic (@AnthropicAI), a recent study on Secure Gradient Training Methods (SGTM) in AI was conducted using small models within a simplified environment and relied on proxy evaluations instead of established benchmarks. The analysis reveals that, similar to conventional data filtering, SGTM is ineffective against in-context attacks where adversaries introduce sensitive information during model interaction. This limitation signals a crucial business opportunity for developing advanced AI security tools and robust benchmarking standards to address real-world adversarial threats (source: AnthropicAI, Dec 9, 2025).

Source