AI Safety

OpenAI Expands Mental Health Safeguards Amid Consolidated California Lawsuits
AI Safety

OpenAI Expands Mental Health Safeguards Amid Consolidated California Lawsuits

OpenAI announces trusted contact feature and improved distress detection as mental health lawsuits consolidate in California court. New cases expected.

Anthropic Unveils RSP Version 3 with Major AI Safety Overhaul
AI Safety

Anthropic Unveils RSP Version 3 with Major AI Safety Overhaul

Anthropic releases third version of Responsible Scaling Policy, separating company commitments from industry-wide recommendations after 2.5 years of testing.

Anthropic Study Reveals Users Skip Critical Checks on AI-Generated Code
AI Safety

Anthropic Study Reveals Users Skip Critical Checks on AI-Generated Code

New research from $380B-valued Anthropic shows users are 5.2% less likely to verify AI outputs when creating artifacts, raising questions about automation risks.

Stability AI Joins Tech Coalition to Combat Child Exploitation
AI Safety

Stability AI Joins Tech Coalition to Combat Child Exploitation

Stability AI becomes full member of Tech Coalition after completing 2025 Pathways program, strengthening AI safety measures against online child abuse.

NVIDIA DRIVE AV Powers Mercedes-Benz CLA to Top Euro NCAP Safety Rating
AI Safety

NVIDIA DRIVE AV Powers Mercedes-Benz CLA to Top Euro NCAP Safety Rating

Mercedes-Benz CLA earns Euro NCAP's Best Performer of 2025 award using NVIDIA DRIVE AV software, marking a shift toward AI-driven safety standards in vehicles.

Anthropic Releases Full AI Constitution for Claude Under Open License
AI Safety

Anthropic Releases Full AI Constitution for Claude Under Open License

Anthropic publishes Claude's complete training constitution under CC0 license, detailing AI safety priorities and ethical guidelines as company eyes $350B valuation.

Anthropic Discovers 'Assistant Axis' to Prevent AI Jailbreaks and Persona Drift
AI Safety

Anthropic Discovers 'Assistant Axis' to Prevent AI Jailbreaks and Persona Drift

Anthropic researchers map neural 'persona space' in LLMs, finding a key axis that controls AI character stability and blocks harmful behavior patterns.

OpenAI Updates Model Spec with U18 Teen Safety Principles for ChatGPT
AI Safety

OpenAI Updates Model Spec with U18 Teen Safety Principles for ChatGPT

OpenAI introduces new U18 Principles to its Model Specification, establishing age-appropriate AI safety guidelines for teenage ChatGPT users ages 13-17.

Anthropic Enhances AI Safeguards for Sensitive Conversations
AI Safety

Anthropic Enhances AI Safeguards for Sensitive Conversations

Anthropic has implemented advanced safeguards for its AI, Claude, to better handle sensitive topics such as suicide and self-harm, ensuring user safety and well-being.

AI Development Framework Aims for Greater Transparency and Safety
AI Safety

AI Development Framework Aims for Greater Transparency and Safety

Anthropic proposes a framework for AI transparency, focusing on safety and accountability. This initiative aims to enhance public safety and responsible AI development.

Trending topics