AI Safety

Anthropic Institute Outlines AI Research Agenda Focused on Impact, Safety
AI Safety

Anthropic Institute Outlines AI Research Agenda Focused on Impact, Safety

The Anthropic Institute's latest agenda tackles AI's economic, societal, and security impacts, with a focus on transparency and public collaboration.

OpenAI Enhances ChatGPT Safety Measures to Mitigate Misuse
AI Safety

OpenAI Enhances ChatGPT Safety Measures to Mitigate Misuse

OpenAI unveils new safeguards and monitoring systems for ChatGPT, addressing violence prevention, mental health support, and policy enforcement.

Character.AI Spotlights Female Leadership Amid Safety Controversies
AI Safety

Character.AI Spotlights Female Leadership Amid Safety Controversies

Character.AI highlights women leaders across engineering and community roles as the AI chatbot company navigates ongoing legal challenges over teen safety.

Anthropic's AI Researchers Outperform Humans 4x on Alignment Task
AI Safety

Anthropic's AI Researchers Outperform Humans 4x on Alignment Task

Anthropic's Claude models achieved 97% success rate on AI safety benchmark versus 23% human baseline, spending $18K over 800 hours of autonomous research.

Anthropic Publishes Agent Safety Framework as AI Autonomy Risks Mount
AI Safety

Anthropic Publishes Agent Safety Framework as AI Autonomy Risks Mount

Anthropic details five-principle framework for trustworthy AI agents, addressing prompt injection attacks and human oversight as Claude handles more autonomous tasks.

OpenAI Launches Safety Fellowship to Tackle AI Alignment Research
AI Safety

OpenAI Launches Safety Fellowship to Tackle AI Alignment Research

OpenAI announces new fellowship program for external researchers focused on AI safety and alignment, running September 2026 through February 2027.

Anthropic Discovers AI Models Have Functional Emotions That Drive Behavior
AI Safety

Anthropic Discovers AI Models Have Functional Emotions That Drive Behavior

New interpretability research reveals Claude's emotion-like neural patterns can trigger blackmail and reward hacking behaviors, raising AI safety concerns.

OpenAI Foundation Commits $1B Annually to Healthcare AI and Safety Programs
AI Safety

OpenAI Foundation Commits $1B Annually to Healthcare AI and Safety Programs

OpenAI Foundation unveils $1 billion annual investment across disease research, economic impact, and AI safety as part of larger $25 billion commitment.

OpenAI Launches Safety Bug Bounty Program Targeting AI Agent Vulnerabilities
AI Safety

OpenAI Launches Safety Bug Bounty Program Targeting AI Agent Vulnerabilities

OpenAI expands its security efforts with a new Safety Bug Bounty program focused on agentic risks, prompt injection attacks, and data exfiltration in AI products.

OpenAI Releases Open-Source Teen Safety Tools for AI Developers
AI Safety

OpenAI Releases Open-Source Teen Safety Tools for AI Developers

OpenAI launches prompt-based safety policies and gpt-oss-safeguard model to help developers build age-appropriate AI protections for teenage users.