AI Safety
Anthropic Publishes Agent Safety Framework as AI Autonomy Risks Mount
Anthropic details five-principle framework for trustworthy AI agents, addressing prompt injection attacks and human oversight as Claude handles more autonomous tasks.
OpenAI Launches Safety Fellowship to Tackle AI Alignment Research
OpenAI announces new fellowship program for external researchers focused on AI safety and alignment, running September 2026 through February 2027.
Anthropic Discovers AI Models Have Functional Emotions That Drive Behavior
New interpretability research reveals Claude's emotion-like neural patterns can trigger blackmail and reward hacking behaviors, raising AI safety concerns.
OpenAI Foundation Commits $1B Annually to Healthcare AI and Safety Programs
OpenAI Foundation unveils $1 billion annual investment across disease research, economic impact, and AI safety as part of larger $25 billion commitment.
OpenAI Launches Safety Bug Bounty Program Targeting AI Agent Vulnerabilities
OpenAI expands its security efforts with a new Safety Bug Bounty program focused on agentic risks, prompt injection attacks, and data exfiltration in AI products.
OpenAI Releases Open-Source Teen Safety Tools for AI Developers
OpenAI launches prompt-based safety policies and gpt-oss-safeguard model to help developers build age-appropriate AI protections for teenage users.
OpenAI Deploys GPT-5.4 to Monitor AI Agents for Misalignment Risks
OpenAI reveals its internal AI safety system using GPT-5.4 to monitor coding agents in real-time, flagging potential misalignment behaviors before they escalate.
OpenAI Drops IH-Challenge Dataset to Harden AI Against Prompt Injection Attacks
OpenAI's new IH-Challenge training dataset improves LLM instruction hierarchy by up to 15%, strengthening defenses against prompt injection and jailbreak attempts.
Anthropic Launches Institute to Tackle AI's Societal Disruption
Anthropic unveils The Anthropic Institute, a new research body led by co-founder Jack Clark to study AI's impact on jobs, cybersecurity, and governance.
OpenAI Finds AI Reasoning Models Cant Hide Their Thinking - A Win for Safety
OpenAI's new CoT-Control benchmark reveals frontier AI models struggle to obscure their reasoning chains, reinforcing monitoring as a viable safety layer.