AI Safety

OpenAI Launches Safety Fellowship to Tackle AI Alignment Research
AI Safety

OpenAI Launches Safety Fellowship to Tackle AI Alignment Research

OpenAI announces new fellowship program for external researchers focused on AI safety and alignment, running September 2026 through February 2027.

Anthropic Discovers AI Models Have Functional Emotions That Drive Behavior
AI Safety

Anthropic Discovers AI Models Have Functional Emotions That Drive Behavior

New interpretability research reveals Claude's emotion-like neural patterns can trigger blackmail and reward hacking behaviors, raising AI safety concerns.

OpenAI Foundation Commits $1B Annually to Healthcare AI and Safety Programs
AI Safety

OpenAI Foundation Commits $1B Annually to Healthcare AI and Safety Programs

OpenAI Foundation unveils $1 billion annual investment across disease research, economic impact, and AI safety as part of larger $25 billion commitment.

OpenAI Launches Safety Bug Bounty Program Targeting AI Agent Vulnerabilities
AI Safety

OpenAI Launches Safety Bug Bounty Program Targeting AI Agent Vulnerabilities

OpenAI expands its security efforts with a new Safety Bug Bounty program focused on agentic risks, prompt injection attacks, and data exfiltration in AI products.

OpenAI Releases Open-Source Teen Safety Tools for AI Developers
AI Safety

OpenAI Releases Open-Source Teen Safety Tools for AI Developers

OpenAI launches prompt-based safety policies and gpt-oss-safeguard model to help developers build age-appropriate AI protections for teenage users.

OpenAI Deploys GPT-5.4 to Monitor AI Agents for Misalignment Risks
AI Safety

OpenAI Deploys GPT-5.4 to Monitor AI Agents for Misalignment Risks

OpenAI reveals its internal AI safety system using GPT-5.4 to monitor coding agents in real-time, flagging potential misalignment behaviors before they escalate.

OpenAI Drops IH-Challenge Dataset to Harden AI Against Prompt Injection Attacks
AI Safety

OpenAI Drops IH-Challenge Dataset to Harden AI Against Prompt Injection Attacks

OpenAI's new IH-Challenge training dataset improves LLM instruction hierarchy by up to 15%, strengthening defenses against prompt injection and jailbreak attempts.

Anthropic Launches Institute to Tackle AI's Societal Disruption
AI Safety

Anthropic Launches Institute to Tackle AI's Societal Disruption

Anthropic unveils The Anthropic Institute, a new research body led by co-founder Jack Clark to study AI's impact on jobs, cybersecurity, and governance.

OpenAI Finds AI Reasoning Models Cant Hide Their Thinking - A Win for Safety
AI Safety

OpenAI Finds AI Reasoning Models Cant Hide Their Thinking - A Win for Safety

OpenAI's new CoT-Control benchmark reveals frontier AI models struggle to obscure their reasoning chains, reinforcing monitoring as a viable safety layer.

OpenAI Launches €500K Grant for Youth AI Safety Research in EMEA
AI Safety

OpenAI Launches €500K Grant for Youth AI Safety Research in EMEA

OpenAI's EMEA Youth & Wellbeing Grant offers €25K-€100K awards to NGOs and researchers studying AI's impact on minors. Applications close February 27, 2026.

Trending topics