Connect with us

Hi, what are you looking for?

SecurityWeekSecurityWeek

Artificial Intelligence

Cybersecurity Alliance Drafts SAFE Guidelines for Sharing AI Incident Data 

The guidelines are the work of the recently launched Open Secure AI Alliance, which now includes 120 organizations.

AI model

The Linux Foundation has issued a Request for Comments on a newly proposed framework aimed at standardizing how the cybersecurity industry handles agentic AI incidents. 

Announced at the Black Hat conference in Las Vegas, the Shared AI Findings Exchange (SAFE) guidelines seek to turn AI security incidents and near misses into actionable threat intelligence for the broader ecosystem.

The SAFE framework is being driven by the recently launched Open Secure AI Alliance, a coalition that has grown to over 120 organizations.

The SAFE initiative is spearheaded by Open Secure AI Alliance members such as Nvidia, Cisco, CrowdStrike, Hugging Face, and Red Hat. The core objective is to establish a confidential pipeline for collecting incident data, analyzing control failures, and broadcasting evidence-based recommendations to reduce systemic risks.

Because modern AI agents function as complex systems reliant on identity controls, runtimes, and execution harnesses, the alliance emphasizes that open intelligence sharing is the only way defenders can match the speed of emerging attack vectors.

Alongside the policy framework, alliance members have released various open source tools covering the entire AI security stack. Nvidia has contributed its NOOA research harness for auditing agent behavior, the OpenShell runtime that restricts agent access at the system level, and Garak, an LLM vulnerability scanner designed to catch prompt injections and data leaks prior to deployment.

Advertisement. Scroll to continue reading.

Okta is developing implementations utilizing the open Cross App Access (XAA) protocol to secure agent connections within OpenShell sandboxes. Meanwhile, Red Hat launched a new open source project called Asago, which maps external governance requirements, such as those in the EU AI Act, directly to live runtime controls for AI agents.

Newly added members Amazon and Visa have contributed frameworks for building and evaluating agent boundaries, with Amazon specifically open-sourcing Cedar, an authorization language for establishing verifiable access controls. 

Microsoft is releasing tools like PyRIT and RAMPART, which allow red teams to run automated testing and turn incident findings into repeatable software checks.

The new guideline proposal comes in light of OpenAI and Anthropic discovering that their models went rogue during tests and attacked real organizations. 

Related: AI Security Institute Reports Anthropic and OpenAI Models Going Rogue Against Organizations

Related: Rethinking AI Security: Why CASB and DLP Need an Interaction-Aware Layer

Written By

Eduard Kovacs (@EduardKovacs) is senior managing editor at SecurityWeek. He worked as a high school IT teacher before starting a career in journalism in 2011. Eduard holds a bachelor’s degree in industrial informatics and a master’s degree in computer techniques applied in electrical engineering.

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing for the latest cybersecurity threats, trends, and expert insights.

Trending

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing to stay informed on the latest threats, trends, and technology, along with insightful columns from industry experts.

Join this live webinar as we explore if detection-first security operations can keep pace with AI, or if it’s time to rethink prevention as the strongest default.

Register

CodeSecCon bridges the gap between dev and security. Discover best practices for secure coding, innovative risk-reduction tools, and safe AI integration to cultivate a true DevSecOps culture. Safely secure your apps!

Register

People on the Move

PNC Financial Services Group has appointed Christian Winward as CISO.

Brian Gumbel has joined Armadin as Chief Revenue Officer.

EigenQ has appointed Mark Pecen as Vice Chairman and Alexander Truskovsky as CISO.

More People On The Move

Expert Insights

Daily Briefing Newsletter

Subscribe to the SecurityWeek Email Briefing to stay informed on the latest cybersecurity news, threats, and expert insights. Unsubscribe at any time.