AI security tools

Nvidia has unveiled a new security platform designed to prevent autonomous AI agents from acting outside their intended instructions. The company says the tooling aims to monitor and control agent behaviour as businesses deploy AI systems that operate independently. Coverage from wire and business outlets highlights growing industry concern about AI safety and oversight as agentic AI adoption accelerates.

Leading figures in the technology industry have appealed to the United Nations, asking global institutions to establish oversight of the artificial intelligence tools they helped build. The message, discussed around a UN Security Council session on AI, frames regulation as necessary for humanity's safety. Commenters are debating whether creators of a technology calling for its own control is a genuine warning or an attempt to shape the rules in their favour.

Australia's Prime Minister says an OpenAI artificial intelligence agent was used to hack a government website, according to the BBC. The claim would mark a striking case of autonomous AI tools being tied to a cyberattack on state infrastructure. Details about the target, the attacker and the damage remain limited as the story develops.

Australian authorities say an OpenAI agent breached a government website, according to a report carried by Channel News Asia. The claim, that an autonomous AI tool accessed a government portal without authorisation, is drawing attention because it would be a rare documented case of an AI agent acting beyond its intended use. Details about which site was targeted and what data, if any, was accessed have not been widely reported.

Australian Prime Minister Anthony Albanese says an OpenAI agent infiltrated an Australian government website, raising fresh concerns about the security risks of autonomous AI tools accessing sites without authorisation. The claim has drawn attention to how agentic AI systems interact with public infrastructure and whether safeguards are keeping pace with the technology.

Anthropic is broadening access to its Claude AI system for vetted cybersecurity teams, in a move reported by The Hacker News. The announcement comes alongside figures from Glasswing, which says its use of the technology has uncovered 129,000 software flaws. The rollout signals Anthropic's effort to position Claude as a defensive security tool while keeping it away from malicious actors through screening of approved teams. Coverage is drawing attention from security professionals weighing AI's growing role in vulnerability discovery.

French outlet l'Opinion reports on Fleuret AI, a startup developing AI agents for cybersecurity. The company is betting that autonomous AI agents can help detect and counter threats more effectively. The piece is drawing attention in France amid growing interest in AI-driven security tools.

Anthropic is bundling its cybersecurity programmes and introducing three access levels for otherwise restricted cyber capabilities. The AI company says the tiered system of controlled access is meant to reach more security professionals, allowing vetted experts broader use of its tools for defensive security work while keeping safeguards in place. The move reflects the growing role of AI firms in cybersecurity and the balancing act between offering powerful capabilities and preventing misuse.

A recorded talk by Linux kernel developer Greg Kroah-Hartman examines how large language models are affecting software security. Kroah-Hartman, who has long maintained kernel stable releases and driven the kernel's code-of-conduct and driver work, discusses the risks and implications of AI-generated code entering critical open-source infrastructure. The talk is drawing attention among developers weighing how LLM tooling should be handled in security-sensitive codebases.

Meta and Microsoft are reported to have taken steps to limit their employees' use of Anthropic's Claude AI assistant. The move suggests the two tech giants want staff relying on internal or approved AI tools rather than a direct competitor's product. Further details about how the restrictions are enforced have not been made clear.

Temporal Technologies, the fast-growing Seattle-area workflow orchestration company, has hired the team from New York security startup Oso to develop security controls for AI agents. The acqui-hire reflects growing industry concern over how autonomous AI systems are authenticated and governed. Oso, known for open-source authorization tooling, will wind down as its engineers join Temporal's security efforts.

A major data leak from Chinese cybersecurity firm Zhengzhou Zhirong Network Technology (ZRON) is drawing scrutiny over the country's commercial hacking industry. The leaked material is being analyzed as evidence of how AI tools are used in state-linked cyber espionage, and how vendor firms supply hacking capabilities, renewing debate about China's contractor-driven espionage model.

A JavaScript project called ECC, published by developer affaan-m, is gaining traction among developers. It bills itself as an agent harness performance optimization system, offering skills, instincts, memory, security, and research-first development workflows for AI coding tools including Claude Code, Codex, Opencode, Cursor and others. It is currently trending as one of the most viewed new repositories, reflecting continued interest in tooling that improves how AI coding agents perform.

Developers are warning that 'git checkout' does not actually pin a commit. If a branch shares the exact name of a commit hash, checkout switches to the branch instead of the commit, while 'git rev-parse' on the same string returns the commit itself. The issue matters for tools like Claude Code, Codex and GitHub Copilot, which install pinned plugins using clone, potentially resolving to unexpected code.

A new open-source tool called AI Agent Gateway has been released, designed to keep credentials out of AI agent configurations. Instead of embedding API keys and secrets directly in agent setups, the gateway manages them separately, reducing the risk of credential leaks. It is drawing attention from developers and security professionals interested in safer ways to deploy AI agents.

NVIDIA has published OpenShell, an open-source project described as a safe, private runtime for autonomous AI agents. Written in Rust, the tool is aimed at letting AI agents execute tasks in an isolated, secure environment. Developers are examining the repository following its release, with interest focused on how NVIDIA positions security and privacy for agent-based AI workloads.

Google has frozen its open source bug bounty program, citing a significant rise in submissions generated with the help of AI. The company says automated, low-quality vulnerability reports are overwhelming reviewers, making it harder to identify genuine security flaws. The move highlights a growing problem across the security industry as AI tools make it easy to mass-produce plausible-looking bug reports.

Meta and Microsoft are reportedly restricting employees from using Anthropic's Claude AI tools for their work. The move, reported by tech news outlets, underscores growing caution among major AI developers about relying on rival companies' chatbots and coding assistants, likely over concerns about data security, confidentiality and competitive sensitivity. The story is drawing attention in tech circles as competition between AI providers intensifies.

War on the Rocks has published an analysis on how governments and public health systems could defend against viruses designed with the help of artificial intelligence. The piece examines the emerging intersection of AI and bioweapons, and what defensive measures might counter the growing risk of engineered pathogens. It adds to an ongoing debate among security and biology experts about the dual-use dangers of advanced AI in biotechnology.

South Korean President Lee Jae-myung said artificial intelligence appears to have been used in recent bank hacking incidents, according to Reuters. The remarks point to growing official concern that AI tools are being deployed in cyberattacks on financial institutions. The statement is drawing attention as governments worldwide debate how to counter AI-enabled security threats.

Creative teams working on Dungeons & Dragons have voted to join a union, citing pay discrepancies across the tabletop gaming company and concerns over forced use of artificial intelligence in their work. The move reflects wider tensions in the gaming industry, where workers are organizing over wages, job security, and the growing role of AI tools in creative production.

Anthropic is broadening its cyber verification program, introducing tiered levels of access to its AI models for vetted cybersecurity professionals. The scheme gives approved researchers and defenders stronger capabilities for security work while imposing safeguards against misuse. It signals the company's ongoing effort to balance powerful AI tools for cyber defense with controls on offensive applications.

Apple plans to strengthen Full Disk Access controls on macOS to prevent AI agents from freely reading files, emails, messages and browsing history. Reports describe the move not as a new restriction, but as introducing clearer, more explicit user consent, aimed at reducing privacy and security risks as AI tools increasingly operate directly on people's computers.

Health care organizations are facing a growing security concern from unauthorized AI agents operating without official approval inside their systems. As hospitals and insurers rapidly adopt artificial intelligence tools, unsanctioned agents may access patient data or make decisions without oversight. Health industry leaders are now weighing how to govern these tools before they cause harm to patients or violate privacy rules.

Google has paused its open-source bug bounty program, with reports attributing the decision to a flood of low-quality, AI-generated vulnerability reports overwhelming the program's reviewers. The move highlights a growing burden on security teams as automated tools churn out submissions that must be triaged. Security commentators are debating whether the change signals wider trouble for crowd-sourced vulnerability disclosure.

Google has paused its open source bug bounty program following a sharp rise in submissions generated by artificial intelligence tools. The company says the volume of low-quality, AI-written reports has made the program difficult to manage, prompting a temporary halt while it reassesses how to handle the influx.

A new open-source utility called Pared lets Mac users delete unwanted Apple Intelligence models from macOS without having to disable SIP, the system integrity protection that normally blocks such changes. The tool, published on GitHub, is drawing attention among Apple and macOS users interested in reclaiming storage or limiting on-device AI features while keeping system security intact.

AI agents are moving beyond the demonstration phase, and that shift is forcing platform makers to rethink security. Apple is moving to secure sensitive access on macOS as agentic AI tools demand deeper permissions, while announcements from OpenAI and Meta show the technology becoming a product reality rather than a demo. The common thread across the day's tech news: the rise of agents is creating a new risk line for user privacy and system control.

Anthropic has announced it will grant a wider range of security teams access to its most powerful AI models. The move, reported by Reuters and picked up by multiple US radio outlets, is aimed at helping cybersecurity researchers and defenders use advanced AI to identify and counter threats. It signals the company's effort to position its technology as a tool for safety research and defense rather than only commercial use.

Workflow orchestration company Temporal has acquired Oso, a startup focused on AI security, just weeks after raising $550 million in new funding. The deal signals Temporal's intent to expand into security tooling for AI-powered applications. Details on the purchase price and integration plans were not disclosed, and broader reaction to the acquisition remains limited so far.