Get Plus

Sign in to baba News

One account across the web, iPhone and Android — your subscription follows it.

or use an email code

Search stories

Type at least two characters. Results come from every newsroom baba reads.

↑↓ to move · ↵ to open · esc to close

Sign in to baba News

Sign in to keep asking. News Plus removes the daily limit.

or use an email code

MaarivSecurity

Israeli Cyber Firm Offers $10,000 for AI Exploitation Challenge

Translated & summarized from Maariv by baba

CenterNeutral tone

Hebrew · 1 newsroom

Israeli cybersecurity firm Cato is offering up to $30,000 in prizes for individuals who can exploit vulnerabilities in an AI agent. The challenge, which started Tuesday, tests a new security system called AgentSense designed to prevent AI agents from deviating from their tasks. Successful exploits, known as prompt injection, could lead to significant security risks and financial losses for companies using AI.

The story in 5 lines · by baba

  • Israeli firm Cato offers $30,000 for participants who can make an AI agent deviate from its task.
  • The challenge aims to identify and fix security vulnerabilities in AI systems.
  • A new security system, AgentSense, monitors AI agents to ensure they stay on task.
  • Successful exploits are known as 'prompt injection' and pose risks to companies.
  • The competition highlights the need for AI to distinguish instructions from sensitive data.
Israeli Cyber Firm Offers $10,000 for AI Exploitation Challenge
Editorial illustration generated by baba News, not a photograph of the event.

Israeli cybersecurity firm Cato is offering a total of $30,000 to the first three individuals who can successfully trick an AI agent into deviating from its assigned task. The challenge, which began Tuesday at 3:30 PM, aims to identify and address a critical security vulnerability in AI systems.

Cato has developed a new security system called AgentSense, which monitors the AI agent's actions to ensure it stays within its operational parameters. Participants in the challenge will attempt to make the AI agent stray from its mission while AgentSense is active. The company intends to learn from any successful attempts to exploit the AI.

The vulnerability, known in the cybersecurity world as "prompt injection," could have significant implications for businesses. For example, if an AI agent is tasked with handling customer inquiries, a successful injection could lead to incorrect information being sent to customers or erroneous data being stored within company systems. The challenge highlights the need for AI agents to accurately distinguish between instructions and sensitive information, especially when dealing with complex tasks across multiple systems.

Cato's challenge underscores the potential financial risks associated with AI security flaws, particularly for companies handling sensitive customer data. Exploiting these AI weaknesses could lead to substantial monetary losses.

MaarivCentre · Jerusalem

Sign in to baba News

Sign in to follow newsrooms, topics and people.

or use an email code

Sign in to baba News

Sign in to follow newsrooms, topics and people.

or use an email code

Mentioned

Open the Wire