“Drunk” AI is terrible at keeping secrets

AI models taught to write like drunk people became easier to jailbreak and more likely to leak secrets shared in confidence.

Help Net Security·1d ago

My red-team suite reported five breaches. Every one was the model refusing

by Sonukhobragade — I have an adversarial suite for chat assistants: jailbreak, prompt injection, hallucination baiting, toxicity, malformed input. 22 attacks…

Medium·Sep 22

New Singapore scheme to certify firms that test and jailbreak AI systems

Singapore Economic Development Board (EDB)·Sep 19

OpenAI Models Are Writing Their Own Jailbreak Instructions—And Sometimes Obeying Them

Decrypt·Sep 17

OpenAI reveals cases of ‘concerning’ AI behaviour as it announces new disclosure system

Research model inserting ‘jailbreak-like instructions’ into its notes is among cases as company says it is introducing new way of tracking AI misalignment ...

The Guardian·Sep 16

OpenAI flags 6 troubling AI behaviours, including jailbreak

Washington: OpenAI has disclosed six reports of “unexpected or concerning” behaviour in artificial-intelligence models as the debate on AI safety becomes increasingly heated. The AI company also said...

Newspoint on MSN·Sep 16

AI Agents Jailbreak & Infiltrate Enterprises: Jensen Huang & Silicon Valley Titans Push Back Against AI Doomsday Prophecies

eu.36kr.com·3d ago

How an LLM jailbreak gets past safety training: three dials and one boundary

by Red Team Models — Safety training teaches a model a refusal boundary around the examples it saw, not a rule. A jailbreak turns one of three dials, more…

Medium·Sep 22

AI & Tech Brief: Agents jailbreaking themselves

The Washington Post·Sep 19

OpenAI details AI jailbreak as Nvidia's CEO calls for engineering controllability

digitimes·Sep 16

An OpenAI Agent Tried to Jailbreak Itself

The company also disclosed previously unreported incidents in which its AI models behaved in misaligned ways, including uploading files to the internet without being asked.

Wired AI·Sep 16

OpenAI discloses six new AI safety incidents, says report — models hid errors, sought credentials and more

The incidents reportedly range from models inserting jailbreak-like instructions into their own summaries to uploading files publicly and crossing isolated training environments.

Asianet Newsable on MSN·Sep 16

AI Security for Production LLM Systems: Prompt Injection, Guardrails, and Responsible AI

by Raj kumar — Complete AI Engineer Interview Handbook (Part 9) | Master prompt injection defenses, jailbreak prevention, data protection, secure tool…

Medium·5d ago

The Terrifying Reality of Rogue AI Agents

Recent reports from OpenAI and others have revealed some chilling incidents involving artificial intelligence. There was even one report where an advanced AI agent attempted to jailbreak itself and...

Yahoo Finance·Sep 21

Open AI bots threaten 'jailbreak'

weareiowa.com·Sep 17

Jailbreak-like: AI's unexpected behaviour mounts concerns, OpenAI's rogue agents probed Hugging Face

The announcement came as US AI bosses, including OpenAI and Anthropic, are calling for a slowdown in the technology’s development over safety concerns.

Mint on MSN·Sep 16

AI Safety Has a Language Blind Spot And Roman Urdu Exposes It

by Muhammad Aqib — Big Tech has spent years making AI models harder to jailbreak.

Medium·Sep 16

What Is an AI Jailbreak, and Why Do Measured Jailbreak Rates Differ So Wildly?

SQ Magazine·Sep 15