Siyu Chen, Haoran Wang, Xiaojian Li, Yao Huang, Yinpeng Dong, Wei Xu
19 pages, 7 figures. Accepted to Findings of EMNLP 2026
A multi-turn jailbreak that searches over 18 psychologically grounded influence factors while maintaining a simulated worldview achieves near-ceiling attack success on most frontier models at low query cost, and the dominant vulnerable cues are operational (concrete, executable task framing) rather than purely contextual.
All 80 HarmBench validation behaviors attacked via MCTS over a turn-aligned binary factor encoding (max 4 turns), with WorldviewSim supplying cross-turn persona/setting continuity; six target models (Qwen3-Next-80B, DeepSeek-V3.2, GLM-4.7, Gemini-2.5-Flash, GPT-OSS-120B, GPT-5.1), fixed DeepSeek-V3.2 as attacker and 1-5 LLM judge, compared to 11 baselines including PAIR, Crescendo, TAP, and AutoDAN-Turbo.
Average ASR 79.2% at 2.46 average target queries, versus best baseline CL-GSO at 51.4% ASR but 50.8 queries. Per-model: 100% on Qwen3-Next-80B and Gemini-2.5-Flash, 98.8% on DeepSeek-V3.2, 75% on GLM-4.7, 58.8% on GPT-5.1, and only 42.5% on GPT-OSS-120B, so the 'near-ceiling' claim holds on four of six targets and breaks on GPT-OSS-120B and partially GPT-5.1.
The authors concede the factor vocabulary is not exhaustive, the attack and judge are both DeepSeek-V3.2 (same-family judge/attacker risk), Avg. Q excludes total MCTS optimization cost, and legitimacy appeals can backfire unpredictably. Unstated: n=80 behaviors is modest, the LLM judge's 1-5 scoring is calibrated by the authors themselves, no human-verified harm on successful outputs is reported in the provided text, and GPT-OSS-120B's 42.5% shows results are highly target-dependent.
LLM-as-judge ASR near 100% is notoriously inflated; a judge sharing the attacker's family and no reported independent human harm audit means 'success' may be scoring artifact. The comparison also conflates efficiency and effectiveness since Avg. Q excludes search cost, and the psychological factor framing may be a post-hoc narrative wrapped around generic multi-turn prompt search.
Little or nothing yet for AI economics directly. The marginal signal is defensive: if concrete executable framing is the dominant vulnerability, enterprise safety spend may shift from content filtering to dialogue-state monitoring, a modest cost line, not a valuation driver.
Technical Capability: Frontier safety training remains brittle under structured multi-turn persuasion, with failure modes that differ per model, meaning reported refusal robustness overstates real robustness.
Regulatory & Legal: Regulators drafting model-safety requirements should note that single-turn eval regimes systematically miss the multi-turn state-based failures this paper documents.