PULSE
AI 认知观点 VIEWPOINT重要度 62

开放模型与网络风险:作者为何部分修正立场

Interconnects · 2026-10-30 · 原题《Was I wrong about open models & cyber risks?》 · 原文约 6 分钟 · 阅读原文 ↗
开放模型与网络风险:立场修正 风险是加速,不是突变 恐慌被夸大,但动荡更严重 原判断 → 修正 “黑色十月”标志风险显现 但加密黑客史不适合作指标 曾称开放模型大体“fine” 修正:低估了昂贵行业更新 可证伪预测 若 Mythos 以开放权重发布 世界大体没事 风险加速,而非阶跃提升 论证链条 1 夸张措辞 影响公众认知 2 GLM-5.3 发现漏洞 ≠ 造成危害 3 利用需多阶段对齐 攻防方程平衡 4 攻击者资源少 有固定业务模式 开放权重:加速风险,但提供攻防平衡
作者认为开放权重模型带来的网络风险更像加速而非突变,此前对开放模型风险的恐慌被夸大,但他也承认即将到来的行业动荡比“fine”更严重。

论证要点

  1. 作者曾称“黑色十月”标志AI网络风险开始显现,但指出加密行业黑客史使其不适合作为社会危害的指标。
  2. 他提出可证伪预测:若Claude Mythos以开放权重发布,世界大体上会没事,只会加速而非阶跃式提升风险。
  3. 他引用Rob Wiblin和Anthropic的夸张措辞,说明前沿AI社区的语言如何影响公众和联邦政府认知。
  4. Epoch AI用GLM-5.3在Firefox中发现漏洞,但作者强调利用漏洞需多阶段对齐,仅发现漏洞不等于造成危害。
  5. 作者修正“fine”一词:对已悲观者合适,对未预期动荡者则低估了即将到来的昂贵行业更新。
  6. 他认为开放模型在攻防方程中提供平衡,攻击者资源通常少于大公司,且威胁行为者像企业一样有固定业务模式。

对实践的启示

做AI应用的人应预期网络安全漏洞披露加速,需将漏洞修补和供应链安全纳入常态成本;同时不必因开放模型恐慌而放弃使用,但应关注攻击者动机和实际利用链条。

作者承认的反方与局限

作者承认自己不是网络安全专家,对预测有很高误差棒;他也承认开放模型若泄露会增加网络安全事件,且“混乱”目前限于大型数字产品运营者,但可能变化。

原文摘引

If Claude Mythos was accidentally released as open-weight, it seems like the world would have been more or less fine.
It’s a fine line between “all of our tech companies need to work extra hard to keep us secure” and “public infrastructure is actually going down.”
Life is a lot easier once you stop seeing threat actors as hackers who want to break into systems by any means possible, and start seeing them as businesses with well defined business processes.
▸ 展开原文全文(26 段,抓取自 Interconnects)

Last week coined the term “Black October“ after an onslaught of critical vulnerability disclosures, including PHP2Shell and GitLab, signified the moment when the cyber risks of AI models started to materialize. It seemed like the news cycle had stabilized a bit when I started writing this, but then there was news about another major crypto security incident at Binance. The crypto industry has a very long history of hacks, so it’s not the best industry to indicate vulnerabilities translating into new societal harm. Still, we are very much still living through the implications of this.

The best guess for what is happening in the cybersecurity space is that the behind the scenes work has only accelerated, bringing more people and resources in to try and patch the internet — the Wall Street Journal reported that cyber first responders are strained, which seems like the system working. We’re living through this plot of an exponential rise in vulnerabilities, which will take a long time to level off at the top of the sigmoid.

A few weeks ago, before the rapid acceleration in vulnerability disclosures and the uptick in reported hacks, I wrote the following take. It’s been getting a pretty consistent barrage of feedback, some hopeless dunk attempts and some reasonable discussion, so I wanted to unpack where I stand.

Open-weight Mythos in April would’ve been fine?

When Claude Mythos was announced, it was previewed as if it was a new class of cyber weapon, where if it ended up in the wrong hands it would’ve caused mass societal destabilization.

It seems like this was wrong.

By all measures, GLM-5.3 is the model that crosses that threshold of capability, and there’s little public evidence that much has changed, and we’re over a month out of the model weight release.

In fact, I would go further. If Claude Mythos was accidentally released as open-weight, it seems like the world would have been more or less fine. Yes, there would be a clear increase in cybersecurity incidents and it would be bad for society if the model leaked, but it would be a scenario that looks more like an acceleration than a step change in risk.

The leading proponents of this new wave of open-weight fear mongering have effectively been making a falsifiable prediction — that the current open-weight models are going to cause substantial, not seen before AI harms by crippling our cyber infrastructure.

Based on all the evidence I have, which I’ve unpacked above, they’re set up to be wrong. At least now, after so many years of debating open weight risks, we will start to get some real answers.

To start the reflection, I wanted to do more due diligence and track down some receipts on the claim that the AI safety community was reacting as if open-weight Mythos would be an actual disaster, and not just a painful headache. This was distinctly my impression having lived through the online discourse. I’ve gotten criticism that the frontier AI community never said it would be a “true disaster,” but regardless of exactly what they said, it is always about how people hear and internalize your information.

Here are some examples of the sort of language that I felt was too exaggerated and from prominent people, which spilled into the public and more importantly federal government perspective that this was a cyber weapon include:

- Rob Wiblin, host of the 80,000 hours podcast, on his own podcast (April 10, 2026): “If it fell into the hands of criminals or hostile state cyber actors, it would be an actual disaster.”

- Anthropic, in the Project Glasswing announcement blog (April 7, 2026): “Given the rate of AI progress, it will not be long before such capabilities proliferate, potentially beyond actors who are committed to deploying them safely. The fallout—for economies, public safety, and national security—could be severe.”

For one that is actually more reasonable, to illustrate the fine lines between correct and exaggerated, from Zvi Mowshowitz (who I don’t agree with a ton of things on) on April 9, 2026: “Claude Mythos would give attackers a cornucopia of zero-day exploits for essentially all the software on Earth … It would be chaos.” To date, this chaos has been confined to those running large-scale digital products, which is good, but could change.

I largely still stand by my above writing a few weeks ago, but I’m nervous about it. I’m not a cyber expert, I’m working hard to make the most educated predictions I can. It’s a fine line between “all of our tech companies need to work extra hard to keep us secure” and “public infrastructure is actually going down.” It is very clear as of writing this that there are way more critical vulnerabilities which are being found in popular tools and fixes are being built.

For example, Epoch AI recently published a nice post on their internal work using GLM-5.3 to try and find vulnerabilities and chain them into what could be an attack. The actual exploit they found in Firefox is a good example of why cyber risks need multiple things to align for harm to be done:

We used GLM 5.3 to create a website that, simply when visited by a Firefox user and without further interaction, gave the attacker the ability to exfiltrate files from the user’s computer.

Here, the exploit is in Firefox, and a would-be hacker needs to plant a website that is looking for this exploit. This is doable, and could have serious consequences, but just finding the exploit is only one step in a multi-stage process.

In the previous post, I should’ve been more specific on what “fine” is for a future of cybersecurity, and in this case it means giving more credit to some of the AI safety community that discussed this reasonably as a new era in cyber instability. Reflecting on it, I’m not sure fine is the right word to describe what is inevitably coming – a forced industry update to a new way of working with software, which will clearly be expensive and accompanied by some hard work. If you’re already somber about the challenges coming from AI, I think fine is actually very suitable. If you didn’t price in a period of turbulence, fine undersells. I’ve written many times that I am in the former, difficulty will come, group — but I think humans are good at muddling through problems and patching immediate concerns.

What my view was closer to is that open models are providing balance in the offense-defense equation, and that Mythos coming sooner wouldn’t have massively upended this. I suspect most of these companies would be faster to adopt open-weight models than attackers, as most attackers are lower resourced than these companies. A key needle we’re watching the balance on is how willing attackers are to cause physical harm within the U.S. its allies. For now, while our adversaries have likely used these models and exploits to extract information en-masse in a clandestine way, it is not clear if there is a party who will cause mass harm by pushing the full force of these models at public institutions.

I thought this Tweet was a funny way to summarize some of the personnel / motive gaps in hacking:

Life is a lot easier once you stop seeing threat actors as hackers who want to break into systems by any means possible, and start seeing them as businesses with well defined business processes.

A bakery isn’t going to start making dog food because there’s a dog food shortage. ClickFix and Phishing actors aren’t going to drop everything to vibecode exploits just because a critical CVE came out.

The fact that the only actors exploiting this are the actors whose MO is exploiting things... isn’t a coincidence. It’s entirely predictable if you understand threat actor behavior.

Where I sit, I expect most of these vulnerabilities are being found by closed models, but I have very high error bars on this prediction. A lot hinges on how open models are actually being used in the near term. Today, open models are expensive to serve and the compute to serve the largest models is extremely sold out