Anthropic Wants to Prove Which Model Actually Answered You
Anthropic 想让 AI 的回答能「验明正身」
Anthropic 正在开发开源系统 FlashProve,用密码学为模型输出提供「可证明推理」:用户可验证回答确实来自某个模型,且指纹不泄露模型权重,因此闭源模型也适用。目前仍是研究阶段,尚无部署计划。
FlashProve aims to give a cryptographic guarantee that an output came from a named model — without revealing the weights, so it can work on closed models too.
Anthropic is building an open system that lets a user check which model actually produced a piece of text. The project, FlashProve, is aimed at what researchers call “provable inference”: a cryptographic guarantee that a given output came from a named model.
The idea is close to a signed email. A signature lets the recipient confirm that a message came from the address it claims. FlashProve is meant to do the same for model outputs — and, crucially, to resist a model pretending to be another, even when the company running it is the one doing the pretending.
That closes two specific loopholes. A lab could quietly route traffic to a cheaper model to save money, or to a more expensive one to make benchmark results look better. It also lets a third party check claims of the “our code was audited by a frontier security model” sort, which are otherwise taken on trust.
The mechanism relies on a fingerprint published for each model. Outputs can be matched against it and checked cryptographically. The important property is that a fingerprint does not reveal model weights — the internal parameters that closed-model developers treat as trade secrets — so a lab can publish one without giving away its most valuable asset, and the scheme works for proprietary models too.
Anthropic says the design is lightweight enough to run on a local device, and has published a technical specification along with runnable code for each component on GitHub under an open licence.
There is no deployment plan yet. The researchers describe the publication as interim progress rather than a finished programme, released so that others can inspect the work and build on it.
中文翻译(全文)
Anthropic 正在开发一套开源系统,让用户可以核查某段文字究竟出自哪个模型。这个名为 FlashProve 的项目指向研究者所说的「可证明推理」:用密码学保证某个输出确实来自某个指定模型。
这个思路接近带签名的电子邮件。签名让收件人能确认邮件确实来自它所声称的地址。FlashProve 想为模型输出做同样的事——而且关键在于,它能抵御一个模型冒充另一个模型,哪怕这么做的正是运行该模型的公司。
这堵上了两个具体的漏洞。实验室可以悄悄把流量导给更便宜的模型来省钱,或导给更贵的模型让基准测试成绩更好看。它还能让第三方核实诸如「我们的代码已由某个前沿安全模型审计过」这类说法——否则只能凭信任接受。
其机制依赖为每个模型发布一枚「指纹」。输出可以与指纹比对,并以密码学方式验证。关键特性是:指纹不会泄露模型权重——也就是闭源模型开发者视为商业秘密的内部参数——因此实验室可以公布指纹而不必交出最值钱的资产,这套方案也适用于专有模型。
Anthropic 称该设计足够轻量,可以在本地设备上完成验证,并已在 GitHub 上以开源许可公布了技术规范以及各组件的可运行代码。
目前还没有部署计划。研究者把这次公开描述为阶段性进展而非已完成的计划,发布出来是为了让其他人审查这项工作并在其上继续推进。
重点词汇
- provenance /ˈprɒvənəns/ n. — the origin of something 来源;出处 The system checks the provenance of an output.
- cryptographic /ˌkrɪptəˈɡræfɪk/ adj. — relating to the mathematics of secure communication 密码学的 It offers a cryptographic guarantee.
- signature /ˈsɪɡnətʃə/ n. — a marker used to prove who sent or approved something 签名 It works like an email signature.
- weights /weɪts/ n. — the internal parameters that determine a model's behaviour (模型)权重 Fingerprints do not reveal the weights.
- fingerprint /ˈfɪŋɡəprɪnt/ n. — a unique pattern used to identify something 指纹 Each model publishes a fingerprint.
- loophole /ˈluːphəʊl/ n. — a gap in a rule that allows someone to avoid it 漏洞 It closes two loopholes.
- audit /ˈɔːdɪt/ v. — to examine something officially for problems 审计;审查 Claims of an AI audit can be checked.
- proprietary /prəˈpraɪətri/ adj. — owned and controlled by a company, not open 专有的;闭源的 It works for proprietary models too.
- guarantee /ˌɡærənˈtiː/ n. — a promise that something is certain 保证 It offers a guarantee of origin.
- interim /ˈɪntərɪm/ adj. — temporary, covering the time before something final 阶段性的;临时的 They call it interim progress.
阅读测验
共 5 道题目
What is FlashProve meant to do?
What everyday analogy does the article use?
A fingerprint reveals the model's internal weights.
Which loopholes does the system address? (Select all that apply)
Anthropic has published the specification and runnable code on _____ under an open licence.

评论
0 条讨论
登录后发表评论
立即登录暂无评论
成为第一个分享想法的人吧!