质疑 JevBench 基准的真实性与成本
问题概述
多位用户对 JevBench 的成本宣称、模型真实性以及评估透明度表示怀疑，质疑其是否为真实可复现的基准，并呼吁寻找替代方案或独立验证。
痛点标签
- 质疑 Jev 的真实性和成本宣称
- 对基准测试的透明度不足
- 寻求替代的 System One 模型或本地可运行的方案
- 对评估结果的可信度存疑
待验证问题
- Jev 的成本模型是否基于真实使用情况？
- 是否有独立的第三方审计报告公布？
- 用户是否能在本地运行类似的决策模型？
证据
原话 · @Anonymous
$40m in funding, 2 years in stealth.Performs on-par with SemIf which was built in a couple days and apparently uses raw Qwen, with no fine-tuning. SemIf runs in your freaking browser. Oh and Jev is twice as expensive?Is it surprising that Jev consistently thinks it's Qwen?I'm almost convinced that Jev is a scam. Take Qwen, fine tune it a little, tell investors it cost $10m, spend $1m on advertising, profit.
原话 · @Anonymous
You can spot vibecoded websites by how they include the prompt or commit-style comments into the literal interface, instead of communicating it via visual context (or simply excluding it)> Sort by any column; values the run could not produce always sort last. Hover a cost for how it was priced, a latency for the endpoint. Names link to each project.
原话 · @Anonymous
Are there any "System One" models or jev like models that run on ollama?
免责声明：本卡片由 AI 从社区讨论中提炼，属于「痛点证据」，是需求分析与验证的起点，不等同于「已验证的市场需求」。AI 存在分析局限，关键决策前请打开上方原始讨论人工复核。