开源模型推理经济性
问题概述
开源模型在推理成本、硬件转售和单位经济可持续性方面面临若干关键挑战,导致其在实际使用中可能不如闭源模型具竞争力。
痛点标签
- 缺乏过时硬件的定价和转售市场
- 人工智能硬件被人为抬高以刺激新硬件销售
- 开源模型在能力退步时体验下降,单位经济不如闭源模型可持续
待验证问题
- 是否存在可行的过时硬件转售市场?
- 开源模型在单位经济上是否真的比闭源模型更可持续?
- 闭源模型的利润动机是否会导致 enshittification?
证据
原话 · @匿名
hardware as of today still has no utility value after its reported lifetime has elapsed, which prevents neolabs and smaller labs from getting older HW clusters as the banks are not willing to give out loans against them. There is no agreed upon pricing for "expired" A100 clusters or similar.
原话 · @匿名
I feel like there is some artificial moat being built here to stimulate sales of new hardware, because an H100 at 1/16th the price will have comparable dollar/FLOP as Vera Rubin.
原话 · @匿名
This makes the case that open weight models are not necessarily cheaper than closed weight modelsBut I'd still rather use them since it's inevitable the unsustainable margins of the closed weight providers lead to enshittification once they stop subsidizing demandI'd rather spend more today with a workflow whose underlying unit economics are sustainable and don't force me to inevitably look for other solutions once the closed weight providers start optimizing for profit and extracting value
免责声明:本卡片由 AI 从社区讨论中提炼,属于「痛点证据」,是需求分析与验证的起点,不等同于「已验证的市场需求」。AI 存在分析局限,关键决策前请打开上方原始讨论人工复核。