Memberships for companies and creative individuals. Apply here please!
面向公司和创意个人的会员资格。请在此申请！
impromptu ai engineer preshow floor tour and AMA
impromptu ai engineer 预热现场参观与 AMA
An interesting way to take Noam at his word in regards to always keeping a constant inference budget for any eval reporting - is that open models have a lot more dollar per token mileage than closed model APIs. So anyone launching an open model today or situationally incentivized toward open models should obviously report thinking levels measured by dollar inference on popular inference providers, instead of by number of tokens on the x axis
就 Noam 关于在任何 eval（评测）报告中始终保持恒定 inference（推理）预算这一点“照字面执行”，有一种有趣的方式：open models 的每 token 美元性价比，要比 closed model APIs 高得多。因此，任何今天发布 open model 的人，或者在特定情境下有动力偏向 open models 的人，显然都应该按热门推理服务商上的美元推理成本来报告 thinking（思考）水平，而不是在 x 轴上用 token 数量来衡量。