Multi-model agentic systems clearly are the future. Great post by cursor. Their new research shows that a frontier model as a planner and orchestrator with a workhorse cheaper model can materially lower the cost of total tokens on a project, resulting in a 15X cost improvement. “Few moments in a large task genuinely require frontier intelligence, such as the original decomposition, the design decisions, and certain trade-offs. Once a frontier planner has collapsed the ambiguity into a detailed, explicit instruction, less expensive models simply have to follow it.” This is increasingly becoming the core design pattern of complex agents, because the tokens used on large amounts of work on many tasks don’t require the same intelligence threshold as the planning step. By routing to different models based on where you are in the task, you get much greater efficiency overall. This provides the template for where the applied layer in AI will differentiate. You can only drive this efficiency if you know the domain well and have the ability to work with multiple model tiers; companies that can do this will across coding, finance, legal, healthcare, life sciences, and other critical spaces will be in a strong position to get larger workloads that would otherwise be too expensive for the customer to deploy.
多模型的 agentic systems(代理式系统)显然就是未来。cursor 的这篇文章很棒。他们最新的研究表明,让 frontier model(前沿模型)担任规划者和编排者,再配合一个更便宜、负责大量执行工作的 workhorse model(主力模型),可以显著降低一个项目的总 token 成本,带来 15 倍的成本改进。“在一个大型任务中,真正需要 frontier intelligence(前沿智能)的时刻其实很少,比如最初的任务拆解、设计决策以及某些权衡。一旦 frontier planner(前沿规划器)把模糊性收束为细致、明确的指令,成本更低的模型就只需要照着执行。” 这正越来越成为复杂 agent 的核心设计模式,因为在许多任务的大量工作中所消耗的 token,并不需要像规划步骤那样高的智能门槛。根据任务所处的不同阶段,把请求路由到不同模型,就能在整体上获得高得多的效率。这也为 AI 应用层未来将如何形成差异化提供了模板。只有当你非常了解具体领域,并且有能力协同使用多个模型层级时,才能真正推动这种效率;而能够做到这一点的公司——无论是在 coding、finance、legal、healthcare、life sciences,还是其他关键领域——都将处于有利位置,去承接那些原本会因为对客户来说过于昂贵而无法部署的更大规模工作负载。