跳到正文
elvis· @omarsar0 · X·· 3 小时前AI 评分44
AI 导读

OpenAI DevDay 笔记指出,构建智能体应用优化成本与性能的4个关键杠杆是:prompt caching、reasoning effort、programmatic tool calling 和 batch request。OpenAI 开发文档提供了大量相关信息,建议熟悉这些杠杆并用 evals 进行测量。

正文

Sharing some notes from OpenAI DevDay in parts.

The first part matters, since it's on everyone's mind.

How do you optimize for cost and performance?

If you are building agentic applications today, these are 4 of the most important levers you absolutely must try:

  • prompt caching
  • reasoning effort
  • programmatic tool calling
  • batch request

The OpenAI dev docs have plenty of information, but these alone are good starting points for optimizing your agentic applications.

Familiarize yourself with these and measure them with evals.

来源:elvis · x.com