Semantic caching cuts agent tool calls by 40 percent in new eval

A recent arXiv preprint introduces a semantic cache layer for tool arguments in multi-step agents. Testing on AgentBench shows latency drops significantly without measurable accuracy loss. This approach could simplify production deployments where API cost is a primary constraint.