October 18, 2026
Session affinity in Vercel AI Gateway: a conversation stays with the provider that holds its prompt cache

Vercel AI Gateway now groups requests into sessions by conversation. Logs show cost, cache hit rate, and the agent that made each request. Session affinity keeps each session with the provider where its prompt cache lives.
Source