How OpenAI’s Responses API WebSocket Revamp Accelerates Agent Workflows by 40%
OpenAI identified API‑overhead as the new bottleneck after faster model inference and introduced a persistent WebSocket connection that caches conversation state, overlaps request phases, and preserves the original API shape, delivering up to a 40% end‑to‑end latency reduction and dramatically higher TPS.
