SL#163 - Architecture at Scale (7) - Cloudflare: Your Connection Pool Is an Architecture Decision, Not a Tuning Knob

When Cloudflare replaced NGINX with Pingora, the 80 ms it cut from p95 latency came from changing who owns the connection pool, not from faster code. Here is how a process model decides your latency, and what to copy from it.