r/devops • u/imvmanish • 4h ago
Architecture How do you protect the first entry point from traffic overload?
Regardless of whether it's a CDN, WAF, Load Balancer, API Gateway, or Ingress, the first layer receiving traffic has finite resources.
Even with rate limiting, incoming requests still reach that layer. With millions of requests or large payloads (5–10 MB), how do we prevent the entry point itself from becoming the bottleneck?
- Can we reject requests before receiving their entire payload?
- Where should admission control actually happen?
- How do large-scale systems handle this without endlessly scaling the front layer?
Would love to hear real-world architectural approaches and trade-offs.