System design interview question
Design a Distributed Reverse-Proxy and Load Balancing Control Plane for a Global API Gateway (Like AWS API Gateway at Enterprise Scale)
Design a distributed control plane that manages routing rules, load balancing policies, and traffic shaping for 50,000+ API endpoints across 12 global regions, handling 5M requests per second with sub-100ms rule propagation latency. The system must support dynamic endpoint registration/deregistration, weighted traffic splitting, circuit breaker policies, request rate limiting overrides, and real-time observability dashboards. Ensure consistency across regions while minimizing cross-region communication, handle graceful degradation when control plane is partially unavailable, and support atomic updates to complex routing rules affecting millions of concurrent requests without dropping traffic.
Practice this question step by step with an AI interviewer that reviews your requirements, your architecture and your trade-offs, and scores the design.