Connection Pooling
Inspired by Design a Distributed Rate Limiter w/ a Ex-Meta Staff Engineer: System Design Breakdown
Connection pooling allows avoiding TCP handshake overhead.
Keep some connections ahead
Sources
Referenced by
- Adding a dependency to a service adds network overheadGrowing
Server operation time + network overhead. For example, Redis operations are quite fast (couple of ms), there will always be network overhead.