Chapter I: Networking & Web Fundamentals
Latency vs Throughput
Time per request vs. requests served per second — and why they differ.
In short
Latency is how long one request takes; throughput is how many requests complete per unit of time.
Loading diagram…
Key takeaways
- Latency = time per request; throughput = requests per second.
- Track latency at p95/p99, not just the average.
- More parallelism raises throughput without lowering latency.