First, what kind of performance are we talking about?

• Responsiveness—How quickly a system returns the result of an individual request (think of "latency")
• Throughput—The total amount of computational work done per unit time (think of "bandwidth")

We are primarily interested in responsiveness.