Real World Maths Busters

The Maths Behind Everyday Life

The story, the formula and a worked example — see exactly where this maths shows up in the world around you.

Back to all stories
Technology 3 min read

Why Caching Makes Everything Faster

A 99% cache hit rate reduces server load by 100×.

Caching stores frequently-requested data in fast memory. If 99 out of 100 requests hit the cache, only 1 reaches the slower database — a 100× reduction in database load.

Cache Hit Rate

If your cache serves 99% of requests and each cached response takes 1 ms while a database query takes 100 ms, the average response time drops dramatically.

tˉ=h×tc+(1−h)×td\bar{t} = h \times t_c + (1-h) \times t_d

h = hit rate, t_c = cache time, t_d = database time

99% hit rate, 1 ms cache, 100 ms database

  1. 1

    Average time

    0.99×1+0.01×100=0.99+1=1.99 ms0.99 \times 1 + 0.01 \times 100 = 0.99 + 1 = 1.99 \text{ ms}
  2. 2

    Without cache

    Every request: 100 ms

  3. 3

    Speedup

    1001.99≈50×\frac{100}{1.99} \approx 50 \times
Answer

50× faster on average with a 99% cache hit rate

The takeaway

Caching turns most requests into instant responses — the higher the hit rate, the bigger the win.

Back to all stories