According to cache capacity guidelines, when should you scale the cache?

According to cache capacity guidelines, when should you scale the cache?

• A. Scale cache only when memory usage exceeds 50%.
• B. Scale cache only when ops/sec exceed 10k.
• C. Scale cache only when latency exceeds 10 ms.
• D. Scale when memory usage exceeds 80% or ops/sec exceed 100k, or latency falls below 0.5 ms.

Answer: (D)

The idea is to manage cache capacity using multiple, practical signals rather than a single metric. Scale when you’re genuinely approaching the limits or when demand is high, so you keep performance from degrading. If memory usage climbs above 80%, you’re near the memory cap and eviction pressure rises, so adding capacity helps. If the workload pushes throughput beyond a high threshold (like 100k ops/sec), the cache is under heavier use and may start showing latency or miss penalties unless you scale. If latency is already very good (below 0.5 ms), you have headroom to scale ahead of expected growth to preserve that fast response as traffic increases. Using these combined conditions helps ensure scaling happens in response to real pressure and also in anticipation of rising load, rather than based on a single metric that might mislead.

The idea is to manage cache capacity using multiple, practical signals rather than a single metric. Scale when you’re genuinely approaching the limits or when demand is high, so you keep performance from degrading. If memory usage climbs above 80%, you’re near the memory cap and eviction pressure rises, so adding capacity helps. If the workload pushes throughput beyond a high threshold (like 100k ops/sec), the cache is under heavier use and may start showing latency or miss penalties unless you scale. If latency is already very good (below 0.5 ms), you have headroom to scale ahead of expected growth to preserve that fast response as traffic increases. Using these combined conditions helps ensure scaling happens in response to real pressure and also in anticipation of rising load, rather than based on a single metric that might mislead.