HPE Slashes LLM Latency 1000×: 1TB Cache Loads in 120ms, Not Hours
TL;DR
* HPE unveils Alletra Storage MP X10000 for AI workloads with KV cache and shared object storage
* Scale Computing Acquires Adaptiv Networks to Integrate SD-WAN/SASE into Managed Network Services
⚡ HPE MP X10000: 120ms KV-Cache Offload Cuts LLM Prefill From Minutes to Milliseconds
1 TB KV cache loads in