TensorRT-LLM adds Mooncake cache sharing to its v1.4 release candidateNVIDIA's October 22nd release candidate lists the connector, which lets serving instances reuse cached prompt prefixes. Operators trade repeated prompt computation for shared host-memory capacity and KV-transfer overhead.RuntimeWire · 2026-10-27T04:29:34.965Z