Storage Services

File and object storage for application data, and shared KV cache storage for LLM inference.

The MASS KV cache store holds KV cache generated during LLM inference and makes it available for reuse across GPU servers. It extends cache capacity beyond a server's GPU and host memory, reducing repeated computation when later requests share the same prompt prefix.