Maintained with ☕️ by
IcePanel logo

You can use Bigtable as a remote storage backend for LMCache

Share

Services

## Feature Feature You can use Bigtable as a remote storage backend for[LMCache](https://docs.lmcache.ai/kv%5Fcache/storage%5Fbackends/bigtable.html). By storing the large language model (LLM) key-value (KV) cache externally in Bigtable, multiple AI serving instances can share and reuse precomputed attention tensors. This reduces compute overhead and significantly improves time-to-first-token (TTFT) for repeated prompts and shared documents. This feature is in [Preview](https://cloud.google.com/products#product-launch-stages).