You can use Bigtable as a remote storage backend for LMCache
Share
Services
## Feature
Feature
You can use Bigtable as a remote storage backend for[LMCache](https://docs.lmcache.ai/kv%5Fcache/storage%5Fbackends/bigtable.html). By storing the large language model (LLM) key-value (KV) cache externally in Bigtable, multiple AI serving instances can share and reuse precomputed attention tensors. This reduces compute overhead and significantly improves time-to-first-token (TTFT) for repeated prompts and shared documents. This feature is in [Preview](https://cloud.google.com/products#product-launch-stages).
What else is happening at Google Cloud Platform?
Read update
Services
Share
GKE cluster versions have been updated. New versions available for upgrades and new clusters
about 1 hour ago
Services
Share
Read update
Services
Share
Read update
Services
Share