2 docs tagged with "semantic-cache"

Sub-millisecond semantic caching for generative AI applications with Redis LangCache.

System design of semantic caching architectures for LLMs: similarity thresholds, TTL policies, and cost reduction.