semantic-cache 0.2.0
Cache LLM responses using semantic similarity matching. Similar questions return cached answers instantly, cutting API costs by 70% or more. Works with OpenAI, Anthropic, and Gemini.
Gemfile:
=
安装:
=
Runtime 依赖 (1):
ruby-openai
~> 7.0