Skip to content

Commit

Permalink
gptcache
Browse files Browse the repository at this point in the history
  • Loading branch information
王奇文 committed Dec 22, 2023
1 parent 7267c5b commit aea7ba8
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions _posts/2023-09-20-llm-optimize.md
Original file line number Diff line number Diff line change
Expand Up @@ -718,6 +718,7 @@ GPTCache是一个开源库,支持OpenAI ChatGPT 接口和 LangChain 接口
GPTCache 通过 embedding 算法将query转换为向量,并使用向量数据库进行相似性搜索,从缓存中检索相关查询。

GPTCache 采用了模块化的设计,允许用户灵活自定义每个模块。
- ![](https://github.com/zilliztech/GPTCache/raw/main/docs/GPTCacheStructure.png)

虽然语义缓存可能会返回假正类(false positive)和负类(negative)结果,但 GPTCache 提供 3 种性能指标来帮助开发人员优化其缓存系统。

Expand Down

0 comments on commit aea7ba8

Please sign in to comment.