Skip to content

Commit

Permalink
Docs tencent pages update (#14879)
Browse files Browse the repository at this point in the history
- updated `Tencent` provider page: added a chat model and document
loader references; company description
- updated Chat model and Document loader pages with descriptions, links
- renamed files to consistent formats; redirected file names
Note:
I was getting this linting error on code that **was not changed in my
PR**!

> Error:
docs/docs/guides/safety/hugging_face_prompt_injection.ipynb:1:1: I001
Import block is un-sorted or un-formatted
> make: *** [Makefile:47: lint_package] Error 1

I've fixed this error in the notebook
  • Loading branch information
leo-gan authored Dec 19, 2023
1 parent c5a685b commit 2861766
Show file tree
Hide file tree
Showing 7 changed files with 138 additions and 28 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -49,8 +49,8 @@
},
"outputs": [],
"source": [
"from transformers import pipeline, AutoTokenizer\n",
"from optimum.onnxruntime import ORTModelForSequenceClassification\n",
"from transformers import AutoTokenizer, pipeline\n",
"\n",
"# Using https://huggingface.co/laiyer/deberta-v3-base-prompt-injection\n",
"model_path = \"laiyer/deberta-v3-base-prompt-injection\"\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,16 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"# ChatHunyuan\n",
"# Tencent Hunyuan\n",
"\n",
"Hunyuan chat model API by Tencent. For more information, see [https://cloud.tencent.com/document/product/1729](https://cloud.tencent.com/document/product/1729)"
">[Tencent's hybrid model API](https://cloud.tencent.com/document/product/1729) (`Hunyuan API`) \n",
"> implements dialogue communication, content generation, \n",
"> analysis and understanding, and can be widely used in various scenarios such as intelligent \n",
"> customer service, intelligent marketing, role playing, advertising copywriting, product description,\n",
"> script creation, resume generation, article writing, code generation, data analysis, and content\n",
"> analysis.\n",
"\n",
"See for [more information](https://cloud.tencent.com/document/product/1729)."
]
},
{
Expand Down Expand Up @@ -85,7 +92,10 @@
{
"cell_type": "markdown",
"metadata": {
"collapsed": false
"collapsed": false,
"jupyter": {
"outputs_hidden": false
}
},
"source": [
"## For ChatHunyuan with Streaming"
Expand All @@ -99,7 +109,10 @@
"end_time": "2023-10-19T10:20:41.507720Z",
"start_time": "2023-10-19T10:20:41.496456Z"
},
"collapsed": false
"collapsed": false,
"jupyter": {
"outputs_hidden": false
}
},
"outputs": [],
"source": [
Expand All @@ -119,7 +132,10 @@
"end_time": "2023-10-19T10:20:46.275673Z",
"start_time": "2023-10-19T10:20:44.241097Z"
},
"collapsed": false
"collapsed": false,
"jupyter": {
"outputs_hidden": false
}
},
"outputs": [
{
Expand Down Expand Up @@ -150,7 +166,10 @@
"ExecuteTime": {
"start_time": "2023-10-19T10:19:56.233477Z"
},
"collapsed": false
"collapsed": false,
"jupyter": {
"outputs_hidden": false
}
},
"outputs": [],
"source": []
Expand All @@ -172,10 +191,9 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.4"
},
"orig_nbformat": 4
"version": "3.10.12"
}
},
"nbformat": 4,
"nbformat_minor": 2
"nbformat_minor": 4
}
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,15 @@
"source": [
"# Tencent COS Directory\n",
"\n",
">[Tencent Cloud Object Storage (COS)](https://www.tencentcloud.com/products/cos) is a distributed \n",
"> storage service that enables you to store any amount of data from anywhere via HTTP/HTTPS protocols. \n",
"> `COS` has no restrictions on data structure or format. It also has no bucket size limit and \n",
"> partition management, making it suitable for virtually any use case, such as data delivery, \n",
"> data processing, and data lakes. `COS` provides a web-based console, multi-language SDKs and APIs, \n",
"> command line tool, and graphical tools. It works well with Amazon S3 APIs, allowing you to quickly \n",
"> access community tools and plugins.\n",
"\n",
"\n",
"This covers how to load document objects from a `Tencent COS Directory`."
]
},
Expand Down Expand Up @@ -108,7 +117,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.6"
"version": "3.10.12"
}
},
"nbformat": 4,
Expand Down
10 changes: 9 additions & 1 deletion docs/docs/integrations/document_loaders/tencent_cos_file.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,14 @@
"source": [
"# Tencent COS File\n",
"\n",
">[Tencent Cloud Object Storage (COS)](https://www.tencentcloud.com/products/cos) is a distributed \n",
"> storage service that enables you to store any amount of data from anywhere via HTTP/HTTPS protocols. \n",
"> `COS` has no restrictions on data structure or format. It also has no bucket size limit and \n",
"> partition management, making it suitable for virtually any use case, such as data delivery, \n",
"> data processing, and data lakes. `COS` provides a web-based console, multi-language SDKs and APIs, \n",
"> command line tool, and graphical tools. It works well with Amazon S3 APIs, allowing you to quickly \n",
"> access community tools and plugins.\n",
"\n",
"This covers how to load document object from a `Tencent COS File`."
]
},
Expand Down Expand Up @@ -83,7 +91,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.9.6"
"version": "3.10.12"
}
},
"nbformat": 4,
Expand Down
82 changes: 82 additions & 0 deletions docs/docs/integrations/providers/tencent.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,82 @@
# Tencent

>[Tencent Holdings Ltd. (Wikipedia)](https://en.wikipedia.org/wiki/Tencent) (Chinese: 腾讯; pinyin: Téngxùn)
> is a Chinese multinational technology conglomerate and holding company headquartered
> in Shenzhen. `Tencent` is one of the highest grossing multimedia companies in the
> world based on revenue. It is also the world's largest company in the video game industry
> based on its equity investments.

## Chat model

>[Tencent's hybrid model API](https://cloud.tencent.com/document/product/1729) (`Hunyuan API`)
> implements dialogue communication, content generation,
> analysis and understanding, and can be widely used in various scenarios such as intelligent
> customer service, intelligent marketing, role playing, advertising, copyrighting, product description,
> script creation, resume generation, article writing, code generation, data analysis, and content
> analysis.

For more information, see [this notebook](/docs/integrations/chat/tencent_hunyuan)

```python
from langchain.chat_models import ChatHunyuan
```

## Vector Store

>[Tencent Cloud VectorDB](https://www.tencentcloud.com/products/vdb) is a fully managed,
> self-developed enterprise-level distributed database service
>dedicated to storing, retrieving, and analyzing multidimensional vector data. The database supports a variety of index
>types and similarity calculation methods, and a single index supports 1 billion vectors, millions of QPS, and
>millisecond query latency. `Tencent Cloud Vector Database` can not only provide an external knowledge base for large
>models and improve the accuracy of large models' answers, but also be widely used in AI fields such as
>recommendation systems, NLP services, computer vision, and intelligent customer service.
Install the Python SDK:

```bash
pip install tcvectordb
```

For more information, see [this notebook](/docs/integrations/vectorstores/tencentvectordb)

```python
from langchain.vectorstores import TencentVectorDB
```

## Document Loaders

### Tencent COS

>[Tencent Cloud Object Storage (COS)](https://www.tencentcloud.com/products/cos) is a distributed
> storage service that enables you to store any amount of data from anywhere via HTTP/HTTPS protocols.
> `COS` has no restrictions on data structure or format. It also has no bucket size limit and
> partition management, making it suitable for virtually any use case, such as data delivery,
> data processing, and data lakes. COS provides a web-based console, multi-language SDKs and APIs,
> command line tool, and graphical tools. It works well with Amazon S3 APIs, allowing you to quickly
> access community tools and plugins.
Install the Python SDK:

```bash
pip install cos-python-sdk-v5
```

#### Tencent COS Directory

For more information, see [this notebook](/docs/integrations/document_loaders/tencent_cos_directory)

```python
from langchain.document_loaders import TencentCOSDirectoryLoader
from qcloud_cos import CosConfig
```

#### Tencent COS File

For more information, see [this notebook](/docs/integrations/document_loaders/tencent_cos_file)

```python
from langchain.document_loaders import TencentCOSFileLoader
from qcloud_cos import CosConfig
```
15 changes: 0 additions & 15 deletions docs/docs/integrations/providers/tencentvectordb.mdx

This file was deleted.

8 changes: 8 additions & 0 deletions docs/vercel.json
Original file line number Diff line number Diff line change
@@ -1,5 +1,13 @@
{
"redirects": [
{
"source": "/docs/integrations/providers/tencentvectordb",
"destination": "/docs/integrations/providers/tencent"
},
{
"source": "/docs/integrations/chat/hunyuan",
"destination": "/docs/integrations/chat/tencent_hunyuan"
},
{
"source": "/docs/integrations/providers/aws_dynamodb",
"destination": "/docs/integrations/platforms/aws#aws-dynamodb"
Expand Down

0 comments on commit 2861766

Please sign in to comment.