mirror of
https://github.com/labring/FastGPT.git
synced 2025-10-17 00:14:51 +00:00
reranker.md优化docker启动命令,并增加docker-compose.yml示例 (#936)
原docker启动命令启动后的容器只能使用CPU运行。本次修改增加了GPU参数,并提供docker-compose.yml示例
This commit is contained in:
@@ -54,11 +54,37 @@ ACCESS_TOKEN=mytoken
|
|||||||
```
|
```
|
||||||
|
|
||||||
**运行命令示例**
|
**运行命令示例**
|
||||||
|
- 无需GPU环境,使用CPU运行
|
||||||
```sh
|
```sh
|
||||||
docker run -d --name reranker -p 6006:6006 -e ACCESS_TOKEN=mytoken luanshaotong/reranker:v0.1
|
docker run -d --name reranker -p 6006:6006 -e ACCESS_TOKEN=mytoken luanshaotong/reranker:v0.1
|
||||||
```
|
```
|
||||||
|
|
||||||
|
- 需要CUDA 11.7环境
|
||||||
|
```sh
|
||||||
|
docker run -d --gpus all --name reranker -p 6006:6006 -e ACCESS_TOKEN=mytoken luanshaotong/reranker:v0.1
|
||||||
|
```
|
||||||
|
|
||||||
|
**docker-compose.yml示例**
|
||||||
|
```
|
||||||
|
version: "3"
|
||||||
|
services:
|
||||||
|
reranker:
|
||||||
|
image: luanshaotong/reranker:v0.1
|
||||||
|
container_name: reranker
|
||||||
|
# GPU运行环境,如果宿主机未安装,将deploy配置隐藏即可
|
||||||
|
deploy:
|
||||||
|
resources:
|
||||||
|
reservations:
|
||||||
|
devices:
|
||||||
|
- driver: nvidia
|
||||||
|
count: all
|
||||||
|
capabilities: [gpu]
|
||||||
|
ports:
|
||||||
|
- 6006:6006
|
||||||
|
environment:
|
||||||
|
- ACCESS_TOKEN=mytoken
|
||||||
|
|
||||||
|
```
|
||||||
## 接入 FastGPT
|
## 接入 FastGPT
|
||||||
|
|
||||||
参考 [ReRank模型接入](/docs/development/configuration/#rerank-接入),host 变量为部署的域名。
|
参考 [ReRank模型接入](/docs/development/configuration/#rerank-接入),host 变量为部署的域名。
|
||||||
|
Reference in New Issue
Block a user