mirror of
https://github.com/labring/FastGPT.git
synced 2025-07-22 12:20:34 +00:00
![dependabot[bot]](/assets/img/avatar_default.png)
Bumps [axios](https://github.com/axios/axios) from 1.7.9 to 1.8.2. - [Release notes](https://github.com/axios/axios/releases) - [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md) - [Commits](https://github.com/axios/axios/compare/v1.7.9...v1.8.2) --- updated-dependencies: - dependency-name: axios dependency-type: direct:production ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
webcrawler
docker版快速部署
代码版部署
- 按照 https://github.com/searxng/searxng-docker 的方式处理docker
- 参考SPIDER文件夹下的.env.example,添加.env文件
- 进入SPIDER文件夹进行pnpm install
- 回到根目录,运行docker compose up -d
代码版开发
- 将docker-compose.yml中与SPIDER相关的部分注释掉(nodeapp)
- .env文件中的URL参照注释修改
- 注释掉启动puppteer部分里面指定浏览器地址的代码
- pnpm run dev
测试样例:
Auth的Bear Token记得填,也就是.env里的ACCESS_TOKEN
读取单页面(content以HTML形式返回)
http://localhost:3000/api/read?queryUrl=<url>
返回结构
{
"status": 200,
"data": {
"title": "something here",
"content": "something here"
}
}
{
"status": 400,
"error": {
"code": "MISSING_PARAM",
"message": "缺少必要参数: query"
}
}
搜索(content以HTML形式返回)
http://localhost:3000/api/search?query=<something>&pageCount=5&needDetails=true&engine=baidu
{
"status": 200,
"data": {
"results": [
{
"title": "string",
"url": "string",
"snippet": "string",
"source": "string",
"crawlStatus": "string",
"score": 0,
"content": "string"
}
]
}
}
{
"status": 400,
"error": {
"code": "MISSING_PARAM",
"message": "缺少必要参数: query"
}
}