ChatGPT/FastGPT
1
0
Fork 0
mirror of https://github.com/labring/FastGPT.git synced 2025-07-23 05:12:39 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,143 Commits 12 Branches 231 Tags
6873af01d4f72b6d7c300450a2f349b2905c4900
Commit Graph

466 Commits

Author SHA1 Message Date
Archer
7494ce8453 perf: async read file (#4978) 
* perf: async read file

* package

* doc
 2025-06-08 18:46:36 +08:00
dependabot[bot]
de1dcf9370 chore(deps): bump multer from 2.0.0 to 2.0.1 in /packages/service (#4964) 
Bumps [multer](https://github.com/expressjs/multer) from 2.0.0 to 2.0.1.
- [Release notes](https://github.com/expressjs/multer/releases)
- [Changelog](https://github.com/expressjs/multer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/expressjs/multer/compare/v2.0.0...v2.0.1)

---
updated-dependencies:
- dependency-name: multer
  dependency-version: 2.0.1
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-06-06 15:29:35 +08:00
Archer
c30f069f2f V4.9.11 feature (#4969) 
* Feat: Images dataset collection (#4941)

* New pic (#4858)

* 更新数据集相关类型，添加图像文件ID和预览URL支持；优化数据集导入功能，新增图像数据集处理组件；修复部分国际化文本；更新文件上传逻辑以支持新功能。

* 与原先代码的差别

* 新增 V4.9.10 更新说明，支持 PG 设置`systemEnv.hnswMaxScanTuples`参数，优化 LLM stream 调用超时，修复全文检索多知识库排序问题。同时更新数据集索引，移除 datasetId 字段以简化查询。

* 更换成fileId_image逻辑，并增加训练队列匹配的逻辑

* 新增图片集合判断逻辑，优化预览URL生成流程，确保仅在数据集为图片集合时生成预览URL，并添加相关日志输出以便调试。

* Refactor Docker Compose configuration to comment out exposed ports for production environments, update image versions for pgvector, fastgpt, and mcp_server, and enhance Redis service with a health check. Additionally, standardize dataset collection labels in constants and improve internationalization strings across multiple languages.

* Enhance TrainingStates component by adding internationalization support for the imageParse training mode and update defaultCounts to include imageParse mode in trainingDetail API.

* Enhance dataset import context by adding additional steps for image dataset import process and improve internationalization strings for modal buttons in the useEditTitle hook.

* Update DatasetImportContext to conditionally render MyStep component based on data source type, improving the import process for non-image datasets.

* Refactor image dataset handling by improving internationalization strings, enhancing error messages, and streamlining the preview URL generation process.

* 图片上传到新建的 dataset_collection_images 表，逻辑跟随更改

* 修改了除了controller的其他部分问题

* 把图片数据集的逻辑整合到controller里面

* 补充i18n

* 补充i18n

* resolve评论：主要是上传逻辑的更改和组件复用

* 图片名称的图标显示

* 修改编译报错的命名问题

* 删除不需要的collectionid部分

* 多余文件的处理和改动一个删除按钮

* 除了loading和统一的imageId,其他都resolve掉的

* 处理图标报错

* 复用了MyPhotoView并采用全部替换的方式将imageFileId变成imageId

* 去除不必要文件修改

* 报错和字段修改

* 增加上传成功后删除临时文件的逻辑以及回退一些修改

* 删除path字段，将图片保存到gridfs内，并修改增删等操作的代码

* 修正编译错误

---------

Co-authored-by: archer <545436317@qq.com>

* perf: image dataset

* feat: insert image

* perf: image icon

* fix: training state

---------

Co-authored-by: Zhuangzai fa <143257420+ctrlz526@users.noreply.github.com>

* fix: ts (#4948)

* Thirddatasetmd (#4942)

* add thirddataset.md

* fix thirddataset.md

* fix

* delete wrong png

---------

Co-authored-by: dreamer6680 <146868355@qq.com>

* perf: api dataset code

* perf: log

* add secondary.tsx (#4946)

* add secondary.tsx

* fix

---------

Co-authored-by: dreamer6680 <146868355@qq.com>

* perf: multiple menu

* perf: i18n

* feat: parse queue (#4960)

* feat: parse queue

* feat: sync parse queue

* fix thirddataset.md (#4962)

* fix thirddataset-4.png (#4963)

* feat: Dataset template import (#4934)

* 模版导入部分除了文档还没写

* 修复模版导入的 build 错误

* Document production

* compress pictures

* Change some constants to variables

---------

Co-authored-by: Archer <545436317@qq.com>

* perf: template import

* doc

* llm pargraph

* bocha tool

* fix: del collection

---------

Co-authored-by: Zhuangzai fa <143257420+ctrlz526@users.noreply.github.com>
Co-authored-by: dreamer6680 <1468683855@qq.com>
Co-authored-by: dreamer6680 <146868355@qq.com>
 2025-06-06 14:48:44 +08:00
gggaaallleee
9fb5d05865 add audit (#4923) 
* add audit

* update audit

* update audit
 2025-06-03 21:28:26 +08:00
Archer
0f866fc552 feat: text collecion auto save for a txt file (#4924) 2025-05-29 17:57:27 +08:00
heheer
fa80ce3a77 fix child app external variables (#4919) 2025-05-29 13:37:59 +08:00
Archer
830358aa72 remove invalid code (#4915) 2025-05-28 22:11:40 +08:00
Archer
02b214b3ec feat: remove buffer;fix: custom pdf parse (#4914) 
* fix: doc

* fix: remove buffer

* fix: pdf parse
 2025-05-28 21:48:10 +08:00
Archer
a171c7b11c perf: buffer;fix: back up split (#4913) 
* perf: buffer

* fix: back up split

* fix: app limit

* doc
 2025-05-28 18:18:25 +08:00
heheer
802de11363 fix runtool empty message (#4911) 
* fix runtool empty message

* del unused code

* fix
 2025-05-28 17:48:30 +08:00
Archer
b4ecfb0b79 Feat: Node latest version (#4905) 
* node versions add keep the latest option (#4899)

* node versions add keep the latest option

* i18n

* perf: version code

* fix: ts

* hide system version

* hide system version

* hide system version

* fix: ts

* fix: ts

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-05-28 10:46:32 +08:00
Archer
c25cd48e72 perf: chunk trigger and paragraph split (#4893) 
* perf: chunk trigger and paragraph split

* update max size computed

* perf: i18n

* remove table
 2025-05-26 18:57:22 +08:00
Archer
874300a56a fix: chinese name export (#4890) 
* fix: chinese name export

* fix: xlsx white space

* doc

* doc
 2025-05-25 21:19:29 +08:00
Archer
1dea2b71b4 perf: human check;perf: recursion get node response (#4888) 
* perf: human check

* version

* perf: recursion get node response
 2025-05-25 20:55:29 +08:00
Archer
fae76e887a perf: dataset import params code (#4875) 
* perf: dataset import params code

* perf: api dataset code

* model
 2025-05-23 10:40:25 +08:00
dreamer6680
9af92d1eae Open Yufu Feishu Knowledge Base Permissions (#4867) 
* add feishu yuque dataset

* Open Yufu Feishu Knowledge Base Permissions

* Refactor the dataset request module, optimize the import path, and fix the type definition

---------

Co-authored-by: dreamer6680 <146868355@qq.com>
 2025-05-22 23:19:55 +08:00
Archer
6a6719e93d perf: isPc check;perf: dataset max token checker (#4872) 
* perf: isPc check

* perf: dataset max token checker

* perf: dataset max token checker
 2025-05-22 18:40:29 +08:00
Archer
88bd3aaa9e perf: backup import (#4866) 
* i18n

* remove invalid code

* perf: backup import

* backup tip

* fix: indexsize invalid
 2025-05-22 15:53:51 +08:00
Archer
dd3c251603 fix: stream response (#4853) 2025-05-21 10:21:20 +08:00
Archer
aa55f059d4 perf: chat history api;perf: full text error (#4852) 
* perf: chat history api

* perf: i18n

* perf: full text
 2025-05-20 22:31:32 +08:00
dependabot[bot]
593ebfd269 chore(deps): bump multer from 1.4.5-lts.1 to 2.0.0 (#4839) 
Bumps [multer](https://github.com/expressjs/multer) from 1.4.5-lts.1 to 2.0.0.
- [Release notes](https://github.com/expressjs/multer/releases)
- [Changelog](https://github.com/expressjs/multer/blob/v2.0.0/CHANGELOG.md)
- [Commits](https://github.com/expressjs/multer/compare/v1.4.5-lts.1...v2.0.0)

---
updated-dependencies:
- dependency-name: multer
  dependency-version: 2.0.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-05-20 13:58:47 +08:00
Archer
1dac2b70ec perf: stream timeout;feat: hnsw max_scan_tuples config;fix: fulltext search merge error (#4838) 
* perf: stream timeout

* feat: hnsw max_scan_tuples config

* fix: fulltext search merge error

* perf: jieba code
 2025-05-20 09:59:24 +08:00
Archer
2d2d0fffe9 Test apidataset (#4830) 
* Dataset (#4822)

* apidataset support to basepath

* Resolve the error of the Feishu Knowledge Base modification configuration page not supporting baseurl bug.

* apibasepath

* add

* perf: api dataset

---------

Co-authored-by: dreamer6680 <1468683855@qq.com>
 2025-05-17 22:41:10 +08:00
Archer
e145f63554 feat: chat error msg (#4826) 
* perf: i18n

* feat: chat error msg

* feat: doc
 2025-05-16 12:07:11 +08:00
Archer
554b2ca8dc perf: mcp tool type (#4820) 2025-05-15 18:14:32 +08:00
Archer
4e83840c14 perf: tool call check (#4818) 
* i18n

* tool call

* fix: mcp create permission;Plugin unauth tip

* fix: mcp create permission;Plugin unauth tip

* fix: Cite modal permission

* remove invalide cite

* perf: prompt

* filter fulltext search

* fix: ts

* fix: ts

* fix: ts
 2025-05-15 15:51:34 +08:00
Archer
a4db03a3b7 feat: session id (#4817) 
* feat: session id

* feat: Add default index
 2025-05-14 17:24:02 +08:00
Archer
cba8f773fe New license (#4809) 
* feat: new-license

* perf: volumn watch

* Set use client
 2025-05-14 13:55:09 +08:00
heheer
3688842cc7 filter tool type version & fix unpublished version (#4803) 2025-05-13 17:58:51 +08:00
Archer
1470c37ef1 Test media tag (#4796) 
* feat: add html video tag convertion (#4784)

Co-authored-by: Zhenyi Wang <zhenyiwang@intl.zju.edu.cn>

* perf: media tag

---------

Co-authored-by: Zhenyi-Wang <47094597+Zhenyi-Wang@users.noreply.github.com>
Co-authored-by: Zhenyi Wang <zhenyiwang@intl.zju.edu.cn>
 2025-05-13 10:46:49 +08:00
Archer
0ef3d40296 Test version (#4792) 
* plugin node version select (#4760)

* plugin node version select

* type

* fix

* fix

* perf: version list

* fix node version (#4787)

* change my select

* fix-ui

* fix test

* add test

* fix

* remove invalid version field

* filter deprecated field

* fix: claude tool call

* fix: test

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-05-12 22:27:01 +08:00
Theresa
3cc6b8a17a fix: improve handling of interactive node responses in workflow dispatch (#4786) 
* fix: improve handling of interactive node responses in workflow dispatch

* fix: simplify interactive response handling in dispatch functions
 2025-05-12 18:18:05 +08:00
Archer
657fa32217 feat: system config type；fix: retraining permission (#4772) 
* feat: system config type

* fix: retraining permission
 2025-05-08 22:09:55 +08:00
Archer
12d6948ba7 Feat: prelogin (#4773) 
* add prelogin api (#4762)

* add prelogin api

* move type.d.ts

* perf: prelogin code

* doc

* fix: ts

---------

Co-authored-by: dreamer6680 <1468683855@qq.com>
 2025-05-08 22:09:02 +08:00
Archer
83d54d046d perf: replace cite;perf: app card ui (#4768) 
* perf: replace cite

* perf: app card ui

* fix: test
 2025-05-08 13:35:08 +08:00
Archer
c75f154728 Password security policy (#4765) 
* Psw (#4748)

* feat: 添加重置密码功能及相关接口

- 在用户模型中新增 passwordUpdateTime 字段以记录密码更新时间。
- 更新用户模式以支持密码更新时间的存储。
- 新增重置密码的模态框组件，允许用户重置密码。
- 实现重置密码的 API 接口，支持根据用户 ID 更新密码。
- 更新相关国际化文件，添加重置密码的提示信息。

* 更新国际化文件，添加重置密码相关提示信息，并优化重置密码模态框的实现。修复部分代码逻辑，确保用户体验流畅。

* 更新国际化文件，添加重置密码相关提示信息，优化重置密码模态框的实现，修复部分代码逻辑，确保用户体验流畅。新增获取用户密码更新时间的API接口，并调整相关逻辑以支持密码重置功能。

* update

* fix

* fix

* Added environment variables NEXT_PUBLIC_PASSWORD_UPDATETIME to support password update time configuration, update related logic to implement password mandatory update function, and optimize the implementation of reset password modal box to improve user experience.

* update index

* 更新用户密码重置功能，调整相关API接口，优化重置密码模态框的实现，确保用户体验流畅。修复部分代码逻辑，更新国际化提示信息。

* 删除获取用户密码更新时间的API接口，并在布局组件中移除不必要的重置密码模态框。优化代码结构，提升可维护性。

* update

* perf: reset expired password code

* perf: layout child components

* doc

* remove invalid env

* perf: update password code

---------

Co-authored-by: dreamer6680 <1468683855@qq.com>
 2025-05-08 12:11:08 +08:00
Archer
96e7dd581e fix: json schema parse error;fix: retraining image reset (#4757) 
* i18n

* fix: json schema parse error

* fix: retraining image reset

* update doc
 2025-05-07 15:38:03 +08:00
Theresa
2d3117c5da feat: update ESLint config with @typescript-eslint/consistent-type-imports (#4746) 
* update: Add type

* fix: update import statement for NextApiRequest type

* fix: update imports to use type for LexicalEditor and EditorState

* Refactor imports to use 'import type' for type-only imports across multiple files

- Updated imports in various components and API files to use 'import type' for better clarity and to optimize TypeScript's type checking.
- Ensured consistent usage of type imports in files related to chat, dataset, workflow, and user management.
- Improved code readability and maintainability by distinguishing between value and type imports.

* refactor: remove old ESLint configuration and add new rules

- Deleted the old ESLint configuration file from the app project.
- Added a new ESLint configuration file with updated rules and settings.
- Changed imports to use type-only imports in various files for better clarity and performance.
- Updated TypeScript configuration to remove unnecessary options.
- Added an ESLint ignore file to exclude build and dependency directories from linting.

* fix: update imports to use 'import type' for type-only imports in schema files
 2025-05-06 17:33:09 +08:00
Archer
ef537f391c fix: rerank usage (#4751) 
* remove invalid index

* perf: i18n

* fix: rerank usage
 2025-05-06 16:23:36 +08:00
Archer
7b9f935119 update next version (#4743) 2025-05-05 18:44:56 +08:00
Archer
a6fbfac96f Yuque dataset baseurl (#4742) 
* Yuque dataset baseurl (#4512)

* feat: 增加API数据集功能和国际化支持

* 在apiDataset.d.ts中添加uuid、slug、parent_uuid和children字段
* 更新英文、简体中文和繁体中文的dataset.json文件，增加多条提示信息
* 在ApiDatasetForm组件中实现目录选择功能，支持获取Yuque路径
* 新增BaseUrlSelector组件，用于选择根目录
* 实现getpath API，支持根据Yuque服务器获取路径
* 更新相关API调用，确保兼容性和功能完整性

* feat: 更新Yuque服务器的baseUrl处理逻辑

* 在apiDataset.d.ts中将YuqueServer的baseUrl属性改为必填
* 更新ApiDatasetForm组件，调整baseUrl的状态管理和路径加载逻辑
* 新增getcatalog API以支持获取数据集目录
* 修改相关API调用，确保baseUrl的正确传递和使用
* 优化路径返回值为中文“根目录”

* feat: 更新数据集API调用逻辑

* 将getFeishuAndYuqueDatasetFileList替换为getProApiDatasetFileListRequest，统一API调用方式
* 更新相关文件以确保新API的正确使用
* 优化代码结构，提高可读性和维护性

* 清理代码：移除ApiDatasetForm、BaseUrlSelector和相关API中的调试日志

* 删除不必要的console.log语句，提升代码整洁性
* 确保API逻辑的清晰性，避免冗余输出

* 更新数据集相关类型和API逻辑

- 在apiDataset.d.ts中添加ApiDatasetDetailResponse类型，移除不必要的字段。
- 在proApi.ts中新增DETAIL操作类型及相关参数类型。
- 修改ApiDatasetForm.tsx以支持新的API调用逻辑，统一路径获取方式。
- 更新BaseUrlSelector组件，简化目录选择逻辑。
- 优化getpath.ts和getcatalog.ts中的路径处理逻辑，确保API调用的一致性和正确性。
- 清理不必要的代码和注释，提高代码可读性。

* 清理ApiDatasetForm组件中的调试日志，移除console.log语句以提升代码整洁性和可读性。

* fix

* updata apidatasetform

* remove console

* updata

* updata

* updata editapiservermodal

* updata i18n

* add type

* update getpath

* add type

* perf: yuque dataset baseurl

* perf: remove rerank records

* fix: ts

---------

Co-authored-by: dreamer6680 <1468683855@qq.com>
 2025-05-05 18:37:14 +08:00
Archer
864eff47c7 perf: i18n (#4740) 
* feat: login limit time config

* doc

* perf: code

* i18n update

* update lock

* fix: ts

* update package
 2025-05-05 16:16:59 +08:00
Archer
fdd4e9edbd Test parse cite and add tool call parallel (#4737) 
* add quote response filter (#4727)

* chatting

* add quote response filter

* add test

* remove comment

* perf: cite hidden

* perf: format llm response

* feat: comment

* update default chunk size

* update default chunk size

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-04-30 17:43:50 +08:00
Archer
4b8db293ce perf: init token worker (#4726) 
* perf: init token worker

* init worker

* preload worker

* preload worker

* remove invalid code
 2025-04-29 16:00:35 +08:00
Archer
360a2ec392 Remove quote prompt in api request (#4724) 
* chat completion add parsequote param (#4720)

* chat completion add parsequote param

* fix

* perf: quote prompt

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-04-29 13:10:17 +08:00
Archer
5023da4489 Feat: Quote auth (#4715) 
* fix outlink quote number auth (#4705)

* perf: quote auth

* feat: qwen3 config

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-04-29 12:05:04 +08:00
Archer
ca8adbbf95 feat: streamable http mcp (#4695) 
* feat: streamable http mcp

* mcp api path

* fix: ts
 2025-04-28 12:45:51 +08:00
Archer
bf14506603 perf: add outlink usage (#4691) 
* update doc

* perf: add outlink usage

* feat: jina provider
 2025-04-28 10:41:32 +08:00
Archer
659b8b1106 Test shorurl (#4686) 
* Short-chain burying (#4678)

* TrackRegisterParams

* 新增工作流导入功能，支持从URL获取工作流JSON数据并创建应用。实现了URL验证、CORS处理、剪贴板读取等功能，确保用户能够顺利导入工作流数据。

* 更新工作流导入功能，将导入逻辑从utils模块迁移至workflow模块，并修正相关导入路径。此更改有助于代码结构的清晰和模块化。

* 优化工作流导入组件，重构导入逻辑，增加从URL获取工作流数据的功能，并实现JSON配置导入窗口。修复了状态管理和错误处理，提升用户体验。

* 更新工作流导入功能，增加对UTM参数的支持，优化从URL获取工作流数据的逻辑，并重构相关API接口。修复了状态管理和错误处理，提升了用户体验。

* 更新创建应用的API接口，将UTM参数的字段名称从`shorUrlId`和`projectCode`修改为`shorUrlPlatform`和`shorUrlProjectCode`，以提高代码的可读性和一致性。

* impoter json

* Optimize the logic

* delete some console

* fix

* perf: sem code

---------

Co-authored-by: dreamer6680 <1468683855@qq.com>
 2025-04-27 22:56:42 +08:00
Archer
5357aa402b perf: Add tool call prompt (#4683) 
* update i18n

* perf: Add tool call prompt
 2025-04-27 18:29:10 +08:00