ChatGPT/FastGPT
1
0
Fork 0
mirror of https://github.com/labring/FastGPT.git synced 2025-07-24 22:03:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,150 Commits 12 Branches 231 Tags
a848c2e3baa7fc30b492e0f6ab58d65bd66db080
Commit Graph

348 Commits

Author SHA1 Message Date
Archer
a848c2e3ba feat: more sub plan info;fix: emprt index (#4997) 
* feat: more sub plan info

* fix: emprt index

* doc
 2025-06-10 19:01:10 +08:00
Archer
01ff56b42b perf: password special chars;feat: llm paragraph;perf: chunk setting params;perf: text splitter worker (#4984) 
* perf: password special chars

* feat: llm paragraph;perf: chunk setting params

* perf: text splitter worker

* perf: get rawtext buffer

* fix: test

* fix: test

* doc

* min chunk size
 2025-06-10 00:05:54 +08:00
Archer
7494ce8453 perf: async read file (#4978) 
* perf: async read file

* package

* doc
 2025-06-08 18:46:36 +08:00
Archer
c30f069f2f V4.9.11 feature (#4969) 
* Feat: Images dataset collection (#4941)

* New pic (#4858)

* 更新数据集相关类型，添加图像文件ID和预览URL支持；优化数据集导入功能，新增图像数据集处理组件；修复部分国际化文本；更新文件上传逻辑以支持新功能。

* 与原先代码的差别

* 新增 V4.9.10 更新说明，支持 PG 设置`systemEnv.hnswMaxScanTuples`参数，优化 LLM stream 调用超时，修复全文检索多知识库排序问题。同时更新数据集索引，移除 datasetId 字段以简化查询。

* 更换成fileId_image逻辑，并增加训练队列匹配的逻辑

* 新增图片集合判断逻辑，优化预览URL生成流程，确保仅在数据集为图片集合时生成预览URL，并添加相关日志输出以便调试。

* Refactor Docker Compose configuration to comment out exposed ports for production environments, update image versions for pgvector, fastgpt, and mcp_server, and enhance Redis service with a health check. Additionally, standardize dataset collection labels in constants and improve internationalization strings across multiple languages.

* Enhance TrainingStates component by adding internationalization support for the imageParse training mode and update defaultCounts to include imageParse mode in trainingDetail API.

* Enhance dataset import context by adding additional steps for image dataset import process and improve internationalization strings for modal buttons in the useEditTitle hook.

* Update DatasetImportContext to conditionally render MyStep component based on data source type, improving the import process for non-image datasets.

* Refactor image dataset handling by improving internationalization strings, enhancing error messages, and streamlining the preview URL generation process.

* 图片上传到新建的 dataset_collection_images 表，逻辑跟随更改

* 修改了除了controller的其他部分问题

* 把图片数据集的逻辑整合到controller里面

* 补充i18n

* 补充i18n

* resolve评论：主要是上传逻辑的更改和组件复用

* 图片名称的图标显示

* 修改编译报错的命名问题

* 删除不需要的collectionid部分

* 多余文件的处理和改动一个删除按钮

* 除了loading和统一的imageId,其他都resolve掉的

* 处理图标报错

* 复用了MyPhotoView并采用全部替换的方式将imageFileId变成imageId

* 去除不必要文件修改

* 报错和字段修改

* 增加上传成功后删除临时文件的逻辑以及回退一些修改

* 删除path字段，将图片保存到gridfs内，并修改增删等操作的代码

* 修正编译错误

---------

Co-authored-by: archer <545436317@qq.com>

* perf: image dataset

* feat: insert image

* perf: image icon

* fix: training state

---------

Co-authored-by: Zhuangzai fa <143257420+ctrlz526@users.noreply.github.com>

* fix: ts (#4948)

* Thirddatasetmd (#4942)

* add thirddataset.md

* fix thirddataset.md

* fix

* delete wrong png

---------

Co-authored-by: dreamer6680 <146868355@qq.com>

* perf: api dataset code

* perf: log

* add secondary.tsx (#4946)

* add secondary.tsx

* fix

---------

Co-authored-by: dreamer6680 <146868355@qq.com>

* perf: multiple menu

* perf: i18n

* feat: parse queue (#4960)

* feat: parse queue

* feat: sync parse queue

* fix thirddataset.md (#4962)

* fix thirddataset-4.png (#4963)

* feat: Dataset template import (#4934)

* 模版导入部分除了文档还没写

* 修复模版导入的 build 错误

* Document production

* compress pictures

* Change some constants to variables

---------

Co-authored-by: Archer <545436317@qq.com>

* perf: template import

* doc

* llm pargraph

* bocha tool

* fix: del collection

---------

Co-authored-by: Zhuangzai fa <143257420+ctrlz526@users.noreply.github.com>
Co-authored-by: dreamer6680 <1468683855@qq.com>
Co-authored-by: dreamer6680 <146868355@qq.com>
 2025-06-06 14:48:44 +08:00
heheer
fa80ce3a77 fix child app external variables (#4919) 2025-05-29 13:37:59 +08:00
Archer
a171c7b11c perf: buffer;fix: back up split (#4913) 
* perf: buffer

* fix: back up split

* fix: app limit

* doc
 2025-05-28 18:18:25 +08:00
heheer
802de11363 fix runtool empty message (#4911) 
* fix runtool empty message

* del unused code

* fix
 2025-05-28 17:48:30 +08:00
Archer
b4ecfb0b79 Feat: Node latest version (#4905) 
* node versions add keep the latest option (#4899)

* node versions add keep the latest option

* i18n

* perf: version code

* fix: ts

* hide system version

* hide system version

* hide system version

* fix: ts

* fix: ts

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-05-28 10:46:32 +08:00
Archer
c25cd48e72 perf: chunk trigger and paragraph split (#4893) 
* perf: chunk trigger and paragraph split

* update max size computed

* perf: i18n

* remove table
 2025-05-26 18:57:22 +08:00
Archer
1dea2b71b4 perf: human check;perf: recursion get node response (#4888) 
* perf: human check

* version

* perf: recursion get node response
 2025-05-25 20:55:29 +08:00
Archer
fae76e887a perf: dataset import params code (#4875) 
* perf: dataset import params code

* perf: api dataset code

* model
 2025-05-23 10:40:25 +08:00
dreamer6680
9af92d1eae Open Yufu Feishu Knowledge Base Permissions (#4867) 
* add feishu yuque dataset

* Open Yufu Feishu Knowledge Base Permissions

* Refactor the dataset request module, optimize the import path, and fix the type definition

---------

Co-authored-by: dreamer6680 <146868355@qq.com>
 2025-05-22 23:19:55 +08:00
Archer
6a6719e93d perf: isPc check;perf: dataset max token checker (#4872) 
* perf: isPc check

* perf: dataset max token checker

* perf: dataset max token checker
 2025-05-22 18:40:29 +08:00
Archer
88bd3aaa9e perf: backup import (#4866) 
* i18n

* remove invalid code

* perf: backup import

* backup tip

* fix: indexsize invalid
 2025-05-22 15:53:51 +08:00
Archer
dd3c251603 fix: stream response (#4853) 2025-05-21 10:21:20 +08:00
Archer
aa55f059d4 perf: chat history api;perf: full text error (#4852) 
* perf: chat history api

* perf: i18n

* perf: full text
 2025-05-20 22:31:32 +08:00
Archer
1dac2b70ec perf: stream timeout;feat: hnsw max_scan_tuples config;fix: fulltext search merge error (#4838) 
* perf: stream timeout

* feat: hnsw max_scan_tuples config

* fix: fulltext search merge error

* perf: jieba code
 2025-05-20 09:59:24 +08:00
Archer
2d2d0fffe9 Test apidataset (#4830) 
* Dataset (#4822)

* apidataset support to basepath

* Resolve the error of the Feishu Knowledge Base modification configuration page not supporting baseurl bug.

* apibasepath

* add

* perf: api dataset

---------

Co-authored-by: dreamer6680 <1468683855@qq.com>
 2025-05-17 22:41:10 +08:00
Archer
e145f63554 feat: chat error msg (#4826) 
* perf: i18n

* feat: chat error msg

* feat: doc
 2025-05-16 12:07:11 +08:00
Archer
554b2ca8dc perf: mcp tool type (#4820) 2025-05-15 18:14:32 +08:00
Archer
4e83840c14 perf: tool call check (#4818) 
* i18n

* tool call

* fix: mcp create permission;Plugin unauth tip

* fix: mcp create permission;Plugin unauth tip

* fix: Cite modal permission

* remove invalide cite

* perf: prompt

* filter fulltext search

* fix: ts

* fix: ts

* fix: ts
 2025-05-15 15:51:34 +08:00
Archer
a4db03a3b7 feat: session id (#4817) 
* feat: session id

* feat: Add default index
 2025-05-14 17:24:02 +08:00
Archer
cba8f773fe New license (#4809) 
* feat: new-license

* perf: volumn watch

* Set use client
 2025-05-14 13:55:09 +08:00
heheer
3688842cc7 filter tool type version & fix unpublished version (#4803) 2025-05-13 17:58:51 +08:00
Archer
0ef3d40296 Test version (#4792) 
* plugin node version select (#4760)

* plugin node version select

* type

* fix

* fix

* perf: version list

* fix node version (#4787)

* change my select

* fix-ui

* fix test

* add test

* fix

* remove invalid version field

* filter deprecated field

* fix: claude tool call

* fix: test

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-05-12 22:27:01 +08:00
Theresa
3cc6b8a17a fix: improve handling of interactive node responses in workflow dispatch (#4786) 
* fix: improve handling of interactive node responses in workflow dispatch

* fix: simplify interactive response handling in dispatch functions
 2025-05-12 18:18:05 +08:00
Archer
83d54d046d perf: replace cite;perf: app card ui (#4768) 
* perf: replace cite

* perf: app card ui

* fix: test
 2025-05-08 13:35:08 +08:00
Archer
96e7dd581e fix: json schema parse error;fix: retraining image reset (#4757) 
* i18n

* fix: json schema parse error

* fix: retraining image reset

* update doc
 2025-05-07 15:38:03 +08:00
Theresa
2d3117c5da feat: update ESLint config with @typescript-eslint/consistent-type-imports (#4746) 
* update: Add type

* fix: update import statement for NextApiRequest type

* fix: update imports to use type for LexicalEditor and EditorState

* Refactor imports to use 'import type' for type-only imports across multiple files

- Updated imports in various components and API files to use 'import type' for better clarity and to optimize TypeScript's type checking.
- Ensured consistent usage of type imports in files related to chat, dataset, workflow, and user management.
- Improved code readability and maintainability by distinguishing between value and type imports.

* refactor: remove old ESLint configuration and add new rules

- Deleted the old ESLint configuration file from the app project.
- Added a new ESLint configuration file with updated rules and settings.
- Changed imports to use type-only imports in various files for better clarity and performance.
- Updated TypeScript configuration to remove unnecessary options.
- Added an ESLint ignore file to exclude build and dependency directories from linting.

* fix: update imports to use 'import type' for type-only imports in schema files
 2025-05-06 17:33:09 +08:00
Archer
ef537f391c fix: rerank usage (#4751) 
* remove invalid index

* perf: i18n

* fix: rerank usage
 2025-05-06 16:23:36 +08:00
Archer
a6fbfac96f Yuque dataset baseurl (#4742) 
* Yuque dataset baseurl (#4512)

* feat: 增加API数据集功能和国际化支持

* 在apiDataset.d.ts中添加uuid、slug、parent_uuid和children字段
* 更新英文、简体中文和繁体中文的dataset.json文件，增加多条提示信息
* 在ApiDatasetForm组件中实现目录选择功能，支持获取Yuque路径
* 新增BaseUrlSelector组件，用于选择根目录
* 实现getpath API，支持根据Yuque服务器获取路径
* 更新相关API调用，确保兼容性和功能完整性

* feat: 更新Yuque服务器的baseUrl处理逻辑

* 在apiDataset.d.ts中将YuqueServer的baseUrl属性改为必填
* 更新ApiDatasetForm组件，调整baseUrl的状态管理和路径加载逻辑
* 新增getcatalog API以支持获取数据集目录
* 修改相关API调用，确保baseUrl的正确传递和使用
* 优化路径返回值为中文“根目录”

* feat: 更新数据集API调用逻辑

* 将getFeishuAndYuqueDatasetFileList替换为getProApiDatasetFileListRequest，统一API调用方式
* 更新相关文件以确保新API的正确使用
* 优化代码结构，提高可读性和维护性

* 清理代码：移除ApiDatasetForm、BaseUrlSelector和相关API中的调试日志

* 删除不必要的console.log语句，提升代码整洁性
* 确保API逻辑的清晰性，避免冗余输出

* 更新数据集相关类型和API逻辑

- 在apiDataset.d.ts中添加ApiDatasetDetailResponse类型，移除不必要的字段。
- 在proApi.ts中新增DETAIL操作类型及相关参数类型。
- 修改ApiDatasetForm.tsx以支持新的API调用逻辑，统一路径获取方式。
- 更新BaseUrlSelector组件，简化目录选择逻辑。
- 优化getpath.ts和getcatalog.ts中的路径处理逻辑，确保API调用的一致性和正确性。
- 清理不必要的代码和注释，提高代码可读性。

* 清理ApiDatasetForm组件中的调试日志，移除console.log语句以提升代码整洁性和可读性。

* fix

* updata apidatasetform

* remove console

* updata

* updata

* updata editapiservermodal

* updata i18n

* add type

* update getpath

* add type

* perf: yuque dataset baseurl

* perf: remove rerank records

* fix: ts

---------

Co-authored-by: dreamer6680 <1468683855@qq.com>
 2025-05-05 18:37:14 +08:00
Archer
864eff47c7 perf: i18n (#4740) 
* feat: login limit time config

* doc

* perf: code

* i18n update

* update lock

* fix: ts

* update package
 2025-05-05 16:16:59 +08:00
Archer
fdd4e9edbd Test parse cite and add tool call parallel (#4737) 
* add quote response filter (#4727)

* chatting

* add quote response filter

* add test

* remove comment

* perf: cite hidden

* perf: format llm response

* feat: comment

* update default chunk size

* update default chunk size

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-04-30 17:43:50 +08:00
Archer
360a2ec392 Remove quote prompt in api request (#4724) 
* chat completion add parsequote param (#4720)

* chat completion add parsequote param

* fix

* perf: quote prompt

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-04-29 13:10:17 +08:00
Archer
5023da4489 Feat: Quote auth (#4715) 
* fix outlink quote number auth (#4705)

* perf: quote auth

* feat: qwen3 config

---------

Co-authored-by: heheer <heheer@sealos.io>
 2025-04-29 12:05:04 +08:00
Archer
bf14506603 perf: add outlink usage (#4691) 
* update doc

* perf: add outlink usage

* feat: jina provider
 2025-04-28 10:41:32 +08:00
Archer
5357aa402b perf: Add tool call prompt (#4683) 
* update i18n

* perf: Add tool call prompt
 2025-04-27 18:29:10 +08:00
heheer
9923a402d9 fix: chat quote number (#4679) 2025-04-27 17:54:07 +08:00
Archer
6763ac60d5 fix same tag in different datasets (#4673) (#4680) 
Co-authored-by: heheer <heheer@sealos.io>
 2025-04-27 17:33:14 +08:00
heheer
229c8acdb9 fix rerank model undefined (#4674) 2025-04-27 11:53:09 +08:00
Archer
1465999c46 feat: get tokens from api usage (#4671) 2025-04-27 01:13:38 +08:00
Archer
0720bbe4da V4.9.7 feature (#4669) 
* update doc

* feat: Add coupon redemption feature for team subscriptions (#4595)

* feat: Add coupon redemption feature for team subscriptions

- Introduced `TeamCouponSub` and `TeamCouponSchema` types
- Added `redeemCoupon` API endpoint
- Updated UI to include a modal for coupon redemption
- Added new icon and translations for "Redeem coupon"

* perf: remove field teamId

* perf: use dynamic import

* refactor: move to page component

* perf: coupon code

* perf: mcp server

* perf: test

* auto layout (#4634)

* fix 4.9.6 (#4631)

* fix debug quote list

* delete next text node match

* fix extract default boolean value

* export latest 100 chat items

* fix quote item ui

* doc

* fix doc

* feat: auto layout

* perf: auto layout

* fix: auto layout null

* add start node

---------

Co-authored-by: heheer <heheer@sealos.io>

* fix: share link (#4644)

* Add workflow run duration；Get audio duration (#4645)

* add duration

* get audio duration

* Custom config path (#4649)

* feat: 通过环境变量DATA_PATH获取配置文件目录 (#4622)

通过环境变量DATA_PATH获取配置文件目录，以应对不同的部署方式的多样化需求

* feat: custom configjson path

* doc

---------

Co-authored-by: John Chen <sss1991@163.com>

* 程序api调用场景下，如果大量调用带有图片或视频，产生的聊天记录会导致后台mongo数据库异常。这个修改给api客户端一个禁止生成聊天记录的选项，避免这个后果。 (#3964)

* update special chatId

* perf: vector db rename

* update operationLog (#4647)

* update operationLog

* combine operationLogMap

* solve operationI18nLogMap bug

* remoce log

* feat: Rerank usage (#4654)

* refresh concat when update (#4655)

* fix: refresh code

* perf: timer lock

* Fix operationLog (#4657)

* perf: http streamable mcp

* add alipay (#4630)

* perf: subplan ui

* perf: pay code

* hiden bank tip

* Fix: pay error (#4665)

* fix quote number (#4666)

* remove log

---------

Co-authored-by: a.e. <49438478+I-Info@users.noreply.github.com>
Co-authored-by: heheer <heheer@sealos.io>
Co-authored-by: John Chen <sss1991@163.com>
Co-authored-by: gaord <bengao168@msn.com>
Co-authored-by: gggaaallleee <91131304+gggaaallleee@users.noreply.github.com>
 2025-04-26 16:17:21 +08:00
heheer
25dc8984be add answer quote number (#4658) 2025-04-25 10:34:37 +08:00
heheer
2a54be4d91 support mcp client streamable http (#4650) 
* support mcp streamable http

* fix

* fix

* remove deps
 2025-04-24 23:04:54 +08:00
heheer
5c93545016 fix 4.9.6 (#4631) 
* fix debug quote list

* delete next text node match

* fix extract default boolean value

* export latest 100 chat items

* fix quote item ui

* doc

* fix doc
 2025-04-22 20:10:35 +08:00
Archer
9cd6d2e81f perf: init model (#4610) 
* fix: model config undefined value

* perf: init model
 2025-04-21 14:44:34 +08:00
Archer
4ac2a2f43e fix: timezone count (#4604) 
* fix: timezone count

* fix: ts

* fix: test llm
 2025-04-20 22:24:03 +08:00
Archer
5542eadb2d fix: tool call history (#4576) 2025-04-17 14:53:38 +08:00
Archer
952412f648 V4.9.6 feature (#4565) 
* Dashboard submenu (#4545)

* add app submenu (#4452)

* add app submenu

* fix

* width & i18n

* optimize submenu code (#4515)

* optimize submenu code

* fix

* fix

* fix

* fix ts

* perf: dashboard sub menu

* doc

---------

Co-authored-by: heheer <heheer@sealos.io>

* feat: value format test

* doc

* Mcp export (#4555)

* feat: mcp server

* feat: mcp server

* feat: mcp server build

* update doc

* perf: path selector (#4556)

* perf: path selector

* fix: docker file path

* perf: add image endpoint to dataset search (#4557)

* perf: add image endpoint to dataset search

* fix: mcp_server url

* human in loop (#4558)

* Support interactive nodes for loops, and enhance the function of merging nested and loop node history messages. (#4552)

* feat: add LoopInteractive definition

* feat: Support LoopInteractive type and update related logic

* fix: Refactor loop handling logic and improve output value initialization

* feat: Add mergeSignId to dispatchLoop and dispatchRunAppNode responses

* feat: Enhance mergeChatResponseData to recursively merge plugin details and improve response handling

* refactor: Remove redundant comments in mergeChatResponseData for clarity

* perf: loop interactive

* perf: human in loop

---------

Co-authored-by: Theresa <63280168+sd0ric4@users.noreply.github.com>

* mcp server ui

* integrate mcp (#4549)

* integrate mcp

* delete unused code

* fix ts

* bug fix

* fix

* support whole mcp tools

* add try catch

* fix

* fix

* fix ts

* fix test

* fix ts

* fix: interactive in v1 completions

* doc

* fix: router path

* fix mcp integrate (#4563)

* fix mcp integrate

* fix ui

* fix: mcp ux

* feat: mcp call title

* remove repeat loading

* fix mcp tools avatar (#4564)

* fix

* fix avatar

* fix update version

* update doc

* fix: value format

* close server and remove cache

* perf: avatar

---------

Co-authored-by: heheer <heheer@sealos.io>
Co-authored-by: Theresa <63280168+sd0ric4@users.noreply.github.com>
 2025-04-16 22:18:51 +08:00
gaord
97a6c6749a 变量更新组件处理字符串数组错误修复 (#4523) 
1，字符串数组的值可能包含转义斜杠会导致typeof value为string，结果变量更新后的值变形为多层数组嵌套而无法使用（[[]]）。这个修复解决了这个问题。
2，另外对整体的逻辑做了梳理和整理，更加清晰易懂
 2025-04-15 15:28:12 +08:00