Archer
c30f069f2f
V4.9.11 feature ( #4969 )
...
* Feat: Images dataset collection (#4941 )
* New pic (#4858 )
* 更新数据集相关类型，添加图像文件ID和预览URL支持；优化数据集导入功能，新增图像数据集处理组件；修复部分国际化文本；更新文件上传逻辑以支持新功能。
* 与原先代码的差别
* 新增 V4.9.10 更新说明，支持 PG 设置`systemEnv.hnswMaxScanTuples`参数，优化 LLM stream 调用超时，修复全文检索多知识库排序问题。同时更新数据集索引，移除 datasetId 字段以简化查询。
* 更换成fileId_image逻辑，并增加训练队列匹配的逻辑
* 新增图片集合判断逻辑，优化预览URL生成流程，确保仅在数据集为图片集合时生成预览URL，并添加相关日志输出以便调试。
* Refactor Docker Compose configuration to comment out exposed ports for production environments, update image versions for pgvector, fastgpt, and mcp_server, and enhance Redis service with a health check. Additionally, standardize dataset collection labels in constants and improve internationalization strings across multiple languages.
* Enhance TrainingStates component by adding internationalization support for the imageParse training mode and update defaultCounts to include imageParse mode in trainingDetail API.
* Enhance dataset import context by adding additional steps for image dataset import process and improve internationalization strings for modal buttons in the useEditTitle hook.
* Update DatasetImportContext to conditionally render MyStep component based on data source type, improving the import process for non-image datasets.
* Refactor image dataset handling by improving internationalization strings, enhancing error messages, and streamlining the preview URL generation process.
* 图片上传到新建的 dataset_collection_images 表，逻辑跟随更改
* 修改了除了controller的其他部分问题
* 把图片数据集的逻辑整合到controller里面
* 补充i18n
* 补充i18n
* resolve评论：主要是上传逻辑的更改和组件复用
* 图片名称的图标显示
* 修改编译报错的命名问题
* 删除不需要的collectionid部分
* 多余文件的处理和改动一个删除按钮
* 除了loading和统一的imageId,其他都resolve掉的
* 处理图标报错
* 复用了MyPhotoView并采用全部替换的方式将imageFileId变成imageId
* 去除不必要文件修改
* 报错和字段修改
* 增加上传成功后删除临时文件的逻辑以及回退一些修改
* 删除path字段，将图片保存到gridfs内，并修改增删等操作的代码
* 修正编译错误
---------
Co-authored-by: archer <545436317@qq.com >
* perf: image dataset
* feat: insert image
* perf: image icon
* fix: training state
---------
Co-authored-by: Zhuangzai fa <143257420+ctrlz526@users.noreply.github.com >
* fix: ts (#4948 )
* Thirddatasetmd (#4942 )
* add thirddataset.md
* fix thirddataset.md
* fix
* delete wrong png
---------
Co-authored-by: dreamer6680 <146868355@qq.com >
* perf: api dataset code
* perf: log
* add secondary.tsx (#4946 )
* add secondary.tsx
* fix
---------
Co-authored-by: dreamer6680 <146868355@qq.com >
* perf: multiple menu
* perf: i18n
* feat: parse queue (#4960 )
* feat: parse queue
* feat: sync parse queue
* fix thirddataset.md (#4962 )
* fix thirddataset-4.png (#4963 )
* feat: Dataset template import (#4934 )
* 模版导入部分除了文档还没写
* 修复模版导入的 build 错误
* Document production
* compress pictures
* Change some constants to variables
---------
Co-authored-by: Archer <545436317@qq.com >
* perf: template import
* doc
* llm pargraph
* bocha tool
* fix: del collection
---------
Co-authored-by: Zhuangzai fa <143257420+ctrlz526@users.noreply.github.com >
Co-authored-by: dreamer6680 <1468683855@qq.com >
Co-authored-by: dreamer6680 <146868355@qq.com >
2025-06-06 14:48:44 +08:00
Theresa
2d3117c5da
feat: update ESLint config with @typescript-eslint/consistent-type-imports ( #4746 )
...
* update: Add type
* fix: update import statement for NextApiRequest type
* fix: update imports to use type for LexicalEditor and EditorState
* Refactor imports to use 'import type' for type-only imports across multiple files
- Updated imports in various components and API files to use 'import type' for better clarity and to optimize TypeScript's type checking.
- Ensured consistent usage of type imports in files related to chat, dataset, workflow, and user management.
- Improved code readability and maintainability by distinguishing between value and type imports.
* refactor: remove old ESLint configuration and add new rules
- Deleted the old ESLint configuration file from the app project.
- Added a new ESLint configuration file with updated rules and settings.
- Changed imports to use type-only imports in various files for better clarity and performance.
- Updated TypeScript configuration to remove unnecessary options.
- Added an ESLint ignore file to exclude build and dependency directories from linting.
* fix: update imports to use 'import type' for type-only imports in schema files
2025-05-06 17:33:09 +08:00
Archer
f642c9603b
V4.9.4 feature ( #4470 )
...
* Training status (#4424 )
* dataset data training state (#4311 )
* dataset data training state
* fix
* fix ts
* fix
* fix api format
* fix
* fix
* perf: count training
* format
* fix: dataset training state (#4417 )
* fix
* add test
* fix
* fix
* fix test
* fix test
* perf: training count
* count
* loading status
---------
Co-authored-by: heheer <heheer@sealos.io >
* doc
* website sync feature (#4429 )
* perf: introduce BullMQ for website sync (#4403 )
* perf: introduce BullMQ for website sync
* feat: new redis module
* fix: remove graceful shutdown
* perf: improve UI in dataset detail
- Updated the "change" icon SVG file.
- Modified i18n strings.
- Added new i18n string "immediate_sync".
- Improved UI in dataset detail page, including button icons and
background colors.
* refactor: Add chunkSettings to DatasetSchema
* perf: website sync ux
* env template
* fix: clean up website dataset when updating chunk settings (#4420 )
* perf: check setting updated
* perf: worker currency
* feat: init script for website sync refactor (#4425 )
* website feature doc
---------
Co-authored-by: a.e. <49438478+I-Info@users.noreply.github.com >
* pro migration (#4388 ) (#4433 )
* pro migration
* reuse customPdfParseType
Co-authored-by: gggaaallleee <91131304+gggaaallleee@users.noreply.github.com >
* perf: remove loading ui
* feat: config chat file expired time
* Redis cache (#4436 )
* perf: add Redis cache for vector counting (#4432 )
* feat: cache
* perf: get cache key
---------
Co-authored-by: a.e. <49438478+I-Info@users.noreply.github.com >
* perf: mobile voice input (#4437 )
* update:Mobile voice interaction (#4362 )
* Add files via upload
* Add files via upload
* Update ollama.md
* Update ollama.md
* Add files via upload
* Update useSpeech.ts
* Update ChatInput.tsx
* Update useSpeech.ts
* Update ChatInput.tsx
* Update useSpeech.ts
* Update constants.ts
* Add files via upload
* Update ChatInput.tsx
* Update useSpeech.ts
* Update useSpeech.ts
* Update useSpeech.ts
* Update ChatInput.tsx
* Add files via upload
* Update common.json
* Update VoiceInput.tsx
* Update ChatInput.tsx
* Update VoiceInput.tsx
* Update useSpeech.ts
* Update useSpeech.ts
* Update common.json
* Update common.json
* Update common.json
* Update VoiceInput.tsx
* Update VoiceInput.tsx
* Update ChatInput.tsx
* Update VoiceInput.tsx
* Update ChatInput.tsx
* Update VoiceInput.tsx
* Update ChatInput.tsx
* Update useSpeech.ts
* Update common.json
* Update chat.json
* Update common.json
* Update chat.json
* Update common.json
* Update chat.json
* Update VoiceInput.tsx
* Update ChatInput.tsx
* Update useSpeech.ts
* Update VoiceInput.tsx
* speech ui
* 优化语音输入组件，调整输入框显示逻辑，修复语音输入遮罩层样式，更新画布背景透明度，增强用户交互体验。 (#4435 )
* perf: mobil voice input
---------
Co-authored-by: dreamer6680 <1468683855@qq.com >
* Test completion v2 (#4438 )
* add v2 completions (#4364 )
* add v2 completions
* completion config
* config version
* fix
* frontend
* doc
* fix
* fix: completions v2 api
---------
Co-authored-by: heheer <heheer@sealos.io >
* package
* Test mongo log (#4443 )
* feat: mongodb-log (#4426 )
* perf: mongo log
* feat: completions stop reasoner
* mongo db log
---------
Co-authored-by: Finley Ge <32237950+FinleyGe@users.noreply.github.com >
* update doc
* Update doc
* fix external var ui (#4444 )
* action
* fix: ts (#4458 )
* preview doc action
add docs preview permission
update preview action
udpate action
* update doc (#4460 )
* update preview action
* update doc
* remove
* update
* schema
* update mq export;perf: redis cache (#4465 )
* perf: redis cache
* update mq export
* perf: website sync error tip
* add error worker
* website sync ui (#4466 )
* Updated the dynamic display of the voice input pop-up (#4469 )
* Update VoiceInput.tsx
* Update VoiceInput.tsx
* Update VoiceInput.tsx
* fix: voice input
---------
Co-authored-by: heheer <heheer@sealos.io >
Co-authored-by: a.e. <49438478+I-Info@users.noreply.github.com >
Co-authored-by: gggaaallleee <91131304+gggaaallleee@users.noreply.github.com >
Co-authored-by: dreamer6680 <1468683855@qq.com >
Co-authored-by: Finley Ge <32237950+FinleyGe@users.noreply.github.com >
2025-04-08 12:05:04 +08:00
Archer
e812ad6e84
feat: chunk index independent config ( #4271 )
...
* sync collection
* remove lock
* feat: chunk index independent config
* feat: add max chunksize to split chunk function
* remove log
* update doc
* remove
* remove log
2025-03-27 10:05:31 +08:00
Archer
adf5377ebe
Add image index and pdf parse ( #3956 )
...
* feat: think tag parse
* feat: parse think tag test
* feat: pdf parse ux
* feat: doc2x parse
* perf: rewrite training mode setting
* feat: image parse queue
* perf: image index
* feat: image parse process
* feat: add init sh
* fix: ts
2025-03-06 18:28:03 +08:00
Archer
a9db5b57c5
feat: add training retry time ( #3187 )
...
* feat: add training retry time
* remoce log
2024-11-18 20:57:03 +08:00
Archer
1e02544c3a
feat: reset milvus ( #3013 )
2024-10-29 14:55:27 +08:00
Archer
5605f1a892
4.8.6 fix ( #1963 )
...
* feat: log store
* fix: full text search match query
* perf: mongo schema import, Avoid duplicate import
2024-07-05 17:37:42 +08:00
Archer
67c52992d7
External dataset ( #1519 )
...
* perf: local file create collection
* rename middleware
* perf: remove code
* feat: next14
* feat: external file dataset
* collection tags field
* external file dataset doc
* fix: ts
2024-05-17 16:44:15 +08:00
Archer
80a84a5733
Change embedding ( #1463 )
...
* rebuild embedding queue
* dataset menu
* feat: rebuild data api
* feat: ui change embedding model
* dataset ui
* feat: rebuild index ui
* rename collection
2024-05-13 14:51:42 +08:00
Archer
2991c07467
Fix share page whisper auth ( #1161 )
...
Co-authored-by: heheer <71265218+newfish-cmyk@users.noreply.github.com >
2024-04-09 21:38:47 +08:00
Archer
9d27de154b
4.7-alpha2 ( #1027 )
...
* feat: stop toolCall and rename some field. (#46 )
* perf: node delete tip;pay tip
* fix: toolCall cannot save child answer
* feat: stop tool
* fix: team modal
* fix feckbackMoal auth bug (#47 )
* 简单的支持提示词运行tool。优化workflow模板 (#49 )
* remove templates
* fix: request body undefined
* feat: prompt tool run
* feat: workflow tamplates modal
* perf: plugin start
* 4.7 (#50 )
* fix docker-compose download url (#994 )
original code is a bad url with '404 NOT FOUND' return.
fix docker-compose download url, add 'v' before docker-compose version
* Update ai_settings.md (#1000 )
* Update configuration.md
* Update configuration.md
* Fix history in classifyQuestion and extract modules (#1012 )
* Fix history in classifyQuestion and extract modules
* Add chatValue2RuntimePrompt import and update text formatting
* flow controller to packages
* fix: rerank select
* modal ui
* perf: modal code path
* point not sufficient
* feat: http url support variable
* fix http key
* perf: prompt
* perf: ai setting modal
* simple edit ui
---------
Co-authored-by: entorick <entorick11@qq.com >
Co-authored-by: liujianglc <liujianglc@163.com >
Co-authored-by: Fengrui Liu <liufengrui.work@bytedance.com >
* fix team share redirect to login (#51 )
* feat: support openapi import plugins (#48 )
* feat: support openapi import plugins
* feat: import from url
* fix: add body params parse
* fix build
* fix
* fix
* fix
* tool box ui (#52 )
* fix: training queue
* feat: simple edit tool select
* perf: simple edit dataset prompt
* fix: chatbox tool ux
* feat: quote prompt module
* perf: plugin tools sign
* perf: model avatar
* tool selector ui
* feat: max histories
* perf: http plugin import (#53 )
* perf: plugin http import
* chatBox ui
* perf: name
* fix: Node template card (#54 )
* fix: ts
* setting modal
* package
* package
* feat: add plugins search (#57 )
* feat: add plugins search
* perf: change http plugin header input
* Yjl (#56 )
* perf: prompt tool call
* perf: chat box ux
* doc
* doc
* price tip
* perf: tool selector
* ui'
* fix: vector queue
* fix: empty tool and empty response
* fix: empty msg
* perf: pg index
* perf: ui tip
* doc
* tool tip
---------
Co-authored-by: yst <77910600+yu-and-liu@users.noreply.github.com >
Co-authored-by: entorick <entorick11@qq.com >
Co-authored-by: liujianglc <liujianglc@163.com >
Co-authored-by: Fengrui Liu <liufengrui.work@bytedance.com >
Co-authored-by: heheer <71265218+newfish-cmyk@users.noreply.github.com >
2024-03-21 13:32:31 +08:00
Archer
064c64e74c
V4.6.9-first commit ( #899 )
...
* perf: insert mongo dataset data session
* perf: dataset data index
* remove delay
* rename bill schema
* rename bill record
* perf: bill table
* perf: prompt
* perf: sub plan
* change the usage count
* feat: usage bill
* publish usages
* doc
* 新增团队聊天功能 (#20 )
* perf: doc
* feat 添加标签部分
feat 信息团队标签配置
feat 新增团队同步管理
feat team分享页面
feat 完成team分享页面
feat 实现模糊搜索
style 格式化
fix 修复迷糊匹配
style 样式修改
fix 团队标签功能修复
* fix 修复鉴权功能
* merge 合并代码
* fix 修复引用错误
* fix 修复pr问题
* fix 修复ts格式问题
---------
Co-authored-by: archer <545436317@qq.com >
Co-authored-by: liuxingwan <liuxingwan.lxw@alibaba-inc.com >
* update extra plan
* fix: ts
* format
* perf: bill field
* feat: standard plan
* fix: ts
* feat 个人账号页面修改 (#22 )
* feat 添加标签部分
feat 信息团队标签配置
feat 新增团队同步管理
feat team分享页面
feat 完成team分享页面
feat 实现模糊搜索
style 格式化
fix 修复迷糊匹配
style 样式修改
fix 团队标签功能修复
* fix 修复鉴权功能
* merge 合并代码
* fix 修复引用错误
* fix 修复pr问题
* fix 修复ts格式问题
* feat 修改个人账号页
---------
Co-authored-by: liuxingwan <liuxingwan.lxw@alibaba-inc.com >
* sub plan page (#23 )
* fix chunk index; error page text
* feat: dataset process Integral prediction
* feat: stand plan field
* feat: sub plan limit
* perf: index
* query extension
* perf: share link push app name
* perf: plan point unit
* perf: get sub plan
* perf: account page
* feat 新增套餐详情弹窗代码 (#24 )
* merge 合并代码
* fix 新增套餐详情弹框
* fix 修复pr问题
* feat: change http node input to prompt editor (#21 )
* feat: change http node input to prompt editor
* fix
* split PromptEditor to HttpInput
* Team plans (#25 )
* perf: pay check
* perf: team plan test
* plan limit check
* replace sensitive text
* perf: fix some null
* collection null check
* perf: plans modal
* perf: http module
* pacakge (#26 )
* individuation page and pay modal amount (#27 )
* feat: individuation page
* team chat config
* pay modal
* plan count and replace invalid chars (#29 )
* fix: user oneapi
* fix: training queue
* fix: qa queue
* perf: remove space chars
* replace invalid chars
* change httpinput dropdown menu (#28 )
* perf: http
* reseet free plan
* perf: plan code to packages
* remove llm config to package
* perf: code
* perf: faq
* fix: get team plan
---------
Co-authored-by: yst <77910600+yu-and-liu@users.noreply.github.com >
Co-authored-by: liuxingwan <liuxingwan.lxw@alibaba-inc.com >
Co-authored-by: heheer <71265218+newfish-cmyk@users.noreply.github.com >
2024-02-28 13:19:15 +08:00
Archer
fd9b6291af
Revert "sub plan page ( #885 )" ( #886 )
...
This reverts commit 443ad37b6a
2024-02-23 17:48:15 +08:00
Archer
443ad37b6a
sub plan page ( #885 )
...
* perf: insert mongo dataset data session
* perf: dataset data index
* remove delay
* rename bill schema
* rename bill record
* perf: bill table
* perf: prompt
* perf: sub plan
* change the usage count
* feat: usage bill
* publish usages
* doc
* 新增团队聊天功能 (#20 )
* perf: doc
* feat 添加标签部分
feat 信息团队标签配置
feat 新增团队同步管理
feat team分享页面
feat 完成team分享页面
feat 实现模糊搜索
style 格式化
fix 修复迷糊匹配
style 样式修改
fix 团队标签功能修复
* fix 修复鉴权功能
* merge 合并代码
* fix 修复引用错误
* fix 修复pr问题
* fix 修复ts格式问题
---------
Co-authored-by: archer <545436317@qq.com >
Co-authored-by: liuxingwan <liuxingwan.lxw@alibaba-inc.com >
* update extra plan
* fix: ts
* format
* perf: bill field
* feat: standard plan
* fix: ts
* feat 个人账号页面修改 (#22 )
* feat 添加标签部分
feat 信息团队标签配置
feat 新增团队同步管理
feat team分享页面
feat 完成team分享页面
feat 实现模糊搜索
style 格式化
fix 修复迷糊匹配
style 样式修改
fix 团队标签功能修复
* fix 修复鉴权功能
* merge 合并代码
* fix 修复引用错误
* fix 修复pr问题
* fix 修复ts格式问题
* feat 修改个人账号页
---------
Co-authored-by: liuxingwan <liuxingwan.lxw@alibaba-inc.com >
* fix chunk index; error page text
* feat: dataset process Integral prediction
* feat: stand plan field
* feat: sub plan limit
* perf: index
* query extension
* perf: share link push app name
* perf: plan point unit
* perf: get sub plan
* perf: account page
---------
Co-authored-by: yst <77910600+yu-and-liu@users.noreply.github.com >
Co-authored-by: liuxingwan <liuxingwan.lxw@alibaba-inc.com >
2024-02-23 17:47:34 +08:00
Archer
bf7ee919b6
Fix: pdf version ( #853 )
...
* doc
* perf: mongo index
* perf: chat item index
* fix: packages
2024-02-16 12:19:05 +08:00
William Zhang
91b7d81c1a
bugfix: correct time to real 7 days ( #754 )
2024-01-19 21:36:38 +08:00
Archer
c031e6dcc9
4.6.7-alpha commit ( #743 )
...
Co-authored-by: Archer <545436317@qq.com >
Co-authored-by: heheer <71265218+newfish-cmyk@users.noreply.github.com >
2024-01-19 11:17:28 +08:00
Archer
006ad17c6a
4.6.7 first pr ( #726 )
2024-01-10 23:35:04 +08:00
Archer
3f088bce6a
Update docs and response tag in share page ( #694 )
...
* perf: chunk index show
* share response
* perf: vector query
* web printFinger
* remove log
* fix: bucket name
* perf: training schema
* perf: sort index
2024-01-05 18:02:37 +08:00
Archer
759a2330e6
V4.6.6-1 ( #656 )
2023-12-27 11:07:39 +08:00
Archer
b916183848
4.6.3-alpha1 ( #529 )
2023-11-29 20:45:36 +08:00
Archer
c5664c7e90
feat: vision model ( #489 )
...
* mongo init
* perf: mongo connect
* perf: tts
perf: whisper and tts
peref: tts whisper permission
log
reabase (#488 )
* perf: modal
* i18n
* perf: schema lean
* feat: vision model format
* perf: tts loading
* perf: static data
* perf: tts
* feat: image
* perf: image
* perf: upload image and title
* perf: image size
* doc
* perf: color
* doc
* speaking can not select file
* doc
2023-11-18 15:42:35 +08:00
Archer
cd3acb44ab
v4.6-4 ( #473 )
2023-11-15 21:35:50 +08:00
Archer
bfd8be5df0
v4.6-3 ( #471 )
2023-11-15 11:36:25 +08:00
Archer
8bb5588305
v4.6 -1 ( #459 )
2023-11-09 09:46:57 +08:00
Archer
60ee160131
v4.5.2 ( #439 )
2023-10-30 13:26:42 +08:00
Archer
a3534407bf
v4.5.1 ( #417 )
2023-10-22 23:54:04 +08:00
