V4.9.7 feature (#4669)

* update doc

* feat: Add coupon redemption feature for team subscriptions (#4595)

* feat: Add coupon redemption feature for team subscriptions

- Introduced `TeamCouponSub` and `TeamCouponSchema` types
- Added `redeemCoupon` API endpoint
- Updated UI to include a modal for coupon redemption
- Added new icon and translations for "Redeem coupon"

* perf: remove field teamId

* perf: use dynamic import

* refactor: move to page component

* perf: coupon code

* perf: mcp server

* perf: test

* auto layout (#4634)

* fix 4.9.6 (#4631)

* fix debug quote list

* delete next text node match

* fix extract default boolean value

* export latest 100 chat items

* fix quote item ui

* doc

* fix doc

* feat: auto layout

* perf: auto layout

* fix: auto layout null

* add start node

---------

Co-authored-by: heheer <heheer@sealos.io>

* fix: share link (#4644)

* Add workflow run duration；Get audio duration (#4645)

* add duration

* get audio duration

* Custom config path (#4649)

* feat: 通过环境变量DATA_PATH获取配置文件目录 (#4622)

通过环境变量DATA_PATH获取配置文件目录，以应对不同的部署方式的多样化需求

* feat: custom configjson path

* doc

---------

Co-authored-by: John Chen <sss1991@163.com>

* 程序api调用场景下，如果大量调用带有图片或视频，产生的聊天记录会导致后台mongo数据库异常。这个修改给api客户端一个禁止生成聊天记录的选项，避免这个后果。 (#3964)

* update special chatId

* perf: vector db rename

* update operationLog (#4647)

* update operationLog

* combine operationLogMap

* solve operationI18nLogMap bug

* remoce log

* feat: Rerank usage (#4654)

* refresh concat when update (#4655)

* fix: refresh code

* perf: timer lock

* Fix operationLog (#4657)

* perf: http streamable mcp

* add alipay (#4630)

* perf: subplan ui

* perf: pay code

* hiden bank tip

* Fix: pay error (#4665)

* fix quote number (#4666)

* remove log

---------

Co-authored-by: a.e. <49438478+I-Info@users.noreply.github.com>
Co-authored-by: heheer <heheer@sealos.io>
Co-authored-by: John Chen <sss1991@163.com>
Co-authored-by: gaord <bengao168@msn.com>
Co-authored-by: gggaaallleee <91131304+gggaaallleee@users.noreply.github.com>

packages/service/core/ai/rerank/index.ts

@@ -3,6 +3,7 @@ import { POST } from '../../../common/api/serverRequest';
 import { getDefaultRerankModel } from '../model';
 import { getAxiosConfig } from '../config';
 import { RerankModelItemType } from '@fastgpt/global/core/ai/model.d';
+import { countPromptTokens } from '../../../common/string/tiktoken';
 
 type PostReRankResponse = {
   id: string;
@@ -10,8 +11,17 @@ type PostReRankResponse = {
     index: number;
     relevance_score: number;
   }[];
+  meta?: {
+    tokens: {
+      input_tokens: number;
+      output_tokens: number;
+    };
+  };
+};
+type ReRankCallResult = {
+  results: { id: string; score?: number }[];
+  inputTokens: number;
 };
-type ReRankCallResult = { id: string; score?: number }[];
 
 export function reRankRecall({
   model = getDefaultRerankModel(),
@@ -28,18 +38,22 @@ export function reRankRecall({
     return Promise.reject('no rerank model');
   }
   if (documents.length === 0) {
-    return Promise.resolve([]);
+    return Promise.resolve({
+      results: [],
+      inputTokens: 0
+    });
   }
 
   const { baseUrl, authorization } = getAxiosConfig();
 
   let start = Date.now();
+  const documentsTextArray = documents.map((doc) => doc.text);
   return POST<PostReRankResponse>(
     model.requestUrl ? model.requestUrl : `${baseUrl}/rerank`,
     {
       model: model.model,
       query,
-      documents: documents.map((doc) => doc.text)
+      documents: documentsTextArray
     },
     {
       headers: {
@@ -49,17 +63,22 @@ export function reRankRecall({
       timeout: 30000
     }
   )
-    .then((data) => {
+    .then(async (data) => {
       addLog.info('ReRank finish:', { time: Date.now() - start });
 
       if (!data?.results || data?.results?.length === 0) {
         addLog.error('ReRank error, empty result', data);
       }
 
-      return data?.results?.map((item) => ({
-        id: documents[item.index].id,
-        score: item.relevance_score
-      }));
+      return {
+        results: data?.results?.map((item) => ({
+          id: documents[item.index].id,
+          score: item.relevance_score
+        })),
+        inputTokens:
+          data?.meta?.tokens?.input_tokens ||
+          (await countPromptTokens(documentsTextArray.join('\n') + query, ''))
+      };
     })
     .catch((err) => {
       addLog.error('rerank error', err);