feat gpts的部署说明

.github/workflows/ninja-image.yml

@@ -42,5 +42,6 @@ jobs:
         push: true
         tags: |
           yangclivia/pandora-to-api:${{ steps.tag_name.outputs.tag }}
+          yangclivia/pandora-to-api:0.7.7
         platforms: linux/amd64,linux/arm64
         build-args: TARGETPLATFORM=${{ matrix.platform }}

Dockerfile

@@ -10,15 +10,13 @@ COPY . /app
 # 设置环境变量
 ENV PYTHONUNBUFFERED=1
 
-RUN chmod +x /app/start.sh
-
-RUN apt update && apt install -y jq
+RUN chmod +x /app/main.py
 
 # # 设置 pip 源为清华大学镜像
 # RUN pip config set global.index-url https://pypi.tuna.tsinghua.edu.cn/simple
 
 # 安装任何所需的依赖项
-RUN pip install --no-cache-dir flask flask_apscheduler gunicorn requests Pillow flask-cors tiktoken fake_useragent redis websocket-client pysocks requests[socks] websocket-client[optional]
+RUN pip install --no-cache-dir flask flask_apscheduler requests Pillow flask-cors tiktoken fake_useragent redis websocket-client pysocks requests[socks] websocket-client[optional]
 
 # 在容器启动时运行 Flask 应用
-CMD ["/app/start.sh"]
+CMD ["python3", "main.py"]

Readme.md

@@ -1,5 +1,5 @@
-## 项目简介
-
+## 0.7.7 ninja版本项目简介
+![Docker Image Size (tag)](https://img.shields.io/docker/image-size/yangclivia/pandora-to-api/0.7.7)![Docker Pulls](https://img.shields.io/docker/pulls/yangclivia/pandora-to-api)[![GitHub Repo stars](https://img.shields.io/github/stars/Yanyutin753/RefreshToV1Api?style=social)](https://github.com/Yanyutin753/refresh-gpt-chat/stargazers)
 > [!IMPORTANT]
 >
 > Respect Zhile大佬 , Respect Wizerd！
@@ -34,7 +34,7 @@
 
 - [x] 支持 gpt-3.5-turbo
 
-- [x] 支持 gpts
+- [x] 支持 动态gpts
 
 - [x] 支持 流式输出
 
@@ -157,7 +157,9 @@ PS. 注意，arkose_urls中的地址需要支持PandoraNext的Arkose Token获取
 
 ## GPTS配置说明
 
-如果需要使用 GPTS，需要修改 `gpts.json` 文件，其中每个对象的key即为调用对应 GPTS 的时候使用的模型名称，而 `id` 则为对应的模型id，该 `id` 对应每个 GPTS 的链接的后缀。配置多个GPTS的时候用逗号隔开。
+### 使用 GPTS
+
+1. 可修改 `gpts.json` 文件，其中每个对象的key即为调用对应 GPTS 的时候使用的模型名称，而 `id` 则为对应的模型id，该 `id` 对应每个 GPTS 的链接的后缀。配置多个GPTS的时候用逗号隔开。
 
 例如：PandoraNext的官方 GPTS 的链接为：`https://chat.oaifree.com/g/g-CFsXuTRfy-pandoranextzhu-shou`，则该模型的 `id` 的值应为 `g-CFsXuTRfy-pandoranextzhu-shou`，而模型名可以自定义。
 
@@ -174,7 +176,16 @@ PS. 注意，arkose_urls中的地址需要支持PandoraNext的Arkose Token获取
 }
 ```
 
-注意：使用该配置的时候需要保证正确填写 `docker-compose.yml` 的环境变量 `KEY_FOR_GPTS_INFO`，同时该变量设置的 `key` 允许访问所有配置的 GPTS。
+2. 直接请求的时候加上相应的gpt-4-gizmo-XXX，XXX等同于上面的id的值
+```json
+{
+    "stream":true,
+    "model":"gpt-4-gizmo-XXXX",
+    "messages": [{"role": "user", "content": "你是什么模型"}]
+}
+```
+
+注意：使用该配置的时候需要保证正确填写 `config.json` 文件的环境变量 `KEY_FOR_GPTS_INFO`，同时该变量设置的 `key` 允许访问所有配置的 GPTS。
 
 ## 绘图接口使用说明
 
@@ -315,19 +326,20 @@ PS. 注意，arkose_urls中的地址需要支持PandoraNext的Arkose Token获取
 
 ## 示例
 
-以ChatGPT-Next-Web项目的docker-compose部署为例，这里提供一个简单的部署配置文件示例：
+以[ChatGPT-Next-Web](https://github.com/Yanyutin753/ChatGPT-Next-Web-LangChain-Gpt-4-All)项目插件版的docker-compose部署为例，支持完全适配项目，这里提供一个简单的部署配置文件示例：
 
 ```
 version: '3'
 services:
   chatgpt-next-web:
-    image: yidadaa/chatgpt-next-web
+    image: yangclivia/chatgpt-next-web-langchain
     ports:
       - "50013:3000"
     environment:
+      - CUSTOM_MODELS=-all,+gpt-3.5-turbo,+gpt-4-s,+gpt-4-mobile,+gpt-4-vision-preview,+gpt-4-gizmo-XXX
       - OPENAI_API_KEY=<正确的refresh_token>
       - BASE_URL=<backend-to-api容器地址>
-      - CUSTOM_MODELS=+gpt-4-s,+gpt-4-mobile,+<gpts.json 中的模型名>
+      - CUSTOM_MODELS=-gpt-4-0613,-gpt-4-32k,-gpt-4-32k-0613,-gpt-4-turbo-preview,-gpt-4-1106-preview,-gpt-4-0125-preview,-gpt-3.5-turbo-0125,-gpt-3.5-turbo-0613,-gpt-3.5-turbo-1106,-gpt-3.5-turbo-16k,-gpt-3.5-turbo-16k-0613,+gpt-3.5-turbo,+gpt-4,+gpt-4-mobile,+gpt-4-vision-preview,+gpt-4-mobile,+<gpts.json 中的模型名>
 
 ```
 
@@ -342,17 +354,20 @@ services:
 
 ![api-2](https://github.com/Ink-Osier/PandoraToV1Api/assets/133617214/37c0381f-a70a-42bb-83f1-1491053240b7)
 
+### 读文件
+![api-3](https://github.com/Yanyutin753/xyhelperToV1Api_refresh/assets/132346501/e1f2e770-cd33-4af0-a0c7-5ddabf1c076d)
+
 ### 绘图
 
-![api-3](https://github.com/Ink-Osier/PandoraToV1Api/assets/133617214/8eea9436-12ee-46b1-86c1-67e7e97da83a)
+![api-4](https://github.com/Ink-Osier/PandoraToV1Api/assets/133617214/8eea9436-12ee-46b1-86c1-67e7e97da83a)
 
 ### GPT-4-Mobile
 
-![api-4](https://github.com/Ink-Osier/PandoraToV1Api/assets/133617214/2eb4fd4f-7c66-4a1f-a54a-3c280a36e509)
+![api-5](https://github.com/Ink-Osier/PandoraToV1Api/assets/133617214/2eb4fd4f-7c66-4a1f-a54a-3c280a36e509)
 
 ### GPTS
 
-![api-5](https://github.com/Ink-Osier/PandoraToV1Api/assets/133617214/299df56a-d245-4920-8892-94e1a9cc644a)
+![api-6](https://github.com/Ink-Osier/PandoraToV1Api/assets/133617214/299df56a-d245-4920-8892-94e1a9cc644a)
 
 ### Bot 模式
 

main.py

@@ -273,15 +273,17 @@ def add_config_to_global_list(base_url, proxy_api_prefix, gpts_data):
             if gizmo_info:
                 redis_client.set(model_id, str(gizmo_info))
                 logger.info(f"Cached gizmo info for {model_name}, {model_id}")
-                # 检查模型名称是否已经在列表中
-                if not any(d['name'] == model_name for d in gpts_configurations):
-                    gpts_configurations.append({
-                        'name': model_name,
-                        'id': model_id,
-                        'config': gizmo_info
-                    })
-                else:
-                    logger.info(f"Model already exists in the list, skipping...")
+                
+        # 检查模型名称是否已经在列表中
+        if gizmo_info and not any(d['name'] == model_name for d in gpts_configurations):
+            gpts_configurations.append({
+                'name': model_name,
+                'id': model_id,
+                'config': gizmo_info
+            })
+        else:
+            logger.info(f"Model already exists in the list, skipping...")
+
 
 
 def generate_gpts_payload(model, messages):
@@ -319,9 +321,9 @@ scheduler.start()
 # PANDORA_UPLOAD_URL = 'files.pandoranext.com'
 
 
-VERSION = '0.7.7.1'
+VERSION = '0.7.7.3'
 # VERSION = 'test'
-UPDATE_INFO = '支持gpt-4-gizmo-XXX，动态配置GPTS'
+UPDATE_INFO = 'flask直接启动，解决部分机cpu占用过大问题'
 # UPDATE_INFO = '【仅供临时测试使用】 '
 
 # 解析响应中的信息
@@ -942,7 +944,28 @@ def send_text_prompt_and_get_response(messages, api_key, stream, model):
                         logger.info(f"Model already exists in the list, skipping...")
                     payload = generate_gpts_payload(model, formatted_messages)
                 else:
-                    raise Exception('KEY_FOR_GPTS_INFO is not accessible')
+                    payload = {
+                        # 构建 payload
+                        "action": "next",
+                        "messages": formatted_messages,
+                        "parent_message_id": str(uuid.uuid4()),
+                        "model": "text-davinci-002-render-sha",
+                        "timezone_offset_min": -480,
+                        "suggestions": [
+                            "What are 5 creative things I could do with my kids' art? I don't want to throw them away, but it's also so much clutter.",
+                            "I want to cheer up my friend who's having a rough day. Can you suggest a couple short and sweet text messages to go with a kitten gif?",
+                            "Come up with 5 concepts for a retro-style arcade game.",
+                            "I have a photoshoot tomorrow. Can you recommend me some colors and outfit options that will look good on camera?"
+                        ],
+                        "history_and_training_disabled": False,
+                        "arkose_token": None,
+                        "conversation_mode": {
+                            "kind": "primary_assistant"
+                        },
+                        "force_paragen": False,
+                        "force_rate_limit": False
+                    }
+                    logger.debug('KEY_FOR_GPTS_INFO is not accessible')
         else:
             payload = generate_gpts_payload(model, formatted_messages)
             if not payload:
@@ -1186,7 +1209,7 @@ def generate_actions_allow_payload(author_role, author_name, target_message_id,
             "action": "next",
             "messages": [
                 {
-                    "id": generate_custom_uuid_v4(),
+                    "id": str(uuid.uuid4()),
                     "author": {
                         "role": author_role,
                         "name": author_name
@@ -2037,7 +2060,7 @@ def old_data_fetcher(upstream_response, data_queue, stop_event, last_data_time,
                 "id": chat_message_id,
                 "object": "chat.completion.chunk",
                 "created": timestamp,
-                "model": message.get("metadata", {}).get("model_slug"),
+                "model": model,
                 "choices": [
                     {
                         "index": 0,
@@ -2663,4 +2686,4 @@ scheduler.add_job(id='updateRefresh_run', func=updateRefresh_dict, trigger='cron
 
 # 运行 Flask 应用
 if __name__ == '__main__':
-    app.run(host='0.0.0.0')
+    app.run(host='0.0.0.0', port=33333, threaded=True)

start.sh

@@ -31,4 +31,4 @@ echo "PROCESS_WORKERS: ${PROCESS_WORKERS}"
 echo "PROCESS_THREADS: ${PROCESS_THREADS}"
 
 # 启动 Gunicorn 并使用 tee 命令同时输出日志到文件和控制台
-exec gunicorn -w ${PROCESS_WORKERS} --threads ${PROCESS_THREADS} --bind 0.0.0.0:33333 main:app --access-logfile - --error-logfile -
+exec gunicorn -w ${PROCESS_WORKERS} --threads ${PROCESS_THREADS} --bind 0.0.0.0:33333 main:app --access-logfile - --error-logfile - --timeout 60