Commit Graph

661 Commits

Author SHA1 Message Date
shaohuzhang1 bfae088df6
feat: knowledge workflow (#4399)
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
* feat: init knowledge workflow

* feat: add knowledge workflow and version models, serializers, and API views

* feat: knowledge workflow

* feat: knowledge workflow

* feat: add KnowledgeWorkflowModelSerializer and Operate class for workflow management

* fix: route

* feat: knowledge workflow

* feat: Knowledge workflow permission

* feat: knowledge workflow

* feat: knowledge workflow

* feat: knowledge workflow

* feat: knowledge workflow

* feat: Data source web node

* fix: Back route

* feat: knowledge workflow

* feat: knowledge workflow

* feat: Knowledge write node

* feat: add Data Source tool functionality and localization

* feat: add Data Source tool functionality and localization

* feat: knowledge workflow

* feat: knowledge workflow

* fix: simplify export tool permission check in ToolListContainer.vue

* fix: simplify export condition in ToolResourceIndex.vue

* fix: simplify condition for copying tool in ToolListContainer

* feat: knowledge workflow

* fix: Upload local files and add output fields

* feat: Knowledge write

* feat: add Document Split Node functionality and localization

* feat: add Document Split Node functionality and localization

* feat: Knowledge write

* feat: enhance Document Split Node with result processing and problem list generation

* fix: Allow problem be blank

* feat: enhance Document Split Node with result processing and problem list generation

* feat: tool datasource

* fix: Optimization of knowledge base workflow execution logic

* refactor: streamline image handling by updating application and knowledge ID management

* refactor: streamline image handling by updating application and knowledge ID management

* feat: extend support modes in variable aggregation node to include knowledge workflows

* feat: Chunks stored

* refactor: simplify file handling in document extraction by removing unnecessary byte conversion and enhancing file saving logic

* refactor: update file ID assignment in document extraction to use provided metadata

* feat: Workflow menu that distinguishes between applications and knowledge bases

* refactor: update file ID assignment in document extraction to use provided metadata

* fix: Add workspace ID as workflow execution parameter

* feat: add code template for Data Source tool form functionality

* refactor: remove unused sys import and improve module handling

* feat: Execution details support loading status

* refactor: update tool type handling and improve category merging logic

* feat: Alter fork depth

* fix: ensure filterList is properly initialized and updated in getList function

* refactor: simplify ToolStoreDialog by removing unused toolType logic

* perf: Optimize the style

* style: adjust div width for improved layout in Tree component

* refactor: improve polling mechanism for knowledge workflow action

* fix: Get workspace_id from workflow params

* fix: filter out 'file_bytes' from result in get_details method

* feat: add recursive filtering for file_bytes in context data

* fix: append results to paragraph_list instead of replacing it

* perf: Optimize translation files

* fix: include document name in bytes_to_uploaded_file call for better file handling

* refactor: optimize buffer retrieval in document processing

* refactor: remove redundant parameter from bytes_to_uploaded_file call

* fix: Page style optimization

* feat: add slider for setting limit in document rules form

* feat: add workflow knowledge management endpoints and related functionality

* fix: swap file size and file count limits in form inputs

* refactor: update tool_config args to use list format for improved readability

* feat: Node supports knowledge base workflow

* feat: Node supports knowledge base workflow

* fix: Basic node data cannot be obtained in the workflow

* style: Knowledge base workflow debugging page style adjustment

* fix: Loop nodes cannot be used in the knowledge base workflow

* fix: Knowledge base workflow variable assignment node

* feat: add chunk size slider to form for custom split strategy

* fix: Workflow style optimization

---------

Co-authored-by: CaptainB <bin@fit2cloud.com>
Co-authored-by: zhangzhanwei <zhanwei.zhang@fit2cloud.com>
Co-authored-by: wangdan-fit2cloud <dan.wang@fit2cloud.com>
2025-11-28 15:38:20 +08:00
liqiang-fit2cloud cf59cca8bd fix: change dir permission. 2025-11-28 14:14:31 +08:00
liqiang-fit2cloud 94b2659019 refactor: use /tmp instead of /opt/maxkb-app/sandbox/tmp if SANDBOX_TMP_DIR_ENABLED is enabled. 2025-11-28 10:13:48 +08:00
liqiang-fit2cloud f67aef11fd fix: os.execvp() can create subprocess.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-27 20:11:38 +08:00
liqiang-fit2cloud 94e60b073f refactor: optimize timeout exception msg. 2025-11-27 16:56:20 +08:00
liqiang-fit2cloud 715adc13c5 deps: upgrade redis-server. 2025-11-27 15:41:51 +08:00
liqiang-fit2cloud 10b466ba91 refactor: change lib dir.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-27 11:21:55 +08:00
liqiang-fit2cloud 674e34a735 refactor: change lib dir. 2025-11-27 10:29:20 +08:00
liqiang-fit2cloud 74ba4ce4fc fix: kill all processes after timeout.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-26 14:01:43 +08:00
liqiang-fit2cloud 9ec9cf7e0f fix: kill all processes after timeout. 2025-11-26 12:23:15 +08:00
liqiang-fit2cloud 197d514cb4 refactor: clear all env from sandbox. 2025-11-25 14:33:13 +08:00
liqiang-fit2cloud 5e909a4ba1 feat: add MAXKB_SANDBOX_PYTHON_PROCESS_TIMEOUT_SECONDS env. 2025-11-25 10:27:08 +08:00
liqiang-fit2cloud eb30b88d10 refactor: remove MAXKB_SANDBOX_PYTHON_BANNED_KEYWORDS.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-24 18:42:06 +08:00
liqiang-fit2cloud 057e0420cf security: not allow to create subprocess in sandbox by default. 2025-11-24 18:25:20 +08:00
liqiang-fit2cloud d6a3a3cf1f refactor: change dir permissions.
Some checks failed
sync2gitee / repo-sync (push) Has been cancelled
Typos Check / Spell Check with Typos (push) Has been cancelled
2025-11-21 15:05:32 +08:00
liqiang-fit2cloud 49e52aa53c refactor: change dir permissions. 2025-11-21 14:58:59 +08:00
liqiang-fit2cloud e27d39c1ac refactor: change dir permissions. 2025-11-21 14:10:28 +08:00
liqiang-fit2cloud 491c39f4d0 refactor: change dir permissions. 2025-11-21 12:23:36 +08:00
liqiang-fit2cloud a9b6f2b211 refactor: change dir permissions. 2025-11-21 10:35:47 +08:00
liqiang-fit2cloud fb37c57b53 refactor: change dir permissions.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-21 09:37:19 +08:00
liqiang-fit2cloud 8c0836627a refactor: remove print.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-19 17:16:22 +08:00
liqiang-fit2cloud 7d3f92bd51 fix: fix incorrect permission may introduce security vulnerabilities. 2025-11-19 14:32:05 +08:00
liqiang-fit2cloud 30494cf6de refactor: avoid using temp files in sandbox. 2025-11-18 17:46:13 +08:00
liqiang-fit2cloud 390ab83ed4 refactor: avoid using temp files in sandbox. 2025-11-18 16:48:22 +08:00
liqiang-fit2cloud da5c4b0ee2 refactor: avoid using temp files in sandbox.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-18 16:10:08 +08:00
liqiang-fit2cloud dec1431560 refactor: avoid using temp files in sandbox. 2025-11-18 15:55:34 +08:00
liqiang-fit2cloud 6a1c3786f4 refactor: avoid using temp files in sandbox. 2025-11-18 14:56:52 +08:00
liqiang-fit2cloud 24b8a7bab1 refactor: avoid using temp files in sandbox. 2025-11-18 14:37:12 +08:00
liqiang-fit2cloud 8bfce62ad8 refactor: avoid using temp files in sandbox. 2025-11-18 14:27:48 +08:00
liqiang-fit2cloud 60a66c47a1 fix: fix incorrect permission may introduce security vulnerabilities. 2025-11-17 14:35:04 +08:00
liqiang-fit2cloud c1eb6ac621 fix: fix incorrect permission may introduce security vulnerabilities. 2025-11-17 12:46:26 +08:00
liqiang-fit2cloud d12b74f27c fix: fix incorrect permission may introduce security vulnerabilities. 2025-11-17 12:23:55 +08:00
liqiang-fit2cloud 79988b170c fix: fix incorrect permission may introduce security vulnerabilities. 2025-11-17 11:16:31 +08:00
liqiang-fit2cloud 91e8e833a9 fix: fix incorrect permission may introduce security vulnerabilities. 2025-11-17 10:59:09 +08:00
CaptainB 37d886e9ed refactor: optimize RSA encryption and decryption functions with caching
Some checks failed
sync2gitee / repo-sync (push) Has been cancelled
Typos Check / Spell Check with Typos (push) Has been cancelled
2025-11-14 22:15:09 +08:00
zhangzhanwei f3350980c7 perf: Memory optimization
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-14 18:42:53 +08:00
CaptainB 4f58295d39 feat: add default manager to AppModelMixin 2025-11-12 15:31:41 +08:00
CaptainB decd060304 chore: adjust default worker count calculation in command.py
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-11 20:41:55 +08:00
liqiang-fit2cloud 324f836fdd refactor: never restart core worker if worker=1. 2025-11-11 18:13:21 +08:00
liqiang-fit2cloud ad1742fd0f refactor: delete .SANDBOX_BANNED_HOSTS file if SANDBOX_PYTHON_BANNED_KEYWORDS is empty/ 2025-11-10 09:39:54 +08:00
CaptainB 42d91e232b refactor: remove scheduler service and related code 2025-11-07 21:02:27 +08:00
liqiang-fit2cloud f9c1742b43 refactor: change model path in MKTokenizer. 2025-11-07 14:57:04 +08:00
shaohuzhang1 3f6453eb3a
feat: Using the HuggingFace tokenizer (#4329) 2025-11-07 13:29:17 +08:00
liqiang-fit2cloud fa0cd61584 fix: ensure worker count is properly converted to integer for max_requests 2025-11-07 11:18:02 +08:00
liqiang-fit2cloud 180ee40cdc refactor: set MAXKB_SANDBOX_HOME env. 2025-11-07 11:10:14 +08:00
CaptainB fe7d75d720 fix: ensure worker count is properly converted to integer for max_requests 2025-11-07 10:33:06 +08:00
CaptainB 6b8a9bdc74 fix: correct parameter name for graceful timeout in Gunicorn configuration 2025-11-07 10:19:40 +08:00
liqiang-fit2cloud 7a4594db66 refactor: set timeout for workers. 2025-11-07 10:13:24 +08:00
liqiang-fit2cloud 207a67dcc2 refactor: never restart scheduler worker if worker=1. 2025-11-07 10:04:16 +08:00
liqiang-fit2cloud ea2c2f9e2b refactor: never restart local_model worker if LOCAL_MODEL_HOST_WORKER=1. 2025-11-07 09:58:15 +08:00