Commit Graph

5673 Commits

Author SHA1 Message Date
shaohuzhang1 bfae088df6
feat: knowledge workflow (#4399)
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
* feat: init knowledge workflow

* feat: add knowledge workflow and version models, serializers, and API views

* feat: knowledge workflow

* feat: knowledge workflow

* feat: add KnowledgeWorkflowModelSerializer and Operate class for workflow management

* fix: route

* feat: knowledge workflow

* feat: Knowledge workflow permission

* feat: knowledge workflow

* feat: knowledge workflow

* feat: knowledge workflow

* feat: knowledge workflow

* feat: Data source web node

* fix: Back route

* feat: knowledge workflow

* feat: knowledge workflow

* feat: Knowledge write node

* feat: add Data Source tool functionality and localization

* feat: add Data Source tool functionality and localization

* feat: knowledge workflow

* feat: knowledge workflow

* fix: simplify export tool permission check in ToolListContainer.vue

* fix: simplify export condition in ToolResourceIndex.vue

* fix: simplify condition for copying tool in ToolListContainer

* feat: knowledge workflow

* fix: Upload local files and add output fields

* feat: Knowledge write

* feat: add Document Split Node functionality and localization

* feat: add Document Split Node functionality and localization

* feat: Knowledge write

* feat: enhance Document Split Node with result processing and problem list generation

* fix: Allow problem be blank

* feat: enhance Document Split Node with result processing and problem list generation

* feat: tool datasource

* fix: Optimization of knowledge base workflow execution logic

* refactor: streamline image handling by updating application and knowledge ID management

* refactor: streamline image handling by updating application and knowledge ID management

* feat: extend support modes in variable aggregation node to include knowledge workflows

* feat: Chunks stored

* refactor: simplify file handling in document extraction by removing unnecessary byte conversion and enhancing file saving logic

* refactor: update file ID assignment in document extraction to use provided metadata

* feat: Workflow menu that distinguishes between applications and knowledge bases

* refactor: update file ID assignment in document extraction to use provided metadata

* fix: Add workspace ID as workflow execution parameter

* feat: add code template for Data Source tool form functionality

* refactor: remove unused sys import and improve module handling

* feat: Execution details support loading status

* refactor: update tool type handling and improve category merging logic

* feat: Alter fork depth

* fix: ensure filterList is properly initialized and updated in getList function

* refactor: simplify ToolStoreDialog by removing unused toolType logic

* perf: Optimize the style

* style: adjust div width for improved layout in Tree component

* refactor: improve polling mechanism for knowledge workflow action

* fix: Get workspace_id from workflow params

* fix: filter out 'file_bytes' from result in get_details method

* feat: add recursive filtering for file_bytes in context data

* fix: append results to paragraph_list instead of replacing it

* perf: Optimize translation files

* fix: include document name in bytes_to_uploaded_file call for better file handling

* refactor: optimize buffer retrieval in document processing

* refactor: remove redundant parameter from bytes_to_uploaded_file call

* fix: Page style optimization

* feat: add slider for setting limit in document rules form

* feat: add workflow knowledge management endpoints and related functionality

* fix: swap file size and file count limits in form inputs

* refactor: update tool_config args to use list format for improved readability

* feat: Node supports knowledge base workflow

* feat: Node supports knowledge base workflow

* fix: Basic node data cannot be obtained in the workflow

* style: Knowledge base workflow debugging page style adjustment

* fix: Loop nodes cannot be used in the knowledge base workflow

* fix: Knowledge base workflow variable assignment node

* feat: add chunk size slider to form for custom split strategy

* fix: Workflow style optimization

---------

Co-authored-by: CaptainB <bin@fit2cloud.com>
Co-authored-by: zhangzhanwei <zhanwei.zhang@fit2cloud.com>
Co-authored-by: wangdan-fit2cloud <dan.wang@fit2cloud.com>
2025-11-28 15:38:20 +08:00
liqiang-fit2cloud cf59cca8bd fix: change dir permission. 2025-11-28 14:14:31 +08:00
liqiang-fit2cloud 594b7b27fa Merge remote-tracking branch 'origin/v2' into v2 2025-11-28 11:22:48 +08:00
liqiang-fit2cloud 64561a7b67 fix: forbid sandbox to replace process, only creating is permitted 2025-11-28 11:22:38 +08:00
wxg0103 47939ac6c0 fix: correct typo in application_id parameter for get_url endpoint 2025-11-28 10:17:54 +08:00
wxg0103 15a44158be feat: update get_url endpoint to include application ID in the URL 2025-11-28 10:16:13 +08:00
liqiang-fit2cloud 94b2659019 refactor: use /tmp instead of /opt/maxkb-app/sandbox/tmp if SANDBOX_TMP_DIR_ENABLED is enabled. 2025-11-28 10:13:48 +08:00
liqiang-fit2cloud ca9fa9d10d refactor: change TMPDIR env. 2025-11-28 09:58:35 +08:00
liqiang-fit2cloud 9f18d3ce07 refactor: change heartbeat file dir. 2025-11-28 09:35:52 +08:00
liqiang-fit2cloud f67aef11fd fix: os.execvp() can create subprocess.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-27 20:11:38 +08:00
zhangzhanwei d9ecf8cc9c fix: Generate prompt 2025-11-27 18:22:46 +08:00
wxg0103 a05335a0b3 feat: update getFile function to include application ID for URL retrieval 2025-11-27 17:44:36 +08:00
wxg0103 8c3caa27dd feat: refactor URL content retrieval to use a dedicated function with application checks 2025-11-27 17:37:00 +08:00
liqiang-fit2cloud 94e60b073f refactor: optimize timeout exception msg. 2025-11-27 16:56:20 +08:00
liqiang-fit2cloud 3bfe400d70 build: fix gcc error in arm64. 2025-11-27 16:08:58 +08:00
liqiang-fit2cloud 916a8fe67c deps: upgrade redis-server. 2025-11-27 15:53:49 +08:00
liqiang-fit2cloud 2d0e0b45c4 deps: upgrade redis-server. 2025-11-27 15:46:20 +08:00
liqiang-fit2cloud 715adc13c5 deps: upgrade redis-server. 2025-11-27 15:41:51 +08:00
liqiang-fit2cloud 10b466ba91 refactor: change lib dir.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-27 11:21:55 +08:00
liqiang-fit2cloud af9bf0d99c refactor: change lib dir. 2025-11-27 10:52:42 +08:00
liqiang-fit2cloud c74cfebebf Revert "deps: upgrade redis-server."
This reverts commit d3e7d81c33.
2025-11-27 10:51:35 +08:00
liqiang-fit2cloud d3e7d81c33 deps: upgrade redis-server. 2025-11-27 10:48:28 +08:00
liqiang-fit2cloud 674e34a735 refactor: change lib dir. 2025-11-27 10:29:20 +08:00
liqiang-fit2cloud f341930795 security: not allow to create subprocess in sandbox by default.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-26 15:18:43 +08:00
liqiang-fit2cloud 74ba4ce4fc fix: kill all processes after timeout.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-26 14:01:43 +08:00
liqiang-fit2cloud 9ec9cf7e0f fix: kill all processes after timeout. 2025-11-26 12:23:15 +08:00
liqiang-fit2cloud 0222d9e89a Merge remote-tracking branch 'origin/v2' into v2 2025-11-26 12:16:30 +08:00
liqiang-fit2cloud fd4c14f8e8 refactor: format code. 2025-11-26 12:16:20 +08:00
fit2cloudzhao 2cdd42ccd3 fix: Fix the non-empty check of the tool input parameters 2025-11-26 11:42:19 +08:00
wxg0103 9a474b2302 feat: implement SAML2 authentication with configuration options 2025-11-26 11:31:04 +08:00
liqiang-fit2cloud a89b1ff6d9 security: not allow to create subprocess in sandbox by default. 2025-11-26 11:24:59 +08:00
zhangzhanwei 7da64a2268 feat: Filter user by role
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-25 15:22:58 +08:00
liqiang-fit2cloud 197d514cb4 refactor: clear all env from sandbox. 2025-11-25 14:33:13 +08:00
liqiang-fit2cloud ec0be20525 Merge remote-tracking branch 'origin/v2' into v2
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-25 10:58:28 +08:00
liqiang-fit2cloud 75da3bd82d refactor: format code. 2025-11-25 10:58:17 +08:00
dependabot[bot] 938098948f chore(deps): bump pypdf in the pip group across 1 directory
Bumps the pip group with 1 update in the / directory: [pypdf](https://github.com/py-pdf/pypdf).


Updates `pypdf` from 6.1.3 to 6.4.0
- [Release notes](https://github.com/py-pdf/pypdf/releases)
- [Changelog](https://github.com/py-pdf/pypdf/blob/main/CHANGELOG.md)
- [Commits](https://github.com/py-pdf/pypdf/compare/6.1.3...6.4.0)

---
updated-dependencies:
- dependency-name: pypdf
  dependency-version: 6.4.0
  dependency-type: direct:production
  dependency-group: pip
...

Signed-off-by: dependabot[bot] <support@github.com>
2025-11-25 10:37:57 +08:00
liqiang-fit2cloud 5e909a4ba1 feat: add MAXKB_SANDBOX_PYTHON_PROCESS_TIMEOUT_SECONDS env. 2025-11-25 10:27:08 +08:00
liqiang-fit2cloud eb30b88d10 refactor: remove MAXKB_SANDBOX_PYTHON_BANNED_KEYWORDS.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-24 18:42:06 +08:00
liqiang-fit2cloud 057e0420cf security: not allow to create subprocess in sandbox by default. 2025-11-24 18:25:20 +08:00
wxg0103 3670ec27de feat: enhance image generation by supporting multiple model types
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-24 10:33:17 +08:00
CaptainB fff59daa9c chore: update langchain dependencies to latest versions for some security fix
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-23 14:13:53 +08:00
liqiang-fit2cloud d6a3a3cf1f refactor: change dir permissions.
Some checks failed
sync2gitee / repo-sync (push) Has been cancelled
Typos Check / Spell Check with Typos (push) Has been cancelled
2025-11-21 15:05:32 +08:00
liqiang-fit2cloud 49e52aa53c refactor: change dir permissions. 2025-11-21 14:58:59 +08:00
liqiang-fit2cloud e27d39c1ac refactor: change dir permissions. 2025-11-21 14:10:28 +08:00
liqiang-fit2cloud 491c39f4d0 refactor: change dir permissions. 2025-11-21 12:23:36 +08:00
liqiang-fit2cloud a9b6f2b211 refactor: change dir permissions. 2025-11-21 10:35:47 +08:00
liqiang-fit2cloud fb37c57b53 refactor: change dir permissions.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-21 09:37:19 +08:00
wangdan-fit2cloud dfd26dea40 perf: One click beautification within the loop node
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-20 15:17:46 +08:00
liqiang-fit2cloud c114eff9b6 refactor: change dir permissions. 2025-11-20 14:46:48 +08:00
wxg0103 56a8795b33 feat: add local and URL upload options with validation messages 2025-11-20 10:23:20 +08:00