Commit Graph

705 Commits

Author SHA1 Message Date
shaohuzhang1 d5e04a15b7
fix: The image uploaded from the workflow knowledge base zip file cannot be parsed (#4509) 2025-12-12 15:07:59 +08:00
shaohuzhang1 61a5303e7d
fix: The image uploaded from the workflow knowledge base zip file cannot be parsed (#4507) 2025-12-12 14:35:03 +08:00
shaohuzhang1 621fbd3bd6
fix: The image uploaded from the workflow knowledge base zip file cannot be parsed (#4505) 2025-12-12 14:01:29 +08:00
shaohuzhang1 e529514842
fix: The image uploaded from the workflow knowledge base zip file cannot be parsed (#4503) 2025-12-12 11:57:38 +08:00
CaptainB 6d2f9279c5 fix: handle None values in row data for markdown table generation 2025-12-12 10:18:50 +08:00
liqiang-fit2cloud ebfc290bd3 refactor: log tool execution duration 2025-12-11 17:20:01 +08:00
zhangzhanwei e919666f01 fix: Filter special character 2025-12-11 16:23:24 +08:00
shaohuzhang1 41c0503856
fix: Manually adding file types to the workflow knowledge base cannot upload files after adding them in lowercase letters (#4499) 2025-12-11 15:57:11 +08:00
CaptainB f6102b1457 chore: enhance zip content extraction with posixpath for path normalization 2025-12-11 15:10:49 +08:00
liqiang-fit2cloud d68acede6f refactor: change error number. 2025-12-09 19:02:49 +08:00
CaptainB e1a12c8684 refactor: optimize image Excel ID extraction logic in common_handle.py
--bug=1064254 --user=刘瑞斌 【github#4430】Excel里带图片的数据超过5行上传后不显示图片 https://www.tapd.cn/62980211/s/1807666
2025-12-08 19:13:51 +08:00
CaptainB f39e029cda feat: implement aggregation document status retrieval in listener management 2025-12-08 18:30:03 +08:00
liqiang-fit2cloud 3c8601639c refactor: remove duplicated function. 2025-12-08 15:04:16 +08:00
shaohuzhang1 8a9de5964d
fix: update file handling functions (#4455) 2025-12-08 14:26:44 +08:00
CaptainB dc0d9e29ce feat: enhance image path handling in markdown processing
--bug=1064136 --user=刘瑞斌 【工作流知识库】上传zip文件,文件中的图片内容没有写入知识库 https://www.tapd.cn/62980211/s/1806941
2025-12-08 11:16:38 +08:00
liqiang-fit2cloud ff5150d520 refactor: redirect stdout. 2025-12-08 10:17:56 +08:00
liqiang-fit2cloud 21437632af refactor: change print to sys.stdout. 2025-12-05 16:45:30 +08:00
liqiang-fit2cloud 3eff896f2d refactor: change print to sys.stdout. 2025-12-05 16:25:54 +08:00
CaptainB ce6b41d78e fix: handle None case for cell_value in xlsx_parse_table_handle
--bug=1064042 --user=刘瑞斌 【工作流知识库】QA问答对分段时,分段的问题为空,导入后关联问题为 None https://www.tapd.cn/62980211/s/1806084
2025-12-05 10:47:24 +08:00
liqiang-fit2cloud 778d379cc5 fix: set --graceful-timeout to 5 min. 2025-12-04 19:47:45 +08:00
liqiang-fit2cloud cbdfb31211 fix: set --graceful-timeout to 60. 2025-12-04 19:42:47 +08:00
CaptainB 2ce4f9af92 feat: enhance Markdown parsing by splitting content into sheets and adding sheet titles 2025-12-04 19:10:26 +08:00
liqiang-fit2cloud f8ada9a110 refactor: remove init parameter from class ToolExecutor. 2025-12-04 15:40:50 +08:00
CaptainB a197cfc69d feat: implement CSV, XLS, and XLSX content extraction with Markdown formatting 2025-12-04 14:33:19 +08:00
liqiang-fit2cloud 94eb6959d9 feat: add MAXKB_SANDBOX_PYTHON_PROCESS_LIMIT_CPU_CORES env.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-12-04 11:23:33 +08:00
liqiang-fit2cloud b1db3a6c25 perf: simplify initialization of ToolExecutor. 2025-12-03 17:46:13 +08:00
liqiang-fit2cloud 243cc6ccd2 feat: catch memory error. 2025-12-03 14:39:34 +08:00
liqiang-fit2cloud f55f38bce3 Merge branch 'v2' of https://github.com/maxkb-dev/maxkb into v2 2025-12-03 11:35:33 +08:00
liqiang-fit2cloud 6960262757 feat: add mem limit. 2025-12-03 11:35:23 +08:00
CaptainB ec238b7132 feat: set current working directory for sandbox execution 2025-12-03 11:23:18 +08:00
CaptainB ae0a34a220 chore: remove newline character from split characters in split_model.py 2025-12-03 10:32:36 +08:00
liqiang-fit2cloud 71f1e26c8f refactor: run python code without su -. 2025-12-03 09:52:02 +08:00
CaptainB 9255089d8b feat: enhance PDF content extraction with font size analysis
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-12-02 19:22:56 +08:00
CaptainB 8c802c3d01 feat: add Markdown parsing support for QA handling 2025-12-02 18:20:01 +08:00
CaptainB 582fb99b9e feat: add Markdown parsing support for QA handling 2025-12-02 17:39:28 +08:00
liqiang-fit2cloud 0638f6951a fix: handle long arguments in sandbox. 2025-12-02 16:07:51 +08:00
liqiang-fit2cloud 9b621bc783 fix: handle long arguments in sandbox. 2025-12-02 15:42:55 +08:00
zhangzhanwei e39aa24dca feat: Knowledge workflow back route permission 2025-12-02 14:56:18 +08:00
wxg0103 33da607302 feat: implement AWS Bedrock Vision-Language and Reranker models with credential validation 2025-12-02 14:27:38 +08:00
shaohuzhang1 7e1c2c2166
fix: Unable to parse expression (#4408) 2025-12-01 17:25:46 +08:00
liqiang-fit2cloud e3c36b3476 refactor: catch more exception details. 2025-12-01 14:52:05 +08:00
liqiang-fit2cloud 5b393e92d6 fix: remove useless code caused by merge. 2025-12-01 11:25:25 +08:00
zhangzhanwei 35fe162032 feat: Knowledge write node chunk embeding 2025-11-28 17:36:00 +08:00
CaptainB 6ca265dae8 feat: add chunk_size parameter to document splitting and chunk handling 2025-11-28 16:05:12 +08:00
shaohuzhang1 bfae088df6
feat: knowledge workflow (#4399)
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
* feat: init knowledge workflow

* feat: add knowledge workflow and version models, serializers, and API views

* feat: knowledge workflow

* feat: knowledge workflow

* feat: add KnowledgeWorkflowModelSerializer and Operate class for workflow management

* fix: route

* feat: knowledge workflow

* feat: Knowledge workflow permission

* feat: knowledge workflow

* feat: knowledge workflow

* feat: knowledge workflow

* feat: knowledge workflow

* feat: Data source web node

* fix: Back route

* feat: knowledge workflow

* feat: knowledge workflow

* feat: Knowledge write node

* feat: add Data Source tool functionality and localization

* feat: add Data Source tool functionality and localization

* feat: knowledge workflow

* feat: knowledge workflow

* fix: simplify export tool permission check in ToolListContainer.vue

* fix: simplify export condition in ToolResourceIndex.vue

* fix: simplify condition for copying tool in ToolListContainer

* feat: knowledge workflow

* fix: Upload local files and add output fields

* feat: Knowledge write

* feat: add Document Split Node functionality and localization

* feat: add Document Split Node functionality and localization

* feat: Knowledge write

* feat: enhance Document Split Node with result processing and problem list generation

* fix: Allow problem be blank

* feat: enhance Document Split Node with result processing and problem list generation

* feat: tool datasource

* fix: Optimization of knowledge base workflow execution logic

* refactor: streamline image handling by updating application and knowledge ID management

* refactor: streamline image handling by updating application and knowledge ID management

* feat: extend support modes in variable aggregation node to include knowledge workflows

* feat: Chunks stored

* refactor: simplify file handling in document extraction by removing unnecessary byte conversion and enhancing file saving logic

* refactor: update file ID assignment in document extraction to use provided metadata

* feat: Workflow menu that distinguishes between applications and knowledge bases

* refactor: update file ID assignment in document extraction to use provided metadata

* fix: Add workspace ID as workflow execution parameter

* feat: add code template for Data Source tool form functionality

* refactor: remove unused sys import and improve module handling

* feat: Execution details support loading status

* refactor: update tool type handling and improve category merging logic

* feat: Alter fork depth

* fix: ensure filterList is properly initialized and updated in getList function

* refactor: simplify ToolStoreDialog by removing unused toolType logic

* perf: Optimize the style

* style: adjust div width for improved layout in Tree component

* refactor: improve polling mechanism for knowledge workflow action

* fix: Get workspace_id from workflow params

* fix: filter out 'file_bytes' from result in get_details method

* feat: add recursive filtering for file_bytes in context data

* fix: append results to paragraph_list instead of replacing it

* perf: Optimize translation files

* fix: include document name in bytes_to_uploaded_file call for better file handling

* refactor: optimize buffer retrieval in document processing

* refactor: remove redundant parameter from bytes_to_uploaded_file call

* fix: Page style optimization

* feat: add slider for setting limit in document rules form

* feat: add workflow knowledge management endpoints and related functionality

* fix: swap file size and file count limits in form inputs

* refactor: update tool_config args to use list format for improved readability

* feat: Node supports knowledge base workflow

* feat: Node supports knowledge base workflow

* fix: Basic node data cannot be obtained in the workflow

* style: Knowledge base workflow debugging page style adjustment

* fix: Loop nodes cannot be used in the knowledge base workflow

* fix: Knowledge base workflow variable assignment node

* feat: add chunk size slider to form for custom split strategy

* fix: Workflow style optimization

---------

Co-authored-by: CaptainB <bin@fit2cloud.com>
Co-authored-by: zhangzhanwei <zhanwei.zhang@fit2cloud.com>
Co-authored-by: wangdan-fit2cloud <dan.wang@fit2cloud.com>
2025-11-28 15:38:20 +08:00
liqiang-fit2cloud cf59cca8bd fix: change dir permission. 2025-11-28 14:14:31 +08:00
liqiang-fit2cloud 94b2659019 refactor: use /tmp instead of /opt/maxkb-app/sandbox/tmp if SANDBOX_TMP_DIR_ENABLED is enabled. 2025-11-28 10:13:48 +08:00
liqiang-fit2cloud f67aef11fd fix: os.execvp() can create subprocess.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-27 20:11:38 +08:00
liqiang-fit2cloud 94e60b073f refactor: optimize timeout exception msg. 2025-11-27 16:56:20 +08:00
liqiang-fit2cloud 715adc13c5 deps: upgrade redis-server. 2025-11-27 15:41:51 +08:00