Commit Graph

259 Commits

Author SHA1 Message Date
shaohuzhang1 cbbdef0462
feat: Knowledge base workflow release, version management function (#4405)
* feat: Knowledge base workflow release, version management function

* feat: Knowledge base workflow release, version management function
2025-12-01 15:04:25 +08:00
CaptainB c2658fa735 feat: update file name for existing records based on sha256_hash and knowledge/document IDs 2025-12-01 14:36:36 +08:00
CaptainB e9d4ac38ac feat: enhance knowledge serialization to include workflow details
Some checks failed
sync2gitee / repo-sync (push) Has been cancelled
Typos Check / Spell Check with Typos (push) Has been cancelled
2025-11-28 19:17:36 +08:00
shaohuzhang1 bfae088df6
feat: knowledge workflow (#4399)
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
* feat: init knowledge workflow

* feat: add knowledge workflow and version models, serializers, and API views

* feat: knowledge workflow

* feat: knowledge workflow

* feat: add KnowledgeWorkflowModelSerializer and Operate class for workflow management

* fix: route

* feat: knowledge workflow

* feat: Knowledge workflow permission

* feat: knowledge workflow

* feat: knowledge workflow

* feat: knowledge workflow

* feat: knowledge workflow

* feat: Data source web node

* fix: Back route

* feat: knowledge workflow

* feat: knowledge workflow

* feat: Knowledge write node

* feat: add Data Source tool functionality and localization

* feat: add Data Source tool functionality and localization

* feat: knowledge workflow

* feat: knowledge workflow

* fix: simplify export tool permission check in ToolListContainer.vue

* fix: simplify export condition in ToolResourceIndex.vue

* fix: simplify condition for copying tool in ToolListContainer

* feat: knowledge workflow

* fix: Upload local files and add output fields

* feat: Knowledge write

* feat: add Document Split Node functionality and localization

* feat: add Document Split Node functionality and localization

* feat: Knowledge write

* feat: enhance Document Split Node with result processing and problem list generation

* fix: Allow problem be blank

* feat: enhance Document Split Node with result processing and problem list generation

* feat: tool datasource

* fix: Optimization of knowledge base workflow execution logic

* refactor: streamline image handling by updating application and knowledge ID management

* refactor: streamline image handling by updating application and knowledge ID management

* feat: extend support modes in variable aggregation node to include knowledge workflows

* feat: Chunks stored

* refactor: simplify file handling in document extraction by removing unnecessary byte conversion and enhancing file saving logic

* refactor: update file ID assignment in document extraction to use provided metadata

* feat: Workflow menu that distinguishes between applications and knowledge bases

* refactor: update file ID assignment in document extraction to use provided metadata

* fix: Add workspace ID as workflow execution parameter

* feat: add code template for Data Source tool form functionality

* refactor: remove unused sys import and improve module handling

* feat: Execution details support loading status

* refactor: update tool type handling and improve category merging logic

* feat: Alter fork depth

* fix: ensure filterList is properly initialized and updated in getList function

* refactor: simplify ToolStoreDialog by removing unused toolType logic

* perf: Optimize the style

* style: adjust div width for improved layout in Tree component

* refactor: improve polling mechanism for knowledge workflow action

* fix: Get workspace_id from workflow params

* fix: filter out 'file_bytes' from result in get_details method

* feat: add recursive filtering for file_bytes in context data

* fix: append results to paragraph_list instead of replacing it

* perf: Optimize translation files

* fix: include document name in bytes_to_uploaded_file call for better file handling

* refactor: optimize buffer retrieval in document processing

* refactor: remove redundant parameter from bytes_to_uploaded_file call

* fix: Page style optimization

* feat: add slider for setting limit in document rules form

* feat: add workflow knowledge management endpoints and related functionality

* fix: swap file size and file count limits in form inputs

* refactor: update tool_config args to use list format for improved readability

* feat: Node supports knowledge base workflow

* feat: Node supports knowledge base workflow

* fix: Basic node data cannot be obtained in the workflow

* style: Knowledge base workflow debugging page style adjustment

* fix: Loop nodes cannot be used in the knowledge base workflow

* fix: Knowledge base workflow variable assignment node

* feat: add chunk size slider to form for custom split strategy

* fix: Workflow style optimization

---------

Co-authored-by: CaptainB <bin@fit2cloud.com>
Co-authored-by: zhangzhanwei <zhanwei.zhang@fit2cloud.com>
Co-authored-by: wangdan-fit2cloud <dan.wang@fit2cloud.com>
2025-11-28 15:38:20 +08:00
liqiang-fit2cloud 8c0836627a refactor: remove print.
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-19 17:16:22 +08:00
CaptainB 30fdae34c6 fix: change default value of with_valid parameter in save method to True 2025-11-12 15:10:26 +08:00
CaptainB b148152c94 fix: update terminology from "documents" to "problems" in batch generation 2025-11-12 11:05:56 +08:00
shaohuzhang1 8cabf823e8
fix: dependency package (#4325)
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
2025-11-06 16:46:20 +08:00
CaptainB 5b46e7d730 chore: update document deletion logic to handle paragraph IDs and related mappings
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
--bug=1063248 --user=刘瑞斌 【知识库】删除文档时,分段与问题的关联关系没有清除 https://www.tapd.cn/62980211/s/1793500
2025-11-03 16:38:32 +08:00
王旭辉 d636d6ea7a fix(vector): 修复 source_type 判断类型问题
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
Typos Check / Spell Check with Typos (push) Waiting to run
- 将 source_type 转换为字符串后再与枚举值比较
- 避免了类型不匹配导致的判断错误
- 确保了数据分块功能的正常运行
2025-11-03 10:44:21 +08:00
CaptainB d0cd6d657a refactor: replace get_embedding_model_default_params with get_model_default_params 2025-10-30 17:12:30 +08:00
CaptainB ed19db07d1 feat: add function to retrieve default parameters for embedding models
--bug=1063177 --user=刘瑞斌 【知识库】-知识库使用的模型更换维度参数值并重新向量化后,命中测试、检索报错 https://www.tapd.cn/62980211/s/1792117
2025-10-30 17:00:38 +08:00
CaptainB 25d4e3d502 chore: refactor embedding model parameter handling 2025-10-27 12:50:54 +08:00
CaptainB 27b74580a4 chore: update document.py to create and associate new source file ID in metadata 2025-10-23 16:41:15 +08:00
CaptainB 096c72513f feat: add handling for missing source files in document processing
--bug=1062915 --user=刘瑞斌 【知识库】快速创建的文档,替换原文档报错,找不到源文件 https://www.tapd.cn/62980211/s/1789099
2025-10-23 11:48:44 +08:00
CaptainB a584378002 chore: update file query to include document_id in filter
--bug=1062912 --user=刘瑞斌 【知识库】文档-替换原文档成功,但是下载原文档依然是替换前的文档 https://www.tapd.cn/62980211/s/1789094
2025-10-23 11:43:13 +08:00
CaptainB 75d79918b8 fix: ensure unique tag IDs when creating new document tags
--bug=1062908 --user=刘瑞斌 【知识库】文档标签设置,添加标签时,重复选择相同的标签,添加报错 https://www.tapd.cn/62980211/s/1789052
2025-10-23 10:55:03 +08:00
CaptainB 887de56877 feat: enhance model handling with default parameters and cache model check 2025-10-22 12:30:47 +08:00
zhangzhanwei 4487964d17 feat: Replace source file permission 2025-10-22 11:25:11 +08:00
CaptainB 147eea4160 feat: implement bulk update for files with matching SHA256 hash 2025-10-22 10:43:32 +08:00
zhangzhanwei c0ae78411e feat: Tag permission interface 2025-10-22 10:18:41 +08:00
CaptainB 219fe97c87 feat: Add document_id_list parameter to query methods in vector classes 2025-10-22 10:04:37 +08:00
CaptainB c31142eeab feat: add tag filtering and input support in document search functionality 2025-10-21 10:38:16 +08:00
CaptainB 620d4ff996 feat: add document replacement functionality with file upload 2025-10-20 15:32:30 +08:00
zhangzhanwei 4b0dd1b7c0 feat: Variable aggregation 2025-10-17 17:31:59 +08:00
CaptainB 3e1e434dbf feat: delete associated DocumentTag entries when deleting documents 2025-10-17 17:27:02 +08:00
CaptainB 79fbc52741 feat: add search document node functionality and related configurations 2025-10-17 10:27:31 +08:00
CaptainB 47546ecef4 fix: correct tag ID retrieval in document filtering 2025-10-15 15:03:37 +08:00
CaptainB c47c70afb0 feat: implement knowledge tag management functionality 2025-10-15 11:35:34 +08:00
zhangzhanwei 9a8c8cc7d5 feat: The folder creator manages permissions and the root directory displays all resources 2025-10-15 10:45:54 +08:00
zhangzhanwei 89749a3006 feat: Folder authorization backend 2025-10-14 16:33:13 +08:00
shaohuzhang1 70cfd7eb59
fix: typos (#4182) 2025-10-14 12:01:15 +08:00
CaptainB 121614fb81 chore: add model_params_setting to document, knowledge, and paragraph processing
Some checks failed
sync2gitee / repo-sync (push) Has been cancelled
Typos Check / Spell Check with Typos (push) Has been cancelled
--story=1018694 --user=刘瑞斌 【菲尼克斯】知识库生成问题选择模型,希望可以设置模型参数 https://www.tapd.cn/62980211/s/1768601
2025-09-05 17:48:40 +08:00
CaptainB 383957abb3 chore: update regex pattern and file path in common.py
--bug=1061351 --user=刘瑞斌 【知识库】知识库导出zip没有图片 https://www.tapd.cn/62980211/s/1768275
2025-09-05 11:48:14 +08:00
CaptainB 689391384e chore: update export_zip to include knowledge name in filename
--bug=1061385 --user=刘瑞斌 【知识库】导出的知识库名字都为archive https://www.tapd.cn/62980211/s/1768251
2025-09-05 11:37:09 +08:00
zhangzhanwei 1ec918632f fix: Problem create permission 2025-09-02 17:33:50 +08:00
CaptainB f9f96fd2cd chore: add allow_download flag to document metadata 2025-08-28 10:12:15 +08:00
CaptainB a19bd1eef1 chore: add allow_download field to existing Document records
--bug=1060848 --user=刘瑞斌 【知识库】文档设置[允许知识库来源中下载 ]应该默认开启 https://www.tapd.cn/62980211/s/1762365
2025-08-27 15:36:54 +08:00
CaptainB 4063fef48a chore: add allow_download field to existing Document records
--bug=1060848 --user=刘瑞斌 【知识库】文档设置[允许知识库来源中下载 ]应该默认开启 https://www.tapd.cn/62980211/s/1762365
2025-08-27 15:27:19 +08:00
wxg0103 b5cd3f9b31 feat: add reset_meta function and update meta handling in Document model 2025-08-27 15:26:22 +08:00
CaptainB 4847eba4bf fix: add check for existing problem-paragraph mapping before processing
--bug=1060558 --user=刘瑞斌 【github#3868】知识库分段,重复添加同一个问题,问题会重复多次关联分段 https://www.tapd.cn/62980211/s/1756889
2025-08-18 17:08:22 +08:00
CaptainB f1356e9b61 feat: add MCP tool support with new form and dropdown options 2025-08-12 10:41:42 +08:00
CaptainB f668daa902 fix: refactor delete method in DocumentSerializers for improved clarity
--bug=1060005 --user=刘瑞斌 【资源管理】知识库-删除文档报错 https://www.tapd.cn/62980211/s/1749123
2025-08-05 15:08:12 +08:00
CaptainB d635cc24b4 fix: add validation checks in page and list methods of KnowledgeFolder
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
2025-08-04 11:10:30 +08:00
CaptainB 39ac62745e feat: enhance SystemKnowledgeSerializer and related components to support workspace and folder IDs
--bug=1059926 --user=刘瑞斌 【资源管理】知识库文档迁移时,可选择的目标知识库展示了系统所有的知识库 https://www.tapd.cn/62980211/s/1747947
2025-08-04 11:08:44 +08:00
zhangzhanwei 6660552618 fix: Problem related 2025-08-01 17:31:45 +08:00
CaptainB 4e6d19235b fix: remove unnecessary validation checks for query sets in paragraph handling 2025-07-31 15:41:28 +08:00
CaptainB 7fc0bd2396 fix: simplify validation checks in document and paragraph retrieval methods 2025-07-31 15:37:38 +08:00
CaptainB a3a124d581 feat: update permission checks to remove row.id dependency and add workspace_id to knowledge retrieval 2025-07-30 09:56:33 +08:00
CaptainB 4d18b78d29 fix: update SQL queries to improve similarity calculations and indexing
Some checks are pending
sync2gitee / repo-sync (push) Waiting to run
2025-07-24 16:18:53 +08:00