zeekrAI/document_analyzer
1
0
Fork 0
Code Issues 2 Pull Requests Actions Packages Projects Releases Wiki Activity

fix: [bug] IR 覆盖率回归：Layer B 从 92.6% 降至 63% + Layer A 新 schema 错误 - 来自 #18 - Closes #57 #59

Merged
pzhang_zywl merged 1 commits from dev/issue-57-fix-coverage-regression into main 2026-06-02 16:17:55 +08:00
Conversation 0 Commits 1 Files Changed 3
+49 -10
pzhang_zywl commented 2026-06-02 16:17:02 +08:00
Owner
Copy Link
Copy Source

Summary

  • step3 _normalize_rule: 非法 source type（如 function_unit_description）→ text
  • step1 重试质量门控: 仅纳入实际降低 coverage_warnings/missing_rows 的 retry 结果
    • 避免低质量 LLM 输出稀释 ensemble 导致覆盖率回归 (92.6%→63%)
  • 新增 UT: test_normalize_source_invalid_type

Root Cause

  1. LLM 在 step2 中 hallucinate 了 function_unit_description 等非法 source type，导致 Layer A schema 失败
  2. step1 无条件纳入所有 retry 结果，低质量输出稀释 ensemble，可能引发覆盖率回归

Test

  • pytest: 108 passed, 15 skipped

Closes #57

[da-0602-1321]

## Summary - **step3 `_normalize_rule`**: 非法 source type（如 `function_unit_description`）→ `text` - **step1 重试质量门控**: 仅纳入实际降低 coverage_warnings/missing_rows 的 retry 结果 - 避免低质量 LLM 输出稀释 ensemble 导致覆盖率回归 (92.6%→63%) - 新增 UT: `test_normalize_source_invalid_type` ## Root Cause 1. LLM 在 step2 中 hallucinate 了 `function_unit_description` 等非法 source type，导致 Layer A schema 失败 2. step1 无条件纳入所有 retry 结果，低质量输出稀释 ensemble，可能引发覆盖率回归 ## Test - [x] pytest: 108 passed, 15 skipped Closes #57 --- [da-0602-1321]
pzhang_zywl added 1 commit 2026-06-02 16:17:06 +08:00
fix: step3 过滤非法 source type + step1 重试质量门控 - Closes #57
CI / test (pull_request) Successful in 11s
Details
268520d453 
- step3 _normalize_rule: 将 function_unit_description 等非法 source type 标准化为 text
- step1 覆盖反馈重试: 仅纳入实际提升覆盖率的 retry 结果，避免低质量输出稀释 ensemble
- 新增 UT: test_normalize_source_invalid_type

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
pzhang_zywl merged commit 9f0872c36a into main 2026-06-02 16:17:55 +08:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
blocked
被其他 issue 阻塞，暂不处理
 product-code
产品功能相关
 test-code
QE-Agent 测试代码相关
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
dzhou_dev_agent_01 dzhou_qe_agent_01 hshen_dev_agent_01 hshen_qe_agent_01 phong_dev_agent_01 phong_qe_agent_01 pzhang_dev_agent_01 pzhang_qe_agent_01 pzhang_zywl vlu_dev_agent_01 vlu_qe_agent_01
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: zeekrAI/document_analyzer#59
Delete Branch "dev/issue-57-fix-coverage-regression"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?