真实数据集扩产与被动语料接入

- scripts/expand_real_dataset.py:AutoWeakS 全量 2215 条 + 500 条分层评测集 + 简历扩量(seed=2026 可复现)
- pipeline 被动语料机制(passive_sources):真实无日期 JD 参与接入/清洗/抽取验证(2915 条命中率 99.8%),不进图谱/演化/发现
- 新岗位发现第四指标'差异度'与双年窗口增长率口径
- 评测新增 real_jd_500 维度(99.91%);测试会话隔离 jd_extra_dirs 防止本机配置拖慢套件
This commit is contained in:
RoyirinRosmontis
2026-08-03 15:07:54 +08:00
parent 441d555caf
commit 1722c00249
9 changed files with 412 additions and 18 deletions
+7
View File
@@ -40,9 +40,16 @@ def isolated_state_db(tmp_path_factory):
routes._cfg["state_db_path"] = str(tmp / "state.db")
routes._cfg["audit_path"] = str(tmp / "audit.jsonl")
routes._cfg["pending_path"] = str(tmp / "pending.json")
# 测试不加载本机附加数据源:真实语料会让 API 触发的重建超出任务等待窗口
extra_orig = routes._cfg.get("jd_extra_dirs")
routes._cfg["jd_extra_dirs"] = ""
yield
for k, v in originals.items():
if v is None:
routes._cfg.pop(k, None)
else:
routes._cfg[k] = v
if extra_orig is None:
routes._cfg.pop("jd_extra_dirs", None)
else:
routes._cfg["jd_extra_dirs"] = extra_orig