真实数据集扩产与被动语料接入

- scripts/expand_real_dataset.py:AutoWeakS 全量 2215 条 + 500 条分层评测集 + 简历扩量(seed=2026 可复现)
- pipeline 被动语料机制(passive_sources):真实无日期 JD 参与接入/清洗/抽取验证(2915 条命中率 99.8%),不进图谱/演化/发现
- 新岗位发现第四指标'差异度'与双年窗口增长率口径
- 评测新增 real_jd_500 维度(99.91%);测试会话隔离 jd_extra_dirs 防止本机配置拖慢套件
This commit is contained in:
RoyirinRosmontis
2026-08-03 15:07:54 +08:00
parent 441d555caf
commit 1722c00249
9 changed files with 412 additions and 18 deletions
+1
View File
@@ -61,6 +61,7 @@ def _tmp_cfg(tmp_path, records) -> dict:
"\n".join(json.dumps(r, ensure_ascii=False) for r in records) + "\n", encoding="utf-8")
cfg = load_config()
cfg["jd_raw_dir"] = str(jd_dir)
cfg["jd_extra_dirs"] = "" # 测试不加载本机附加数据源(真实语料会使 pipeline 变慢且引入不确定性)
cfg["graph_path"] = str(tmp_path / "graph.json")
cfg["state_db_path"] = str(tmp_path / "state.db")
cfg["audit_path"] = str(tmp_path / "audit.jsonl")