真实数据集扩产与被动语料接入

- scripts/expand_real_dataset.py:AutoWeakS 全量 2215 条 + 500 条分层评测集 + 简历扩量(seed=2026 可复现)
- pipeline 被动语料机制(passive_sources):真实无日期 JD 参与接入/清洗/抽取验证(2915 条命中率 99.8%),不进图谱/演化/发现
- 新岗位发现第四指标'差异度'与双年窗口增长率口径
- 评测新增 real_jd_500 维度(99.91%);测试会话隔离 jd_extra_dirs 防止本机配置拖慢套件
This commit is contained in:
RoyirinRosmontis
2026-08-03 15:07:54 +08:00
parent 441d555caf
commit 1722c00249
9 changed files with 412 additions and 18 deletions
+2 -1
View File
@@ -17,7 +17,7 @@ RUNTIME_KEYS = {
"llm_api_key", "llm_base_url", "llm_model", "llm_timeout",
"embed_model_path", "embed_provider", "embed_api_key",
"embed_api_base_url", "embed_api_model",
"guided",
"guided", "jd_extra_dirs", "passive_sources",
}
DEFAULTS: dict = {
@@ -27,6 +27,7 @@ DEFAULTS: dict = {
"data_dir": "data",
"jd_raw_dir": "data/jd_raw",
"jd_extra_dirs": "", # 附加 JD 数据源目录(逗号分隔,可切换到真实数据集)
"passive_sources": "autoweaks", # 被动语料来源(无日期真实数据,不进图谱/演化/发现)
"graph_path": "data/graph.json",
"lexicon_path": "data/skills_lexicon.json",
"pending_path": "data/review/pending.json", # 旧待审核文件(仅作 SQLite 一次性迁移种子)