5eaab2bd30
Batch enrichment of 3,728 person profiles with additional data: - Birth decade inference from education/career history - Location resolution for inferred birth settlements - Web claims with full provenance (source_url, retrieved_on) - Organizational subdivision extraction - Heritage relevance scoring Also includes: - 14 profile renames for PPID format corrections - Updated _manifest.json with extraction statistics - New _extraction_log.txt and _extraction_summary.json Enrichment follows AGENTS.md rules: - Rule 44: EDTF unknown date notation (XXXX, 196X, etc.) - Rule 45: Inferred data with explicit provenance - Rule 30: Confidence scoring (0.50-0.95) - Rule 31: Organizational subdivision extraction 35,052 files changed, +4,507,411 insertions, -63,118 deletions
95 lines
4.8 KiB
Text
95 lines
4.8 KiB
Text
======================================================================
|
|
LINKEDIN PERSON EXTRACTION WITH PROVENANCE
|
|
======================================================================
|
|
|
|
Input directory: /Volumes/KINGSTON/data/glam/data/custodian/person/affiliated/manual
|
|
Output directory: /Users/kempersc/apps/glam/data/custodian/person/entity
|
|
Total files to process: 6670
|
|
Dry run: False
|
|
|
|
Starting at: 2026-01-09T22:40:43.970829+00:00
|
|
|
|
Progress: 100/6670 (1.5%) - 4103 entities, 14106 claims
|
|
Progress: 200/6670 (3.0%) - 5790 entities, 19306 claims
|
|
Progress: 300/6670 (4.5%) - 6075 entities, 20616 claims
|
|
Progress: 400/6670 (6.0%) - 6227 entities, 21435 claims
|
|
Progress: 500/6670 (7.5%) - 6393 entities, 22251 claims
|
|
Progress: 600/6670 (9.0%) - 6489 entities, 22779 claims
|
|
Progress: 700/6670 (10.5%) - 6619 entities, 23583 claims
|
|
Progress: 800/6670 (12.0%) - 7086 entities, 25494 claims
|
|
Progress: 900/6670 (13.5%) - 8803 entities, 31795 claims
|
|
Progress: 1000/6670 (15.0%) - 9334 entities, 34301 claims
|
|
Progress: 1100/6670 (16.5%) - 11130 entities, 41287 claims
|
|
Progress: 1200/6670 (18.0%) - 13695 entities, 49206 claims
|
|
Progress: 1300/6670 (19.5%) - 17620 entities, 63145 claims
|
|
Progress: 1400/6670 (21.0%) - 23852 entities, 85809 claims
|
|
Progress: 1500/6670 (22.5%) - 25420 entities, 91344 claims
|
|
Progress: 1600/6670 (24.0%) - 27586 entities, 99121 claims
|
|
Progress: 1700/6670 (25.5%) - 30581 entities, 109345 claims
|
|
Progress: 1800/6670 (27.0%) - 35356 entities, 127676 claims
|
|
Progress: 1900/6670 (28.5%) - 36763 entities, 133242 claims
|
|
Progress: 2000/6670 (30.0%) - 41743 entities, 152155 claims
|
|
Progress: 2100/6670 (31.5%) - 48545 entities, 177120 claims
|
|
Progress: 2200/6670 (33.0%) - 52331 entities, 189794 claims
|
|
Progress: 2300/6670 (34.5%) - 52698 entities, 191525 claims
|
|
Progress: 2400/6670 (36.0%) - 56252 entities, 204060 claims
|
|
Progress: 2500/6670 (37.5%) - 58444 entities, 212325 claims
|
|
Progress: 2600/6670 (39.0%) - 62252 entities, 225948 claims
|
|
Progress: 2700/6670 (40.5%) - 67324 entities, 243655 claims
|
|
Progress: 2800/6670 (42.0%) - 72448 entities, 261589 claims
|
|
Progress: 2900/6670 (43.5%) - 76244 entities, 274592 claims
|
|
Progress: 3000/6670 (45.0%) - 80340 entities, 288980 claims
|
|
Progress: 3100/6670 (46.5%) - 86057 entities, 309425 claims
|
|
Progress: 3200/6670 (48.0%) - 89207 entities, 320865 claims
|
|
Progress: 3300/6670 (49.5%) - 99733 entities, 360465 claims
|
|
Progress: 3400/6670 (51.0%) - 107593 entities, 389424 claims
|
|
Progress: 3500/6670 (52.5%) - 107593 entities, 389424 claims
|
|
Progress: 3600/6670 (54.0%) - 107593 entities, 389424 claims
|
|
Progress: 3700/6670 (55.5%) - 107593 entities, 389424 claims
|
|
Progress: 3800/6670 (57.0%) - 107593 entities, 389424 claims
|
|
Progress: 3900/6670 (58.5%) - 107593 entities, 389424 claims
|
|
Progress: 4000/6670 (60.0%) - 107593 entities, 389424 claims
|
|
Progress: 4100/6670 (61.5%) - 107593 entities, 389424 claims
|
|
Progress: 4200/6670 (63.0%) - 107593 entities, 389424 claims
|
|
Progress: 4300/6670 (64.5%) - 107593 entities, 389424 claims
|
|
Progress: 4400/6670 (66.0%) - 107593 entities, 389424 claims
|
|
Progress: 4500/6670 (67.5%) - 107593 entities, 389424 claims
|
|
Progress: 4600/6670 (69.0%) - 107593 entities, 389424 claims
|
|
Progress: 4700/6670 (70.5%) - 107593 entities, 389424 claims
|
|
Progress: 4800/6670 (72.0%) - 107593 entities, 389424 claims
|
|
Progress: 4900/6670 (73.5%) - 107593 entities, 389424 claims
|
|
Progress: 5000/6670 (75.0%) - 107593 entities, 389424 claims
|
|
Progress: 5100/6670 (76.5%) - 107593 entities, 389424 claims
|
|
Progress: 5200/6670 (78.0%) - 107593 entities, 389424 claims
|
|
Progress: 5300/6670 (79.5%) - 107593 entities, 389424 claims
|
|
Progress: 5400/6670 (81.0%) - 107593 entities, 389424 claims
|
|
Progress: 5500/6670 (82.5%) - 107593 entities, 389424 claims
|
|
Progress: 5600/6670 (84.0%) - 107593 entities, 389424 claims
|
|
Progress: 5700/6670 (85.5%) - 107593 entities, 389424 claims
|
|
Progress: 5800/6670 (87.0%) - 107593 entities, 389424 claims
|
|
Progress: 5900/6670 (88.5%) - 107593 entities, 389424 claims
|
|
Progress: 6000/6670 (90.0%) - 107593 entities, 389424 claims
|
|
Progress: 6100/6670 (91.5%) - 107593 entities, 389424 claims
|
|
Progress: 6200/6670 (93.0%) - 107593 entities, 389424 claims
|
|
Progress: 6300/6670 (94.5%) - 107593 entities, 389424 claims
|
|
Progress: 6400/6670 (96.0%) - 107593 entities, 389424 claims
|
|
Progress: 6500/6670 (97.5%) - 107593 entities, 389424 claims
|
|
Progress: 6600/6670 (99.0%) - 107593 entities, 389424 claims
|
|
|
|
======================================================================
|
|
EXTRACTION COMPLETE
|
|
======================================================================
|
|
|
|
Total files: 6670
|
|
Processed: 6670
|
|
Skipped: 0
|
|
Errors: 0
|
|
|
|
Total profiles extracted: 108398
|
|
Person entities created: 108398
|
|
Heritage-relevant: 46409
|
|
Total web claims (with provenance): 392463
|
|
|
|
|
|
Summary saved to: /Users/kempersc/apps/glam/data/person/_extraction_summary.json
|
|
======================================================================
|