glam/backend/rag
kempersc fb7993e3af fix: filter DSPy field markers from streaming output
Implements a state machine to filter streaming tokens:
- Only stream tokens from the 'answer' field to the frontend
- Skip tokens from 'reasoning', 'citations', 'confidence', 'follow_up' fields
- Remove DSPy field markers like '[[ ## answer ## ]]' from streamed content

This fixes the issue where raw DSPy signature field markers were being
displayed in the chat interface instead of clean answer text.
2025-12-26 03:11:44 +01:00
..
optimized_models fix(rag): correct SPARQL ontology prefixes for LinkML schema 2025-12-22 21:31:08 +01:00
__init__.py enrich custodians 2025-12-11 22:32:09 +01:00
atomic_decomposer.py enrich custodians 2025-12-11 22:32:09 +01:00
benchmark_lm_optimization.py remove a,bihguous web-claims 2025-12-21 00:01:54 +01:00
benchmark_optimization.py remove a,bihguous web-claims 2025-12-21 00:01:54 +01:00
benchmark_optimization_v2.py enrich entries 2025-12-21 22:12:34 +01:00
benchmark_prompt_caching.py enrich entries 2025-12-23 13:27:35 +01:00
cache_config.py enrich custodians 2025-12-11 22:32:09 +01:00
cost_tracker.py enrich person custodian 2025-12-14 17:09:55 +01:00
dspy_heritage_rag.py fix: filter DSPy field markers from streaming output 2025-12-26 03:11:44 +01:00
gepa_training_extended.py enrich custodians 2025-12-11 22:32:09 +01:00
LM_OPTIMIZATION_FINDINGS.md enrich entries 2025-12-21 22:12:34 +01:00
main.py Logo enrichment batch: CZ+260, JP+260 - 11,663 files (36.7%) 2025-12-25 19:23:41 +01:00
ontology_mapping.py feat(rag): Add hybrid language detection and enhanced ontology mapping 2025-12-14 15:55:18 +01:00
optimization_log.txt enrich custodians 2025-12-11 22:32:09 +01:00
optimized_heritage_router.json enrich person custodian 2025-12-14 17:09:55 +01:00
requirements.txt enrich custodians 2025-12-11 22:32:09 +01:00
run_bootstrap_optimization.py enrich custodians 2025-12-11 22:32:09 +01:00
run_gepa_optimization.py enrich custodians 2025-12-11 22:32:09 +01:00
run_mipro_optimization.py remove a,bihguous web-claims 2025-12-21 00:01:54 +01:00
schema_loader.py enrich entries 2025-12-23 13:27:35 +01:00
semantic_cache.py enrich entries 2025-12-23 13:27:35 +01:00
test_dspy_rag.py enrich person custodian 2025-12-14 17:09:55 +01:00
test_live_rag.py fix(rag): correct SPARQL ontology prefixes for LinkML schema 2025-12-22 21:31:08 +01:00
test_rate_limit_handling.py enrich entries 2025-12-23 13:27:35 +01:00