混合检索增强生成
关键词检索与向量检索互补盲区后融合,再由本地开源模型来回答。
Problem
Domain-specific factual question answering where neither keyword search nor embeddings alone are reliable.
Approach
- Convert heterogeneous HTML and PDF sources into chunked embeddings and searchable FAISS and BM25 indexes.
- Hybrid retrieval: run both retrievers, fuse with reciprocal rank fusion, then generate with a locally served open-source LLM.
- Automated evaluation across retrieval relevance and answer quality.
Result
A pipeline where each component can be swapped and measured independently, with the fused retriever beating either retriever alone on the evaluation set.