Skip to content

混合检索增强生成

关键词检索与向量检索互补盲区后融合,再由本地开源模型来回答。

CMUCMU Advanced NLPretrievalllm源码 ↗正文为英文。

Problem

Domain-specific factual question answering where neither keyword search nor embeddings alone are reliable.

Approach

  • Convert heterogeneous HTML and PDF sources into chunked embeddings and searchable FAISS and BM25 indexes.
  • Hybrid retrieval: run both retrievers, fuse with reciprocal rank fusion, then generate with a locally served open-source LLM.
  • Automated evaluation across retrieval relevance and answer quality.

Result

A pipeline where each component can be swapped and measured independently, with the fused retriever beating either retriever alone on the evaluation set.