RAG and Data
RAG and Data
Vector databases, embedding tools, rerankers, and RAG application frameworks.
Vector Databases
Qdrant
Rust · Apache-2.0 · 🟢 stable
Vector search engine with rich payload filtering, built for production.
- Replaces: Pinecone
- Edge: Written in Rust — predictable latency under load. Scalar/product/binary quantization cuts RAM dramatically. Filtered search stays accurate instead of degrading like naive pre/post-filtering.
Milvus
Go + C++ · Apache-2.0 · 🟢 stable
Distributed vector database built for billion-scale workloads.
- Edge: Separated storage and compute, GPU indexing — the heaviest-duty option when the corpus genuinely is enormous. Milvus Lite covers local dev.
Weaviate
Go · BSD-3-Clause · 🟢 stable
Vector database with built-in vectorization modules and a GraphQL API.
- Edge: Module system embeds data for you at ingest. Native hybrid (BM25 + vector) search and multi-tenancy.
Chroma
Rust + Python · Apache-2.0 · 🟢 stable
The batteries-included embedding database for AI applications.
- Edge:
pip install chromadband you have a working vector store in four lines. The right default for prototypes; scale out later if you must.
pgvector
C · PostgreSQL License · 🟢 stable
Vector similarity search inside PostgreSQL.
- Edge: No new infrastructure. Your embeddings live next to your relational data with real transactions, joins, and backups. Start here unless you’ve measured a reason not to.
MongrelDB
Rust · MIT OR Apache-2.0 · Embedded + server · 🟠 experimental
Columnar database with AI-native retrieval — dense ANN, sparse vectors, full-text, and metadata filters in one transactional engine.
- Replaces: Pinecone + a separate operational DB for RAG/agent memory
- Edge: Not a pure vector store — dense ANN, sparse, and full-text indexes share one transactional row store, so hybrid search with RRF fusion runs without a separate vector service, keeping SQL, encryption-at-rest, and multi-user access. Companion MongrelDB Viewer for schema, SQL, and ANN exploration.
Embeddings & Rerankers
The retrieval quality layer. Swapping your embedding model usually beats swapping your vector database.
FlagEmbedding / BGE
Python · MIT · 🟢 stable
The BGE family — BGE-M3 embeddings and the BGE reranker models.
- Replaces: OpenAI text-embedding-3, Cohere Embed, Cohere Rerank
- Edge: BGE-M3 does dense, sparse (lexical), and multi-vector retrieval from one model across 100+ languages, so you get hybrid search without running two systems. Pairing BGE-M3 with a BGE reranker is the default open retrieval stack, and it runs on your own hardware with no per-query cost.
Sentence Transformers
Python · Apache-2.0 · 🟢 stable
The library for computing, training, and fine-tuning text embeddings.
- Edge: the interface almost every open embedding model ships against — learn it once and every model on Hugging Face is available. Fine-tuning an embedding model on your own domain is usually the single highest-leverage RAG improvement, and this is how you do it.
RAG Frameworks
LlamaIndex
Python + TypeScript · MIT · 🟢 stable
The data framework for LLM applications — ingestion, indexing, retrieval, and agentic workflows over your data.
- Edge: Hundreds of data connectors (LlamaHub) and the deepest library of retrieval strategies — hierarchical, recursive, hybrid, auto-merging. When naive top-k retrieval isn’t good enough, the fix is usually already implemented here.
RAGFlow
Python · Apache-2.0 · 🟢 stable
RAG engine built on deep document understanding — layout-aware parsing of PDFs, tables, and scans.
- Edge: Document parsing is where most RAG systems actually fail. RAGFlow treats it as the core problem and shows you citation-grounded chunks so you can debug retrieval visually.
Dify
Python + TypeScript · Apache-2.0 (with conditions) · 🟢 stable
Production-ready platform for agentic workflows — visual builder, RAG pipeline, model management, and observability in one.
- Replaces: OpenAI GPTs platform, Vertex AI Agent Builder
- Edge: Non-engineers can build and ship an internal AI tool without touching code, while engineers keep API access to everything. Self-hosted, so your data stays put.
Docling
Python · MIT · 🟢 stable
Parse PDF, DOCX, PPTX, HTML, and images into structured, LLM-ready formats.
- Edge: Layout and table-structure models that handle real-world documents. Plugs directly into LlamaIndex and LangChain.
Unstructured
Python · Apache-2.0 · 🟢 stable
Preprocessing library for ingesting unstructured documents into ML pipelines.
- Edge: Broadest format coverage. The workhorse behind many production ingestion pipelines.
LLMSlim
Python · MIT · library + CLI · 🟡 active
Fits retrieved documents, chat history and tool output into a token budget before the model call, with drop-in compressors for LangChain, LlamaIndex and Haystack.
- Edge: The default mode is extractive and runs no model: it keeps sentences from your input, chosen by query relevance (BM25), so the same input always gives the same context and nothing is paraphrased. Retrieved text is treated as untrusted, so imperative wording inside a document is never force-kept.