Back to directory
V

vLLM

Active

High-throughput LLM serving engine with PagedAttention for efficient inference.

RAG FrameworkOpen Source
Visit WebsiteGitHub

Overview

High-throughput LLM serving engine with PagedAttention for efficient inference.

self_hosted

Pricing

Open Source

Free to use.

Visit pricing page

Similar Solutions

L

LlamaIndex

Data framework for LLM applications to ingest, structure, and access private data.

RAG Framework
H

Haystack

End-to-end NLP framework for building production-ready RAG pipelines.

RAG Framework
V

Verba

Golden RAGtriever - open-source RAG application powered by Weaviate.

RAG Framework
M

Mem0

Memory layer for AI assistants and agents with long-term memory management.

RAG Framework
L

LangChain

Framework for developing applications powered by language models with composable chains.

RAG Framework