2 variants
vLLM is an open-source library for fast LLM inference and serving, built around PagedAttention and continuous batching, started at UC Berkeley.
vllm-icon.svg
vllm.svg
