PyPI package

vllm

0.9.1

Default version

Published

Description

A high-throughput and memory-efficient inference and serving engine for LLMs

Similarly named packages
Computed by deps.dev.

Package name

Total package dependents

llm

237

vllm (this package)

136

Projects

vllm-project/vllm

GitHub

A high-throughput and memory-efficient inference and serving engine for LLMs

 8k forks
 49k stars

Project metadata as of .