PyPI package
vllm
check_circle
arrow_drop_down0.9.1
Default versionPublished
Description
A high-throughput and memory-efficient inference and serving engine for LLMs
Links
- Origin
- Homepage
- Repo
- Documentation
Similarly named packageslightbulb_outlineComputed by deps.dev.
lightbulb_outline
Computed by deps.dev.
Projects
vllm-project/vllm
GitHub
A high-throughput and memory-efficient inference and serving engine for LLMs
call_split 8k forks
star 49k stars
Project metadata as of .