PyPI package

lmdeploy

0.8.0

Newer version available

Published

Description

A toolset for compressing, deploying and serving LLM