vllm

0

reviews

A high-throughput and memory-efficient inference and serving engine for LLMs

65 Security

22 Quality

40 Maintenance

46 Overall

v0.15.1 PyPI Python Feb 5, 2026 by vLLM Team

70640 GitHub Stars

forum Community Reviews

rate_review

No reviews yet

Be the first to share your experience with this package

edit Write a Review

lock

Sign in to write a review

account_tree Dependencies

prometheus_client

prometheus-fastapi-instrumentator

and 40 more

hub Used By

pydantic-ai-slim