As an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)
Want a good monitor light? See my photos
All times are UTCnotbug
Remember
I remember
Menu ☰ Menu
Searches without login should now work. You must get asked to click a button.
Some translations wanted please.
New RSS 2.0 and Atom feeds are here. The old /backend/ feeds still work, but will be redirected later, so please update your subscriptions. Details.
Port details
py-vllm High-throughput and memory-efficient LLM inference engine
0.20.2_1 misc Σ=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 0.20.2_1Version of this port present on the latest quarterly branch.
Maintainer: yuri@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2026-04-07 19:21:24
Last Update: 2026-09-17 16:31:59
Commit Hash: 0c4806a
Also Listed In: python
License: APACHE20
WWW:
https://vllm.ai/
https://github.com/vllm-project/vllm
Description: #
vLLM is a fast and easy-to-use library for LLM inference and serving. It provides high-throughput and memory-efficient inference for large language models (LLMs) using state-of-the-art serving technologies including: - PagedAttention for efficient KV cache memory management - Continuous batching of incoming requests - Optimized CUDA kernels (on supported platforms) - Hugging Face model compatibility - Various decoding algorithms including parallel sampling and beam search - OpenAI-compatible API server On FreeBSD, vLLM runs in CPU/empty device mode (VLLM_TARGET_DEVICE=empty), providing pure Python inference without GPU acceleration.
HomepageHomepage    cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port
Manual pages: #
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist #
There is no configure plist information for this port.
USE_RC_SUBR (Service Scripts)
  • no SUBR information found for this port
Dependency lines:
  • ${PYTHON_PKGNAMEPREFIX}vllm>0:misc/py-vllm@${PY_FLAVOR}
To install the port: #
cd /usr/ports/misc/py-vllm/ && make install clean
To add the package, run one of these commands:
  • pkg install misc/py-vllm
  • pkg install py312-vllm
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
NOTE: This is a Python port. Instead of py312-vllm listed in the above command, you can pick from the names under the Packages section.
PKGNAME: py312-vllm
Package flavors (<flavor>: <package>) #
  • py312: py312-vllm
distinfo: #
TIMESTAMP = 1778478277 SHA256 (vllm-0.20.2.tar.gz) = 58809377798c5335c6e2fe30092abda54d9200b5b8a717b3735a63f5daa0e383 SIZE (vllm-0.20.2.tar.gz) = 33526607

Expand this list (2 items)

Collapse this list.

SHA256 (v3.10.tar.gz) = ba5834a1fdbb6d1c1b1c065dfd789438e7aa42c03fc52d92c02af85d78d1c75c SIZE (v3.10.tar.gz) = 13507701

Collapse this list.

Packages (timestamps in pop-ups are UTC): #
py312-vllm
ABIaarch64amd64armv6armv7i386
FreeBSD:14:latest-0.20.2_1---
FreeBSD:14:quarterly-0.20.2_1---
FreeBSD:15:latest-0.20.2_1n/a-n/a
FreeBSD:15:quarterly-0.20.2_1n/a-n/a
FreeBSD:16:latest--n/a-n/a
Dependencies #
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies: #
  1. clang : devel/llvm19
  2. py312-Jinja2>=3.1.6 : devel/py-Jinja2@py312
  3. py312-ninja>=1.13 : devel/py-ninja@py312
  4. py312-packaging>=24.2 : devel/py-packaging@py312
  5. py312-pytorch>=2.11.0 : misc/py-pytorch@py312
  6. py312-setuptools>=63.0 : devel/py-setuptools@py312
  7. py312-setuptools-scm>=8.0 : devel/py-setuptools-scm@py312
  8. py312-wheel>0 : devel/py-wheel@py312
  9. cmake : devel/cmake-core
  10. python3.12 : lang/python312
  11. py312-build>=0 : devel/py-build@py312
  12. py312-installer>=0 : devel/py-installer@py312
Test dependencies: #
  1. py312-datasets>=4.8.2 : misc/py-datasets@py312
  2. py312-evaluate>=0.4.6 : misc/py-evaluate@py312
  3. py312-multiprocess>=0.70.19 : devel/py-multiprocess@py312
  4. py312-pytest-asyncio>=1.3.0 : devel/py-pytest-asyncio@py312
  5. py312-tblib>=3.2.2 : devel/py-tblib@py312
  6. py312-pytest>=7,1 : devel/py-pytest@py312
  7. python3.12 : lang/python312
Runtime dependencies: #
  1. py312-aiohttp>=3.13.3 : www/py-aiohttp@py312
  2. py312-anthropic>=0.71.0 : misc/py-anthropic@py312
  3. py312-blake3>0 : security/py-blake3@py312
  4. py312-cachetools>0 : devel/py-cachetools@py312
  5. py312-cbor2>0 : devel/py-cbor2@py312
  6. py312-cloudpickle>0 : devel/py-cloudpickle@py312
  7. py312-compressed-tensors>=0.15.0.1 : misc/py-compressed-tensors@py312
  8. py312-depyf>=0.20.0 : devel/py-depyf@py312
  9. py312-diskcache>=5.6.3 : devel/py-diskcache@py312
  10. py312-einops>0 : misc/py-einops@py312
  11. py312-fastapi>=0.115.0 : www/py-fastapi@py312
  12. py312-filelock>=3.16.1 : sysutils/py-filelock@py312
  13. py312-gguf>=0.17.0 : misc/py-gguf@py312
  14. py312-ijson>0 : devel/py-ijson@py312
  15. py312-Jinja2>=3.1.6 : devel/py-Jinja2@py312
  16. py312-lark>=1.2.2 : devel/py-lark@py312
  17. py312-llguidance>=1.3.0 : textproc/py-llguidance@py312
  18. py312-lm-format-enforcer>=0.11.3 : misc/py-lm-format-enforcer@py312
  19. py312-mcp>0 : misc/py-mcp@py312
  20. py312-mistral-common>=1.11.0 : misc/py-mistral-common@py312
  21. py312-model-hosting-container-standards>=0.1.13 : misc/py-model-hosting-container-standards@py312
  22. py312-msgspec>0 : devel/py-msgspec@py312
  23. py312-ninja>=1.13 : devel/py-ninja@py312
  24. py312-numba>=0.65.0 : devel/py-numba@py312
  25. py312-numpy>=1.25 : math/py-numpy@py312
  26. py312-openai>=2.0.0 : misc/py-openai@py312
  27. py312-openai-harmony>=0.0.3 : misc/py-openai-harmony@py312
  28. py312-opentelemetry-api>=1.27.0 : devel/py-opentelemetry-api@py312
  29. py312-opentelemetry-exporter-otlp>=1.27.0 : devel/py-opentelemetry-exporter-otlp@py312
  30. py312-opentelemetry-sdk>=1.27.0 : devel/py-opentelemetry-sdk@py312
  31. py312-opentelemetry-semantic-conventions-ai>=0.4.1 : devel/py-opentelemetry-semantic-conventions-ai@py312
  32. py312-opencv-python-headless>=4.13.0 : graphics/py-opencv-python-headless@py312
  33. py312-outlines-core>=0.2.14 : textproc/py-outlines-core@py312
  34. py312-partial-json-parser>0 : textproc/py-partial-json-parser@py312
  35. py312-pillow>=10.0.0 : graphics/py-pillow@py312
  36. py312-prometheus-client>=0.18.0 : net-mgmt/py-prometheus-client@py312
  37. py312-prometheus-fastapi-instrumentator>=7.0.0 : www/py-prometheus-fastapi-instrumentator@py312
  38. py312-protobuf>=5.29.6 : devel/py-protobuf@py312
  39. py312-psutil>=5.9.0 : sysutils/py-psutil@py312
  40. py312-py-cpuinfo2>0 : sysutils/py-py-cpuinfo2@py312
  41. py312-pybase64>0 : devel/py-pybase64@py312
  42. py312-pydantic2>=2.12.0 : devel/py-pydantic2@py312
  43. py312-python-json-logger>0 : devel/py-python-json-logger@py312
  44. py312-pytorch>=2.11.0 : misc/py-pytorch@py312
  45. py312-pyyaml>0 : devel/py-pyyaml@py312
  46. py312-pyzmq>=25.0.0 : net/py-pyzmq@py312
  47. py312-regex>0 : textproc/py-regex@py312
  48. py312-requests>=2.26.0 : www/py-requests@py312
  49. py312-sentencepiece>0 : textproc/py-sentencepiece@py312
  50. py312-setproctitle>0 : devel/py-setproctitle@py312
  51. py312-setuptools>=63.0 : devel/py-setuptools@py312
  52. py312-six>=1.16.0 : devel/py-six@py312
  53. py312-tiktoken>=0.6.0 : textproc/py-tiktoken@py312
  54. py312-tokenizers>=0.21.1 : textproc/py-tokenizers@py312
  55. py312-torchaudio>=0 : audio/py-torchaudio@py312
  56. py312-torchvision>=0 : misc/py-torchvision@py312
  57. py312-tqdm>=4.0 : misc/py-tqdm@py312
  58. py312-transformers>=4.56.0 : misc/py-transformers@py312
  59. py312-typing-extensions>=4.10 : devel/py-typing-extensions@py312
  60. py312-uvloop>=0.20.0 : devel/py-uvloop@py312
  61. py312-watchfiles>0 : devel/py-watchfiles@py312
  62. py312-xgrammar>=0.1.32 : misc/py-xgrammar@py312
  63. python3.12 : lang/python312
Library dependencies: #
  1. libabsl_status.so : devel/abseil
  2. libprotobuf.so : devel/protobuf
This port is required by: #
for Run #
  1. graphics/py-olmocr
Configuration Options: #
No options to configure
Options name: #
misc_py-vllm
USES: #
cmake:indirect python
pkg-message: #
FreshPorts was unable to extract/find any pkg message
Master Sites: #
Expand this list (2 items)
Collapse this list.
  1. https://files.pythonhosted.org/packages/source/v/vllm/
  2. https://pypi.org/packages/source/v/vllm/
Collapse this list.

Number of commits found: 7 #

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
0.20.2_1
17 Sep 2026 16:31:59
commit hash: 0c4806a5273bbd0c8b0c097e94da4a47e7ba2803commit hash: 0c4806a5273bbd0c8b0c097e94da4a47e7ba2803commit hash: 0c4806a5273bbd0c8b0c097e94da4a47e7ba2803commit hash: 0c4806a5273bbd0c8b0c097e94da4a47e7ba2803 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/py-vllm: fix build with the latest pytorch
0.20.2_1
17 Sep 2026 04:49:44
commit hash: 9845f5db558d87dc616593e589db068488680d07commit hash: 9845f5db558d87dc616593e589db068488680d07commit hash: 9845f5db558d87dc616593e589db068488680d07commit hash: 9845f5db558d87dc616593e589db068488680d07 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
sysutils/py-py-cpuinfo: remove in favor of sysutils/py-py-cpuinfo2
0.20.2
20 May 2026 08:36:12
commit hash: a1d8561878fc94eb4b462a2a1280296270bd45cbcommit hash: a1d8561878fc94eb4b462a2a1280296270bd45cbcommit hash: a1d8561878fc94eb4b462a2a1280296270bd45cbcommit hash: a1d8561878fc94eb4b462a2a1280296270bd45cb files touched by this commit		 Piotr Kubaj (pkubaj) search for other commits by this committer 
misc/py-vllm: fix build on powerpc*

1. Fix ISA detection in cpu_extension.cmake.
2. Fix Clang AltiVec incompatibilities.
0.20.2
11 May 2026 07:15:18
commit hash: 95b8eea61d9fe9a9ecda30412e057b7c43107dffcommit hash: 95b8eea61d9fe9a9ecda30412e057b7c43107dffcommit hash: 95b8eea61d9fe9a9ecda30412e057b7c43107dffcommit hash: 95b8eea61d9fe9a9ecda30412e057b7c43107dff files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/py-vllm: update 0.19.0 → 0.20.2
0.19.0_1
05 May 2026 19:29:37
commit hash: 2bf3834a197ccf8956332378eda8dd7577965246commit hash: 2bf3834a197ccf8956332378eda8dd7577965246commit hash: 2bf3834a197ccf8956332378eda8dd7577965246commit hash: 2bf3834a197ccf8956332378eda8dd7577965246 files touched by this commit		 Max Brazhnikov (makc) search for other commits by this committer 
*/*: bump PORTREVISION after switching to NumPy 2.x
0.19.0
05 May 2026 19:29:37
commit hash: b0b4d9e1eae890d0de1591e20fb37358439a2ff6commit hash: b0b4d9e1eae890d0de1591e20fb37358439a2ff6commit hash: b0b4d9e1eae890d0de1591e20fb37358439a2ff6commit hash: b0b4d9e1eae890d0de1591e20fb37358439a2ff6 files touched by this commit Sanity Test Failure		 Max Brazhnikov (makc) search for other commits by this committer 
*/*: Switch to NumPy 2.x

PR:		294328
Exp-run:	antoine
0.19.0
07 Apr 2026 19:19:14
commit hash: 919c3600edaed3248916e0b75d4249fa9903b904commit hash: 919c3600edaed3248916e0b75d4249fa9903b904commit hash: 919c3600edaed3248916e0b75d4249fa9903b904commit hash: 919c3600edaed3248916e0b75d4249fa9903b904 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/py-vllm: New port: High-throughput and memory-efficient LLM inference
engine

Number of commits found: 7

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
Security Policy
Privacy
Blog
Contact

Latest Vulnerabilities
ankiNov 05
elixirNov 05
elixir-develNov 05
elixir-develNov 05
giteaNov 05
keycloakNov 05
openexrNov 05
openvox-agent8Nov 05
openvox-agent9Nov 05
openvox-server8Nov 05
openvox-server8Nov 05
openvox-server9Nov 05
openvox-server9Nov 05
openvoxdb8Nov 05
openvoxdb9Nov 05

77 vulnerabilities affecting 686 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last processed:
2026-11-05 17:50:32 UTC


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)

Calculated hourly:
Port count 35451
Broken 62
Deprecated 353
Ignore 185
Forbidden 0
Restricted 1
No CDROM 1
Vulnerable 54
Expired 11
Set to expire 273
Interactive 0
new 24 hours 15
new 48 hours79
new 7 days141
new fortnight180
new month322
Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD 		Valid HTML, CSS, and RSS. Copyright © 2000-2026 Dan Langille. All rights reserved.