notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)Want a good monitor light? See my photosAll times are UTC		 Ukraine
Port details
llama-cpp Facebook's LLaMA model in C/C++
4837 misc on this many watch lists=3 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 4381Version of this port present on the latest quarterly branch.
Maintainer: yuri@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2024-02-15 11:27:23
Last Update: 2025-03-07 15:57:21
Commit Hash: 9d86f7e
People watching this port, also watch:: autoconf, ta-lib, weberp, prestashop, irrlicht
License: MIT
WWW:
https://github.com/ggerganov/llama.cpp
Description:
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide variety of hardware - locally and in the cloud.
Homepage    cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port

Manual pages:
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist
Expand this list (78 items)
Collapse this list.
  1. @ldconfig
  2. /usr/local/share/licenses/llama-cpp-4837/catalog.mk
  3. /usr/local/share/licenses/llama-cpp-4837/LICENSE
  4. /usr/local/share/licenses/llama-cpp-4837/MIT
  5. bin/convert_hf_to_gguf.py
  6. bin/llama-batched
  7. bin/llama-batched-bench
  8. bin/llama-bench
  9. bin/llama-cli
  10. bin/llama-convert-llama2c-to-ggml
  11. bin/llama-cvector-generator
  12. bin/llama-embedding
  13. bin/llama-eval-callback
  14. bin/llama-export-lora
  15. bin/llama-gbnf-validator
  16. bin/llama-gen-docs
  17. bin/llama-gguf
  18. bin/llama-gguf-hash
  19. bin/llama-gguf-split
  20. bin/llama-gritlm
  21. bin/llama-imatrix
  22. bin/llama-infill
  23. bin/llama-llava-cli
  24. bin/llama-llava-clip-quantize-cli
  25. bin/llama-lookahead
  26. bin/llama-lookup
  27. bin/llama-lookup-create
  28. bin/llama-lookup-merge
  29. bin/llama-lookup-stats
  30. bin/llama-minicpmv-cli
  31. bin/llama-parallel
  32. bin/llama-passkey
  33. bin/llama-perplexity
  34. bin/llama-quantize
  35. bin/llama-quantize-stats
  36. bin/llama-qwen2vl-cli
  37. bin/llama-retrieval
  38. bin/llama-run
  39. bin/llama-save-load-state
  40. bin/llama-server
  41. bin/llama-simple
  42. bin/llama-simple-chat
  43. bin/llama-speculative
  44. bin/llama-speculative-simple
  45. bin/llama-tokenize
  46. bin/llama-tts
  47. bin/vulkan-shaders-gen
  48. include/ggml-alloc.h
  49. include/ggml-backend.h
  50. include/ggml-blas.h
  51. include/ggml-cann.h
  52. include/ggml-cpp.h
  53. include/ggml-cpu.h
  54. include/ggml-cuda.h
  55. include/ggml-kompute.h
  56. include/ggml-metal.h
  57. include/ggml-opt.h
  58. include/ggml-rpc.h
  59. include/ggml-sycl.h
  60. include/ggml-vulkan.h
  61. include/ggml.h
  62. include/gguf.h
  63. include/llama-cpp.h
  64. include/llama.h
  65. lib/cmake/ggml/ggml-config.cmake
  66. lib/cmake/ggml/ggml-version.cmake
  67. lib/cmake/llama/llama-config.cmake
  68. lib/cmake/llama/llama-version.cmake
  69. lib/libggml-base.so
  70. lib/libggml-cpu.so
  71. lib/libggml-vulkan.so
  72. lib/libggml.so
  73. lib/libllama.so
  74. lib/libllava_shared.so
  75. libdata/pkgconfig/llama.pc
  76. @owner
  77. @group
  78. @mode
Collapse this list.
Dependency lines:
  • llama-cpp>0:misc/llama-cpp
To install the port:
cd /usr/ports/misc/llama-cpp/ && make install clean
To add the package, run one of these commands:
  • pkg install misc/llama-cpp
  • pkg install llama-cpp
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
PKGNAME: llama-cpp
Flavors: there is no flavor information for this port.
distinfo:
TIMESTAMP = 1741327314 SHA256 (ggerganov-llama.cpp-b4837_GH0.tar.gz) = 60587fd5b417ac35d691284e1b117a8c114f10c8d3960494551a4e49338b5e0f SIZE (ggerganov-llama.cpp-b4837_GH0.tar.gz) = 20796825

Expand this list (2 items)

Collapse this list.

SHA256 (nomic-ai-kompute-4565194_GH0.tar.gz) = 95b52d2f0514c5201c7838348a9c3c9e60902ea3c6c9aa862193a212150b2bfc SIZE (nomic-ai-kompute-4565194_GH0.tar.gz) = 13540496

Collapse this list.

Packages (timestamps in pop-ups are UTC):
llama-cpp
ABIaarch64amd64armv6armv7i386powerpcpowerpc64powerpc64le
FreeBSD:13:latest47354837------
FreeBSD:13:quarterly44094409------
FreeBSD:14:latest47354837------
FreeBSD:14:quarterly44094409------
FreeBSD:15:latest47844784n/a-n/a--2241
Dependencies
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies:
  1. glslc : graphics/shaderc
  2. vulkan-headers>0 : graphics/vulkan-headers
  3. cmake : devel/cmake-core
  4. ninja : devel/ninja
Runtime dependencies:
  1. python3.11 : lang/python311
Library dependencies:
  1. libcurl.so : ftp/curl
  2. libvulkan.so : graphics/vulkan-loader
This port is required by:
for Libraries
  1. devel/tabby
Configuration Options:
===> The following configuration options are available for llama-cpp-4837: CURL=on: Data transfer support via cURL EXAMPLES=on: Build and/or install examples VULKAN=on: Vulkan GPU offload support ===> Use 'make config' to modify these settings
Options name:
misc_llama-cpp
USES:
cmake:testing compiler:c++11-lang python:run shebangfix localbase
pkg-message:
For install:
You installed LLaMA-cpp: Facebook's LLaMA model runner. In order to experience LLaMA-cpp please download some AI model in the GGUF format, for example from huggingface.com, run the script below, and open localhost:9011 in your browser to communicate with this AI model. $ llama-server -m $MODEL \ --host 0.0.0.0 \ --port 9011
Master Sites:
Expand this list (1 items)
Collapse this list.
  1. https://codeload.github.com/ggerganov/llama.cpp/tar.gz/b4837?dummy=/
Collapse this list.

Number of commits found: 226 (showing only 26 on this page)

«  1 | 2 | 3 

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
2517
25 Mar 2024 05:00:39
commit hash: fe0b95565b26b853fac702c60efce9f61068fc57commit hash: fe0b95565b26b853fac702c60efce9f61068fc57commit hash: fe0b95565b26b853fac702c60efce9f61068fc57commit hash: fe0b95565b26b853fac702c60efce9f61068fc57 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2509 → 2517

Reported by:	portscout
2509
24 Mar 2024 09:59:11
commit hash: 086eaf1ef2bbd062773660fb0d8c8fd08e443493commit hash: 086eaf1ef2bbd062773660fb0d8c8fd08e443493commit hash: 086eaf1ef2bbd062773660fb0d8c8fd08e443493commit hash: 086eaf1ef2bbd062773660fb0d8c8fd08e443493 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2487 → 2509

Reported by:	portscout
2487
22 Mar 2024 12:22:51
commit hash: d8620d2daab3a48f635c2ee365f68db562220adfcommit hash: d8620d2daab3a48f635c2ee365f68db562220adfcommit hash: d8620d2daab3a48f635c2ee365f68db562220adfcommit hash: d8620d2daab3a48f635c2ee365f68db562220adf files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2479 → 2487

Reported by:	portscout
2479
21 Mar 2024 10:10:56
commit hash: 82151f5696a349b78ff4add62e116bf639d4afe8commit hash: 82151f5696a349b78ff4add62e116bf639d4afe8commit hash: 82151f5696a349b78ff4add62e116bf639d4afe8commit hash: 82151f5696a349b78ff4add62e116bf639d4afe8 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2465 → 2479

Reported by:	portscout
2465
20 Mar 2024 08:59:51
commit hash: 5fdb71e305f9d32c74dd72214fae12f1ae38c806commit hash: 5fdb71e305f9d32c74dd72214fae12f1ae38c806commit hash: 5fdb71e305f9d32c74dd72214fae12f1ae38c806commit hash: 5fdb71e305f9d32c74dd72214fae12f1ae38c806 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2450 → 2465

Reported by:	portscout
2450
18 Mar 2024 16:24:19
commit hash: 63b8c00f1078a9b69822688d172c37f4dbfe7bffcommit hash: 63b8c00f1078a9b69822688d172c37f4dbfe7bffcommit hash: 63b8c00f1078a9b69822688d172c37f4dbfe7bffcommit hash: 63b8c00f1078a9b69822688d172c37f4dbfe7bff files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2440 → 2450

Reported by:	portscout
2440
17 Mar 2024 05:40:50
commit hash: 9f2bdb0ed7e6ee9b8d97233903f1b5ebf9c5eadbcommit hash: 9f2bdb0ed7e6ee9b8d97233903f1b5ebf9c5eadbcommit hash: 9f2bdb0ed7e6ee9b8d97233903f1b5ebf9c5eadbcommit hash: 9f2bdb0ed7e6ee9b8d97233903f1b5ebf9c5eadb files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2430 → 2440

Reported by:	portscout
2430
15 Mar 2024 15:46:26
commit hash: 4a80dcf0688eac521741573fa1580a4113b5162ccommit hash: 4a80dcf0688eac521741573fa1580a4113b5162ccommit hash: 4a80dcf0688eac521741573fa1580a4113b5162ccommit hash: 4a80dcf0688eac521741573fa1580a4113b5162c files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2409 → 2430

Reported by:	portscout
2409
13 Mar 2024 06:17:05
commit hash: c62f47f13900d685c20447c9b04f40bcf225bee4commit hash: c62f47f13900d685c20447c9b04f40bcf225bee4commit hash: c62f47f13900d685c20447c9b04f40bcf225bee4commit hash: c62f47f13900d685c20447c9b04f40bcf225bee4 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2405 → 2409

Reported by:	portscout
2405
12 Mar 2024 19:42:11
commit hash: 8f40974604259363e7f4c7c03beea4c97927f554commit hash: 8f40974604259363e7f4c7c03beea4c97927f554commit hash: 8f40974604259363e7f4c7c03beea4c97927f554commit hash: 8f40974604259363e7f4c7c03beea4c97927f554 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2393 → 2405

Reported by:	portscout
2393
11 Mar 2024 17:53:46
commit hash: 3daabcfc15e30b0bd7992bd3d25f8300745cb83ccommit hash: 3daabcfc15e30b0bd7992bd3d25f8300745cb83ccommit hash: 3daabcfc15e30b0bd7992bd3d25f8300745cb83ccommit hash: 3daabcfc15e30b0bd7992bd3d25f8300745cb83c files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2376 → 2393

Reported by:	portscout
2376
10 Mar 2024 07:35:57
commit hash: b7f03d9f73c54c256a8c2a8efd7f3b8f9c4636c3commit hash: b7f03d9f73c54c256a8c2a8efd7f3b8f9c4636c3commit hash: b7f03d9f73c54c256a8c2a8efd7f3b8f9c4636c3commit hash: b7f03d9f73c54c256a8c2a8efd7f3b8f9c4636c3 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2366 → 2376

Reported by:	portscout
2366
09 Mar 2024 07:34:18
commit hash: 2bcc1ff88039885703a1f9ee9f6079a6ee724956commit hash: 2bcc1ff88039885703a1f9ee9f6079a6ee724956commit hash: 2bcc1ff88039885703a1f9ee9f6079a6ee724956commit hash: 2bcc1ff88039885703a1f9ee9f6079a6ee724956 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2360 → 2366

Reported by:	portscout
2360
08 Mar 2024 10:25:53
commit hash: 14d65caf75cb9c19c30f60afcdf603eee4e012c7commit hash: 14d65caf75cb9c19c30f60afcdf603eee4e012c7commit hash: 14d65caf75cb9c19c30f60afcdf603eee4e012c7commit hash: 14d65caf75cb9c19c30f60afcdf603eee4e012c7 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2355 → 2360

Reported by:	portscout
2355
07 Mar 2024 09:48:07
commit hash: 9a8142f48823dc491eefc2646506115b319bc2bccommit hash: 9a8142f48823dc491eefc2646506115b319bc2bccommit hash: 9a8142f48823dc491eefc2646506115b319bc2bccommit hash: 9a8142f48823dc491eefc2646506115b319bc2bc files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2350 → 2355

Reported by:	portscout
2350
06 Mar 2024 11:52:34
commit hash: ff2c29b8e34c3a955ea1a5c6aae8e10761467d59commit hash: ff2c29b8e34c3a955ea1a5c6aae8e10761467d59commit hash: ff2c29b8e34c3a955ea1a5c6aae8e10761467d59commit hash: ff2c29b8e34c3a955ea1a5c6aae8e10761467d59 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2329 → 2350

Reported by:	portscout
2329
04 Mar 2024 16:09:17
commit hash: 03750e81ded56ab47fa6610080407f7358341957commit hash: 03750e81ded56ab47fa6610080407f7358341957commit hash: 03750e81ded56ab47fa6610080407f7358341957commit hash: 03750e81ded56ab47fa6610080407f7358341957 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2294 → 2329

Reported by:	portscout
2294
27 Feb 2024 00:31:15
commit hash: c3acd38c0af7a63df8c1276fc200a8c4188807b4commit hash: c3acd38c0af7a63df8c1276fc200a8c4188807b4commit hash: c3acd38c0af7a63df8c1276fc200a8c4188807b4commit hash: c3acd38c0af7a63df8c1276fc200a8c4188807b4 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2266 → 2294

Reported by:	portscout
2266
26 Feb 2024 05:55:19
commit hash: 72774ca02652fb9da7e4abde06039fc5b63ad272commit hash: 72774ca02652fb9da7e4abde06039fc5b63ad272commit hash: 72774ca02652fb9da7e4abde06039fc5b63ad272commit hash: 72774ca02652fb9da7e4abde06039fc5b63ad272 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2251 → 2266

Reported by:	portscout
2251
25 Feb 2024 00:18:07
commit hash: 677fb06031924c2894152a467cccb37d0722ad7dcommit hash: 677fb06031924c2894152a467cccb37d0722ad7dcommit hash: 677fb06031924c2894152a467cccb37d0722ad7dcommit hash: 677fb06031924c2894152a467cccb37d0722ad7d files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2241 → 2251

Reported by:	portscout
2241
23 Feb 2024 10:25:42
commit hash: d53bc18d13b00224875afd5cced4606a14aa5875commit hash: d53bc18d13b00224875afd5cced4606a14aa5875commit hash: d53bc18d13b00224875afd5cced4606a14aa5875commit hash: d53bc18d13b00224875afd5cced4606a14aa5875 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2234 → 2241

Reported by:	portscout
2234
22 Feb 2024 09:38:40
commit hash: 6b56d743ca3f587f11a39e281436f08514364d31commit hash: 6b56d743ca3f587f11a39e281436f08514364d31commit hash: 6b56d743ca3f587f11a39e281436f08514364d31commit hash: 6b56d743ca3f587f11a39e281436f08514364d31 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2212 → 2234

Reported by:	portscout
2212
20 Feb 2024 07:09:21
commit hash: a07a1109f968f052bebeeab6d685ee7131dbf851commit hash: a07a1109f968f052bebeeab6d685ee7131dbf851commit hash: a07a1109f968f052bebeeab6d685ee7131dbf851commit hash: a07a1109f968f052bebeeab6d685ee7131dbf851 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2185 → 2212

Reported by:	portscout
2185
19 Feb 2024 05:01:44
commit hash: c5779ac034468d5d8dd27ab9712c3df320a87ecbcommit hash: c5779ac034468d5d8dd27ab9712c3df320a87ecbcommit hash: c5779ac034468d5d8dd27ab9712c3df320a87ecbcommit hash: c5779ac034468d5d8dd27ab9712c3df320a87ecb files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2167 → 2185

Reported by:	portscout
2167
17 Feb 2024 08:45:30
commit hash: 66da8bdf86770657d9069cb924fb726e53cc5166commit hash: 66da8bdf86770657d9069cb924fb726e53cc5166commit hash: 66da8bdf86770657d9069cb924fb726e53cc5166commit hash: 66da8bdf86770657d9069cb924fb726e53cc5166 files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: update 2144 → 2167

Reported by:	portscout
2144
15 Feb 2024 11:25:01
commit hash: d549d297aaf7d12246f16893f0521079da99de9ecommit hash: d549d297aaf7d12246f16893f0521079da99de9ecommit hash: d549d297aaf7d12246f16893f0521079da99de9ecommit hash: d549d297aaf7d12246f16893f0521079da99de9e files touched by this commit		 Yuri Victorovich (yuri) search for other commits by this committer 
misc/llama-cpp: New port: Facebook's LLaMA model in C/C++

Number of commits found: 226 (showing only 26 on this page)

«  1 | 2 | 3 
Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
Security Policy
Privacy
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
chromiumMar 11
ungoogled-chromiumMar 11
libreofficeMar 10
vimMar 10
electron33Mar 08
openssh-portable*Mar 08
electron32Mar 07
calderaMar 06
py-Jinja2Mar 06
xorg-serverMar 06
chromiumMar 05
jenkinsMar 05
jenkins-ltsMar 05
py-spotipyMar 05
ungoogled-chromiumMar 05

18 vulnerabilities affecting 197 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last processed:
2025-03-11 08:52:20 UTC


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)

Calculated hourly:
Port count 33268
Broken 127
Deprecated 281
Ignore 241
Forbidden 1
Restricted 1
No CDROM 1
Vulnerable 26
Expired 16
Set to expire 236
Interactive 0
new 24 hours 3
new 48 hours4
new 7 days22
new fortnight41
new month121
Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD 		Valid HTML, CSS, and RSS. Copyright © 2000-2025 Dan Langille. All rights reserved.