Port details |
- llama-cpp Facebook's LLaMA model in C/C++
- 5174 misc
=3 4967Version of this port present on the latest quarterly branch. - Maintainer: yuri@FreeBSD.org
 - Port Added: 2024-02-15 11:27:23
- Last Update: 2025-04-24 07:33:42
- Commit Hash: 47d1634
- People watching this port, also watch:: autoconf, ta-lib, weberp, prestashop, irrlicht
- License: MIT
- WWW:
- https://github.com/ggerganov/llama.cpp
- Description:
- The main goal of llama.cpp is to enable LLM inference with minimal setup and
state-of-the-art performance on a wide variety of hardware - locally and in
the cloud.
¦ ¦ ¦ ¦ 
- Manual pages:
- FreshPorts has no man page information for this port.
- pkg-plist: as obtained via:
make generate-plist - Dependency lines:
-
- llama-cpp>0:misc/llama-cpp
- To install the port:
- cd /usr/ports/misc/llama-cpp/ && make install clean
- To add the package, run one of these commands:
- pkg install misc/llama-cpp
- pkg install llama-cpp
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.- PKGNAME: llama-cpp
- Flavors: there is no flavor information for this port.
- distinfo:
- TIMESTAMP = 1745478030
SHA256 (ggerganov-llama.cpp-b5174_GH0.tar.gz) = ed7974b3c28e41795a189bc0ae57fdba8c82183f48d54b35e2bf13da160a52ba
SIZE (ggerganov-llama.cpp-b5174_GH0.tar.gz) = 21065609
Packages (timestamps in pop-ups are UTC):
- Dependencies
- NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
- Build dependencies:
-
- glslc : graphics/shaderc
- vulkan-headers>0 : graphics/vulkan-headers
- cmake : devel/cmake-core
- ninja : devel/ninja
- Runtime dependencies:
-
- python3.11 : lang/python311
- Library dependencies:
-
- libcurl.so : ftp/curl
- libvulkan.so : graphics/vulkan-loader
- This port is required by:
- for Libraries
-
- devel/tabby
Configuration Options:
- ===> The following configuration options are available for llama-cpp-5174:
CURL=on: Data transfer support via cURL
EXAMPLES=on: Build and/or install examples
VULKAN=on: Vulkan GPU offload support
===> Use 'make config' to modify these settings
- Options name:
- misc_llama-cpp
- USES:
- cmake:testing compiler:c++11-lang python:run shebangfix localbase
- pkg-message:
- For install:
- You installed LLaMA-cpp: Facebook's LLaMA model runner.
In order to experience LLaMA-cpp please download some
AI model in the GGUF format, for example from huggingface.com,
run the script below, and open localhost:9011 in your browser
to communicate with this AI model.
$ llama-server -m $MODEL \
--host 0.0.0.0 \
--port 9011 \
-ngl 15
or
you can add the following lines to /etc/rc.conf,
start the llama-server service,
and navigate to http://localhost:8080:
> llama_server_enable=YES
> llama_server_model=/path/to/models/llama-2-7b-chat.Q4_K_M.gguf
> llama_server_args="--device Vulkan0 -ngl 27"
- Master Sites:
|
Commit History - (may be incomplete: for full details, see links to repositories near top of page) |
Commit | Credits | Log message |
5174 24 Apr 2025 07:33:42
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5162 → 5174
Reported by: portscout |
5162 21 Apr 2025 01:44:17
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5145 → 5162 |
5145 17 Apr 2025 09:54:08
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5142 → 5145
Reported by: portscout |
5142 16 Apr 2025 09:41:13
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5124 → 5142
Reported by: portscout |
5124 12 Apr 2025 22:53:19
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5106 → 5124 |
5106_1 11 Apr 2025 18:45:18
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Fix version printout |
5106 11 Apr 2025 03:00:49
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5097 → 5106 |
5097_2 11 Apr 2025 01:26:36
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Fix run-time on older CPUs
... by disabling explicit flags that enable them. |
5097_1 10 Apr 2025 16:45:58
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Remove native compilation flag |
5097 10 Apr 2025 08:04:27
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5083 → 5097 |
5083_1 09 Apr 2025 10:09:08
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Remove unnecessary lines |
5083_1 09 Apr 2025 10:07:52
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Small corrections |
5083 09 Apr 2025 02:49:28
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5054 → 5083 |
5054_1 09 Apr 2025 02:41:51
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Add the RC service llama-server
... that allows to communicate with AI models in a browser.
Submitted by: Daniel Morante <daniel@morante.net> (initial version of the
service file) |
5054 05 Apr 2025 13:54:29
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5022 → 5054
Reported by: portscout |
5022 02 Apr 2025 09:10:42
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 5002 → 5022
Reported by: portscout |
5002 31 Mar 2025 09:12:28
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4967 → 5002
Reported by: portscout |
4967 27 Mar 2025 06:52:49
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4958 → 4967
Reported by: portscout |
4958 26 Mar 2025 07:54:01
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4951 → 4958
Reported by: portscout |
4951 25 Mar 2025 08:07:16
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4942 → 4951
Reported by: portscout |
4942 23 Mar 2025 07:56:16
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4932 → 4942
Reported by: portscout |
4932 21 Mar 2025 08:18:53
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4920 → 4932
Reported by: portscout |
4920 19 Mar 2025 09:04:03
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4908 → 4920
Reported by: portscout |
4908 18 Mar 2025 07:28:18
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4897 → 4908
Reported by: portscout |
4897 17 Mar 2025 08:28:36
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4889 → 4897
Reported by: portscout |
4889 15 Mar 2025 16:11:59
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4837 → 4889
Reported by: portscout |
4837 07 Mar 2025 15:57:21
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4819 → 4837
Reported by: portscout |
4819 04 Mar 2025 07:19:03
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4793 → 4819
Reported by: portscout |
4793 01 Mar 2025 08:58:19
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4784 → 4793
Reported by: portscout |
4784 28 Feb 2025 05:57:56
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4778 → 4784
Reported by: portscout |
4778 26 Feb 2025 03:36:49
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4762 → 4778 |
4762 23 Feb 2025 09:47:51
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4735 → 4762
Reported by: portscout |
4735 18 Feb 2025 09:01:41
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4731 → 4735
Reported by: portscout |
4731 17 Feb 2025 06:43:39
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4705 → 4731 |
4705 13 Feb 2025 10:14:15
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4689 → 4705
Reported by: portscout |
4689 12 Feb 2025 09:18:27
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4677 → 4689
Reported by: portscout |
4677 10 Feb 2025 09:53:00
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4675 → 4677
Reported by: portscout |
4675 09 Feb 2025 10:03:11
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4667 → 4675
Reported by: portscout |
4667 08 Feb 2025 02:15:36
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4658 → 4667 |
4658 07 Feb 2025 11:37:29
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4649 → 4658
Reported by: portscout |
4649 06 Feb 2025 15:05:43
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4576 → 4649 |
4576 29 Jan 2025 06:43:14
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4568 → 4576
Reported by: portscout |
4568 27 Jan 2025 19:51:35
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4562 → 4568 |
4562 27 Jan 2025 09:58:06
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4557 → 4562
Reported by: portscout |
4557 26 Jan 2025 07:07:16
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4549 → 4557 |
4549 25 Jan 2025 05:50:42
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4539 → 4549
Reported by: portscout |
4539 24 Jan 2025 03:05:38
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4529 → 4539 |
4529 23 Jan 2025 03:53:15
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4520 → 4529 |
4520 21 Jan 2025 09:21:23
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4510 → 4520 |
4510 20 Jan 2025 02:40:40
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4508 → 4510 |
4508 19 Jan 2025 03:53:12
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4502 → 4508 |
4502 18 Jan 2025 06:06:35
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4497 → 4502 |
4497 17 Jan 2025 07:21:39
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4488 → 4497
Reported by: portscout |
4488 16 Jan 2025 06:35:06
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4485 → 4488
Reported by: portscout |
4485 15 Jan 2025 16:44:53
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4481 → 4485 |
4481 14 Jan 2025 21:02:22
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4475 → 4481 |
4475 14 Jan 2025 06:11:22
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4466 → 4475
Reported by: portscout |
4466 13 Jan 2025 00:03:12
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4458 → 4466 |
4458 11 Jan 2025 09:30:41
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4419 → 4458
Reported by: portscout |
4419 06 Jan 2025 11:23:39
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4418 → 4419
Reported by: portscout |
4418 06 Jan 2025 04:01:04
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4409 → 4418
Reported by: portscout |
4409 04 Jan 2025 04:07:50
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4406 → 4409
Reported by: portscout |
4406 03 Jan 2025 10:27:41
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4404 → 4406
Reported by: portscout |
4404 02 Jan 2025 00:39:10
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4381 → 4404 |
4381 26 Dec 2024 21:19:57
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Fix configure
PR: 283621
Reported by: Eric Camachat <eric@camachat.org> |
4381 23 Dec 2024 10:07:55
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4372 → 4381 |
4372_1 23 Dec 2024 00:01:24
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Fix regression in run-time
... caused by missing code to retrieve path
to the currently running executable.
PR: 283470
Reported by: mord0d@firemail.cc
modified: distinfo |
4372 21 Dec 2024 05:19:31
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4367 → 4372
Reported by: portscout |
4367 20 Dec 2024 06:05:51
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4337 → 4367
Reported by: portscout |
4337 17 Dec 2024 09:45:37
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4333 → 4337
Reported by: portscout |
4333 16 Dec 2024 11:44:16
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4329 → 4333
Reported by: portscout |
4329 15 Dec 2024 06:25:08
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4318 → 4329
Reported by: portscout |
4318 13 Dec 2024 11:28:48
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4295 → 4318
Reported by: portscout |
4295 10 Dec 2024 10:49:43
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4285 → 4295
Reported by: portscout |
4285 08 Dec 2024 22:38:28
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: Fix plist when VULKAN=OFF
PR: 283205
Reported by: mord0d@firemail.cc |
4285 08 Dec 2024 11:08:54
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4120 → 4285 |
4120 18 Nov 2024 22:26:47
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4103 → 4120
Reported by: portscout |
4103 17 Nov 2024 18:10:29
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4095 → 4103
Reported by: portscout |
4095 16 Nov 2024 10:27:20
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4081 → 4095
Reported by: portscout |
4081 15 Nov 2024 09:20:28
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4061 → 4081
Reported by: portscout |
4061 10 Nov 2024 17:19:08
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 4053 → 4061
Reported by: portscout |
4053 09 Nov 2024 06:06:09
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3916 → 4053
Reported by: portscout |
3916 03 Nov 2024 05:25:26
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3990 → 3916
Reported by: portscout |
3990 30 Oct 2024 03:54:12
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3983 → 3990 |
3983 28 Oct 2024 07:32:16
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3982 → 3983
Reported by: portscout |
3982 27 Oct 2024 20:46:57
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3974 → 3982
Reported by: portscout |
3974 25 Oct 2024 03:27:39
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3952 → 3974 |
3952 23 Oct 2024 09:44:44
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3938 → 3952
Reported by: portscout |
3938 18 Oct 2024 03:25:24
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3914 → 3938 |
3914 13 Oct 2024 21:01:41
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3902 → 3914 |
3902 10 Oct 2024 03:36:48
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3899 → 3902 |
3899 09 Oct 2024 03:17:34
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3889 → 3899 |
3889 07 Oct 2024 09:42:13
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3883 → 3889
Reported by: portscout |
3883 05 Oct 2024 03:09:27
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3878 → 3883 |
3878 04 Oct 2024 04:24:52
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3868 → 3878
Reported by: portscout |
3868 03 Oct 2024 09:17:09
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3837 → 3868
Reported by: portscout |
3837 29 Sep 2024 09:31:02
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3829 → 3837
Reported by: portscout |
3829 28 Sep 2024 08:29:01
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3828 → 3829
Reported by: portscout |
3828 27 Sep 2024 08:38:49
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3821 → 3828
Reported by: portscout |
3821 25 Sep 2024 08:33:29
    |
Yuri Victorovich (yuri)  |
misc/llama-cpp: update 3813 → 3821
Reported by: portscout |