Port details |
- llama-cpp Facebook's LLaMA model in C/C++
- 4481 misc =3 4381Version of this port present on the latest quarterly branch.
- Maintainer: yuri@FreeBSD.org
- Port Added: 2024-02-15 11:27:23
- Last Update: 2025-01-14 21:02:22
- Commit Hash: c6bdbf4
- People watching this port, also watch:: autoconf, ta-lib, weberp, prestashop, irrlicht
- License: MIT
- WWW:
- https://github.com/ggerganov/llama.cpp
- Description:
- The main goal of llama.cpp is to enable LLM inference with minimal setup and
state-of-the-art performance on a wide variety of hardware - locally and in
the cloud.
- ¦ ¦ ¦ ¦
- Manual pages:
- FreshPorts has no man page information for this port.
- pkg-plist: as obtained via:
make generate-plist - Dependency lines:
-
- llama-cpp>0:misc/llama-cpp
- To install the port:
- cd /usr/ports/misc/llama-cpp/ && make install clean
- To add the package, run one of these commands:
- pkg install misc/llama-cpp
- pkg install llama-cpp
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.- PKGNAME: llama-cpp
- Flavors: there is no flavor information for this port.
- distinfo:
- TIMESTAMP = 1736887589
SHA256 (ggerganov-llama.cpp-b4481_GH0.tar.gz) = ff090b375b2823ff8284ac22e17f0b710589254bedeff1930f5e8718d2b1baa6
SIZE (ggerganov-llama.cpp-b4481_GH0.tar.gz) = 20434654
Packages (timestamps in pop-ups are UTC):
- Dependencies
- NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
- Build dependencies:
-
- glslc : graphics/shaderc
- vulkan-headers>0 : graphics/vulkan-headers
- cmake : devel/cmake-core
- ninja : devel/ninja
- Runtime dependencies:
-
- python3.11 : lang/python311
- Library dependencies:
-
- libcurl.so : ftp/curl
- libvulkan.so : graphics/vulkan-loader
- This port is required by:
- for Libraries
-
- devel/tabby
Configuration Options:
- ===> The following configuration options are available for llama-cpp-4481:
CURL=on: Data transfer support via cURL
EXAMPLES=on: Build and/or install examples
VULKAN=on: Vulkan GPU offload support
===> Use 'make config' to modify these settings
- Options name:
- misc_llama-cpp
- USES:
- cmake:testing compiler:c++11-lang python:run shebangfix localbase
- pkg-message:
- For install:
- You installed LLaMA-cpp: Facebook's LLaMA model runner.
In order to experience LLaMA-cpp please download some
AI model in the GGUF format, for example from huggingface.com,
run the script below, and open localhost:9011 in your browser
to communicate with this AI model.
$ llama-server -m $MODEL \
--host 0.0.0.0 \
--port 9011
- Master Sites:
|
Commit History - (may be incomplete: for full details, see links to repositories near top of page) |
Commit | Credits | Log message |
3405 17 Jul 2024 15:17:16 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3389 → 3405
Reported by: portscout |
3389 15 Jul 2024 07:19:23 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3386 → 3389
Reported by: portscout |
3386 14 Jul 2024 18:20:48 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3384 → 3386
Reported by: portscout |
3384 13 Jul 2024 06:46:10 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3369 → 3384
Reported by: portscout |
3369 12 Jul 2024 03:51:21 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3358 → 3369
Reported by: portscout |
3358 10 Jul 2024 16:00:56 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3347 → 3358
Reported by: portscout |
3347 09 Jul 2024 08:12:38 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3306 → 3347
Reported by: portscout |
3306 05 Jul 2024 23:56:03 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3291 → 3306
Reported by: portscout |
3291 04 Jul 2024 16:31:50 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3285 → 3291
Reported by: portscout |
3285 03 Jul 2024 08:18:55 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3243 → 3285 |
3243 27 Jun 2024 07:19:38 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3232 → 3243
Reported by: portscout |
3232 26 Jun 2024 15:16:54 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3218 → 3232
Reported by: portscout |
3218 25 Jun 2024 16:43:44 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3209 → 3218
Reported by: portscout |
3209 24 Jun 2024 07:49:04 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3202 → 3209
Reported by: portscout |
3202 23 Jun 2024 09:33:48 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3197 → 3202
Reported by: portscout |
3197 22 Jun 2024 07:22:25 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3186 → 3197
Reported by: portscout |
3186 21 Jun 2024 01:53:00 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3173 → 3186
Reported by: portscout |
3173 18 Jun 2024 09:25:05 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3163 → 3173
Reported by: portscout |
3163 17 Jun 2024 08:18:35 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3153 → 3163
Reported by: portscout |
3153 16 Jun 2024 16:56:35 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3151 → 3153 |
3151 15 Jun 2024 09:12:46 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3145 → 3151
Reported by: portscout |
3145 14 Jun 2024 09:11:39 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3135 → 3145
Reported by: portscout |
3135 12 Jun 2024 15:26:15 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3091 → 3135
Reported by: portscout |
3091 06 Jun 2024 08:49:01 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3078 → 3091
Reported by: portscout |
3078 05 Jun 2024 02:29:45 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3066 → 3078 |
3066 02 Jun 2024 08:33:41 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3058 → 3066
Reported by: portscout |
3058 01 Jun 2024 08:10:53 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3040 → 3058
Reported by: portscout |
3040 30 May 2024 10:45:42 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3030 → 3040
Reported by: portscout |
3030 29 May 2024 08:49:15 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3014 → 3030
Reported by: portscout |
3014 28 May 2024 08:12:14 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 3003 → 3014
Reported by: portscout |
3003 27 May 2024 08:06:44 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2998 → 3003
Reported by: portscout |
2998 26 May 2024 04:48:45 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2992 → 2998
Reported by: portscout |
2992 25 May 2024 05:18:28 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2972 → 2992
Reported by: portscout |
2972 23 May 2024 13:22:52 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2961 → 2972
Reported by: portscout |
2961 22 May 2024 07:39:55 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2940 → 2961
Reported by: portscout |
2940 20 May 2024 05:18:24 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2929 → 2940
Reported by: portscout |
2929 19 May 2024 16:03:36 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2901 → 2929
Reported by: portscout |
2901 17 May 2024 05:55:54 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2894 → 2901
Reported by: portscout |
2894 16 May 2024 08:56:47 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2879 → 2894
Reported by: portscout |
2879 15 May 2024 20:08:07 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2864 → 2879
Reported by: portscout |
2864 13 May 2024 06:53:05 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2860 → 2864
Reported by: portscout |
2860 12 May 2024 08:06:52 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2843 → 2860
Reported by: portscout |
2843 11 May 2024 15:42:29 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2836 → 2843
Reported by: portscout |
2836 10 May 2024 06:47:54 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2797 → 2836
Reported by: portscout |
2797 07 May 2024 07:17:04 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2789 → 2797
Reported by: portscout |
2789 06 May 2024 08:39:48 |
Yuri Victorovich (yuri) |
misc/llama-cpp: Broken on armv7
Reported by: fallout |
2789 05 May 2024 08:18:43 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2784 → 2789
Reported by: portscout |
2784 04 May 2024 08:27:21 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2780 → 2784
Reported by: portscout |
2780 02 May 2024 08:57:59 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2775 → 2780
Reported by: portscout |
2775 02 May 2024 08:57:57 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2769 → 2775
Reported by: portscout |
2769 30 Apr 2024 05:24:37 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2755 → 2769
Reported by: portscout |
2755 29 Apr 2024 07:21:41 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2751 → 2755
Reported by: portscout |
2751 28 Apr 2024 07:09:59 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2749 → 2751
Reported by: portscout |
2749 27 Apr 2024 05:55:19 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2717 → 2749
Reported by: portscout |
2717 26 Apr 2024 06:15:14 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2715 → 2717
Reported by: portscout |
2715 24 Apr 2024 09:17:15 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2710 → 2715
Reported by: portscout |
2710 22 Apr 2024 07:01:14 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2699 → 2710
Reported by: portscout |
2699 20 Apr 2024 07:27:28 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2694 → 2699
Reported by: portscout |
2694 19 Apr 2024 01:27:06 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2690 → 2694
Reported by: portscout |
2690 18 Apr 2024 06:02:41 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2687 → 2690
Reported by: portscout |
2687 17 Apr 2024 07:38:19 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2679 → 2687
Reported by: portscout |
2679 16 Apr 2024 04:15:48 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2674 → 2679 |
2674 15 Apr 2024 08:57:49 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2646 → 2674
Reported by: portscout |
2646 11 Apr 2024 08:17:16 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2619 → 2646
Reported by: portscout |
2619 07 Apr 2024 18:38:03 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2615 → 2619
Reported by: portscout |
2615 06 Apr 2024 01:10:44 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2608 → 2615
Reported by: portscout |
2608 05 Apr 2024 09:15:36 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2589 → 2608
Reported by: portscout |
2589 04 Apr 2024 08:05:04 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2581 → 2589
Reported by: portscout |
2581 31 Mar 2024 08:32:53 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2568 → 2581
Reported by: portscout |
2568 29 Mar 2024 20:03:44 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2531 → 2568
Reported by: portscout |
2531 27 Mar 2024 08:37:47 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2517 → 2531
Reported by: portscout |
2517 25 Mar 2024 05:00:39 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2509 → 2517
Reported by: portscout |
2509 24 Mar 2024 09:59:11 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2487 → 2509
Reported by: portscout |
2487 22 Mar 2024 12:22:51 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2479 → 2487
Reported by: portscout |
2479 21 Mar 2024 10:10:56 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2465 → 2479
Reported by: portscout |
2465 20 Mar 2024 08:59:51 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2450 → 2465
Reported by: portscout |
2450 18 Mar 2024 16:24:19 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2440 → 2450
Reported by: portscout |
2440 17 Mar 2024 05:40:50 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2430 → 2440
Reported by: portscout |
2430 15 Mar 2024 15:46:26 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2409 → 2430
Reported by: portscout |
2409 13 Mar 2024 06:17:05 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2405 → 2409
Reported by: portscout |
2405 12 Mar 2024 19:42:11 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2393 → 2405
Reported by: portscout |
2393 11 Mar 2024 17:53:46 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2376 → 2393
Reported by: portscout |
2376 10 Mar 2024 07:35:57 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2366 → 2376
Reported by: portscout |
2366 09 Mar 2024 07:34:18 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2360 → 2366
Reported by: portscout |
2360 08 Mar 2024 10:25:53 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2355 → 2360
Reported by: portscout |
2355 07 Mar 2024 09:48:07 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2350 → 2355
Reported by: portscout |
2350 06 Mar 2024 11:52:34 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2329 → 2350
Reported by: portscout |
2329 04 Mar 2024 16:09:17 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2294 → 2329
Reported by: portscout |
2294 27 Feb 2024 00:31:15 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2266 → 2294
Reported by: portscout |
2266 26 Feb 2024 05:55:19 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2251 → 2266
Reported by: portscout |
2251 25 Feb 2024 00:18:07 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2241 → 2251
Reported by: portscout |
2241 23 Feb 2024 10:25:42 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2234 → 2241
Reported by: portscout |
2234 22 Feb 2024 09:38:40 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2212 → 2234
Reported by: portscout |
2212 20 Feb 2024 07:09:21 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2185 → 2212
Reported by: portscout |
2185 19 Feb 2024 05:01:44 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2167 → 2185
Reported by: portscout |
2167 17 Feb 2024 08:45:30 |
Yuri Victorovich (yuri) |
misc/llama-cpp: update 2144 → 2167
Reported by: portscout |
2144 15 Feb 2024 11:25:01 |
Yuri Victorovich (yuri) |
misc/llama-cpp: New port: Facebook's LLaMA model in C/C++ |