Port details
sentencepiece Unsupervised text tokenizer for Neural Network-based text generation
0.2.2 textproc Σ 0.2.2Version of this port present on the latest quarterly branch. Maintainer: yuri@FreeBSD.org Port Added: 2023-01-16 09:42:22Last Update: 2026-07-13 15:45:48Commit Hash: f3f511d License: APACHE20WWW: https://github.com/google/sentencepiece Description: # SentencePiece is an unsupervised text tokenizer and detokenizer mainly for
Neural Network-based text generation systems where the vocabulary size is
predetermined prior to the neural model training. SentencePiece implements
subword units (e.g., byte-pair-encoding (BPE)) and unigram language model
with the extension of direct training from raw sentences. SentencePiece
allows us to make a purely end-to-end system that does not depend on
language-specific pre/postprocessing. Manual pages: # FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist # USE_RC_SUBR (Service Scripts)
no SUBR information found for this port
Dependency lines :
For RUN/BUILD depends:sentencepiece>0:textproc/sentencepiece For LIB depends:libsentencepiece.so:textproc/sentencepiece libsentencepiece_train.so:textproc/sentencepiece To install the port : # cd /usr/ports/textproc/sentencepiece/ && make install clean To add the package , run one of these commands: pkg install textproc/sentencepiece pkg install sentencepiece PKGNAME: sentencepiece Flavors: there is no flavor information for this port. # distinfo: # TIMESTAMP = 1783926736
SHA256 (google-sentencepiece-v0.2.2_GH0.tar.gz) = 92381f713e094a15a1ccff1ac4a5315a4c4b82a99ac1332d6ac53c9dc8e1bcf1
SIZE (google-sentencepiece-v0.2.2_GH0.tar.gz) = 14160863
Packages (timestamps in pop-ups are UTC): #
Dependencies # NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered. Build dependencies: #
cmake : devel/cmake-core ninja : devel/ninja
Library dependencies: #
libabsl_strings.so : devel/abseil libprotobuf-lite.so : devel/protobuf
This port is required by: # for Libraries #
textproc/py-sentencepiece Configuration Options : # ===> The following configuration options are available for sentencepiece-0.2.2:
GPERFTOOLS=off: Google gperftools support
===> Use 'make config' to modify these settings Options name : # textproc_sentencepiece USES: # cmake:testing compiler:c++17-lang
FreshPorts was unable to extract/find any pkg message # Master Sites: #
Number of commits found: 7 #
Commit History - (may be incomplete: for full details, see links to repositories near top of page) Commit Credits Log message 0.2.2 Yuri Victorovich (yuri) textproc/{,py-}sentencepiece: update 0.2.1 → 0.2.2 0.2.1 Yuri Victorovich (yuri) textproc/sentencepiece: update 0.2.0 → 0.2.1 0.2.0_1 Yuri Victorovich (yuri) textproc/sentencepiece: Add GPERFTOOLS option 0.2.0 Yuri Victorovich (yuri) textproc/{,py-}sentencepiece: update 0.1.99 → 0.2.0
Reported by: portscout 0.1.99 Yuri Victorovich (yuri) textproc/sentencepiece: Update 0.1.98 → 0.1.99
Reported by: portscout 0.1.98 Yuri Victorovich (yuri) textproc/{,py-}sentencepiece: Update 0.1.97 → 0.1.98
Reported by: portscout 0.1.97 Yuri Victorovich (yuri) textproc/sentencepiece: New port: Unsupervised text tokenizer for Neural
Network-based text generation
Number of commits found: 7
