Port details |
- py-bitshuffle Bitshuffle filter for improving typed data compression
- 0.5.2 archivers
=2 0.5.1Version of this port present on the latest quarterly branch. - Maintainer: sunpoet@FreeBSD.org
 - Port Added: 2024-03-23 15:00:10
- Last Update: 2024-10-14 05:25:24
- Commit Hash: b1c3964
- People watching this port, also watch:: jdictionary, py311-Automat, py311-python-gdsii, py39-PyOpenGL, p5-Sane
- Also Listed In: python
- License: MIT
- WWW:
- https://github.com/kiyo-masui/bitshuffle
- Description:
- Bitshuffle is an algorithm that rearranges typed, binary data for improving
compression, as well as a python/C package that implements this algorithm within
the Numpy framework.
The library can be used along side HDF5 to compress and decompress datasets and
is integrated through the dynamically loaded filters framework. Bitshuffle is
HDF5 filter number 32008.
Algorithmically, Bitshuffle is closely related to HDF5's Shuffle filter except
it operates at the bit level instead of the byte level. Arranging a typed data
array in to a matrix with the elements as the rows and the bits within the
elements as the columns, Bitshuffle "transposes" the matrix, such that all the
least-significant-bits are in a row, etc.
This does not in itself compress data, only rearranges it for more efficient
compression. To perform the actual compression you will need a compression
library. Bitshuffle has been designed to be well matched to Marc Lehmann's LZF
as well as LZ4 and ZSTD. Note that because Bitshuffle modifies the data at the
bit level, sophisticated entropy reducing compression libraries such as GZIP and
BZIP are unlikely to achieve significantly better compression than simpler and
faster duplicate-string-elimination algorithms such as LZF, LZ4 and ZSTD.
Bitshuffle thus includes routines (and HDF5 filter options) to apply LZ4 and
ZSTD compression to each block after shuffling.
¦ ¦ ¦ ¦ 
- Manual pages:
- FreshPorts has no man page information for this port.
- pkg-plist: as obtained via:
make generate-plist - There is no configure plist information for this port.
- Dependency lines:
-
- ${PYTHON_PKGNAMEPREFIX}bitshuffle>0:archivers/py-bitshuffle@${PY_FLAVOR}
- To install the port:
- cd /usr/ports/archivers/py-bitshuffle/ && make install clean
- To add the package, run one of these commands:
- pkg install archivers/py-bitshuffle
- pkg install py311-bitshuffle
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above. NOTE: This is a Python port. Instead of py311-bitshuffle listed in the above command, you can pick from the names under the Packages section.- PKGNAME: py311-bitshuffle
- Package flavors (<flavor>: <package>)
- distinfo:
- TIMESTAMP = 1728632308
SHA256 (bitshuffle-0.5.2.tar.gz) = dc0e3fb7bdbf42be1009cc3028744180600d625a75b31833a24aa32aeaf83d8d
SIZE (bitshuffle-0.5.2.tar.gz) = 290156
Packages (timestamps in pop-ups are UTC):
- Dependencies
- NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
- Build dependencies:
-
- py311-h5py>=2.4.0 : science/py-h5py@py311
- py311-numpy>=0,1 : math/py-numpy@py311
- py311-setuptools>=0 : devel/py-setuptools@py311
- py311-wheel>=0 : devel/py-wheel@py311
- pkgconf>=1.3.0_1 : devel/pkgconf
- cython-3.11 : lang/cython@py311
- python3.11 : lang/python311
- py311-build>=0 : devel/py-build@py311
- py311-installer>=0 : devel/py-installer@py311
- Test dependencies:
-
- python3.11 : lang/python311
- Runtime dependencies:
-
- py311-h5py>=2.4.0 : science/py-h5py@py311
- py311-numpy>=1.24,1 : math/py-numpy@py311
- py311-setuptools>=0.7 : devel/py-setuptools@py311
- python3.11 : lang/python311
- There are no ports dependent upon this port
Configuration Options:
- No options to configure
- Options name:
- archivers_py-bitshuffle
- USES:
- pkgconfig python:3.9+
- FreshPorts was unable to extract/find any pkg message
- Master Sites:
|
Number of commits found: 2
Commit History - (may be incomplete: for full details, see links to repositories near top of page) |
Commit | Credits | Log message |
0.5.2 14 Oct 2024 05:25:24
    |
Po-Chuan Hsieh (sunpoet)  |
archivers/py-bitshuffle: Update to 0.5.2
Changes: https://github.com/kiyo-masui/bitshuffle/releases |
0.5.1 23 Mar 2024 14:30:36
    |
Po-Chuan Hsieh (sunpoet)  |
archivers/py-bitshuffle: Add py-bitshuffle 0.5.1
Bitshuffle is an algorithm that rearranges typed, binary data for improving
compression, as well as a python/C package that implements this algorithm within
the Numpy framework.
The library can be used along side HDF5 to compress and decompress datasets and
is integrated through the dynamically loaded filters framework. Bitshuffle is
HDF5 filter number 32008.
Algorithmically, Bitshuffle is closely related to HDF5's Shuffle filter except
it operates at the bit level instead of the byte level. Arranging a typed data
array in to a matrix with the elements as the rows and the bits within the
elements as the columns, Bitshuffle "transposes" the matrix, such that all the
least-significant-bits are in a row, etc.
This does not in itself compress data, only rearranges it for more efficient
compression. To perform the actual compression you will need a compression
library. Bitshuffle has been designed to be well matched to Marc Lehmann's LZF
as well as LZ4 and ZSTD. Note that because Bitshuffle modifies the data at the
bit level, sophisticated entropy reducing compression libraries such as GZIP and
BZIP are unlikely to achieve significantly better compression than simpler and
faster duplicate-string-elimination algorithms such as LZF, LZ4 and ZSTD.
Bitshuffle thus includes routines (and HDF5 filter options) to apply LZ4 and
ZSTD compression to each block after shuffling. |
Number of commits found: 2
|