dnstable implements an encoding format for passive DNS data. It consists of a
C library, libdnstable, and several command line utilities for creating,
querying, and merging dnstable data files.
It stores key-value records in Sorted String Table (SSTable) files and provides
high-level interfaces for querying or iterating over the stored records.
dnstable encodes individual records using a format tailored for efficiently
storing passive DNS data and can quickly perform both "forward" and "inverse"
searches.
devel/mtbl: Upgrade to version 1.7.1
1.7.1:
* Incremented version for new tarball.
1.7.0:
* Add public mtbl_threadpool API, enabling multithreaded functionality
for mtbl_writer and mtbl_sorter objects; see mtbl_threadpool manpage
for more info.
* Add mtbl_writer_options_set_threadpool() to enable multithreaded
data block compression.
* Add mtbl_sorter_options_set_threadpool() to enable multithreaded
sorting.
* Add -t option for setting the preferred number of threads to use in
an mtbl_threadpool object used for writing in mtbl_merge.
Bump PORTREVISION of dependent ports.
Sponsored by: DomainTools LLC
dns/dnstable: Upgrade to 0.14.0
0.14.0:
* Add "+" wildcard character to match single label at beginning or
end of name
.
* Add support for case-sensitive rrset, rdata name queries.
* Multiple performance improvements for time filtered queries.
* Improve performance of rrtype filtered queries through early
filtering.
* Add query statistics API.
(Only the first 15 lines of the commit message are shown above )
dns/dnstable: Upgrade to 0.13.2
0.13.2:
* Fix bug handling short rdata entry keys in IPv6 range queries.
* Efficiency improvements in string handling code and IP range queries.
* Fix use of buggy base32 decoding from wdns in rrtype bitmap test
program.
MFH: 2023Q4
dns/wdns: upgrade to version 0.12.0
0.12.0:
* Add EDNS output to wdns_message_to_str().
* Fix memory leak triggered by multiple OPT records in messages.
* Fixes multiple bugs in base32 encoding, NSEC bitmap parsing, and
HTTPS svcparam parsing.
* Fix out of bounds memory write in wdns_str_to_name.
* Fix handling of no address for client subnets.
Bump PORTREVISION of dependent ports.
MFH: 2023Q3
Sponsored by: DomainTools LLC
dns/dnstable: Upgrade to version 0.13.0
* Updated dependency to libwdns 0.11.0
* Updated dependency to libmtbl 1.5.0
* dnstable_lookup: add new command-line options -A, -a, -B, -b, and -c
for time-fenced lookups.
* Optimize time filtered searches on fileset sources with a filtering
query using the subset of files which may contribute to matching
results.
* Fix duplication of results in unaggregated name prefix or rdata name
suffix searches.
* Fix improper skipping of results in IP range or prefix searches.
* Fix return of non-name results in rdata name searches.
* Fix decode_rdata() rdata length for Big Endian.
Sponsored by: DomainTools LLC
Remove WWW entries moved into port Makefiles
Commit b7f05445c00f has added WWW entries to port Makefiles based on
WWW: lines in pkg-descr files.
This commit removes the WWW: lines of moved-over URLs from these
pkg-descr files.
Approved by: portmgr (tcberner)
Add WWW entries to port Makefiles
It has been common practice to have one or more URLs at the end of the
ports' pkg-descr files, one per line and prefixed with "WWW:". These
URLs should point at a project website or other relevant resources.
Access to these URLs required processing of the pkg-descr files, and
they have often become stale over time. If more than one such URL was
present in a pkg-descr file, only the first one was tarnsfered into
the port INDEX, but for many ports only the last line did contain the
port specific URL to further information.
There have been several proposals to make a project URL available as
a macro in the ports' Makefiles, over time.
(Only the first 15 lines of the commit message are shown above )
dns/wdns: Upgrade to version 0.11.0
* Improve support for CAA records. (CAA was previously rendered as a
"generic" rdata type.)
* Bug fix for NSEC/NSEC3/CSYNC: do not output empty rrtype bitmaps
per RFC6840 section 6.4.
* Fix parsing of A6 records that ommit and address portion. Correct
parsing of A6 records with prefix length 0. Correct handling of
A6 address bytes. The address bytes of an A6 record are an address
suffix relative to the prefix represented by the domain name, and
so must be copied to and from the lower order bytes of the internal
address representation. These A6 code updates were for the purposes
of clearing "round trip" test errors in the existing code base.
(Only the first 15 lines of the commit message are shown above )
dns/dnstable: upgrade to version 1.2.0
dnstable 1.2.0:
* Implement indexing using RRtypes for ENTRY_TYPE_RRSET_NAME_FWD and
ENTRY_TYPE_RDATA_NAME_REV entries. This uses RFC6840 RRtype bitmaps
as the primary data structure.
* Added support for dnstable entries encoding version information and
time metadata.
* The version entries, time metadata, and rrtype index information are
generated by an updated dnstable-convert. Files generated by the old
dnstable-convert will be processed as they were with the previous
dnstable versions i.e., the new entry types and rrset index
(Only the first 15 lines of the commit message are shown above )
Update dns/dnstable to from version 0.11.0 to 0.11.2:
dnstable (0.11.2)
* Fix memory leaks while skipping rows of data during offset processing.
* Fix minor leak in dnstable_lookup printing.
* Add more dnstable_lookup tests.
dnstable (0.11.1)
* Change dnstable_query_set_skip to ..._offset. Note that the
ABI library revision was not bumped.
* Change dnstable_lookup parameter for offset from -s to -O
* Added unit tests for some exposed dnstable functionality, including
for filter and query timeouts.
Sponsored by: Farsight Security, Inc.
Update dns/dnstable port to version 0.11.0
dnstable, the encoding library with utilities for passive DNS
data, version 0.11.0, was released. This release adds functionality
enabling unaggregated query results, the skipping of query results,
and date and rdata presentation options for JSON formatted entries.
In detail:
* Fix bug in raw rdata queries with rrtype specified.
* Add functionality for unaggregated query results.
* Add ability to skip query results.
* Add options for date and rdata presentation in JSON formatted entries.
* Treat RRTYPE "TYPE255" as an alias for "ANY", since 255 is the code
for "ANY".
Insert a blank line into Makefile to pacify portlint.
Sponsored by: Farsight Security, Inc.
Upgrade dnstable to version 0.10.1:
dnstable (0.10.1)
* Check for endian.h headers.
* Add sys/socket.h include.
* Expunge protobuf-c references.
* Correct libyajl include path.
dnstable (0.10.0)
* Remove dnstable_convert into a separate repo to simplify
(Only the first 15 lines of the commit message are shown above )
Upgrade devel/mtbl to version 1.0.0:
mtbl (1.0.0)
* Backwards-incompatible file format change to enable block sizes >4G.
* Add support for zstd compression. This adds a new library dependency
on libzstd.
* Add mtbl_iter_seek function.
* Add mtbl_fileset_partition function.
* Breaks ABI for version 0.x.x.
mtbl (0.8.1)
* Add portability for clock time.
* Simplify and improve portability related to byte order primitives.
* Fix assertion failure. If there is a broken mtbl file in the fileset
then a NULL reader will be returned. This change checks for that
error condition in fs_reinit_merger() and does not pass the empty
reader onwards to mtbl_merger_add_source().
Compatiblity with the latest libz4 has been added so files/patch-configure
is no longer needed.
Bump PORTREVISION on dependent ports due to ABI / shared library version
change.
Upgrade dns/dnstable to version 0.9.1:
* Fix strange values in data value triplets (#16). A 'count' field that has
the value 0 is silently rewritten to 1, and a 'time_last' field that has
the value 0 is silently set to be the same as the 'time_first' field.
Sponsored by: Farsight Security, Inc.
Upgrade to version 0.9.0.
[ Henry Stern ]
* New "query timeout" feature which allows for a configurable timeout on the
execution of certain types of queries. Introduces new function
dnstable_query_set_timeout() and new result code dnstable_res_timeout
(#8).
* New "time fencing" feature which filters based on 'time_first' and
'time_last' values. Introduces new enum dnstable_filter_parameter_type and
new function dnstable_query_set_filter_parameter() (#9).
* Performance enhancement for some IP range and prefix searches (#11).
* Fix unhandled IPv4/IPv6 address overflow for IP range/prefix queries
(Only the first 15 lines of the commit message are shown above )
Upgrade to 0.8.0:
* Replace Jansson with YAJL for JSON rendering, which results in a
substantial performance improvement.
* dnstable_dump: Add "--rrset_names" and "--rdata_names" options which dump
the RRSET_NAME_FWD and RDATA_NAME_REV indices.
* New function dnstable_reader_reload_setfile(), which calls
mtbl_fileset_reload_now() on a dnstable_reader object's underlying
mtbl_fileset object, if present. This requires libmtbl >= 0.8.0.
Sponsored by: Farsight Security, Inc.
Add new port dns/dnstable.
dnstable implements an encoding format for passive DNS data. It
consists of a C library, libdnstable, and several command line
utilities for creating, querying, and merging dnstable data files.
It stores key-value records in Sorted String Table (SSTable) files
and provides high-level interfaces for querying or iterating over
the stored records. dnstable encodes individual records using a
format tailored for efficiently storing passive DNS data and can
quickly perform both "forward" and "inverse" searches.
Differential Revision: https://reviews.freebsd.org/D2214
Approved by: mat (mentor)
Sponsored by: Farsight Security, Inc.
