notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)Want a good monitor light? See my photosAll times are UTC		 Ukraine
Port details on branch 2023Q2
colly Elegant scraper and crawler framework for Golang
2.1.0_12 www on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout 2.1.0_12Version of this port present on the latest quarterly branch.
Maintainer: yuri@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2023-04-08 16:02:42
Last Update: 2023-04-08 15:33:05
Commit Hash: 95d3a8d
License: APACHE20
WWW:
https://go-colly.org/
Description:
With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving. Features: * Clean API * Fast (>1k request/sec on a single core) * Manages request delays and maximum concurrency per domain * Automatic cookie and session handling * Sync/async/parallel scraping * Distributed scraping * Caching * Automatic encoding of non-unicode responses * Robots.txt support * Google App Engine support
Homepage    cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port

Manual pages:
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist
Expand this list (14 items)
Collapse this list.
  1. bin/colly
  2. bin/colly-basic
  3. bin/colly-coursera_courses
  4. bin/colly-cryptocoinmarketcap
  5. bin/colly-factba.se
  6. bin/colly-hackernews_comments
  7. bin/colly-instagram
  8. bin/colly-openedx_courses
  9. bin/colly-reddit
  10. bin/colly-shopify_sitemap
  11. bin/colly-google_groups
  12. /usr/local/share/licenses/colly-2.1.0_12/catalog.mk
  13. /usr/local/share/licenses/colly-2.1.0_12/LICENSE
  14. /usr/local/share/licenses/colly-2.1.0_12/APACHE20
Collapse this list.
Dependency lines:
  • colly>0:www/colly
To install the port:
cd /usr/ports/www/colly/ && make install clean
To add the package, run one of these commands:
  • pkg install www/colly
  • pkg install colly
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
PKGNAME: colly
Flavors: there is no flavor information for this port.
distinfo:
TIMESTAMP = 1619068742 SHA256 (gocolly-colly-v2.1.0_GH0.tar.gz) = f687b922597649033cd388ff81c388b066b4d54b414e86ed1be82fb1c1b0cc3a SIZE (gocolly-colly-v2.1.0_GH0.tar.gz) = 81626

Expand this list (32 items)

Collapse this list.

SHA256 (PuerkitoBio-goquery-v1.5.1_GH0.tar.gz) = 50b671f7128ac6993b7388d4e8a76901afdcaa7c6889f45687a2acc0d0753ca4 SIZE (PuerkitoBio-goquery-v1.5.1_GH0.tar.gz) = 101380 SHA256 (andybalholm-cascadia-v1.2.0_GH0.tar.gz) = 5f2cee3689470b1adc7af495402ccf7e047c7216d865b4b2bf55e910638e31e2 SIZE (andybalholm-cascadia-v1.2.0_GH0.tar.gz) = 17419 SHA256 (antchfx-htmlquery-v1.2.3_GH0.tar.gz) = 059edb4ec919538d236b16bdc5871fe72875e1dd1f8da8b2d09c5d884ad33752 SIZE (antchfx-htmlquery-v1.2.3_GH0.tar.gz) = 7344 SHA256 (antchfx-xmlquery-v1.2.4_GH0.tar.gz) = bbad1b253b8de0ba40b84747086f64438a9b7c0b7950771724e8036b045596ea SIZE (antchfx-xmlquery-v1.2.4_GH0.tar.gz) = 13218 SHA256 (antchfx-xpath-v1.1.8_GH0.tar.gz) = 3295c4338b8961122139e2b9d18cfc6c65d45d95590e6131a46dc508e559e542 SIZE (antchfx-xpath-v1.1.8_GH0.tar.gz) = 25477 SHA256 (gobwas-glob-v0.2.3_GH0.tar.gz) = 325026fc78bcebcf31151b6e060f4e1c3321b04ded3dab63b63610b323c10850 SIZE (gobwas-glob-v0.2.3_GH0.tar.gz) = 25962 SHA256 (golang-appengine-v1.6.6_GH0.tar.gz) = 0c3d1e1c7ba0b97ea3457ddd169aac0667dbbb8c8d81e011632751f75bfbb624 SIZE (golang-appengine-v1.6.6_GH0.tar.gz) = 332981 SHA256 (golang-groupcache-8c9f03a8e57e_GH0.tar.gz) = b92f918daa48048fd360f14d1a4aed6e70c1176ae6b00b0dc04094bb088e9865 SIZE (golang-groupcache-8c9f03a8e57e_GH0.tar.gz) = 26047 SHA256 (golang-net-627f9648deb9_GH0.tar.gz) = a171ecd3ca1ca546c82806d7ddba1985b18da28530cb7479ea62d90ea1f81041 SIZE (golang-net-627f9648deb9_GH0.tar.gz) = 1177189 SHA256 (golang-protobuf-v1.4.2_GH0.tar.gz) = a1e486b3ed6f502c43e10cb28bde4e8f020a420ef9958d3fbe61801492c07c87 SIZE (golang-protobuf-v1.4.2_GH0.tar.gz) = 171778 SHA256 (golang-text-v0.3.2_GH0.tar.gz) = 0b9309698f5708531c5377ab1e29b423a6d9e20c55a8d386c3b8283428212f22 SIZE (golang-text-v0.3.2_GH0.tar.gz) = 7168069 SHA256 (jawher-mow.cli-v1.1.0_GH0.tar.gz) = af18e157df5c23a1a4f05cb45fadef0a0a6f18717582656d42f6287d2bdc398a SIZE (jawher-mow.cli-v1.1.0_GH0.tar.gz) = 65838 SHA256 (kennygrant-sanitize-v1.2.4_GH0.tar.gz) = cba9e054e07ba95b23d16b409eb7ac157e6be68c024e3fed0bbfef78524d4802 SIZE (kennygrant-sanitize-v1.2.4_GH0.tar.gz) = 8922 SHA256 (protocolbuffers-protobuf-go-v1.24.0_GH0.tar.gz) = 318e54ee12d09e9c76fc11cf85f6297360e6444b74a6a7882450501bb952ba56 SIZE (protocolbuffers-protobuf-go-v1.24.0_GH0.tar.gz) = 1227640 SHA256 (saintfish-chardet-3af4cd4741ca_GH0.tar.gz) = c8c970cb05a93c50941a1ee550db75c9fbc7e11374a59b9002c2d87ec55851ab SIZE (saintfish-chardet-3af4cd4741ca_GH0.tar.gz) = 267071 SHA256 (temoto-robotstxt-v1.1.1_GH0.tar.gz) = 11c466c2c9252ab8908eb319189cd7769144d8d039765f6419d605be061098c2 SIZE (temoto-robotstxt-v1.1.1_GH0.tar.gz) = 14170

Collapse this list.

No package information for this port in our database
Sometimes this happens. Not all ports have packages. Perhaps there is a build error. Check the fallout link: pkg-fallout
Dependencies
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies:
  1. go120 : lang/go120
There are no ports dependent upon this port
Configuration Options:
No options to configure
Options name:
www_colly
USES:
go:modules
FreshPorts was unable to extract/find any pkg message
Master Sites:
Expand this list (1 items)
Collapse this list.
  1. https://codeload.github.com/gocolly/colly/tar.gz/v2.1.0?dummy=/
Collapse this list.

Number of commits found: 1

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
2.1.0_12
08 Apr 2023 15:33:05
commit hash: 95d3a8db15d8962f7839ab8406862a29f117d250commit hash: 95d3a8db15d8962f7839ab8406862a29f117d250commit hash: 95d3a8db15d8962f7839ab8406862a29f117d250commit hash: 95d3a8db15d8962f7839ab8406862a29f117d250 files touched by this commit		 Dmitri Goutnik (dmgk) search for other commits by this committer 
all: Bump PORTREVISION after lang/go{119,120} update

Approved by: ports-secteam (blanket)

Number of commits found: 1
Login
User Login
Create account

Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD

This site
What is FreshPorts?
About the authors
Issues
FAQ
How big is it?
Security Policy
Privacy
Blog
Contact

Search
Enter Keywords:
 
more...

Latest Vulnerabilities
gitlabApr 24
redisApr 24
redis62Apr 24
redis72Apr 24
valkeyApr 24
chromiumApr 23
ungoogled-chromiumApr 23
navidromeApr 22
erlangApr 20
erlang-runtime21Apr 20
erlang-runtime22Apr 20
erlang-runtime23Apr 20
erlang-runtime24Apr 20
erlang-runtime25Apr 20
erlang-runtime26Apr 20

14 vulnerabilities affecting 332 ports have been reported in the past 14 days

* - modified, not new

All vulnerabilities

Last processed:
2025-04-25 06:28:01 UTC


Ports
Home
Categories
Deleted ports
Sanity Test Failures
Newsfeeds

Statistics
Graphs
NEW Graphs (Javascript)

Calculated hourly:
Port count 33284
Broken 123
Deprecated 367
Ignore 241
Forbidden 1
Restricted 2
No CDROM 1
Vulnerable 36
Expired 30
Set to expire 312
Interactive 0
new 24 hours 3
new 48 hours5
new 7 days21
new fortnight40
new month83
Servers and bandwidth provided by
New York Internet, iXsystems, and RootBSD 		Valid HTML, CSS, and RSS. Copyright © 2000-2025 Dan Langille. All rights reserved.