Port details |
- py-urlgrabber High-level cross-protocol url-grabber
- 4.0.0_1 www
=3 4.0.0Version of this port present on the latest quarterly branch. - Maintainer: nivit@FreeBSD.org
 - Port Added: 2007-12-18 14:55:07
- Last Update: 2025-03-08 04:05:21
- Commit Hash: 06a08e6
- People watching this port, also watch:: libevent, xorg-docs, libXdamage, xvidtune, libexif
- Also Listed In: python
- License: LGPL21
- WWW:
- http://urlgrabber.baseurl.org/
- Description:
- urlgrabber is a pure python package that drastically simplifies
the fetching of files. It is designed to be used in programs that
need common (but not necessarily simple) url-fetching features.
It is extremely simple to drop into an existing program and provides
a clean interface to protocol-independant file-access. Best of all,
urlgrabber takes care of all those pesky file-fetching details, and
lets you focus on whatever it is that your program is written to do!
¦ ¦ ¦ ¦ 
- Manual pages:
- FreshPorts has no man page information for this port.
- pkg-plist: as obtained via:
make generate-plist - There is no configure plist information for this port.
- Dependency lines:
-
- ${PYTHON_PKGNAMEPREFIX}urlgrabber>0:www/py-urlgrabber@${PY_FLAVOR}
- To install the port:
- cd /usr/ports/www/py-urlgrabber/ && make install clean
- To add the package, run one of these commands:
- pkg install www/py-urlgrabber
- pkg install py311-urlgrabber
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above. NOTE: This is a Python port. Instead of py311-urlgrabber listed in the above command, you can pick from the names under the Packages section.- PKGNAME: py311-urlgrabber
- Package flavors (<flavor>: <package>)
- distinfo:
- TIMESTAMP = 1601416704
SHA256 (urlgrabber-4.0.0.tar.gz) = d152d10c7decce45ce5b44f8ee8ee5fd0047217f4152eebb8e0c552ca5137af0
SIZE (urlgrabber-4.0.0.tar.gz) = 86308
Packages (timestamps in pop-ups are UTC):
- Dependencies
- NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
- Build dependencies:
-
- py311-six>=1.14.0 : devel/py-six@py311
- py311-setuptools>=63.1.0 : devel/py-setuptools@py311
- python3.11 : lang/python311
- Test dependencies:
-
- python3.11 : lang/python311
- Runtime dependencies:
-
- py311-six>=1.14.0 : devel/py-six@py311
- py311-pycurl>=7.19.0_1 : ftp/py-pycurl@py311
- python3.11 : lang/python311
- This port is required by:
- for Run
-
Deleted ports which required this port:
- * - deleted ports are only shown under the This port is required by section. It was harder to do for the Required section. Perhaps later...
Configuration Options:
- ===> The following configuration options are available for py311-urlgrabber-4.0.0_1:
DOCS=on: Build and/or install documentation
===> Use 'make config' to modify these settings
- Options name:
- www_py-urlgrabber
- USES:
- python shebangfix
- FreshPorts was unable to extract/find any pkg message
- Master Sites:
|
Commit History - (may be incomplete: for full details, see links to repositories near top of page) |
Commit | Credits | Log message |
4.0.0_1 08 Mar 2025 04:05:21
    |
Charlie Li (vishwin)  |
python: bump all USE_PYTHON=distutils consumers after RUN_DEPENDS removal
Any missed ports, feel free to bump.
Any ports that need setuptools at runtime can have the devel/py-setuptools
manually added back to RUN_DEPENDS, but understand that this practice
is deprecated; see CHANGES for details. |
4.0.0 27 Jun 2023 19:34:34
    |
Rene Ladan (rene)  |
all: remove explicit versions in USES=python for "3.x+"
The logic in USES=python will automatically convert this to 3.8+ by
itself.
Adjust two ports that only had Python 3.7 mentioned but build fine
on Python 3.8 too.
finance/quickfix: mark BROKEN with PYTHON
libtool: compile: c++ -DHAVE_CONFIG_H -I. -I../.. -I -I. -I.. -I../.. -I../C++
-DLIBICONV_PLUG -DPYTHON_MAJOR_VERSION=3 -Wno-unused-variable
-Wno-maybe-uninitialized -O2 -pipe -DLIBICONV_PLUG -fstack-protector-strong
-fno-strict-aliasing -DLIBICONV_PLUG -Wall -ansi
-Wno-unused-command-line-argument -Wpointer-arith -Wwrite-strings
-Wno-overloaded-virtual -Wno-deprecated-declarations -Wno-deprecated -std=c++0x
-MT _quickfix_la-QuickfixPython.lo -MD -MP -MF
.deps/_quickfix_la-QuickfixPython.Tpo -c QuickfixPython.cpp -fPIC -DPIC -o
.libs/_quickfix_la-QuickfixPython.o
warning: unknown warning option '-Wno-maybe-uninitialized'; did you mean
'-Wno-uninitialized'? [-Wunknown-warning-option]
QuickfixPython.cpp:175:11: fatal error: 'Python.h' file not found
^~~~~~~~~~
1 warning and 1 error generated.
Reviewed by: portmgr, vishwin, yuri
Differential Revision: <https://reviews.freebsd.org/D40568> |
07 Sep 2022 21:58:51
    |
Stefan Eßer (se)  |
Remove WWW entries moved into port Makefiles
Commit b7f05445c00f has added WWW entries to port Makefiles based on
WWW: lines in pkg-descr files.
This commit removes the WWW: lines of moved-over URLs from these
pkg-descr files.
Approved by: portmgr (tcberner) |
4.0.0 07 Sep 2022 21:10:59
    |
Stefan Eßer (se)  |
Add WWW entries to port Makefiles
It has been common practice to have one or more URLs at the end of the
ports' pkg-descr files, one per line and prefixed with "WWW:". These
URLs should point at a project website or other relevant resources.
Access to these URLs required processing of the pkg-descr files, and
they have often become stale over time. If more than one such URL was
present in a pkg-descr file, only the first one was tarnsfered into
the port INDEX, but for many ports only the last line did contain the
port specific URL to further information.
There have been several proposals to make a project URL available as
a macro in the ports' Makefiles, over time.
(Only the first 15 lines of the commit message are shown above ) |
4.0.0 20 Jul 2022 14:23:26
    |
Tobias C. Berner (tcberner)  |
www: remove 'Created by' lines
A big Thank You to the original contributors of these ports:
*
* <hvo.pm@xs4all.nl>
* Aaron Dalton <aaron@FreeBSD.org>
* Aaron Dalton <aaron@daltons.ca>
* Aaron LI <aly@aaronly.me>
* Aaron Zauner <az_mail@gmx.at>
* Abel Chow <achow@transoft.net>
* Adam Weinberger <adamw@FreeBSD.org>
* Ade Lovett <ade@FreeBSD.org>
* Adrian Steinmann <ast@marabu.ch>
* Akinori MUSHA aka knu <knu@idaemons.org> (Only the first 15 lines of the commit message are shown above ) |
4.0.0 06 Apr 2021 14:31:07
    |
Mathieu Arnold (mat)  |
Remove # $FreeBSD$ from Makefiles. |
4.0.0 28 Dec 2020 23:02:15
  |
antoine  |
Drop python 2.7 support from a few ports
With hat: portmgr |
4.0.0 30 Sep 2020 12:43:57
  |
mat  |
REINPLACE_ARGS can only contain the -i argument.
Reported by: kevans |
4.0.0 30 Sep 2020 07:41:14
  |
nivit  |
- Update to 4.0.0
- Remove dependency on Python 2.X (reported by [1])
- Use autoplist facility
PR: 249799
Submitted by: swills [1] |
3.10.2_1 20 Jun 2018 17:05:44
  |
mat  |
Use PY_FLAVOR for dependencies.
FLAVOR is the current port's flavor, it should not be used outside of
this scope.
Sponsored by: Absolight |
3.10.2_1 20 Jan 2018 20:21:16
  |
antoine  |
Do not use %%PYTHON_PYOEXTENSION%% in python2 plists
With hat: portmgr |
3.10.2_1 30 Nov 2017 15:50:34
  |
mat  |
Convert Python ports to FLAVORS.
Ports using USE_PYTHON=distutils are now flavored. They will
automatically get flavors (py27, py34, py35, py36) depending on what
versions they support.
There is also a USE_PYTHON=flavors for ports that do not use distutils
but need FLAVORS to be set. A USE_PYTHON=noflavors can be set if
using distutils but flavors are not wanted.
A new USE_PYTHON=optsuffix that will add PYTHON_PKGNAMESUFFIX has been
added to cope with Python ports that did not have the Python
PKGNAMEPREFIX but are flavored.
USES=python now also exports a PY_FLAVOR variable that contains the (Only the first 15 lines of the commit message are shown above ) |
3.10.2_1 05 Aug 2017 07:07:01
  |
tcberner  |
Readd pycurl as a runtime dependency.
In the previous release [1] pycurl was only dropped as a build-time dependency.
This fixes buildfailures for mythtv for example.
PR: 221157
Approved by: portmgr (blanket)
Differential Revision: https://reviews.freebsd.org/D11868 |
3.10.2 23 Jul 2017 11:42:10
  |
nivit  |
- Update to 3.10.2
- Remove ftp/py-pycurl from dependencies
- Sort variables
- Use shebangfix
- Remove patch/patch-urlgrabber__grabber.py |
3.9.1_4 24 Dec 2016 14:05:45
  |
antoine  |
Remove dependency on the python2 symlink |
3.9.1_3 23 Dec 2016 10:54:22
  |
amdmi3  |
- Reflect that this module does not support python3
- Switch to options helpers
Approved by: portmgr blanket |
3.9.1_3 01 Apr 2016 14:33:58
  |
mat  |
Remove ${PORTSDIR}/ from dependencies, categories v, w, x, y, and z.
With hat: portmgr
Sponsored by: Absolight |
3.9.1_3 12 Dec 2015 23:43:51
  |
sunpoet  |
- Move ftp/py-curl to ftp/py-pycurl
- Bump PORTREVISION for dependent ports |
3.9.1_2 17 Aug 2015 14:20:41
  |
mat  |
Remove UNIQUENAME and LATEST_LINK.
UNIQUENAME was never unique, it was only used by USE_LDCONFIG and now,
we won't have conflicts there.
Use PKGBASE instead of LATEST_LINK in PKGLATESTFILE, the *only* consumer
is pkg-devel, and it works just fine without LATEST_LINK as pkg-devel
has the correct PKGNAME anyway.
Now that UNIQUENAME is gone, OPTIONSFILE is too. (it's been called
OPTIONS_FILE now.)
Reviewed by: antoine, bapt
Exp-run by: antoine
Sponsored by: Absolight
Differential Revision: https://reviews.freebsd.org/D3336 |
3.9.1_2 15 May 2015 17:41:25
  |
amdmi3  |
- Drop @dirrm* from plist
- Add LICENSE_FILE
Approved by: portmgr blanket |
3.9.1_2 03 Jan 2015 08:41:21
  |
mva  |
- Convert USE_PYTHON to new USES in www/
With hat: python@ |
3.9.1_2 08 May 2014 16:08:08
  |
vanilla  |
- Stage
PR: ports/188802
Submitted by: Bartek Rutkowski <ports@robakdesign.com>
Approved by: portmgr@ |
3.9.1_2 21 Jan 2014 23:40:23
  |
bapt  |
Fix properties on pkg-plist |
3.9.1_2 20 Sep 2013 23:36:54
  |
bapt  |
Add NO_STAGE all over the place in preparation for the staging support (cat:
www) |
3.9.1_2 15 Aug 2013 16:21:27
  |
nivit  |
- Add a patch from upstream, that fix value of SSL verify host with pycurl
(see http://goo.gl/KGnkXT ) [1], and so bump PORTREVISION
- Trim Makefile header
- Remove dead link from MASTER_SITES
- Remove leading, indefinite article from COMMENT
- Add LICENSE (LGPL21)
- Convert to the new options framework
- Fix WWW field in pkg-descr
Required by: Yuri <yuri@rawbw.com> (via private email) [1]
Build details: http://goo.gl/7arykr |
3.9.1_1 16 Jul 2012 08:51:23
 |
nivit  |
- Add a patch (provided by the authors of the program: goo.gl/jorPS )
to fix a bug with the size of PyCurlFileObject
- Bump PORTREVISION
PR: ports/168917
Submitted by: Anders F Bjoerklund <afb at rpm5.org> |
3.9.1 19 Mar 2011 12:38:54
 |
miwi  |
- Get Rid MD5 support |
3.9.1 11 May 2010 08:49:24
 |
nivit  |
- Update to 3.9.1
- Add ftp/py-curl to *_DEPENDS
- Change primary download site
- Change WWW site in pkg-descr |
3.1.0_1 03 Jul 2008 15:47:27
 |
nivit  |
- Fix patch target when NOPORTDOCS is set (issue reported by "QA Tindy" via
itetcu
- Use ${PYTHON_PKGNAMEPREFIX} inside DOCSDIR (so bump PORTREVISION)
- Use os.environ.has_key() instead of os.getenv() inside setup.py |
3.1.0 18 Dec 2007 14:54:59
 |
nivit  |
urlgrabber is a pure python package that drastically simplifies
the fetching of files. It is designed to be used in programs that
need common (but not necessarily simple) url-fetching features.
It is extremely simple to drop into an existing program and provides
a clean interface to protocol-independant file-access. Best of all,
urlgrabber takes care of all those pesky file-fetching details, and
lets you focus on whatever it is that your program is written to do!
Author: Michael D. Stenner, Ryan Tomayko
WWW: http://linux.duke.edu/projects/urlgrabber/ |