www/py-scrapy: Update to 2.11.1

Changelog:	https://docs.scrapy.org/en/latest/news.html#scrapy-2-11-1-2024-02-14

PR:		277729
Approved by:	skreuzer (maintainer)

*: Change {RUN,TEST}_DEPENDS from security/py-service_identity to
security/py-service-identity

- Bump PORTREVISION for dependency change (except security/py-trustme)

PR:		275167
Reported by:	Joakim Bergman <jocke@gipset.se>

*: Replace USES=pycryptography* with USE_PYTHON=cryptography{,_build,_test}

- Introduce USE_PYTHON=cryptography{,_build,_test}
- Switch all 96 ports from USES=pycryptography to with
USE_PYTHON=cryptography{,_build,_test}
- Remove Mk/Uses/pycryptography.mk

PR:		273727
Approved by:	tcberner (portmgr)
Exp-run by:	antoine

framework: convert tree to use USES=pycryptography

A future commit will update to security/py-cryptography will introduce a
rust dependency.

PR:		254853

all: remove explicit versions in USES=python for "3.x+"

The logic in USES=python will automatically convert this to 3.8+ by
itself.

Adjust two ports that only had Python 3.7 mentioned but build fine
on Python 3.8 too.

finance/quickfix: mark BROKEN with PYTHON

libtool: compile:  c++ -DHAVE_CONFIG_H -I. -I../.. -I -I. -I.. -I../.. -I../C++
-DLIBICONV_PLUG -DPYTHON_MAJOR_VERSION=3 -Wno-unused-variable
-Wno-maybe-uninitialized -O2 -pipe -DLIBICONV_PLUG -fstack-protector-strong
-fno-strict-aliasing -DLIBICONV_PLUG -Wall -ansi
-Wno-unused-command-line-argument -Wpointer-arith -Wwrite-strings
-Wno-overloaded-virtual -Wno-deprecated-declarations -Wno-deprecated -std=c++0x
-MT _quickfix_la-QuickfixPython.lo -MD -MP -MF
.deps/_quickfix_la-QuickfixPython.Tpo -c QuickfixPython.cpp  -fPIC -DPIC -o
.libs/_quickfix_la-QuickfixPython.o
warning: unknown warning option '-Wno-maybe-uninitialized'; did you mean
'-Wno-uninitialized'? [-Wunknown-warning-option]
QuickfixPython.cpp:175:11: fatal error: 'Python.h' file not found
          ^~~~~~~~~~
1 warning and 1 error generated.

Reviewed by:	portmgr, vishwin, yuri
Differential Revision:	<https://reviews.freebsd.org/D40568>

*/*: rename CHEESESHOP to PYPI in MASTER_SITES

PR:			267994
Differential revision:	D37518
Approved by:		bapt

Remove WWW entries moved into port Makefiles

Commit b7f05445c00f has added WWW entries to port Makefiles based on
WWW: lines in pkg-descr files.

This commit removes the WWW: lines of moved-over URLs from these
pkg-descr files.

Approved by:		portmgr (tcberner)

Add WWW entries to port Makefiles

It has been common practice to have one or more URLs at the end of the
ports' pkg-descr files, one per line and prefixed with "WWW:". These
URLs should point at a project website or other relevant resources.

Access to these URLs required processing of the pkg-descr files, and
they have often become stale over time. If more than one such URL was
present in a pkg-descr file, only the first one was tarnsfered into
the port INDEX, but for many ports only the last line did contain the
port specific URL to further information.

There have been several proposals to make a project URL available as
a macro in the ports' Makefiles, over time.

www: remove 'Created by' lines

A big Thank You to the original contributors of these ports:

  *
  *  <hvo.pm@xs4all.nl>
  *  Aaron Dalton <aaron@FreeBSD.org>
  *  Aaron Dalton <aaron@daltons.ca>
  *  Aaron LI <aly@aaronly.me>
  *  Aaron Zauner <az_mail@gmx.at>
  *  Abel Chow <achow@transoft.net>
  *  Adam Weinberger <adamw@FreeBSD.org>
  *  Ade Lovett <ade@FreeBSD.org>
  *  Adrian Steinmann <ast@marabu.ch>
  *  Akinori MUSHA aka knu <knu@idaemons.org>

www/py-scrapy: Update to version 2.5.1

Security Bug Fix:

If you use HttpAuthMiddleware (i.e. the http_user and http_pass spider
attributes) for HTTP authentication, any request exposes your credentials to
the request target.

To prevent unintended exposure of authentication credentials to unintended
domains, you must now additionally set a new, additional spider attribute,
http_auth_domain, and point it to the specific domain to which the
authentication credentials must be sent.

If the http_auth_domain spider attribute is not set, the domain of the first
request will be considered the HTTP authentication target, and authentication

www/py-scrapy: Add CPE information

Approved by:    portmgr (blanket)

www/py-scrapy: Update to 2.5.0

Changelog:	https://docs.scrapy.org/en/latest/news.html?highlight=news#scrapy-2-5-0-2021-04-06

This also removes/disables the experimental HTTP/2 support, there are
issues with Twisted and h2 at this moment which breaks scrapy.

PR:		256259
Approved by:	maintainer timeout (skreuzer)

Remove # $FreeBSD$ from Makefiles.

Drop python 2.7 support from a few ports

With hat:	portmgr

Bump a few PORTREVISIONs after r498529

With hat:	portmgr

textproc/py-scrapy: Fix the dependency version

PR:		235471
Submitted by:	wen
Approved by:	portmgr (port compliance)

Fix typo in RUN_DEPENDS

Require py-parsel >= 1.2.0

Update to 1.6.0

PR:		235471
Submitted by:	yuri@

Use PY_FLAVOR for dependencies.

FLAVOR is the current port's flavor, it should not be used outside of
this scope.

Sponsored by:	Absolight

www/py-scrapy: Add USE_PYTHON=concurrent

Approved by:	portmgr

Convert Python ports to FLAVORS.

  Ports using USE_PYTHON=distutils are now flavored.  They will
  automatically get flavors (py27, py34, py35, py36) depending on what
  versions they support.

  There is also a USE_PYTHON=flavors for ports that do not use distutils
  but need FLAVORS to be set.  A USE_PYTHON=noflavors can be set if
  using distutils but flavors are not wanted.

  A new USE_PYTHON=optsuffix that will add PYTHON_PKGNAMESUFFIX has been
  added to cope with Python ports that did not have the Python
  PKGNAMEPREFIX but are flavored.

  USES=python now also exports a PY_FLAVOR variable that contains the

Fix dependencies

PR:		219311
Submitted by:	Eric Camachat <eric@camachat.org>

Update to 1.3.3

PR:		219212
Submitted by:	Daniel Ylitalo

Update to version 1.1.1

Remove ${PORTSDIR}/ from dependencies, categories v, w, x, y, and z.

With hat:	portmgr
Sponsored by:	Absolight

Remove UNIQUENAME and LATEST_LINK.

UNIQUENAME was never unique, it was only used by USE_LDCONFIG and now,
we won't have conflicts there.

Use PKGBASE instead of LATEST_LINK in PKGLATESTFILE, the *only* consumer
is pkg-devel, and it works just fine without LATEST_LINK as pkg-devel
has the correct PKGNAME anyway.

Now that UNIQUENAME is gone, OPTIONSFILE is too. (it's been called
OPTIONS_FILE now.)

Reviewed by:	antoine, bapt
Exp-run by:	antoine
Sponsored by:	Absolight
Differential Revision:	https://reviews.freebsd.org/D3336

Adopt port

- Convert USE_PYTHON to new USES in www/

With hat:	python@

Reset maintainership:
- Lots of maintainers timeout
- unresponsive for almost a year

PR:		195059

Update to version 0.22.2

PR:		189719
Submitted by:	amim.knabben@gmail.com
Approved by:	maintainer timeout (clsung, 28 weeks)

- Stage support
- Convert to PYDISTUTILS_AUTOPLIST
- Bump PORTREVISION

Python cleanup:
- USE_PYTHON* = 2.X -> USE_PYTHON* = 2
- USE_PYTHON* = 2.X+ -> USE_PYTHON* = yes
Reviewed by:	python (mva, rm)
Approved by:	portmgr-lurkers (mat)

New USES=twisted, to replace the old USE_TWISTED knob.

twisted can be configured with the arguments run or build to replace
the previous USE_TWISTED_RUN and USE_TWISTED_BUILD knobs. The twisted
components can be added as comma-separated arguments. If you previously
wrote
    USE_TWISTED=        yes
    USE_TWISTED=        conch names
    USE_TWISTED_RUN=    yes
you now would write
    USES=       twisted
    USES=       twisted:conch,names
    USES=       twisted:run

Add NO_STAGE all over the place in preparation for the staging support (cat:
www)

- Update to 0.16.5

- Update to 0.16.4

- update to 0.16.2
- trim Makefile header
- remove indefinite article from COMMENT
- add LICENSE
- remove not needed BUILD_DEPENDS
- depend on TwistedCore via USE_TWISTED_RUN instead of direct dependency on
meta-port
- convert to optionsng
- convert PYTHON_SITELIBDIR usage with PYTHON_PKGNAMEPREFIX

PR:		173661
Submitted by:	rm (myself)
Approved by:	maintainer timeout (2 weeks+)
Feature safe:	yes

- Unbreak
- take maintainership

PR:             ports/162557
Submitted by:   clsung
Approved by:    maintainer (qingfeng_AT_douban.com)
Feature safe:   yes

- Mark BROKEN: does not compile

Reported by:    pointyhat

Update to version 0.12.0.2542, change maintainer email address to a new
one.

PR:             ports/158370
Submitted by:   maintainer

- Get Rid MD5 support

- Update to 0.10.3
- Add sqlite to RUN_DEPENDS
- Add support for SSL and JSON

PR:             ports/149884 (based on)
Submitted by:   lwhsu
Approved by:    maintainer timeout

Scrapy is a high level scraping and web crawling framework for writing
spiders to crawl and parse web pages for all kinds of purposes, from
information retrieval to monitoring or testing web sites.

WWW: http://scrapy.org/

PR:             ports/136811
Submitted by:   Qing Feng <qingfeng@me.com>