scrapy.spidermiddlewares.referer

module documentation
(source)

RefererMiddleware: populates Request referer field, based on the Response which originated it.

Class DefaultReferrerPolicy A variant of "no-referrer-when-downgrade", with the addition that "Referer" is not sent if the parent request was using ``file://`` or ``s3://`` scheme.
Class NoReferrerPolicy https://www.w3.org/TR/referrer-policy/#referrer-policy-no-referrer
Class NoReferrerWhenDowngradePolicy https://www.w3.org/TR/referrer-policy/#referrer-policy-no-referrer-when-downgrade
Class OriginPolicy https://www.w3.org/TR/referrer-policy/#referrer-policy-origin
Class OriginWhenCrossOriginPolicy https://www.w3.org/TR/referrer-policy/#referrer-policy-origin-when-cross-origin
Class RefererMiddleware No class docstring; 0/1 instance variable, 1/6 method, 0/1 class method documented
Class ReferrerPolicy No class docstring; 0/1 class variable, 2/7 methods documented
Class SameOriginPolicy https://www.w3.org/TR/referrer-policy/#referrer-policy-same-origin
Class StrictOriginPolicy https://www.w3.org/TR/referrer-policy/#referrer-policy-strict-origin
Class StrictOriginWhenCrossOriginPolicy https://www.w3.org/TR/referrer-policy/#referrer-policy-strict-origin-when-cross-origin
Class UnsafeUrlPolicy https://www.w3.org/TR/referrer-policy/#referrer-policy-unsafe-url
Constant LOCAL_SCHEMES Undocumented
Constant POLICY_NO_REFERRER Undocumented
Constant POLICY_NO_REFERRER_WHEN_DOWNGRADE Undocumented
Constant POLICY_ORIGIN Undocumented
Constant POLICY_ORIGIN_WHEN_CROSS_ORIGIN Undocumented
Constant POLICY_SAME_ORIGIN Undocumented
Constant POLICY_SCRAPY_DEFAULT Undocumented
Constant POLICY_STRICT_ORIGIN Undocumented
Constant POLICY_STRICT_ORIGIN_WHEN_CROSS_ORIGIN Undocumented
Constant POLICY_UNSAFE_URL Undocumented
Function _load_policy_class Expect a string for the path to the policy class, otherwise try to interpret the string as a standard value from https://www.w3.org/TR/referrer-policy/#referrer-policies
Variable _policy_classes Undocumented
LOCAL_SCHEMES: tuple[str, ...] = (source)

Undocumented

Value
('about', 'blob', 'data', 'filesystem')
POLICY_NO_REFERRER: str = (source)

Undocumented

Value
'no-referrer'
POLICY_NO_REFERRER_WHEN_DOWNGRADE: str = (source)

Undocumented

Value
'no-referrer-when-downgrade'
POLICY_ORIGIN: str = (source)

Undocumented

Value
'origin'
POLICY_ORIGIN_WHEN_CROSS_ORIGIN: str = (source)

Undocumented

Value
'origin-when-cross-origin'
POLICY_SAME_ORIGIN: str = (source)

Undocumented

Value
'same-origin'
POLICY_SCRAPY_DEFAULT: str = (source)

Undocumented

Value
'scrapy-default'
POLICY_STRICT_ORIGIN: str = (source)

Undocumented

Value
'strict-origin'
POLICY_STRICT_ORIGIN_WHEN_CROSS_ORIGIN: str = (source)

Undocumented

Value
'strict-origin-when-cross-origin'
POLICY_UNSAFE_URL: str = (source)

Undocumented

Value
'unsafe-url'
def _load_policy_class(policy, warning_only=False): (source)

Expect a string for the path to the policy class, otherwise try to interpret the string as a standard value from https://www.w3.org/TR/referrer-policy/#referrer-policies

_policy_classes = (source)

Undocumented