scrapy.spidermiddlewares.referer.ReferrerPolicy

class documentation

class ReferrerPolicy: (source)

Known subclasses: scrapy.spidermiddlewares.referer.NoReferrerPolicy, scrapy.spidermiddlewares.referer.NoReferrerWhenDowngradePolicy, scrapy.spidermiddlewares.referer.OriginPolicy, scrapy.spidermiddlewares.referer.OriginWhenCrossOriginPolicy, scrapy.spidermiddlewares.referer.SameOriginPolicy, scrapy.spidermiddlewares.referer.StrictOriginPolicy, scrapy.spidermiddlewares.referer.StrictOriginWhenCrossOriginPolicy, scrapy.spidermiddlewares.referer.UnsafeUrlPolicy

View In Hierarchy

Undocumented

Method origin Return serialized origin (scheme, host, path) for a request or response URL.
Method origin_referrer Undocumented
Method potentially_trustworthy Undocumented
Method referrer Undocumented
Method strip_url https://www.w3.org/TR/referrer-policy/#strip-url
Method stripped_referrer Undocumented
Method tls_protected Undocumented
Class Variable name Undocumented
def origin(self, url): (source)

Return serialized origin (scheme, host, path) for a request or response URL.

def origin_referrer(self, url): (source)

Undocumented

def potentially_trustworthy(self, url): (source)

Undocumented

def referrer(self, response_url, request_url): (source)
overridden in scrapy.spidermiddlewares.referer.NoReferrerPolicy, scrapy.spidermiddlewares.referer.NoReferrerWhenDowngradePolicy, scrapy.spidermiddlewares.referer.OriginPolicy, scrapy.spidermiddlewares.referer.OriginWhenCrossOriginPolicy, scrapy.spidermiddlewares.referer.SameOriginPolicy, scrapy.spidermiddlewares.referer.StrictOriginPolicy, scrapy.spidermiddlewares.referer.StrictOriginWhenCrossOriginPolicy, scrapy.spidermiddlewares.referer.UnsafeUrlPolicy

Undocumented

def strip_url(self, url, origin_only=False): (source)

https://www.w3.org/TR/referrer-policy/#strip-url If url is null, return no referrer. If url's scheme is a local scheme, then return no referrer. Set url's username to the empty string. Set url's password to null. Set url's fragment to null. If the origin-only flag is true, then: Set url's path to null. Set url's query to null. Return url.

def stripped_referrer(self, url): (source)

Undocumented

def tls_protected(self, url): (source)

Undocumented

name: str = (source)

Undocumented