scrapy.utils.request.RequestFingerprinter

class documentation

class RequestFingerprinter: (source)

View In Hierarchy

Default fingerprinter. It takes into account a canonical version (:func:`w3lib.url.canonicalize_url`) of :attr:`request.url <scrapy.http.Request.url>` and the values of :attr:`request.method <scrapy.http.Request.method>` and :attr:`request.body <scrapy.http.Request.body>`. It then generates an `SHA1 <https://en.wikipedia.org/wiki/SHA-1>`_ hash. .. seealso:: :setting:`REQUEST_FINGERPRINTER_IMPLEMENTATION`.

Class Method from_crawler Undocumented
Method __init__ Undocumented
Method fingerprint Undocumented
Instance Variable _fingerprint Undocumented
@classmethod
def from_crawler(cls, crawler): (source)

Undocumented

def __init__(self, crawler=None): (source)

Undocumented

def fingerprint(self, request: Request): (source)

Undocumented

_fingerprint = (source)

Undocumented