scrapy.downloadermiddlewares.retry.RetryMiddleware

class documentation

class RetryMiddleware: (source)

View In Hierarchy

Undocumented

Class Method from_crawler Undocumented
Method __init__ Undocumented
Method process_exception Undocumented
Method process_response Undocumented
Constant EXCEPTIONS_TO_RETRY Undocumented
Instance Variable max_retry_times Undocumented
Instance Variable priority_adjust Undocumented
Instance Variable retry_http_codes Undocumented
Method _retry Undocumented
@classmethod
def from_crawler(cls, crawler): (source)

Undocumented

def __init__(self, settings): (source)

Undocumented

def process_exception(self, request, exception, spider): (source)

Undocumented

def process_response(self, request, response, spider): (source)

Undocumented

EXCEPTIONS_TO_RETRY = (source)

Undocumented

Value
(defer.TimeoutError,
 TimeoutError,
 DNSLookupError,
 ConnectionRefusedError,
 ConnectionDone,
 ConnectError,
 ConnectionLost,
...
max_retry_times = (source)

Undocumented

priority_adjust = (source)

Undocumented

retry_http_codes = (source)

Undocumented

def _retry(self, request, reason, spider): (source)

Undocumented