scrapy.extensions.throttle.AutoThrottle

class documentation

class AutoThrottle: (source)

View In Hierarchy

Undocumented

Class Method from_crawler Undocumented
Method __init__ Undocumented
Instance Variable crawler Undocumented
Instance Variable debug Undocumented
Instance Variable maxdelay Undocumented
Instance Variable mindelay Undocumented
Instance Variable target_concurrency Undocumented
Method _adjust_delay Define delay adjustment policy
Method _get_slot Undocumented
Method _max_delay Undocumented
Method _min_delay Undocumented
Method _response_downloaded Undocumented
Method _spider_opened Undocumented
Method _start_delay Undocumented
@classmethod
def from_crawler(cls, crawler): (source)

Undocumented

def __init__(self, crawler): (source)

Undocumented

crawler = (source)

Undocumented

debug = (source)

Undocumented

maxdelay = (source)

Undocumented

mindelay = (source)

Undocumented

target_concurrency = (source)

Undocumented

def _adjust_delay(self, slot, latency, response): (source)

Define delay adjustment policy

def _get_slot(self, request, spider): (source)

Undocumented

def _max_delay(self, spider): (source)

Undocumented

def _min_delay(self, spider): (source)

Undocumented

def _response_downloaded(self, response, request, spider): (source)

Undocumented

def _spider_opened(self, spider): (source)

Undocumented

def _start_delay(self, spider): (source)

Undocumented