scrapy.utils.spider

module documentation

(source)

Undocumented

Class	`DefaultSpider`	Undocumented
Function	`iter_spider_classes`	Return an iterator over all spider classes defined in the given module that can be instantiated (i.e. which have name)
Function	`iterate_spider_output`	Undocumented
Function	`spidercls_for_request`	Return a spider class that handles the given Request.
Variable	`logger`	Undocumented

def iter_spider_classes(module): (source) ¶

Return an iterator over all spider classes defined in the given module that can be instantiated (i.e. which have name)

def iterate_spider_output(result): (source) ¶

Undocumented

def spidercls_for_request(spider_loader, request, default_spidercls=None, log_none=False, log_multiple=False): (source) ¶

Return a spider class that handles the given Request. This will look for the spiders that can handle the given request (using the spider loader) and return a Spider class if (and only if) there is only one Spider able to handle the Request. If multiple spiders (or no spider) are found, it will return the default_spidercls passed. It can optionally log if multiple or no spiders are found.

logger = (source) ¶

Undocumented