scrapy.downloadermiddlewares.ajaxcrawl.AjaxCrawlMiddleware

class documentation

class AjaxCrawlMiddleware: (source)

View In Hierarchy

Handle 'AJAX crawlable' pages marked as crawlable via meta tag. For more info see https://developers.google.com/webmasters/ajax-crawling/docs/getting-started.

Class Method from_crawler Undocumented
Method __init__ Undocumented
Method process_response Undocumented
Instance Variable lookup_bytes Undocumented
Method _has_ajax_crawlable_variant Return True if a page without hash fragment could be "AJAX crawlable" according to https://developers.google.com/webmasters/ajax-crawling/docs/getting-started.
@classmethod
def from_crawler(cls, crawler): (source)

Undocumented

def __init__(self, settings): (source)

Undocumented

def process_response(self, request, response, spider): (source)

Undocumented

lookup_bytes = (source)

Undocumented

def _has_ajax_crawlable_variant(self, response): (source)

Return True if a page without hash fragment could be "AJAX crawlable" according to https://developers.google.com/webmasters/ajax-crawling/docs/getting-started.