scrapy

package documentation
(source)

Scrapy - a web crawling and web scraping framework written for Python

Module cmdline Undocumented
Package commands Base class for Scrapy commands
Package contracts No package docstring; 0/1 function, 1/2 class, 0/1 module documented
Package core Scrapy core library classes and functions.
Module crawler No module docstring; 0/1 variable, 2/3 classes documented
Package downloadermiddlewares No package docstring; 7/14 modules documented
Module dupefilters No module docstring; 0/2 type variable, 1/2 class documented
Module exceptions Scrapy core exceptions
Module exporters Item Exporters are used to export/serialize items into different formats.
Module extension The Extension Manager
Package extensions No package docstring; 9/13 modules documented
Package http Module containing all HTTP related classes
Module interfaces Undocumented
Module item Scrapy Item
Module link This module defines the Link object used in Link extractors.
Package linkextractors scrapy.linkextractors
Package loader Item Loader
Module logformatter No module docstring; 0/7 constant, 1/1 class documented
Module mail Mail sending helpers
Module middleware No module docstring; 0/1 variable, 1/1 class documented
Package pipelines Item pipeline
Module pqueues No module docstring; 0/1 variable, 1/1 function, 2/3 classes documented
Module resolver No module docstring; 0/1 variable, 2/4 classes documented
Module responsetypes This module implements a class which returns the appropriate Response class based on different criteria.
Module robotstxt Undocumented
Package selector Selectors
Package settings No package docstring; 0/1 constant, 3/3 functions, 3/3 classes, 1/1 module documented
Module shell Scrapy Shell
Module signalmanager Undocumented
Module signals Scrapy signals
Module spiderloader No module docstring; 1/1 class documented
Package spidermiddlewares No package docstring; 5/5 modules documented
Package spiders Base class for Scrapy spiders
Module squeues Scheduler queues
Module statscollectors Scrapy extension for collecting scraping stats
Package utils No package docstring; 17/38 modules documented
Module __main__ Undocumented

From __init__.py:

Class Field Container of field metadata
Class FormRequest Undocumented
Class Item Base class for scraped items.
Class Request Represents an HTTP request, which is usually generated in a Spider and executed by the Downloader, thus generating a :class:`Response`.
Class Selector An instance of :class:`Selector` is a wrapper over response to select certain parts of its content.
Class Spider Base class for scrapy spiders. All spiders must inherit from this class.
Variable __version__ Undocumented
Variable twisted_version Undocumented
Variable version_info Undocumented
__version__ = (source)

Undocumented

version_info = (source)

Undocumented

twisted_version = (source)

Undocumented