scrapy.extensions.postprocessing.PostProcessingManager

class documentation

class PostProcessingManager(IOBase): (source)

View In Hierarchy

This will manage and use declared plugins to process data in a pipeline-ish way. :param plugins: all the declared plugins for the feed :type plugins: list :param file: final target file where the processed data will be written :type file: file like object

Method __init__ Undocumented
Method close Close the target file along with all the plugins.
Method tell Undocumented
Method writable Undocumented
Method write Uses all the declared plugins to process data first, then writes the processed data to target file. :param data: data passed to be written to target file :type data: bytes :return: returns number of bytes written :rtype: int...
Instance Variable feed_options Undocumented
Instance Variable file Undocumented
Instance Variable head_plugin Undocumented
Instance Variable plugins Undocumented
Method _get_head_plugin Undocumented
Method _load_plugins Undocumented
def __init__(self, plugins: List[Any], file: BinaryIO, feed_options: Dict[str, Any]): (source)

Undocumented

def close(self): (source)

Close the target file along with all the plugins.

def tell(self) -> int: (source)

Undocumented

def writable(self) -> bool: (source)

Undocumented

def write(self, data: bytes) -> int: (source)

Uses all the declared plugins to process data first, then writes the processed data to target file. :param data: data passed to be written to target file :type data: bytes :return: returns number of bytes written :rtype: int

feed_options = (source)

Undocumented

file = (source)

Undocumented

head_plugin = (source)

Undocumented

plugins = (source)

Undocumented

def _get_head_plugin(self) -> Any: (source)

Undocumented

def _load_plugins(self, plugins: List[Any]) -> List[Any]: (source)

Undocumented