scrapy.extensions.feedexport.S3FeedStorage

class documentation

class S3FeedStorage(BlockingFeedStorage): (source)

View In Hierarchy

Undocumented

Class Method from_crawler Undocumented
Method __init__ Initialize the storage with the parameters given in the URI and the feed-specific options (see :setting:`FEEDS`)
Instance Variable access_key Undocumented
Instance Variable acl Undocumented
Instance Variable bucketname Undocumented
Instance Variable endpoint_url Undocumented
Instance Variable keyname Undocumented
Instance Variable s3_client Undocumented
Instance Variable secret_key Undocumented
Instance Variable session_token Undocumented
Method _store_in_thread Undocumented

Inherited from BlockingFeedStorage:

Method open Open the storage for the given spider. It must return a file-like object that will be used for the exporters
Method store Store the given file stream
@classmethod
def from_crawler(cls, crawler, uri, *, feed_options=None): (source)

Undocumented

def __init__(self, uri, access_key=None, secret_key=None, acl=None, endpoint_url=None, *, feed_options=None, session_token=None): (source)
from scrapy.extensions.feedexport.IFeedStorage

Initialize the storage with the parameters given in the URI and the feed-specific options (see :setting:`FEEDS`)

access_key = (source)

Undocumented

acl = (source)

Undocumented

bucketname = (source)

Undocumented

endpoint_url = (source)

Undocumented

keyname = (source)

Undocumented

s3_client = (source)

Undocumented

secret_key = (source)

Undocumented

session_token = (source)

Undocumented

def _store_in_thread(self, file): (source)
overrides scrapy.extensions.feedexport.BlockingFeedStorage._store_in_thread

Undocumented