scrapy.pipelines.files.S3FilesStore

class documentation

class S3FilesStore: (source)

View In Hierarchy

Undocumented

Method __init__ Undocumented
Method persist_file Upload file to S3 storage
Method stat_file Undocumented
Constant AWS_ACCESS_KEY_ID Undocumented
Constant AWS_ENDPOINT_URL Undocumented
Constant AWS_REGION_NAME Undocumented
Constant AWS_SECRET_ACCESS_KEY Undocumented
Constant AWS_SESSION_TOKEN Undocumented
Constant AWS_USE_SSL Undocumented
Constant AWS_VERIFY Undocumented
Constant HEADERS Undocumented
Constant POLICY Undocumented
Instance Variable bucket Undocumented
Instance Variable prefix Undocumented
Instance Variable s3_client Undocumented
Method _get_boto_key Undocumented
Method _headers_to_botocore_kwargs Convert headers to botocore keyword arguments.
def __init__(self, uri): (source)

Undocumented

def persist_file(self, path, buf, info, meta=None, headers=None): (source)

Upload file to S3 storage

def stat_file(self, path, info): (source)

Undocumented

AWS_ACCESS_KEY_ID = (source)

Undocumented

Value
None
AWS_ENDPOINT_URL = (source)

Undocumented

Value
None
AWS_REGION_NAME = (source)

Undocumented

Value
None
AWS_SECRET_ACCESS_KEY = (source)

Undocumented

Value
None
AWS_SESSION_TOKEN = (source)

Undocumented

Value
None
AWS_USE_SSL = (source)

Undocumented

Value
None
AWS_VERIFY = (source)

Undocumented

Value
None
HEADERS: dict[str, str] = (source)

Undocumented

Value
{'Cache-Control': 'max-age=172800'}
POLICY: str = (source)

Undocumented

Value
'private'
bucket = (source)

Undocumented

prefix = (source)

Undocumented

s3_client = (source)

Undocumented

def _get_boto_key(self, path): (source)

Undocumented

def _headers_to_botocore_kwargs(self, headers): (source)

Convert headers to botocore keyword arguments.