module documentation

PartitionedDataSet loads and saves partitioned file-like data using the underlying dataset definition. It also uses fsspec for filesystem level operations.

Constant CHECKPOINT_CREDENTIALS_KEY Undocumented
Constant DATASET_CREDENTIALS_KEY Undocumented
Constant KEY_PROPAGATION_WARNING Undocumented
Constant S3_PROTOCOLS Undocumented
CHECKPOINT_CREDENTIALS_KEY: str = (source)

Undocumented

Value
'checkpoint_credentials'
DATASET_CREDENTIALS_KEY: str = (source)

Undocumented

Value
'dataset_credentials'
KEY_PROPAGATION_WARNING: str = (source)

Undocumented

Value
'Top-level %(keys)s will not propagate into the %(target)s since %(keys)s were e
xplicitly defined in the %(target)s config.'
S3_PROTOCOLS: tuple[str, ...] = (source)

Undocumented

Value
('s3', 's3a', 's3n')