module documentation
A collection of CLI commands for working with Kedro catalog.
Function | catalog |
Commands for working with catalog. |
Function | catalog |
Undocumented |
Function | create |
Create Data Catalog YAML configuration with missing datasets. |
Function | list |
Show datasets per type. |
Function | _add |
Undocumented |
Function | _create |
Undocumented |
Function | _map |
Build dictionary with a dataset type as a key and list of datasets of the specific type as a value. |
@catalog.command( 'create')
@env_option( help='Environment to create Data Catalog YAML file in. Defaults to `base`.')
@click.option( '--pipeline', '-p', 'pipeline_name', type=str, required=True, help='Name of a pipeline.')
@click.pass_obj
def create_catalog(metadata:
@env_option(
@click.option(
@click.pass_obj
def create_catalog(metadata:
ProjectMetadata
, pipeline_name, env):
(source)
¶
Create Data Catalog YAML configuration with missing datasets.
Add MemoryDataSet
datasets to Data Catalog YAML configuration file
for each dataset in a registered pipeline if it is missing from
the DataCatalog
.
The catalog configuration will be saved to
<conf_source>/<env>/catalog/<pipeline_name>.yml
file.
@catalog.command( 'list')
@env_option
@click.option( '--pipeline', '-p', type=str, default='', help='Name of the modular pipeline to run. If not set, the project pipeline is run by default.', callback=split_string)
@click.pass_obj
def list_datasets(metadata:
@env_option
@click.option(
@click.pass_obj
def list_datasets(metadata:
ProjectMetadata
, pipeline, env):
(source)
¶
Show datasets per type.