package documentation
kedro.runner provides runners that are able to execute Pipeline instances.
Module | parallel |
ParallelRunner is an AbstractRunner implementation. It can be used to run the Pipeline in parallel groups formed by toposort. |
Module | runner |
AbstractRunner is the base class for all Pipeline runner implementations. |
Module | sequential |
SequentialRunner is an AbstractRunner implementation. It can be used to run the Pipeline in a sequential manner using a topological sort of provided nodes. |
Module | thread |
ThreadRunner is an AbstractRunner implementation. It can be used to run the Pipeline in parallel groups formed by toposort using threads. |
From __init__.py
:
Class |
|
AbstractRunner is the base class for all Pipeline runner implementations. |
Class |
|
ParallelRunner is an AbstractRunner implementation. It can be used to run the Pipeline in parallel groups formed by toposort. Please note that this runner implementation validates dataset using the _validate_catalog... |
Class |
|
SequentialRunner is an AbstractRunner implementation. It can be used to run the Pipeline in a sequential manner using a topological sort of provided nodes. |
Class |
|
ThreadRunner is an AbstractRunner implementation. It can be used to run the Pipeline in parallel groups formed by toposort using threads. |
Function | run |
Run a single Node with inputs from and outputs to the catalog . |
def run_node(node:
Node
, catalog: DataCatalog
, hook_manager: PluginManager
, is_async: bool
= False, session_id: str
= None) -> Node
:
(source)
¶
Run a single Node
with inputs from and outputs to the catalog
.
Parameters | |
node:Node | The Node to run. |
catalog:DataCatalog | A DataCatalog containing the node's inputs and outputs. |
hookPluginManager | The PluginManager to activate hooks. |
isbool | If True, the node inputs and outputs are loaded and saved asynchronously with threads. Defaults to False. |
sessionstr | The session id of the pipeline run. |
Returns | |
Node | The node argument. |
Raises | |
ValueError | Raised if is_async is set to True for nodes wrapping generator functions. |