kedro.runner.runner

module documentation

(source)

AbstractRunner is the base class for all Pipeline runner implementations.

Function	`_call_node_run`	Undocumented
Function	`_collect_inputs_from_hook`	Undocumented
Function	`_enumerate_parents`	For a given `Node`, returns a list containing the direct parents of that `Node` in the given `Pipeline`.
Function	`_find_persistent_ancestors`	Breadth-first search approach to finding the complete set of persistent ancestors of an iterable of ``Node``s. Persistent ancestors exclusively have persisted ``Dataset``s as inputs.
Function	`_has_persistent_inputs`	Check if a `Node` exclusively has persisted Datasets as inputs. If at least one input is a `MemoryDataSet`, return False.
Function	`_run_node_async`	Undocumented
Function	`_run_node_sequential`	Undocumented

def _call_node_run(node: Node, catalog: DataCatalog, inputs: Dict[str, Any], is_async: bool, hook_manager: PluginManager, session_id: str = None) -> Dict[str, Any]: (source) ¶

Undocumented

def _collect_inputs_from_hook(node: Node, catalog: DataCatalog, inputs: Dict[str, Any], is_async: bool, hook_manager: PluginManager, session_id: str = None) -> Dict[str, Any]: (source) ¶

Undocumented

def _enumerate_parents(pipeline: Pipeline, child: Node) -> List[Node]: (source) ¶

For a given Node, returns a list containing the direct parents of that Node in the given Pipeline.

Parameters
pipeline:`Pipeline`	the `Pipeline` to search for direct parents in.
child:`Node`	the `Node` to find parents of.
Returns
`List[Node]`	A list of all Node``s that are direct parents of ``child.

def _find_persistent_ancestors(pipeline: Pipeline, children: Iterable[Node], catalog: DataCatalog) -> Set[Node]: (source) ¶

Breadth-first search approach to finding the complete set of persistent ancestors of an iterable of ``Node``s. Persistent ancestors exclusively have persisted ``Dataset``s as inputs.

Parameters
pipeline:`Pipeline`	the `Pipeline` to find ancestors in.
children:`Iterable[Node]`	the iterable containing ``Node``s to find ancestors of.
catalog:`DataCatalog`	the `DataCatalog` of the run.
Returns
`Set[Node]`	A set containing first persistent ancestors of the given ``Node``s.

def _has_persistent_inputs(node: Node, catalog: DataCatalog) -> bool: (source) ¶

Check if a Node exclusively has persisted Datasets as inputs. If at least one input is a MemoryDataSet, return False.

Parameters
node:`Node`	the `Node` to check the inputs of.
catalog:`DataCatalog`	the `DataCatalog` of the run.
Returns
`bool`	True if the `Node` being checked exclusively has inputs that are not `MemoryDataSet`, else False.

def _run_node_async(node: Node, catalog: DataCatalog, hook_manager: PluginManager, session_id: str = None) -> Node: (source) ¶

Undocumented

def _run_node_sequential(node: Node, catalog: DataCatalog, hook_manager: PluginManager, session_id: str = None) -> Node: (source) ¶

Undocumented