punchpipe.control.cleaner#

Functions#

cleaner(pipeline_config_path[, session])

reset_revivable_flows(logger, session, pipeline_config)

cancel_running_prefect_flows_before_cutoff(cutoff[, ...])

Cancels flows that started running before a cutoff time.

fail_stuck_flows(logger, session, pipeline_config, state)

Module Contents#

async punchpipe.control.cleaner.cleaner(pipeline_config_path: str, session=None)[source]#
punchpipe.control.cleaner.reset_revivable_flows(logger, session, pipeline_config)[source]#
async punchpipe.control.cleaner.cancel_running_prefect_flows_before_cutoff(cutoff: datetime.datetime, batch_size: int = 100)[source]#

Cancels flows that started running before a cutoff time.

async punchpipe.control.cleaner.fail_stuck_flows(logger, session, pipeline_config, state, update_prefect=False)[source]#