Introducing task-level checkpointing in workflows
If your day-to-day involves workflows with long-running tasks, I have good news for you: we just released a new checkpointing feature that makes it possible to save intermediate outputs for a task and resume work from that point if the task gets interrupted. For context, the Cromwell workflow engine we use in Terra already had a smart resume capability at the level of the workflow, called “call caching”.