cromwell Archives

Introducing task-level checkpointing in workflows

Geraldine Van der Auwera January 26, 2021

If your day-to-day involves workflows with long-running tasks, I have good news for you: we just released a new checkpointing feature that makes it possible to save intermediate outputs for a task and resume work from that point if the task gets interrupted. For context, the Cromwell workflow engine we use in Terra already had a smart resume capability at the level of the workflow, called “call caching”.

Improving Job Manager functionality on Terra

Ruchi Munshi September 3, 2019

We can probably all agree that the main point of running analyses in the form of workflows is to automate as much of it as you can. So when something goes wrong, you want to be able to identify the nature of the problem as quickly and easily as possible. Today we wanted […]

Workflow worries to working WDLs in under a week

Allie Cliffe July 19, 2019

How insightful feedback about the GATK showcase led to a flurry of updates and the creation of a suite of format conversion tools. Last June, just as we were putting the final touches on the teaching materials for a 4-day GATK workshop that we were planning to run entirely on Terra, we received […]