If your day-to-day involves workflows with long-running tasks, I have good news for you: we just released a new checkpointing feature that makes it possible to save intermediate outputs for a task and resume work from that point if the task gets interrupted. For context, the Cromwell workflow engine we use in Terra already had a smart resume capability at the level of the workflow, called "call caching".
Whether you’re processing ten data files or ten thousand, making your workflows run faster and cost less is always a goal. The Terra Workflow (aka “Batch”) team has been working on some cost and performance improvements. These aren’t available quite yet, but we wanted to give you a preview of two of the [...]
Intermediate files generated by your workflow may be an unexpected source of storage costs. Fortunately, you now have an easy option to delete these files immediately after your workflow runs. Just select the new “delete intermediate outputs” box on your workflow configuration. Saving money on your workflow analysis is always a top [...]
To see all blog posts, visit our
Archive page
Terra is developed by the Broad Institute of MIT and Harvard
in collaboration with Microsoft and Verily Life Sciences.
Terra is developed by the
Broad Institute of MIT and Harvard in collaboration with Microsoft and
Verily Life Sciences.
