If your day-to-day involves workflows with long-running tasks, I have good news for you: we just released a new checkpointing feature that makes it possible to save intermediate outputs for a task and resume work from that point if the task gets interrupted. For context, the Cromwell workflow engine we use in Terra already had a smart resume capability at the level of the workflow, called "call caching".
New year, new partnership… and a new blog series focusing on highlighting papers that we think will be of interest to many of you. For this first iteration, we review a review paper (review-ception!) fresh off the virtual press over at GigaScience, coming out of C. Titus Brown's lab at UC Davis, on the topic of workflow systems.
Guest blog post by Kylee Degatano, Product Manager for the Lantern Pipelines team in the Data Sciences Platform at the Broad Institute. I'm very excited to announce the recent release of WDL Analysis Research Pipelines (WARP), a brand new, public GitHub repository of cloud-optimized WDL workflows that are used in production at the [...]
One of the foundational principles of Terra is that it's designed to be an open ecosystem, not a walled garden — there are no lock-in mechanisms. If after a while you decide to leave, you can take all the analysis tooling you've been using here and expect it to still be [...]
To see all blog posts, visit our
Archive page
Terra is developed by the Broad Institute of MIT and Harvard
in collaboration with Microsoft and Verily Life Sciences.
Terra is developed by the
Broad Institute of MIT and Harvard in collaboration with Microsoft and
Verily Life Sciences.
