This blog covers some key concepts and practical solutions for tackling the question of compute costs incurred by running workflows, which are typically the hardest to predict among the various types of cloud costs.
Many workflows generate intermediate files that you won’t ever use again once the pipeline has run to completion. You can reduce your data footprint — and your storage costs! — by getting Terra to delete them for you.
On the cloud, the rate you pay for computing resources is based on the technical specifications of the virtual machines you use. Our pipeline engineering team offers some tips for cutting costs by adjusting workflow resource allocations dynamically.
If you're a PI switching from using institutional computing resources that are normally paid out of grant overhead, and until your institution lets you reallocate that money to cover cloud costs, you're going to need to find new funding. The good news is that there are some funding sources out there dedicated to bridging that gap [...]