Just our repo name on github. Toil will be moving from https://github.com/BD2KGenomics/toil to https://github.com/DataBiosphere/toil on June 20th, 2018!
Using Toil to run Cactus, a Full-Genome Alignment with Autoscaling on AWS
This workflow was tested and run using Toil 3.12.0. Before proceeding, please follow the steps in the Toil Autoscaling with AWS Tutorial necessary for the initial setup of a toil leader node. This tutorial will outline how to run Cactus, a reference-free whole-genome multiple alignment program on AWS with autoscaling. The example genomes for this… Continue reading Using Toil to run Cactus, a Full-Genome Alignment with Autoscaling on AWS
Debugging a Toil Mesos Leader Node that was launched through AWS
If you've launched a toil cluster and it is continuously trying to connect, here are some helpful debugging steps: Copy the public ip of the machine launched (in other words, the mesos leader node; you should be able to see this in EC2). You can ssh directly into the coreOS leader that is running the… Continue reading Debugging a Toil Mesos Leader Node that was launched through AWS
Toil Resources
This lists some resources for running toil. Specifically a list of coreOS AMIs and the toil/mesos docker image repo on quay.io. coreOS AMIs Premade coreOS AMIs for Toil's autoscaling instances (which run a mesos docker image on coreOS)*: https://stable.release.core-os.net/amd64-usr/current/coreos_production_ami_all.json Amazon Machine Images use one of two types of virtualization: paravirtual (PV) or hardware virtual machine… Continue reading Toil Resources
Credential Setup: Toil Autoscaling with AWS
This post will cover credential setup and the initial launching of a toil autoscaling cluster. Note: To manage autoscaling, toil mimics a mesos cluster by spinning up an AWS EC2 instance with a docker image of a mesos leader node. This sort of virtual cluster can then spin up mesos worker nodes as needed to… Continue reading Credential Setup: Toil Autoscaling with AWS