Using CWL and Toil to Wrap an Ad-hoc Astronomy Data Processing Pipeline

Blasting Students with Science I was recently invited to give a workshop on reproducible scientific workflows to students as part of the Inter-university Institute for Data Intensive Astronomy’s (IDIA) β€œJEDI” programme. The overall purpose of this workshop was to introduce students from the African continent to various topics that are being dealt with in the data science space. A large focus here was machine learning. This post details some of my experiences with preparing the original pipeline, working CWL around it and also teaching people how to do it....

June 27, 2018 Β· 15 min Β· Eugene de Beste