Testing Multi-Machine Ansible Roles with Travis-CI and Docker compose

A little while ago I spent some time writing various Ansible roles and playbooks for the infrastructure at my place of work. My Ansible skills are intermediate and by no means refined. As a result of this, a lot of the roles were not developed to best practice specifications. I took some time to try to improve my roles and properly test them before using them by taking advantages of the free continuous testing service that Travis-CI offers....

July 16, 2019 ยท 9 min ยท Eugene de Beste

Using CWL and Toil to Wrap an Ad-hoc Astronomy Data Processing Pipeline

Blasting Students with Science I was recently invited to give a workshop on reproducible scientific workflows to students as part of the Inter-university Institute for Data Intensive Astronomyโ€™s (IDIA) โ€œJEDIโ€ programme. The overall purpose of this workshop was to introduce students from the African continent to various topics that are being dealt with in the data science space. A large focus here was machine learning. This post details some of my experiences with preparing the original pipeline, working CWL around it and also teaching people how to do it....

June 27, 2018 ยท 15 min ยท Eugene de Beste