Poster Abstract
P10.42 César Enrique García Dabó (ESO (European Southern Observatory))
Theme: Data processing pipelinesESO VLT/I pipeline packaging system for releases – the complexity behind releasing 20+ pipelines at
The pipeline group at ESO has been delivering 20+ pipelines for the world-classVLT/I telescope since several years with the ambitious goal of providing
an homogeneous user experience, minimize duplication of efforts and provide
flexibility to the individual project deadlines, all spread across
3+ millions lines of C/C++, python and java code.
The use of shared components across the entire portfolio helps minimizing
duplication of code and leverages common solutions, however this requires
an extra coordination effort. A key to success is the continuous
integration system that gives developers promptly feedback about
code performance, compliance with software engineering standards and the
components interactions.
Our pipelines are deployed in a variety of environments, ranging from high-end
operational systems to scientist laptops. A novel in-house packaging system
abstracts the details for the different delivery scenarios helping the
developers to concentrate on their intentions while an automatic system
acts on the different repositories to achieve the end result. Currently
we support rpm, macports and source tarballs kits packaging systems, but the
plugin-based design allows to add other types of packages.