Poster Abstract

P10.29 Bart Scheers (Dataspex (CWI Inc))

Theme: Data processing pipelines

Dataspex, big data management solutions for astronomy

Dataspex is a young company started mid 2018 as spin-off from the Database Architectures Group of the Dutch national NWO research institute CWI. Dataspex delivers advanced solutions for Big data management and analysis for scientific applications, especially in the field of astronomy.
Astronomical observatories call for innovative solutions for the Big Data streams that their new facilities generate. In general, one or more telescopes observe large patches of the skies continuously with high resolution and sensitivity. The most important scientific drivers are to study transient and variable astrophysical sources on several time scales and their light curves, and to build catalogs of all the observed sources. The enormous amounts of data are only valuable if the they data can be processed and stored automatically and if all data can searched quickly and visualised interactively.
Here we will present our R&D and preliminary results of implemented solutions for the MeerLICHT and BlackGEM telescope arrays and the scalability to even larger instruments.