Poster Abstract

P10.54 Yihan Song (NAOC)

Theme: Data processing pipelines

A light weight message queue system

With the modern telescope developing, more data has to be processed. Distributed parallel computing is a way to accelerate the executing time of the pipeline. Using message queue system it is easy to distribute jobs to each processor. There are many similar systems. However most of them depend on database or other the third-part software. We will show a new message queue system which is written in Python. It is easy to deployed to the server and to combine with your existing code.