The IDIA PROCESSMEERKAT pipeline: Fast CASA Processing on a Cloud-Based HPC Cluster
J. D. Collier, B. S. Frank, Srikrishna Sekhar, A. R. Taylor
Abstract
The IDIA PROCESSMEERKAT pipeline is an efficient, user-friendly pipeline that has been widely tested and documented. It has been used to successfully calibrate and image MeerKAT data down to an RMS of several µJy / beam, and supports continuum, polarisation and spectral-line use cases. It runs on the ilifu cluster, making dynamic use of resources and containers, and presents a good framework for implementing pipelines in a HPC environment. The current version performs full-polarisation a priori calibration and produces quick-look images. The next version, which introduces self-calibration, is currently being tested.
Topics & Concepts
Pipeline (software)Pipeline transportComputer scienceA priori and a posterioriCloud computingCalibrationCluster (spacecraft)Computer graphics (images)Real-time computingComputational scienceOperating systemEngineeringPhysicsPhilosophyQuantum mechanicsEpistemologyEnvironmental engineeringComputational Physics and Python ApplicationsGamma-ray bursts and supernovaeParticle Detector Development and Performance