AnaPAON4 : Analysis software for PAON4 JSkyMap : Map making and - PowerPoint PPT Presentation

BAORadio / PAON4 c++ software suite R. Ansari 21 cm Cosmology workshop & Tianlai collaboration meeting Xingchen Tianyuan Hotel, Pingtang, Guizhou , China September 2018

✤ AnaPAON4 : Analysis software for PAON4 ✤ JSkyMap : Map making and simulation software suit for transit instruments ( Jiao Zhang PhD) ✤ TAcq : Acquisition software and software correlator C++ software, using the SOPHYA class library

SOPHYA a C++ class library for intensive data analysis and scientific computing http://www.sophya.org https://gitlab.in2p3.fr/SOPHYA

AnaPAON4

AnaPAON4 (1) git@gitlab.in2p3.fr:baoradio/AnaPAON4.git ✤ Classes for reading/managing the visibility files ✤ Satellites subdirectory: Satellites position / track computation (C. Magneville) ✤ AnaFringes subdirectory: Fringe fitting (with Minuit) (J.E.Campagne) ✤ Phase calibration , array geometry - also part of Qizhi Huang’s PhD work ✤ Script subdirectory: running different tasks , few python scripts ✤ A number of utility Classes in p4autils.h .cc : ✤ P4FreqBand , P4VisiNumEncoder , P4AnaParams , P4Coords , P4RAMapUtil ✤ Visibility reading classes (visip4reader.h .cc) : ✤ VisiP4ReaderBase , VisiP4ReaderNoDB , VisiP4ReaderDB ✤ Classes to compute gains and apply them : g(nu) ( p4gnugain.h .cc ) and G(t) ( p4gvcor.h .cc ) ✤ P4gnuGain , P4gvCor

AnaPAON4 (2) git@gitlab.in2p3.fr:baoradio/AnaPAON4.git ✤ Input visibility reader classes (visip4reader.h .cc) , with services to select data one time frame … ✤ VisiP4ReaderBase , VisiP4ReaderNoDB , VisiP4ReaderDB ✤ Phase correction class Φ ( ν ) ( p4phcor.h .cc ) ✤ P4PhaseCor ✤ Higher level visibility reader class, with time windowing, with the capability to apply gain/phase correction (visp4winreader.h .cc) ✤ VisiP4WindowReader ✤ Few programs to perform averaging/filtering to produce time-frequency (ou RA-freq) or other summary information, or gain computation … ✤ visiavg.cc visi2ra.cc visi2dtacx.cc visi2nt.cc

JSkyMap Map making (visibility to map) and simulation (map to visibility) software tools - J. Zhang PhD Needs some documentation, maybe Jiao will write some …

JSkyMap git@gitlab.in2p3.fr:SCosmoTools/JSkyMap.git ✤ Simulation / computation of visibilities from spherical maps and map reconstruction from visibilities ✤ J. Zhang PhD work (and papers) ✤ Example of utility codes: vis2map.cc , p4src2vis.cc , map2vis.cc ✤ ( α , δ ) map reconstruction through linear combination (beam-forming/phase-array) of visibilities for PAON4 p4src2vis.cc (NOT applicable for polar cap) - Can be useful for mid latitude observations with Tianlai dish array TArray<double> make_map_from_visibilities(vector< TArray< complex<double> > > & vec_visarr, bool useauto=false); ✤ Computing PAON4/Tianlai visibilities from a spherical map from a spherical (HEALPix) or other pixelisations available in SOPHYA or from a liste of sources. Can easily make a version for Tianlai dish array.

JSkyMap : Map making software (II) (J. Zhang PhD) • Do not yet handle polarisation, but extension is rather easy • Except for the computation of polarised beam responses… • The code is rather simple, built around few classes, but relies on the SOPHYA class library ( http://www.sophya.org ) • Main classes used in JSkyMap : • BeamTP , BeamLM and BeamVis • SphCoordTrans , PseudoInverse<T> • JSphSkyMap • JSkyMap and BeamUV for planar geometry • Some utility functions GIT repo: https://gitlab.in2p3.fr/SCosmoTools/JSkyMap

TAcq A flexible and efficient c++ software for interferometer data acquisition, correlator (can be extended to beam former) - mostly for development/debugging purposes Several level of parallelism : • Coarse: processes running over compute nodes in a cluster • Fine: tasks running (threads) on different cores within a single process • VeryFine: multi-threaded tasks for CPU heavy tasks https://gitlab.in2p3.fr/baoradio/tacq

BAORadio Acquisition/Processing software ✤ Multi-thread programs / object oriented (C++) architecture ✤ FITS files (+ directory structure) for data storage (raw data/Fourier coefficient/Visibilities/spectra) ✤ BRPaquet hardware / software data exchange unit ✤ RAcqMemZoneMgr (memory manager) insure thread synchronisation/coordination ✤ Thread objects (ZThread) perform differents tasks ✤ Uses the SOPHYA C++ class library ✤ HDF5 files can also be used , as the latest SOPHYA release has / will have HDF5 support https://gitlab.in2p3.fr/baoradio/tacq

Some of the TAcq classes ✤ Class BRPaquet & BRPaqChecker ✤ Class RAcqMemZoneMgr (Multi fiber / link managed memory zone) ✤ Thread (task) classes ( ZThread) ( see next slide) ✤ Class MiniFITSFile The programs can be deployed over a computer cluster, and coherent execution over time is insured partly thank to the BRPaquet TimeTagged data paquets BRPaquet HDR … Data … TRL

Thread (Task) classes • PCIEMultiReader (PCI-Express DMA to memory) • PCIEToEthernet (PCI-Express DMA to ethernet ) • MultiDataSaver (Writes packet data to disk (FITS format)) • EthernetReader (Read packet from ethernet to memory) • BRMultiFitsReader (Multi fiber fits reader, align in time) • BRVisibilityCalculator (Computes visibilities, multi- threaded internally) • BRFFTCalculator (perform FFT on raw data - multi- threaded internally) • MonitorProc(s) (Monitoring during processing)

↔ ↔ ↔ ↔ ↔ ↔ ZThread Acquisition/visibility computation( mfacq ) T1 -ReadEternet BRVisibilityCalculator P11 P12 P13 P14 … P21 P22 P23 … P31 P32 … RAcqMemZoneMgr Fils d’exécution : EthernetReader, T3 - Monitoring VisiCalc, Monitoring … Task: PCIExpress ➠ Ethernet Ethernet PCIExpress DMA-Task

PAON4 acquisition configuration The same program runs, all the configuration, including the cluster configuration, in parameters (datacard) Operation over different nodes in streaming mode (data is pushed forward) Second layer: computes correlations - saves data to disk Network First layer:perform FFT, split in frequency bands and send to the second level Waveform data stream from receivers