A new correlator for LOFAR l Chris Broekema l On behalf of the COBALT - PowerPoint PPT Presentation

l Netherlands Institute for Radio Astronomy COBALT A new correlator for LOFAR l Chris Broekema l On behalf of the COBALT team Chris Broekema l ASTRON / RUG / DELL NL On behalf of the COBALT team ASTRON / RUG / DELL NL

ASTRON The Netherlands Institute for radio astronomy lVerdana, 20 pts

ASTRON Mission Statement To make discoveries in radio astronomy happen, via the development of novel and innovative technologies, the operation of world-class radio astronomy facilities, and the pursuit of fundamental astronomical research.

Introduction radio astronomy (Slight Dutch bias) • First observations 1932 by Karl Jansky • Frst purpose built telescope 1937 by Grote Reber • 21 cm emission line of neutral hydrogen Predicted 1944 by van de Hulst Detected in 1951 by Ewen and Purcell (MIT) Published after confirmation by Muller and Oort • Opening Dwingeloo radio telescope in 1956 • Doppler effect (redshift) of fast moving objects shows structure of the local galaxy(1950's)

Introduction radio astronomy

LOFAR A distributed radiotelescoop

The LOFAR “Superterp”

Phased Arrays

IBM Blue Gene/P To be retired early 2014

Hardware design – Tasks 1. Receive LOFAR antenna field data l 10 GbE Ethernet; ~3 Gbps/station 2. Transpose data (ref. MPI_Alltoallv()) 3. Compute (correlate, beamform, filter, flag, etc) • Single precision floating point • Complex multiply-add 4. Forward results to storage l Storage cluster >100m, SM fibre l 10GbE or QDR Infiniband

NVIDIA Tesla K10

COBALT Preliminary design (Feb 2013) Strawman node l Dual Xeon E5 l 2x Nvidia K10 l 4x 10GbE l 2x FDR IB

First prototype Dell PowerEdge R720

First prototype Dell PowerEdge R720 PCIe

Second prototype Dell PowerEdge T620

Prototype airflow guides Note: temperatures are under full load

3D-printed prototype designed and produced by ASTRON

Final COBALT system

Current status  9 COBALT nodes operational (testing phase)  “Mass -produced ” airflow ducts/guides in place  Software development effort on schedule  Commissioning proceeding COBALT project passed performance review on 30th Aug COBALT Operational Readiness Review early December

First Fringes with COBALT November 1st 2013

Summary Or: problems faced  R720 PCIe imbalance  40 GbE ≠ 4x 10GbE  R720 doesn't fit 2x dual 10GbE  Dual port ConnectX3 IB PCIe bottleneck  Cooling issues T620 + Nvidia K10  Software optimizations → MPI stack  Accurate measuring performance/load  BUT: we are well on track to build a completely new correlator  within 12 months

Questions?

A new correlator for LOFAR l Chris Broekema l On behalf of the COBALT - PowerPoint PPT Presentation

l Netherlands Institute for Radio Astronomy COBALT A new correlator for LOFAR l Chris Broekema l On behalf of the COBALT team Chris Broekema l ASTRON / RUG / DELL NL On behalf of the COBALT team ASTRON / RUG / DELL NL ASTRON The Netherlands

BL on LOFAR An overview of the Breakthrough Listen on LOFAR International Stations program

The low frequency radio follow-up of gravitational wave merger events with LOFAR Kelly Gourdji

The magnetic fields of external galaxies observed with LOFAR David D. Mulcahy

Deep and sharp imaging with LOFAR: revealing the evolution of AGN Wendy L. Williams

ACSIS Correlator Crate Software HIA/DRAO ACSIS Correlator Crate Software Outline System

LOFAR DATA MANAGEMENT R. F. Pizzo ASTRON, December2 nd 2015 THE LOW FREQUENCY ARRAY KEY

B05 4 Global Correlator 402.06.05 R. Cavanaugh U. Illinois Chicago and Fermilab, L3 Manager,

Processing Real-Time LOFAR Processing Real-Time LOFAR Telescope Data on a Blue Gene/P Telescope

The Global Geometry of SLE Roland Friedrich MPI Roma, 10.09.2008 What is SLE? The correlator

Semi-digital programmable correlator, lab testing and prototyping

Parsa, Andrew Siemion, Dan Werthimer, Mel Wright Outline What is a correlator? Scalable

CALIBRATION AND IMAGING WITH LOFAR Emanuela Orru on behalf of the Calibration and Imaging

The Correlator for the Tianlai Experiment Jie Hao National ASIC Design Engineering Center,

Parton physics from Euclidean current-current correlator with a valence heavy quark: pion

Pulsar observations with the Effelsberg LOFAR station Masaya Kuniyoshi Max Planck Institute for

The Progress of CVN Software Correlator and Its Application Juan Zhang, Weimin Zheng, Li Tong,

showers with LOFAR Laura Rossetto 35 th ICRC July 13 th 2017 Bexco, Busan, South Korea

Singlet Contributions to the Vector Correlator Computational Theoretical Particle Physics B AC

ALMA Correlator Enhancement Study Project Status Rodrigo Amestica, Alain Baudry Ray Escoffier,

Prototype Trigger Correlator Board Multiplex inside FPGA? Digital 1A(0:7) Digital 1B(0:7) ADC

Test Driven Development: Unit-testing for the development of a Correlator-Beamformer Mpho

A Tale of Two Telescopes - Scintillation studies using LEAP and LOFAR Robert Main Olaf Wucknitz,

Outline: 2 . S c i n t i l l a t i o n a r c s o u r c e s : 2.1

The ADP: enabling access and exploitation of radio data collections through the IVOA Marco