GES DISC Data Operations and Services Mike Theobald GES DISC - PowerPoint PPT Presentation

GES DISC Data Operations and Services Mike Theobald GES DISC

Production Highlights  Completed V5.0 Reprocessing with a net rate of 13X.  Integrated V5.2 algorithms and reprocessed from start of AMSU Ch. 4 degradation.  Integrated L3 Support Algorithm  Starting to replace/upgrade some hardware

Data Production Latency NRT AIRI2CCF Latency Standard AIRI2CCF Latency 100% 100% 80% 80% 60% 60% 40% 40% 20% 20% 0% 0% 1 2 3 4 5 24 26 28 30 32 34 36 38 40 NRT vs Standard 30% 20% Standard NRT 10% 0% 0 3 6 9 12 15 18 21 24 27 30 33 36 39 Hours since Observation

Archive Highlights  S4PA archive and distribution system  6 separate servers  100 TB  8,000,000 granules  All data backed up on tape  Redundant disk copies of L0 data  Disk files and tapes verified regularly  Additional capacity is planned  Technology refresh of L0 servers underway

Archive Capacity Data Years Terabytes 20 100 Free L3 In Use L2 80 15 L1 L0 Years 60 TB 10 40 5 20 0 0 L0 L1 L2 L3 In Use Free Product Level

2008 Distribution Highlights  146 TB Net Volume  10 Million Granules  L1: 106.3 TB  L1: 2,700,000  L2: 26.4 TB  L2: 6,500,000  L3: 0.4 TB  L3: 7,000  NRT: 6.6 TB  NRT: 500,000  L0: 6.6 TB  L0: 100,000  Peak Distribution  1477 distinct network addresses  2 TB/day  50+ different top-level  220,000 granules domains

Data Distribution – Volume 2.5 L0 L1 L2 2 L3 NRT 1.5 TB 1 0.5 0 Jan Feb Mar Apr May Jun Jul Aug Sep Oct

Data Distribution – Granules 250 L0 L1 200 L2 Granules (Thousands) L3 NRT 150 100 50 0 Jan Feb Mar Apr May Jun Jul Aug Sep Oct

Volume (TB) 100 120 20 40 60 80 0 Data Distribution – by Product AIRIBRAD AIRABRAD AIRVBRAD AIRXBCAL AIRX2RET AIRX2SUP AIRI2CCF AIRX3STD AIRX2RET_NRT AIRIBRAD_NRT AIRX2SUP_NRT All Others 0 1 2 3 4 5 6 Granules (Millions)

Data Distribution – by Domain Volume (TB) Granules (Millions) 15.2 2.8 5.2 37.7 5.3 5.3 6.4 1.8 18.4 noaa.gov 1.4 umbc.edu wisc.edu nasa.gov 2.4 37.5 princeton.edu 2.6 25.3 0.3 umich.edu 1.6 ac.jp all others

Services Overview  Format conversion  Data portals  NetCDF for L2, L3  Direct ftp/http  L1 soon  Mirador  Granule and global  WHOM browse  ECHO  OPeNDAP  Science support  Subsetting  ARCTAS  Channel  CEOP  Parameter  SO2 Map