CLASS Access 2015 NOAA Satellite Conference, April 27 May 1, 2015 - PowerPoint PPT Presentation

NOAA’s National Centers for Environmental Information CLASS Access 2015 NOAA Satellite Conference, April 27 – May 1, 2015 NOAA Satellite and Information Service | National Centers for Environmental Information

Key Discussion Points • CLASS’s role verses NCEI’s role • Current plans for future access • Datasets in CLASS • Access statistics and patterns • Users accessing data • Levels of data access in CLASS 2 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS Role vs. NCEI Role • Comprehensive Large Array-data Stewardship System (CLASS) is managed by the NESDIS Office of Satellite Ground Services (OSGS). CLASS’s current responsibilities include ingest, management, archival and access to its information holdings. • NOAA’s National Centers for Environmental Information (NCEI), in addition to providing similar services as CLASS, are responsible for data stewardship and user support of all information holdings in CLASS and in NCEI. 3 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS’s Evolution to an Enterprise Archival Storage System Future CLASS (in red) Present CLASS Access Services Climate . Ordering Discovery Gov Dissemination Preservation Planning Pre-ingest Services Services Access Satellite Commercial Interface Data Cloud P C Data Gateway Services R O Managemen NOAA requests t Private O N Interface Interface Cloud Enterprise Ingest D S Model Data Diss. Services Ingest Access Gateway Archival U U C M results Storage System Direct Archival Delivery E E Storage Data R R Insitu Gateway Web Admin. Accessible Administration Folders Interface Administration and Preservation 4 4 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS M2M Interface CLASS Frontend (Web) Users CLASS Backend CLASS Middleware NCEI- NC Users Machine-to- Machine AccessService CLASS Core NCEI- CO Interface (SOAP-based System (RESTful Services) Users Services) NCEI- MD Users The M2M API implements a set of RESTful web services for searching, ordering, and order status querying of CLASS’s information holdings. 5 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

What Data can be Accessed? • There are 80 data families in CLASS. • Each family of data may contain many data types. • Altogether there are 300 datasets in CLASS accessible through its web interface. • The most popular are the original radiance datasets from GOES, POES, and S-NPP. 6 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Most Popular Datasets Satellite/instruments Period of record Volume archived S-NPP VIIRS xDRs 2012 to current 4400 TB GOES GVAR and pre-GVAR 1979 to current 335 TB Imager datasets POES/MetOp AVHRR and 1978 to current 116 TB ATOVS Level 1b datasets MetOp IASI datasets 2007 to current 109 TB 7 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Most Popular Datasets by Volume* *Based on ad hoc orders from Jan 2013 to Mar 2015 VIIRS-SDRs GOES GVAR AVHRR IASI L 1C 23 CLASS data families with over 2 TB delivered 8 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Access Statistics by File Age Based on orders placed from Jan 2013 to Dec 2014 9 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Monthly Totals (TB) Accessed Subscriptions Ad Hoc Orders S-NPP compression began 10 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Total Archive Growth in CLASS Total archive volume in CLASS is around 11.5 PB S-NPP Launched Oct 2011 11 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Who are the users of CLASS? 12 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

How do I access data from CLASS? Step 1: Register for a user id account at www.class.noaa.gov (minimal information: your name, e- mail address, a password) Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region, start/end dates and times, and data types). Step 4: Determine if you need greater access or a subscription Note: Always provide your user ID when contacting the CLASS helpdesk 13 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Levels of Access Services (1) CLASS order types: Average Average File Limit Contact the CLASS completion time Help Desk? Ad hoc orders Usually within 12 to Up to 500 files No (Use Search button to 24 hours obtain inventory) Large orders 24 to 48 hours 1000 to 3000 No (use Quick Search button to skip inventory ) Block orders > 48 hours 3000 to 6000 Yes (use Quick Search button) Subscription < 6-7 hours No limit Yes (standing orders) 14 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Subscription Delivery Times 15 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Levels of Access Services (2) CLASS provides daily tar files containing publicly available S-NPP products (excluding the Raw Data Records) for easy anonymous FTP download at: ftp://ftp-npp.class.ngdc.noaa.gov/ • Most recent 85 days • 76 datatypes (including Geolocation files) • Data are compressed and “tar”-ed by datatype • Sorted by date/instrument-processing level/product • Includes manifest files (xml format) • No registration required 16 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Assistance and Support For technical questions regarding access in CLASS: class.help@noaa.gov axel.graumann@noaa.gov Tutorial on using CLASS: SNPP Access tutorial - on CLASS Home Page in the News section Please see me for a hands on overview of CLASS website! 17 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION