AN ANTAR ARES: Making aking real eal-ti time astr trono nomy y with th LS LSST possible MO MONIKA NIKA D. SO SORAISAM NATIONAL OPTICAL ASTRONOMY OBSERVATORY LSST2018 PROJECT AND COMMUNITY WORKSHOP, AUG 16
ARIZONA-NOAO TEMPORAL ANALYSIS & RESPONSE to EVENTS SYSTEM NOAO: Abi Saha, Tom Matheson, Chien-Hsiu Lee, Monika Soraisam (soraisam@noao.edu), Carl Stubens (cstubens@noao.edu), Adam Scott, Glenn Eychanner STScI: Gautham Narayan (Lasker Fellow; gnarayan@stsci.edu) University of Arizona: Rick Snodgrass, John Kececioglu, Carlos Scheidegger Grads & Undergrads: Zhe Wang, Zhenge Zhao, Eric Welch, Navdeep Singh, Eric M. Evans, Songzhe Zhu, Daniel Muthukrishna (Cambridge)
Time Domain Astronomy (TDA) – then, now • TDA has been historically driven by visual/human Issues: inspection to find a particular class of objects prone to errors, irreproducible, limited by data rate, • Current wide-field surveys rely on it as well … LSST2018: Following-up LSST Alerts, Aug 16
Time Domain Astronomy (TDA) – then, now, near future • TDA has been historically driven by visual/human Issues: inspection to find a particular class of objects prone to errors, irreproducible, limited by data rate, • Current wide-field surveys rely on it as well … • LSST: • colossal volume of data, an astronomic alert Follow-up resources rate (≈ 10 million/night, 1 image/40 secs) available to the entire astronomical • Community’s diverse follow-up interests, e.g., community no rare/novel events, known unknowns,… match for the LSST alert rate • Rare short-lived alerts necessitate prompt follow-up LSST2018: Following-up LSST Alerts, Aug 16
Time Domain Ecosystem • Alert generators: difference imaging, real/bogus classification, moving object assessment • Brokers: manage the alert flow, winnowing down to the most interesting lot Ø characterize alerts automatically Ø distribute to interested parties Ø (can) interface with TOMs to trigger rapid follow-up of transient alerts LSST2018: Following-up LSST Alerts, Aug 16
LSST 1,000 images / night Updated Calibration Thumbnails daily Data Alert Simulator INGEST ANTARES DOES ANTARES DOES Measurement Initial Up to 10,000 alerts / image Camera Alerts Recalibration Ingest ANTARES Alert Existing Throttling Catalogs NOT quarterly Thumbnail Periodic Separation Queries Aggregated AstroObject AstroObject Catalogs Aggregated Locus Locus-Aggregated New Aggregated ASSOCIATE & Alert AstroObject Catalogs (curated) Aggregation Annotated Alerts AstroObject Association AstroObject Catalogs (curated) forking Identification (curated) • ingest alerts generated outside External Alert AstroObject- Ingestion Associated Alerts Other Derive External ANTARES Features Alerts Feature Feature Algorithms Evaluation (curated) Touchstone (curated) Touchstone • perform difference imaging Theorists Touchstone (curated) Characterization (curated) Extended Alerts Algorithms (curated) FEATURIZE and identification of sources Theoretical forking Alert Predictions Characterization Taxonomy of Characterizations • annotate alerts with their history (curated) 1,000 / image Characterized Alerts on images Moving and external contextual data from Position Objects Estimation Initial Filtering (curated) start at image diverted acquisition alerts 100 / image associated astro-object Filtering Moving Level I Alerts Algorithm Trees Object Vetting (curated) Identification Professionals, Advanced Feature Evaluation, citizen scientists Characterization and Filtering • real-bogus assessment of diverted 1.0 / image FILTER Level II Alerts alerts the source • derive features for the alert & Alert Replica compare against the ‘Touchstone’ Coalescing FILTER Combo Assembly forking • moving object identification • filter/rank the alerts Combo Replicas Selected Alert Replicas Combo Feature Evaluation Advanced Feature Evaluation FILTER • follow-up coordination Combo Coalescing • distribute novel alerts, while the rest are stored with their added values Annotated Coalesced Alert in the LADB External Ultra Characterization & Annotated Alert Filtering Coalesced Brokers Alerts Rarest Alerts NOVEL Researchers Alert Routing and public ALERTS LSST2018: Following-up LSST Alerts, Aug 16 0.1 / image Novel Alerts 100 / night black = us “Rarest of the Rare” green = not us 23 Nov 2016 blue = catalog by-products red = alert flow
ANTARES STATUS • Functional prototype being hosted at the cluster at Arizona UITS • Basic architecture design implemented, robust system API • Astro-object catalogs covering wide range of wavelengths (2MASS, ALLWISE, NED, Chandra, Gaia DR1, Galex, SDSS, etc.) • Improved front-ends: web-based front-end Alert Viewer , including data provenance support ( DAFCAA ) • w.r.t ZTF MSIP alert stream, ANTARES can: • connect to ZTF Kafka stream, ingest ZTF .avro formatted data • run alert processing pipeline on ZTF alerts • detect interesting objects automatically LSST2018: Following-up LSST Alerts, Aug 16
LSST2018: Following-up LSST Alerts, Aug 16
Data provenance LSST2018: Following-up LSST Alerts, Aug 16
Data provenance LSST2018: Following-up LSST Alerts, Aug 16
LSST 1,000 images / night Updated Calibration Thumbnails daily Alert Data Simulator Measurement Initial Up to 10,000 alerts / image Camera Alerts Recalibration Ingest ANTARES Alert Existing Throttling Catalogs quarterly Thumbnail Periodic Separation Queries Aggregated AstroObject AstroObject Catalogs Aggregated Locus New AstroObject Catalogs Aggregated & Alert Locus-Aggregated AstroObject (curated) Annotated Alerts Aggregation AstroObject Catalogs (curated) Association Identification (curated) forking AstroObject- External Alert Ingestion Associated Alerts Other Derive External Features Alerts Feature Feature Algorithms Evaluation (curated) Touchstone Touchstone Theorists (curated) Touchstone (curated) Characterization (curated) Extended Alerts Algorithms (curated) Theoretical forking Alert Predictions Characterization Taxonomy of Characterizations (curated) 1,000 / image Characterized Alerts Moving Position Objects Estimation Initial Filtering (curated) start at image acquisition diverted 100 / image alerts Level I Alerts Filtering Moving Algorithm Object Trees Vetting (curated) Identification Professionals, citizen scientists Advanced Feature Evaluation, Characterization and Filtering diverted 1.0 / image alerts Level II Alerts Alert Replica Coalescing Combo Assembly forking Combo Replicas Selected Alert Replicas Combo Feature Evaluation Advanced Feature Evaluation Combo Coalescing Annotated Coalesced Alert Ultra Characterization & Annotated External Filtering Coalesced Alert Brokers Alerts Rarest Alerts Researchers Alert Routing and public 0.1 / image Novel Alerts 100 / night black = us “Rarest of the Rare” green = not us 23 Nov 2016 blue = catalog by-products red = alert flow LSST2018: Following-up LSST Alerts, Aug 16
ANTARES API • ANTARES will accept custom filters from the community. • Filters determine which alerts are distributed in real-time to downstream consumers. • The ANTARES API will define how astronomers will write their filters and what data they have access to. (API documentation coming soon…) LSST2018: Following-up LSST Alerts, Aug 16
LSST2018: Following-up LSST Alerts, Aug 16
SUMMARY • ANTARES strives to serve as a community alert broker for large-scale optical time- domain surveys (LSST, ZTF). • Community involvement will be a big factor for success of brokering • or brokering of success for time-domain efforts. LSST2018: Following-up LSST Alerts, Aug 16
Recommend
More recommend
