modeling with machine learning
play

modeling with machine learning Kelly Kochanski NCAR Multicore - PowerPoint PPT Presentation

Oct 01, 2023 •157 likes •654 views

Accelerating Earth and climate modeling with machine learning Kelly Kochanski NCAR Multicore Workshop 2019 2014 xkcd.com/1425/ What is machine learning? What is machine learning? Machine learning at its most basic is the practice of using

  1. Accelerating Earth and climate modeling with machine learning Kelly Kochanski NCAR Multicore Workshop 2019

  2. 2014 xkcd.com/1425/

  4. What is machine learning?

  5. What is machine learning? Machine learning at its most basic is the practice of using algorithms to parse data, learn from it, and then make a determination or prediction about something in the world. Michael Copeland 2016

  6. Why is machine learning relevant to Earth System Modeling now?

  7. Current trends 1/3 Machine learning offers solutions to once-intractable problems

  10. Model for Prediction Across Scales (2015), Los Alamos National Laboratory

  11. Current trends 2/3 New data streams increase the potential power of data-driven models

  12. Microprocessor trends Karl Rupp, World Economic Forum, 2018

  13. Microprocessor trends Karl Rupp, World Economic Forum, 2018

  14. 9,216 Power9 22-core CPUs 27,648 NVIDIA Tesla V100 GPUs

  15. nvidia.com

  16. Google TensorFlow Processing Units IBM TrueNorth Chips

  17. Current trends 3/3 Machine learning is driving innovation in HPC

  18. My perspective: Climate change impacts ML in service of earth science

  19. climatechange.ai

  20. How can we use machine learning to build better Earth System Models? Image: MPAS-Ocean Los Alamos National Lab

  21. How can we use machine learning to build better Earth System Models? Aims: ● To solve long-standing problems with new methods ● To integrate new sources of data into existing models ● To take advantage of new computing hardware

  22. Monitoring marine clouds Yuan, Tianle, et al. "Automatically Finding Ship ‐ tracks to Enable Large ‐ scale Analysis of Aerosol ‐ Cloud Interactions." Geophysical Research Letters (2019).

  23. Monitoring marine clouds Watson-Parris, Duncan, et al. "Detecting anthropogenic cloud perturbations with deep learning." International Conference on Machine Learning, 2019.

  24. Improving convection + aerosol modelling

  25. Improving convection + aerosol modelling

  26. Improving convection + aerosol modelling Gentine, Pierre, et al. "Could machine learning break the convection parameterization deadlock?." Geophysical Research Letters 45.11 (2018): 5742-5751.

  27. Improving convection + aerosol modelling Rasp, S, M. S. Pritchard, and P. Gentine. "Deep learning to represent subgrid processes in climate models." PNAS (2018)

  28. Tracking extreme events Kurth, Thorsten, et al. "Exascale deep learning for climate analytics." Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis . IEEE Press, 2018.

  29. Deep learning for spatio-temporal patterns Mathieu, Michael, Camille Couprie, and Yann LeCun. "Deep multi-scale video prediction beyond mean square error." (2016)

  30. Deep learning for spatio-temporal patterns Reedster, Mogle and Bogel, ‘Monitoring and analysis of sand dune movement and growth on the Navajo Nation, Southwestern United States’ (2011) USGS Fact Sheet 3085.

  31. Deep learning for spatio-temporal patterns Simulated example Generated frame(s)

  32. Barriers to implementation

  33. Barriers to implementation Machine learning Climate science What’s exciting? Big data! Science! Objectives Well-defined is useful. Broad is interesting. Explainability Second to prediction Often the main goal Data Ideally clean and labelled Many unlabeled features Data formats Images, csv, dataframes Images, netcdf, misc Data use Integral to model Data -> theory -> model Existing code Python, R, Julia C/C++, Fortran Publications At conferences In journals

  34. Removing barriers

  35. Building climate models that are ready to learn Schneider, T., et al. "Earth system modeling 2.0: A blueprint for models that learn from observations and targeted high ‐ resolution simulations." Geophysical Research Letters (2017)

  36. Barriers to implementation Machine learning Climate science What’s exciting? Big data! Science! Objectives Well-defined is useful. Broad is interesting. Explainability Second to prediction Often the main goal Data Ideally clean and labelled Many unlabeled features Data formats Images, csv, dataframes Images, netcdf, misc Data use Integral to model Data -> theory -> model Existing code Python, R, Julia C/C++, Fortran Publications At conferences In journals

  37. Creating benchmark datasets is-geo.org/benchmarks: JPL-CH4-detection-2017-V1.0 extremeweatherdataset.github.io

  38. Barriers to implementation Machine learning Climate science What’s exciting? Big data! Science! Objectives Well-defined is useful. Broad is interesting. Explainability Second to prediction Often the main goal Data Ideally clean and labelled Many unlabeled features Data formats Images, csv, dataframes Images, netcdf, misc Data use Integral to model Data -> theory -> model Existing code Python, R, Julia C/C++, Fortran Publications At conferences In journals

  39. Running machine-learning oriented workshops

  40. Barriers to implementation Machine learning Climate science What’s exciting? Big data! Science! Objectives Well-defined is useful. Broad is interesting. Explainability Second to prediction Often the main goal Data Ideally clean and labelled Many unlabeled features Data formats Images, csv, dataframes Images, netcdf, misc Data use Integral to model Data -> theory -> model Existing code Python, R, Julia C/C++, Fortran Publications At conferences In journals

  41. Next steps

  42. Learn more about machine learning Online courses ● coursera.org/learn/machine-learning Informational blogs ● towardsdatascience.com Python tutorials ● Scikit-learn: bit.ly/sklstrata, fastai: course.fast.ai

  43. Learn more about machine learning for Earth, weather, and climate science ● McGovern, Amy, et al. Bulletin of the American Meteorological Society 98.10 (2017): 2073-2090. Using artificial intelligence to improve real-time decision-making for high-impact weather . ● Reichstein, Markus, et al. Nature 566.7743 (2019): 195. Deep learning and process understanding for data-driven Earth system science . ● Karpatne, Anuj, et al. IEEE Transactions on Knowledge and Data Engineering (2018). Machine learning for the geosciences : Challenges and opportunities. ● Gil, Y., Pierce, S. A., ... & Horel, J. (2018). Communications of the ACM , 62 (1), 76-84. Intelligent systems for geosciences : an essential research agenda. ● Rolnick, D., Donti, P., Kaack, L., Kochanski, K., et al. arXiv preprint arXiv:1906.05433 (2019). Tackling climate change with machine learning

  44. Make connections Climate Change AI climatechange.ai

  45. Make connections Climate Change AI climatechange.ai Climate Informatics climateinformatics.org

  46. Make connections _IS-GEO__ Climate Change AI Intelligent Systems and climatechange.ai Geosciences is-geo.org Climate Informatics climateinformatics.org

  47. Make connections _IS-GEO__ Climate Change AI Intelligent Systems and climatechange.ai Geosciences is-geo.org Climate Informatics AMS Committee on AI climateinformatics.org for Env. Science

  48. Thanks Greg Tucker, David Rolnick, Ghaleb Abdulla, Divya Mohan, Jenna Horrall, Priya Donti, Surya Karthik Mukkavilli, Barry Rountree, Goodwin Gibbons

  49. Questions?

Recommend

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

553 views • 27 slides
Neural Networks for Machine Learning Lecture 7a Modeling sequences: A brief overview Geoffrey

Neural Networks for Machine Learning Lecture 7a Modeling sequences: A brief overview Geoffrey

Neural Networks for Machine Learning Lecture 7a Modeling sequences: A brief overview Geoffrey Hinton Nitish Srivastava, Kevin Swersky Tijmen Tieleman Abdel-rahman Mohamed Getting targets when modeling sequences When applying machine

719 views • 34 slides
STAT 339 Probabilistic Modeling and Machine Learning 30 January 2017 Colin Reimer Dawson

STAT 339 Probabilistic Modeling and Machine Learning 30 January 2017 Colin Reimer Dawson

STAT 339 Probabilistic Modeling and Machine Learning 30 January 2017 Colin Reimer Dawson Outline Data Science and Machine Learning Types of Learning Supervised Learning Unsupervised Learning Discovering Model Complexity Course Outline

239 views • 22 slides
Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret

MACHINE LEARNING TOOLBOX Welcome to the Machine Learning Toolbox! Machine Learning Toolbox Supervised learning caret R package Automates supervised learning (a.k.a. predictive modeling ) Target variable Machine Learning Toolbox

634 views • 16 slides
Machine Learning for Healthcare HST.956, 6.S897 Lecture 19: Disease progression modeling &

Machine Learning for Healthcare HST.956, 6.S897 Lecture 19: Disease progression modeling &

Machine Learning for Healthcare HST.956, 6.S897 Lecture 19: Disease progression modeling & subtyping, Part 2 David Sontag Recap of goals of disease progression modeling Predictive: What will this patients future trajectory look

1.56k views • 51 slides
Machine Learning 2 DS 4420 - Spring 2020 Topic Modeling 2 Byron C. Wallace Last time: Topic

Machine Learning 2 DS 4420 - Spring 2020 Topic Modeling 2 Byron C. Wallace Last time: Topic

Machine Learning 2 DS 4420 - Spring 2020 Topic Modeling 2 Byron C. Wallace Last time: Topic Modeling! Word Mixtures Idea: Model text as a mixture over words (ignore order) gene 0.04 dna 0.02 genetic 0.01 .,, life 0.02

890 views • 37 slides
THE NEXT EVOLUTION OF MDE: a Seamless Integration of Machine Learning into Domain Modeling Thomas

THE NEXT EVOLUTION OF MDE: a Seamless Integration of Machine Learning into Domain Modeling Thomas

THE NEXT EVOLUTION OF MDE: a Seamless Integration of Machine Learning into Domain Modeling Thomas Hartmann*, Assaad Moawad+, Fouquet Franois* and Yves le Traon* (*) Interdisciplinary Centre for Security, Reliability and Trust University of

438 views • 32 slides
machine learning classification algorithms & Topic Modeling A quick look at 145,000 World

machine learning classification algorithms & Topic Modeling A quick look at 145,000 World

An empirical comparison of machine learning classification algorithms & Topic Modeling A quick look at 145,000 World Bank documents Olivier Dupriez, Development Data Group Slides prepared for DEC Policy Research Talk, February 27, 2018

739 views • 43 slides
An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides
Using machine learning Learning knot methods in geometric modeling placement SVM knot placement

Using machine learning Learning knot methods in geometric modeling placement SVM knot placement

Machine learning in geometric modeling Georg Umlauf Using machine learning Learning knot methods in geometric modeling placement SVM knot placement for curves SVM knot placement for skinning Georg Umlauf Learning primitive

825 views • 38 slides
Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

556 views • 17 slides
Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

872 views • 29 slides
Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides
Towards Better Crash Frequency Modeling: Fusing Machine Learning & Econometric Methods

Towards Better Crash Frequency Modeling: Fusing Machine Learning & Econometric Methods

Towards Better Crash Frequency Modeling: Fusing Machine Learning & Econometric Methods Presenter: Behram Wali Ph.D. Student TSITE 2017 Summer Meeting Morning Session July 26, 2017 Contents Background/Challenges Conceptual

693 views • 44 slides
Interactive Machine Learning via Transparent Modeling: Putting Human Experts in the Drivers

Interactive Machine Learning via Transparent Modeling: Putting Human Experts in the Drivers

Interactive Machine Learning via Transparent Modeling: Putting Human Experts in the Drivers Seat Rich Caruana Microsoft Research Joint Work with Sarah Tan & Yin Lou Johannes Gehrke, Paul Koch, Marc Sturm, Noemie Elhadad Thanks to Greg

842 views • 82 slides
Physical Modeling meets Machine Learning: Teaching Bow Control to a Virtual Violinist Graham

Physical Modeling meets Machine Learning: Teaching Bow Control to a Virtual Violinist Graham

Physical Modeling meets Machine Learning: Teaching Bow Control to a Virtual Violinist Physical Modeling meets Machine Learning: Teaching Bow Control to a Virtual Violinist Graham Percival , Nicholas Bailey , George Tzanetakis

1.12k views • 26 slides
Machine Learning for Performance and Power Modeling/Prediction Lizy K. John University of Texas

Machine Learning for Performance and Power Modeling/Prediction Lizy K. John University of Texas

PACT 2010 Machine Learning for Performance and Power Modeling/Prediction Lizy K. John University of Texas at Austin Simulation Challenges Simulation Based Performance Models eg: SimOS, SIMICS, GEM5, SimpleScalar Power modeling eg:

778 views • 39 slides
Decision Trees: Representation Machine Learning 1 Some slides from Tom Mitchell, Dan Roth and

Decision Trees: Representation Machine Learning 1 Some slides from Tom Mitchell, Dan Roth and

Decision Trees: Representation Machine Learning 1 Some slides from Tom Mitchell, Dan Roth and others Key issues in machine learning Modeling How to formulate your problem as a machine learning problem? How to represent data? Which

872 views • 38 slides
Democratizing Machine Learning and Artificial Intelligence: Probabilistic Programming with Scala

Democratizing Machine Learning and Artificial Intelligence: Probabilistic Programming with Scala

Democratizing Machine Learning and Artificial Intelligence: Probabilistic Programming with Scala Brian Ruttenberg, PhD Charles River Analytics bruttenberg@cra.com Goals of This Talk Introduce basic modeling concepts in Machine Learning and

862 views • 73 slides
Combining Machine Learning and Numerical Modeling to Transform Atmospheric Science Dr. Richard

Combining Machine Learning and Numerical Modeling to Transform Atmospheric Science Dr. Richard

Combining Machine Learning and Numerical Modeling to Transform Atmospheric Science Dr. Richard Loft* Director, Technology Development Computational and Information Systems Laboratory National Center for Atmospheric Research *with special

778 views • 46 slides
Towards More Efficient Distributed Machine Learning Jialei Wang University of Chicago ISE,

Towards More Efficient Distributed Machine Learning Jialei Wang University of Chicago ISE,

Towards More Efficient Distributed Machine Learning Jialei Wang University of Chicago ISE, NCSU, 12/13/2017 1/41 The empirical success of machine learning 2/41 The empirical success of machine learning Big Data Advanced Massive Modeling

1.27k views • 90 slides
Limitations of Threat Modeling in Adversarial Machine Learning Florian Tramr EPFL, December 19

Limitations of Threat Modeling in Adversarial Machine Learning Florian Tramr EPFL, December 19

Limitations of Threat Modeling in Adversarial Machine Learning Florian Tramr EPFL, December 19 th 2019 Based on joint work with Jens Behrmannn, Dan Boneh, Nicholas Carlini, Pascal Dupr, Jrn-Henrik Jacobsen, Nicolas Papernot, Giancarlo

498 views • 39 slides
E9 205 Machine Learning for Signal Processing ML, MAP, MMSE and Gaussian 28-08-2019 Modeling

E9 205 Machine Learning for Signal Processing ML, MAP, MMSE and Gaussian 28-08-2019 Modeling

E9 205 Machine Learning for Signal Processing ML, MAP, MMSE and Gaussian 28-08-2019 Modeling Instructor - Sriram Ganapathy (sriram@ee.iisc.ernet.in) Teaching Assistant - Prachi Singh (prachisingh@iisc.ac.in). Decision Theory (PRML Chap. 1.5)

359 views • 20 slides
CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

1/22/19 CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine Learning? A Simple Task: Recognize Obama How do you program a computer to Recognize faces? Recommend movies? Decide which web

581 views • 5 slides

More recommend