A Machine Learning Pipeline for Drought Prediction Tommy Lees , - PowerPoint PPT Presentation

Aug 30, 2023 •164 likes •291 views

A Machine Learning Pipeline for Drought Prediction Tommy Lees , Gabriel Tseng , Alex Hernandez-Garcia, Clement Atzberger, Simon Dadson, Steven Reece @tommylees112, @gabrieltseng tommylees112, gabrieltseng Agricultural drought is a significant

A Machine Learning Pipeline for Drought Prediction Tommy Lees , Gabriel Tseng , Alex Hernandez-Garcia, Clement Atzberger, Simon Dadson, Steven Reece @tommylees112, @gabrieltseng tommylees112, gabrieltseng
Agricultural drought is a significant global problem, and is getting worse. $29 billion in losses to developing world agriculture between 2005 and 2015
Kenya distributes emergency funds using a vegetation index, mitigating the impact of droughts.
We sought a machine-learning based approach to forecast vegetation health. “Information on certain parameters is not only difficult to access … [we also] lack understanding of the different physical processes. This has led to the widespread use and development of data-driven models over process- based models ” Anshuka et. al. 2019
There is friction in applying machine learning to drought forecasting Going from climate data formats (e.g. NetCDF) A very large input space (above: ERA5 land and storage conventions to something which a variables from the Copernicus Climate Data machine learning model can ingest Store)
Our pipeline* aimed to reduce this friction Turn it into machine learning-ready data Plug and play machine Dataset selection and integration learning models *https://github.com/ml-clim/drought-prediction
We used it with the following datasets and models: Copernicus Climate Data Store ERA5 Climate Reanalysis data Persistence Baseline Linear Regression Climate Hazards Group InfraRed Precipitation data (CHIRPS) Linear Neural Network LSTM Global Land Evaporation Amsterdam Model Entity-Aware LSTM Evapotranspiration and Soil Moisture CGIAR-CSI Shuttle Radar Topography Mission Data
Using this pipeline, we were able to achieve results competitive with SOTA to predict vegetation health in Kenya. * * Our predictions are much more spatially granular (pixel wise vs. district wide) than the current SOTA. In order to make models comparable we downscale our predictions to district-level and compare results at this scale. Here we show a table of results for four arid counties in the North of Kenya.
We have started using trained models to investigate the relationships between vegetation health and weather. Lake Turkana
This is how our models need to improve to become operationally useful.
https://github.com/ml-clim/drought-prediction

Recommend

1 Dont Make Me Get Non -Linear! A Grounding Example: Linear Regression Predict

What is Machine Learning? A (Very Short) List of Applications Many different forms of Machine Learning Machine learning widely used in many contexts We focus on the problem of prediction Stock price prediction o Using economic

262 views • 3 slides

Machine Learning pipeline wit ith R Contributions to whiteboxing machine learning for

Towards an Enterprise grade Machine Learning pipeline wit ith R Contributions to whiteboxing machine learning for interoperation with production environments Thomas.Strehl@at.ibm.com Thomas.Weinrich@at.ibm.com Rudolf.Pailer@at.ibm.com @20200120

858 views • 58 slides

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides

Indigenous Knowledge Aware Drought Monitoring, Forecasting and Prediction using Deep Learning

Indigenous Knowledge Aware Drought Monitoring, Forecasting and Prediction using Deep Learning Techniques Kidane W. Degefa kidane1982@gmail.com [or] kidane.woldemariyam@haramaya.edu.et Lecturer and Researcher at Haramaya Univeristy (Ethiopia)

299 views • 8 slides

AMR and machine-learning Prediction of AMR from metagenomes among other things Finlay Maguire

AMR and machine-learning Prediction of AMR from metagenomes among other things Finlay Maguire finlaymaguire@gmail.com December 3, 2019 Faculty of Computer Science, Dalhousie University Table of contents 1. Genomic Phenotype Prediction 2.

908 views • 77 slides

Scaled Machine Learning at Matroid Reza Zadeh @Reza_Zadeh | http://reza-zadeh.com Machine Learning

Scaled Machine Learning at Matroid Reza Zadeh @Reza_Zadeh | http://reza-zadeh.com Machine Learning Pipeline Learning Replicate Algorithm model Data Trained Serve Model Model Repeat entire pipeline Scaling Machine Learning Datasets and

890 views • 21 slides

Machine Learning Methods for Metabolic Pathway Prediction Joseph M. Dale, Liviu Popescu, and

PathoLogic Machine Learning Methods for Prediction Evaluation Conclusions and Future Directions Machine Learning Methods for Metabolic Pathway Prediction Joseph M. Dale, Liviu Popescu, and Peter D. Karp Pathway Tools Workshop August 27, 2009

590 views • 26 slides

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 12 Outline 1 Nearest Neighbor Prediction 2 Complexity Considerations 3 The Voronoi Diagram 4 Overfitting

564 views • 12 slides

Automatically Explaining Machine Learning Prediction Results: A Demonstration on Type 2 Diabetes

Automatically Explaining Machine Learning Prediction Results: A Demonstration on Type 2 Diabetes Risk Prediction Gang Luo Department of Biomedical Informatics and Medical Education University of Washington luogang@uw.edu Clinical Big Data

437 views • 19 slides

Stealing Machine Learning Models via Prediction APIs Florian Tramr, Fan Zhang, Ari Juels,

Stealing Machine Learning Models via Prediction APIs Florian Tramr, Fan Zhang, Ari Juels, Michael K. Reiter, Thomas Ristenpart Usenix Security Symposium Austin, Texas, USA August, 11 th 2016 Machine Learning (ML) Systems (1) Gather labeled

213 views • 17 slides

A Deep Learning Pipeline for Patient Diagnosis Prediction Using Electronic Health Records BIOKDD

A Deep Learning Pipeline for Patient Diagnosis Prediction Using Electronic Health Records BIOKDD 2020 19th International Workshop on Data Mining in Bioinformatics Leopold Franz, Dr. Yash Raj Shrestha, Dr. Bibek Paudel 1 | | 29.05.2020

502 views • 23 slides

GPU Accelerated Machine Learning for Bond Price Prediction Venkat Bala Rafael Nicolas Fermin

GPU Accelerated Machine Learning for Bond Price Prediction Venkat Bala Rafael Nicolas Fermin Cota Motivation Primary Goals Demonstrate potential benefjts of using GPUs over CPUs for machine learning Exploit inherent parallelism to

405 views • 24 slides

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni de Paula Lourenco, Jorge Piazentin Ono, Kyunghyun Cho, Claudio Silva, Juliana Freire International Workshop on Automatic Machine Learning, ICML,

741 views • 28 slides

AlphaD3M Machine Learning Pipeline Synthesis Iddo Drori, Yamuna Krishnamurthy, Remi Rampin, Raoni

421 views • 26 slides

What can Statistical Machine Translation teach Neural Machine Translation about Structured

What can Statistical Machine Translation teach Neural Machine Translation about Structured Prediction? Graham Neubig @ ICLR Workshop on Deep Reinforcement Learning Meets Structured Prediction 5/6/2019 Types of Prediction Types of

1.73k views • 127 slides

Structured Prediction via Implicit Embeddings Alessandro Rudi Imaging and Machine Learning, April

Structured Prediction via Implicit Embeddings Alessandro Rudi Imaging and Machine Learning, April 1st, Paris Inria, cole normale suprieure In collaboration with: Carlo Ciliberto, Lorenzo Rosasco, Francis Bach Structured Prediction 1

811 views • 49 slides

Peer Prediction Mechanisms and their Connections to Machine Learning Jens Witkowski ETH

Peer Prediction Mechanisms and their Connections to Machine Learning Jens Witkowski ETH Zurich Game Theory Meets Computational Learning Theory Dagstuhl June 22, 2017 Joint work with David C. Parkes (Harvard) and Rafael Frongillo

831 views • 16 slides

Decision Trees Aarti Singh Machine Learning 10-701/15-781 Oct 6 , 2010 Learning a good

Decision Trees Aarti Singh Machine Learning 10-701/15-781 Oct 6 , 2010 Learning a good prediction rule Learn a mapping Best prediction rule Hypothesis space/Function class Parametric classes (Gaussian, binomial etc.)

635 views • 38 slides

DART: A Machine Learning Approach to Trajectory Prediction and Demand Capacity Balancing

DART: A Machine Learning Approach to Trajectory Prediction and Demand Capacity Balancing SESAR Belgrade, Serbia November 28 30 2017 Pablo Costas DART DART Project DART: Data driven Aircraft Trajectory prediction Research

229 views • 20 slides

Prediction without probability: a PDE approach to a model problem from machine learning Robert V.

Prediction without probability: a PDE approach to a model problem from machine learning Robert V. Kohn Courant Institute, NYU Joint work with Kangping Zhu (PhD 2014) and Nadejda Drenska (in progress) Mathematics for Nonlinear Phenomena:

924 views • 44 slides

Machine Learning Fall 2017 Structured Prediction (structured perceptron, HMM, structured SVM)

Machine Learning Fall 2017 Structured Prediction (structured perceptron, HMM, structured SVM) Professor Liang Huang (Chap. 17 of CIML) Structured Prediction x x the man bit the dog the man bit the dog x x DT NN

672 views • 27 slides

The Physics of Great Plains Drought: Its Predictability and Its Changed Risk in a Warmer World

The Physics of Great Plains Drought: Its Predictability and Its Changed Risk in a Warmer World Martin Hoerling and Ben Livneh 1 Are Droughts and Rainfall Deficits Synonymous? 1988 2012 Flash Drought Data: NOAA NCEI Is The Drought Prediction

376 views • 35 slides

Machine Learning Methods for Mortality Prediction in Patients with ST Elevation Myocardial

Machine Learning Methods for Mortality Prediction in Patients with ST Elevation Myocardial Infarction J. Vomlel 1 , H. Kru k 2 , P. T uma 2 , J. P cek 3 , and M. Hutyra 3 z re 1 Institute of Information Theory and Automation (

1.1k views • 60 slides