OSM Data Processing with PostgreSQL / PostGIS Jochen Topf - PowerPoint PPT Presentation

Jun 26, 2023 •3.45k likes •4.97k views

OSM Data Processing with PostgreSQL / PostGIS Jochen Topf jochentopf.com OpenStreetMap PostgreSQL Studley Tool Chest | CC-BY-SA | https://www.flickr.com/photos/publicresourceorg/493813720 From help.openstreetmap.org What we will talk

Snapshot vs. History most use cases only need current OSM data some need history of OSM data Much more effort needed !
Use Cases
Use Cases API DB Rendering Geocoding Routing Analytics

Recommend

Introduction to Spatial Data Management with Postgis Spatial Data Management Content

Introduction to Spatial Data Management with Postgis Spatial Data Management Content Introduction Managing Spatial Data with PostGIS PostGIS Data Model Creating a PostGIS enabled Database Insert Coordinates using SQL

489 views • 27 slides

POSTGIS berblick, Tips und Tricks Stefan Keller Topics What is PostGIS? Spatial table

Swiss PGDay 2016, 24. Juni 2016, HSR Rapperswil POSTGIS berblick, Tips und Tricks Stefan Keller Topics What is PostGIS? Spatial table Example with historical data OGC queries in PostGIS Spatial Joins OGC Layers /

766 views • 48 slides

Extending PostgreSQL With Spatiotemporal Data Management Contacts: Esteban Zimanyi

Extending PostgreSQL With Spatiotemporal Data Management Contacts: Esteban Zimanyi (ezimanyi@ulb.ac.be) Mahmoud SAKR (mahmoud.sakr@ulb.ac.be) Mobility Data: PostGIS Mobility Data: Trajectories Mobility Data: Temporal Types tfloat:

693 views • 36 slides

Patterns and Packages in PostgreSQL for Privacy Preservation mantaq10 15 November 2019, Sydney

PostgreSQL, Planning, PostGIS, Partitioning, PaaS, Permissions and now. Patterns and Packages in PostgreSQL for Privacy Preservation mantaq10 15 November 2019, Sydney www.2019.pgdu.org Atif Rahman I was like her According to Pearson-R

508 views • 24 slides

PostGIS Feature Frenzy!!! Wednesday, September 16, 15 frenzy because state of postgis

P AUL R AMSEY PRESENTS .... PostGIS Feature Frenzy!!! Wednesday, September 16, 15 frenzy because state of postgis talks only covered leading edge, nothing covering all the good features already there frenzy because our standard 20-25

1.68k views • 142 slides

Hacking PostgreSQL with Eclipse Metin Dl metin@citusdata.com PGCONF.EU 2017 1

Hacking PostgreSQL with Eclipse Metin Dl metin@citusdata.com PGCONF.EU 2017 1 Motivation Postgres cant do everything You can extend it Eclipse makes it easy 2 Extensions postGIS - Spatial and Geographic objects pg_cron - Run

376 views • 19 slides

PostgreSQL A Platform for Multiple Sources Data Retrieval 3 rd ICTVET UNP Bukittingi, 16-17 Oct

PostgreSQL A Platform for Multiple Sources Data Retrieval 3 rd ICTVET UNP Bukittingi, 16-17 Oct 2015 Abdul Yadi abdulyadi.wordpress.com Software Developer, Datatrans Informatika Front End: GWT, Sencha GXT Database: PostgreSQL data data

745 views • 22 slides

Service 1 Service 2 Service 3 Postgresql/ MySQL Postgresql/ MySQL Data size: ~100GB to a few

Service 1 Service 2 Service 3 Postgresql/ MySQL Postgresql/ MySQL Data size: ~100GB to a few TB Latency: very fast since it was in a real DB Applications: Amazon S3 EMR Kafka 7 ETL/ Modelling City Ops Machine Learning

1.01k views • 58 slides

PostgreSQL As Data Integration Tool PostgreSQL SQL-MED pgDay Paris 2019/03/12 Stefanie Janine

PostgreSQL As Data Integration Tool PostgreSQL SQL-MED pgDay Paris 2019/03/12 Stefanie Janine Stlting @sjstoelting mail@stefanie-stoelting.de SQL/MED First defined in ISO/IEC 9075-9:2008, revised by ISO/IEC 9075-9:2016 Supported by DB2

694 views • 45 slides

Magical PostGIS In 3 Brief Movements Friday, September 18, 15 Friday, September 18, 15 thanks

Magical PostGIS In 3 Brief Movements Friday, September 18, 15 Friday, September 18, 15 thanks to the good folks at cartodb for employing me and letting me work on PostGIS. like a lot of SaaS companies, cartodb has a strong open source ethic

1.73k views • 139 slides

PostgreSQL Who, What, When, Where, Why, How? 1 QUIS? Who's involved with PostgreSQL? Core

PostgreSQL Who, What, When, Where, Why, How? 1 QUIS? Who's involved with PostgreSQL? Core team: https://www.postgresql.org/community/contributors/ Large Users: https://www.postgresql.org/about/users/ Case Studies:

517 views • 7 slides

Hacking PostgreSQL Stephen Frost Crunchy Data stephen@crunchydata.com FOSDEM 2019 February 3,

Hacking PostgreSQL Stephen Frost Crunchy Data stephen@crunchydata.com FOSDEM 2019 February 3, 2019 PostgreSQL Source Code Hacking PostgreSQL Final Code PostgreSQL Subsystems Hacking the PostgreSQL Way Stephen Frost Chief Technology

783 views • 37 slides

Hacking PostgreSQL Stephen Frost Crunchy Data stephen@crunchydata.com PGConf.EU 2018 October

Hacking PostgreSQL Stephen Frost Crunchy Data stephen@crunchydata.com PGConf.EU 2018 October 24, 2018 PostgreSQL Source Code Hacking PostgreSQL Final Code PostgreSQL Subsystems Hacking the PostgreSQL Way Stephen Frost Chief Technology

1.12k views • 36 slides

Distributed Computing on PostgreSQL Marco Slot <marco@citusdata.com> Small data

Distributed Computing on PostgreSQL Marco Slot <marco@citusdata.com> Small data architecture Big data architecture Big data architecture using postgres Real-time analytics Messaging Records Data warehouse PostgreSQL is a perfect

746 views • 41 slides

PostgreSQL SQL-MED Ibrar Ahmed Senior Software Engineer @ Percona PostgreSQL Consultant What?

PostgreSQL SQL-MED Ibrar Ahmed Senior Software Engineer @ Percona PostgreSQL Consultant What? Is an relational database Licence PostgreSQL: Released under the PostgreSQL management system (RDBMS) License. (Similar to the BSD or MIT)

232 views • 10 slides

Crunchy Data PostgreSQL Operator September 2017 Crunchy Data Commitment to Community and Open

Crunchy Data PostgreSQL Operator September 2017 Crunchy Data Commitment to Community and Open Source Emphasis on Data Security and Compliance PostgreSQL for Public, Private and Hybrid Cloud 5 What is an Operator? 3 Operator Basics

1.36k views • 33 slides

Data Masking and Anonymization for PostgreSQL 1 The Anonymization Challenge 8 Strategies

Data Masking and Anonymization for PostgreSQL 1 The Anonymization Challenge 8 Strategies PostgreSQL Anonymizer The Future 2 3 My Story 4 LETS DO THIS ! jailer pgantomizer ARX pgsync anomyze-it anonymizer mat2 Talend open

1.12k views • 77 slides

performance analysis of mongodb vs. postgis/postgresql databases for Why do we need a Internet

Line Intersection and Point Containment Spatial Queries Sarthak Agarwal, KS Rajan September 16, 2015 Lab for Sptial Informatics International Institute of Information Technology Hyderabad FOSS4G Seoul, South Korea performance analysis of

884 views • 15 slides

Week 03 Lectures PostgreSQL Buffer Manager 1/95 PostgreSQL buffer manager: provides a shared

Week 03 Lectures PostgreSQL Buffer Manager 1/95 PostgreSQL buffer manager: provides a shared pool of memory buffers for all backends all access methods get data from disk via buffer manager Buffers are located in a large region of shared

505 views • 25 slides

PostgreSQL Provider The PostgreSQL provider gives the ability to deploy and congure resources

PostgreSQL Provider The PostgreSQL provider gives the ability to deploy and congure resources in a PostgreSQL server. Use the navigation to the left to read about the available resources. Usage provider "postgresql" { host

242 views • 12 slides

Evolving towards Postgres David Steele Crunchy Data PostgresOpen September 13, 2019 Agenda 1

Evolving towards Postgres David Steele Crunchy Data PostgresOpen September 13, 2019 Agenda 1 Introduction 2 What is the PostgreSQL Ecosystem? 3 Ignoring PostgreSQL 4 Contributing to PostgreSQL Choosing a Language 5 Challenges 6

435 views • 16 slides

Protecting the Planet with PostGIS How we are calculating complex protected area coverage

Protecting the Planet with PostGIS How we are calculating complex protected area coverage statistics for all countries in the world. Miguel Torres, Data Manager, UNEP-WCMC Managing WCMC Information Protected Planet All Protected Areas of the

756 views • 28 slides

PostgreSQL and Omics Data How omics data can be stored in postgres database Postgr tgreSQ eSQL

PostgreSQL and Omics Data How omics data can be stored in postgres database Postgr tgreSQ eSQL L SF F Day Jan 2020 Anson Abraham Data Architect at Envisagenics Inc. Omics Predicted to be biggest of big data by 2025 Omics Astronomy

380 views • 24 slides

Introducing LSM-tree into PostgreSQL, making it as a data gobbler By Shichao Jin From

Introducing LSM-tree into PostgreSQL, making it as a data gobbler By Shichao Jin From https://zhuanlan.zhihu.com/p/56259025 About Me 8 years experience in DBMS R&D Redshift AWS and Facebook RocksDB Ex-PhD student at UWaterloo

386 views • 25 slides