storing data
play

Storing Data Thierry Sans Modern Web Platform Client Side Server - PowerPoint PPT Presentation

Mar 03, 2024 •372 likes •475 views

Storing Data Thierry Sans Modern Web Platform Client Side Server Side Web API Database Why using a database Persistency Concurrency (avoid race conditions) Query Scalability SQL vs NoSQL databases Relational database (SQL

  1. Storing Data Thierry Sans

  2. Modern Web Platform Client Side Server Side Web API Database

  3. Why using a database • Persistency • Concurrency (avoid race conditions) • Query • Scalability

  4. SQL vs NoSQL databases

  5. Relational database (SQL database) Data structure tables and tuples Query language SQL Inconvenient not-optimized for big data analysis Advantage complex queries PostgreSQL, MySQL, MariaDB, Technology SQLite, MSSQL

  6. NoSQL database Data structure key/value pairs Query language API style Inconvenient not adequate for complex queries Advantage optimized for big data analysis Technology MongoDB, Redis, CouchDB, NeDB

  7. ORM - Object Relational Mapping ➡ Mapping between (OOP) objects and the database structure Examples • Sequelize for PostgreSQL, MySQL, MariaDB, SQLite • Mongoose for MongoDB

  8. Connecting the REST API with a database

  9. Do/Don't • Do retrieve selected elements only rather than retrieving an entire collection and filtering afterwards • Do defi ne primary keys rather than relying on auto-generated ones • Do split data into different collections rather than storing list attributes • Do create join collections whenever appropriate (only for NoSQL database without performant join feature)

  10. Retrieving collections with paginated results ➡ Only retrieve what you need from a potentially large collection Examples GET /messages[?page=0] GET /messages?page=1 GET /messages[?max=100] GET /messages?max=20

Recommend

11. Persistence The use of files, streams and serialization for storing object model data

11. Persistence The use of files, streams and serialization for storing object model data

11. Persistence The use of files, streams and serialization for storing object model data Storing Application Data Without some way of storing data off-line computers would be virtually unusable imagine a Word Processor which forced you

288 views • 16 slides
CS371m - Mobile Computing Persistence Storing Data Multiple options for storing data

CS371m - Mobile Computing Persistence Storing Data Multiple options for storing data

CS371m - Mobile Computing Persistence Storing Data Multiple options for storing data associated with apps Shared Preferences Internal Storage device memory External Storage SQLite Database Network Connection 2 Saving

1.23k views • 55 slides
Storing Data Review Data collection is an important issue Dirty data Multiple

Storing Data Review Data collection is an important issue Dirty data Multiple

Storing Data Review Data collection is an important issue Dirty data Multiple sources Data collection Data consolidation Data cleaning Data integration CMPT 354: Database I -- Storing Data 2 What Is the Next

272 views • 23 slides
Week 12 - Monday What did we talk about last time? Generics Storing data is a

Week 12 - Monday What did we talk about last time? Generics Storing data is a

Week 12 - Monday What did we talk about last time? Generics Storing data is a fundamental part of programming The Java Collections Framework (JCF) provides a rich set of libraries for storing data in different ways It is the

537 views • 20 slides
Storing and Retrieving Data Database Management Systems need to: Store large volumes of

Storing and Retrieving Data Database Management Systems need to: Store large volumes of

Storing and Retrieving Data Database Management Systems need to: Store large volumes of data Storing Data: Disks and Files Store data reliably (so that data is not lost!) Retrieve data efficiently Alternatives for storage

176 views • 6 slides
Storing Data: Disks and Database Management Systems need to: Files Store large volumes of

Storing Data: Disks and Database Management Systems need to: Files Store large volumes of

Storing and Retrieving Data Storing Data: Disks and Database Management Systems need to: Files Store large volumes of data Store data reliably (so that data is not lost!) Retrieve data efficiently Alternatives for storage

584 views • 7 slides
Data Structures and What is a data structure? Algorithms Way of storing data in computer

Data Structures and What is a data structure? Algorithms Way of storing data in computer

Introduction: Data Structures Data Structures and What is a data structure? Algorithms Way of storing data in computer so can be used efficiently Set of operations that access the data in prescribed ways Prof. Nadeem Abdul Hamid

683 views • 10 slides
Storing Data: Disks and Files Database Management System, R. Ramakrishnan and J. Gehrke 1

Storing Data: Disks and Files Database Management System, R. Ramakrishnan and J. Gehrke 1

Storing Data: Disks and Files Database Management System, R. Ramakrishnan and J. Gehrke 1 Storing and Retrieving Data v Database Management Systems need to: Store large volumes of data Store data reliably (so that data is not lost!)

538 views • 16 slides
an introduction reach1to1 - 1 / 25 what we do big data solutions for capturing, storing,

an introduction reach1to1 - 1 / 25 what we do big data solutions for capturing, storing,

an introduction reach1to1 - 1 / 25 what we do big data solutions for capturing, storing, searching and analyzing structured and unstructured data from multiple sources reach1to1 - 2 / 25 big data technology benefits cluster of low cost

466 views • 25 slides
Storing Data: Database Organization Yea, from the table of my memory Ill wipe away all

Storing Data: Database Organization Yea, from the table of my memory Ill wipe away all

Storing Data: Database Organization Yea, from the table of my memory Ill wipe away all trivial fond records. -- Shakespeare, Hamlet 340151 Big Data & Cloud Computing (P. Baumann) 1 ...Now Databases, Again Buffering

569 views • 25 slides
Data Structures + BIG-O Notation Understanding the engineering trade-offs when storing data

Data Structures + BIG-O Notation Understanding the engineering trade-offs when storing data

CSSE 220 Data Structures + BIG-O Notation Understanding the engineering trade-offs when storing data Checkout LinkedListSimple project from public git Checkout SinglyLinkedList homework from git Data Structures Efficient ways to store data

239 views • 9 slides
Checkout DataStructures from SVN Understanding the engineering trade-offs when storing data

Checkout DataStructures from SVN Understanding the engineering trade-offs when storing data

Data-structure-palooza Checkout DataStructures from SVN Understanding the engineering trade-offs when storing data Boil down data types (e.g., lists) to their essential operations Choosing a data structure for a project then becomes:

664 views • 14 slides
Hash tables Most data structures that were going to see are about storing and manipulating data

Hash tables Most data structures that were going to see are about storing and manipulating data

Hash tables Most data structures that were going to see are about storing and manipulating data When only operations Insert , Search and Delete as dictionary op- erations are needed, hash tables can be quite good Many variations of hash tables

1.04k views • 17 slides
Programming With Data One-Slide Summary A list is a data structure , a way of storing and

Programming With Data One-Slide Summary A list is a data structure , a way of storing and

Programming With Data One-Slide Summary A list is a data structure , a way of storing and organizing data. cons creates a pair of two values. car and cdr (or first and rest ) extract the first and second elements of a cons pair. A

205 views • 8 slides
Simple SQL Queries (1) Review Collecting data Storing data into databases Create

Simple SQL Queries (1) Review Collecting data Storing data into databases Create

Simple SQL Queries (1) Review Collecting data Storing data into databases Create relational tables in SQL Server 2005 Insert tuples into tables Specifying some integrity constraints CMPT 354: Database I -- Simple SQL (1)

268 views • 24 slides
Physical Data Organization and Indexing Chapter 9 1 Disks Capable of storing large

Physical Data Organization and Indexing Chapter 9 1 Disks Capable of storing large

Physical Data Organization and Indexing Chapter 9 1 Disks Capable of storing large quantities of data cheaply Non-volatile Extremely slow compared with cpu speed Performance of DBMS largely a function of the number of disk

1.35k views • 76 slides
Java I/O Department of Computer Science University of Maryland, College Park Storing Data

Java I/O Department of Computer Science University of Maryland, College Park Storing Data

CMSC 132: Object-Oriented Programming II Java I/O Department of Computer Science University of Maryland, College Park Storing Data Approaches to store file data Text files Data represented in human-readable form Example: Java

401 views • 9 slides
Storing and Processing Multi-dimensional Scientific Datasets Alan Sussman UMIACS &

Storing and Processing Multi-dimensional Scientific Datasets Alan Sussman UMIACS &

Storing and Processing Multi-dimensional Scientific Datasets Alan Sussman UMIACS & Department of Computer Science http://www.cs.umd.edu/~als Data Exploration and Analysis Large data collections emerge as important resources Data

578 views • 34 slides
Information System for storing and processing data of environmental monitoring Molorodov Y. I. 2 ,

Information System for storing and processing data of environmental monitoring Molorodov Y. I. 2 ,

Preamble Programming solution System components Technologies and production environment Results Information System for storing and processing data of environmental monitoring Molorodov Y. I. 2 , Minkov V.S. 12 , Shirshov P.E. 12 1 Novosibirsk

968 views • 47 slides
Collections Let's Take a Quick Break Organizing Data We have many ways of storing and

Collections Let's Take a Quick Break Organizing Data We have many ways of storing and

Collections Let's Take a Quick Break Organizing Data We have many ways of storing and organizing data in our programs: String s for holding sequences of characters. ArrayList s for holding sequences of general objects. Arrays for

1.07k views • 64 slides
Bitcoin SV Blockchain Dr. Craig S. Wright January 2019 Storing data on a blockchain has the

Bitcoin SV Blockchain Dr. Craig S. Wright January 2019 Storing data on a blockchain has the

Satoshi Vision: Technical Inventions & Enterprise Uses for the Bitcoin SV Blockchain Dr. Craig S. Wright January 2019 Storing data on a blockchain has the obvious advantage that a payment mechanism is built into the system. Payments can

434 views • 25 slides
Programming With Data One-Slide Summary A list is a data structure , a way of storing and

Programming With Data One-Slide Summary A list is a data structure , a way of storing and

Programming With Data One-Slide Summary A list is a data structure , a way of storing and organizing data. [a,b] creates a pair of two values. pair[0] extracts the first element of a pair. pair[1:] extracts the rest. A list is

317 views • 7 slides
Storing Data in The Client Saves information unique to users On Server: Less network

Storing Data in The Client Saves information unique to users On Server: Less network

Storing Data in The Client Saves information unique to users On Server: Less network traffic Less processing power f-iacobelli@neiu.edu Web App Dev HTML 5 Ideas behind the standard Better use of resources (for Mobile) Get

272 views • 13 slides
Storing Data: Disks and Files Module 2, Lecture 1 Yea, from the table of my memory Ill

Storing Data: Disks and Files Module 2, Lecture 1 Yea, from the table of my memory Ill

Storing Data: Disks and Files Module 2, Lecture 1 Yea, from the table of my memory Ill wipe away all trivial fond records. -- Shakespeare, Hamlet Database Management Systems, R. Ramakrishnan 1 Disks and Files DBMS stores

440 views • 27 slides

More recommend