loading and manipulating data
play

Loading and Manipulating Data Thomas J. Leeper Department of - PowerPoint PPT Presentation

Jan 17, 2023 •281 likes •580 views

Loading Data Basic Data Summaries Data Manipulation Loading and Manipulating Data Thomas J. Leeper Department of Political Science and Government Aarhus University November 14, 2013 Loading Data Basic Data Summaries Data Manipulation

  1. Loading Data Basic Data Summaries Data Manipulation Loading and Manipulating Data Thomas J. Leeper Department of Political Science and Government Aarhus University November 14, 2013

  2. Loading Data Basic Data Summaries Data Manipulation

  3. Loading Data Basic Data Summaries Data Manipulation Loading Data 1 2 Basic Data Summaries Data Manipulation 3

  4. Loading Data Basic Data Summaries Data Manipulation Loading Data 1 2 Basic Data Summaries Data Manipulation 3

  5. Loading Data Basic Data Summaries Data Manipulation Data as Dataframe Typically use data in a “dataframe” Not restricted to one dataframe at a time Functions to load data all create a dataframe Statistical functions accept vectors or dataframes

  6. Loading Data Basic Data Summaries Data Manipulation Try on your own Understand dataframe objects: “Dataframe Structure” “Rearranging Dataframes”

  7. Loading Data Basic Data Summaries Data Manipulation Questions so far?

  8. Loading Data Basic Data Summaries Data Manipulation Loading Data There’s no “open” button A functions for each file format: CSV: read.csv TSV: read.delim Stata: read.dta (from foreign ) SPSS: read.spss (from foreign ) Almost anything can be loaded

  9. Loading Data Basic Data Summaries Data Manipulation Try on your own Understand dataframe objects: Do the “Loading Data” Tutorial

  10. Loading Data Basic Data Summaries Data Manipulation Questions so far?

  11. Loading Data Basic Data Summaries Data Manipulation Summary Statistics Lots of built-in functions to summarize data One important function: summary

  12. Loading Data Basic Data Summaries Data Manipulation Try on your own Understand basic data summaries: “Univariate data summaries” “Correlations”

  13. Loading Data Basic Data Summaries Data Manipulation Summary Tables Tabulation is easy with table Creates univariate tables and cross-tables Tables are objects (of class “table”), so we can work with them like any other object

  14. Loading Data Basic Data Summaries Data Manipulation Try on your own Understand tabulation and cross-tabulation: “Tabulation”

  15. Loading Data Basic Data Summaries Data Manipulation Summary Plots Visualization is one of R’s greatest strengths One important function: plot Many other functions for specific types of plots Basic plots look okay Plots can be made beautiful with a little work

  16. Loading Data Basic Data Summaries Data Manipulation Try on your own Understand basic plots: “Summary plots” “Plotting colors”

  17. Loading Data Basic Data Summaries Data Manipulation Questions so far?

  18. Loading Data Basic Data Summaries Data Manipulation Loading Data 1 2 Basic Data Summaries Data Manipulation 3

  19. Loading Data Basic Data Summaries Data Manipulation Recoding vectors Recoding is all about indexing Several different ways to do it. The car package has a nice function: recode : outvec <- recode(invec, "old1=new1; old2=new2; else=NA")

  20. Loading Data Basic Data Summaries Data Manipulation Try on your own Understand recoding: “Vector recoding”

  21. Loading Data Basic Data Summaries Data Manipulation Questions so far?

  22. Loading Data Basic Data Summaries Data Manipulation Scale Construction Vectorization makes scaling easy Use the usual operators: + - * / ˆ Convenience functions for sums and means

  23. Loading Data Basic Data Summaries Data Manipulation Try on your own Understand scale construction: “Basic Scale Construction”

  24. Loading Data Basic Data Summaries Data Manipulation Questions so far?

  25. Loading Data Basic Data Summaries Data Manipulation Missing Data R has one missing data value: NA Best to handle missing data during preprocessing

  26. Loading Data Basic Data Summaries Data Manipulation Try on your own Understand Missing Data: “Missing Data” “Handling Missing Data” “Multiple Imputation”

  27. Loading Data Basic Data Summaries Data Manipulation Questions so far?

Recommend

Reconciling the Payroll Ledger June 18, 2019 Basics of Manipulating Data Reconciliation

Reconciling the Payroll Ledger June 18, 2019 Basics of Manipulating Data Reconciliation

Reconciling the Payroll Ledger June 18, 2019 Basics of Manipulating Data Reconciliation Based on Job Code Balancing to the General Ledger Specific Reconciliation by Employee Basics of Manipulating Data In Data Warehouse EZ Access:

250 views • 10 slides
Presentation is loading The Latency Problem 100 ms Average : 9,3s Loading -1% Revenue The

Presentation is loading The Latency Problem 100 ms Average : 9,3s Loading -1% Revenue The

The Cache Sketch: Revisiting Expiration-based Caching in the Age of Cloud Data Management Felix Gessert, Michael Schaarschmidt, Wolfram Wingerath, Steffen Friedrich, Norbert Ritter gessert@informatik.uni-hamburg.de Presentation is loading

1.13k views • 43 slides
Handling Missingness Manipulating Time Series Data in R: Case Studies Missingness &gt; citydata

Handling Missingness Manipulating Time Series Data in R: Case Studies Missingness &gt; citydata

MANIPULATING TIME SERIES DATA IN R: CASE STUDIES Handling Missingness Manipulating Time Series Data in R: Case Studies Missingness &gt; citydata citydata pop 1980-01-01 562994 1981-01-01 564179 1982-01-01 565361 570000 1983-01-01 565491

187 views • 14 slides
Hash tables Most data structures that were going to see are about storing and manipulating data

Hash tables Most data structures that were going to see are about storing and manipulating data

Hash tables Most data structures that were going to see are about storing and manipulating data When only operations Insert , Search and Delete as dictionary op- erations are needed, hash tables can be quite good Many variations of hash tables

1.04k views • 17 slides
How to use Dates &amp; Times with pandas Manipulating Time Series Data in Python Date &amp; Time

How to use Dates &amp; Times with pandas Manipulating Time Series Data in Python Date &amp; Time

MANIPULATING TIME SERIES DATA IN PYTHON How to use Dates &amp; Times with pandas Manipulating Time Series Data in Python Date &amp; Time Series Functionality At the root: data types for date &amp; time information Objects for points in

279 views • 25 slides
DBMS Data Loading: An Analysis on Modern Hardware Adam Dziedzic, Manos Karpathiotakis* , Ioannis

DBMS Data Loading: An Analysis on Modern Hardware Adam Dziedzic, Manos Karpathiotakis* , Ioannis

DBMS Data Loading: An Analysis on Modern Hardware Adam Dziedzic, Manos Karpathiotakis* , Ioannis Alagiannis, Raja Appuswamy, Anastasia Ailamaki Data loading: A necessary evil Volume =&gt; Expensive Top query performance 40 zettabytes by

613 views • 35 slides
Rearranging and manipulating data Dr. Nomie Becker Dr. Sonja Grath Special thanks to : Dr.

Rearranging and manipulating data Dr. Nomie Becker Dr. Sonja Grath Special thanks to : Dr.

An introduction to WS 2017/2018 Rearranging and manipulating data Dr. Nomie Becker Dr. Sonja Grath Special thanks to : Dr. Benedikt Holtmann for sharing slides for this lecture What you should know after day 5 Review: Reading and writing

269 views • 15 slides
Advanced Features of xts Manipulating Time Series Data in R: Case Studies Finding Endpoints

Advanced Features of xts Manipulating Time Series Data in R: Case Studies Finding Endpoints

MANIPULATING TIME SERIES DATA IN R: CASE STUDIES Advanced Features of xts Manipulating Time Series Data in R: Case Studies Finding Endpoints endpoints() indexes last observation per interval &gt; years &lt;- endpoints(unemployment, on =

435 views • 12 slides
Select Index Components &amp; Import Data Manipulating Time Series Data in Python Market

Select Index Components &amp; Import Data Manipulating Time Series Data in Python Market

MANIPULATING TIME SERIES DATA IN PYTHON Select Index Components &amp; Import Data Manipulating Time Series Data in Python Market Value-Weighted Index Composite performance of various stocks Components weighted by market

521 views • 37 slides
Compare Time Series Growth Rates Manipulating Time Series Data in Python Comparing Stock

Compare Time Series Growth Rates Manipulating Time Series Data in Python Comparing Stock

MANIPULATING TIME SERIES DATA IN PYTHON Compare Time Series Growth Rates Manipulating Time Series Data in Python Comparing Stock Performance Stock price series: hard to compare at di ff erent levels Simple solution: normalize price

670 views • 39 slides
Loading data into x ts object FOR E C ASTIN G P R OD U C T D E MAN D IN R Aric LaBarr , Ph . D

Loading data into x ts object FOR E C ASTIN G P R OD U C T D E MAN D IN R Aric LaBarr , Ph . D

Loading data into x ts object FOR E C ASTIN G P R OD U C T D E MAN D IN R Aric LaBarr , Ph . D . Senior Data Scientist , Elder Research x ts objects eXtensible Time Series object B u ilds u pon z oo objects FORECASTING PRODUCT DEMAND IN R

440 views • 25 slides
The Loading Spinner AKA, the throbber Why do we have loading spinners? Purpose: tells the

The Loading Spinner AKA, the throbber Why do we have loading spinners? Purpose: tells the

The Loading Spinner AKA, the throbber Why do we have loading spinners? Purpose: tells the user that the computer is performing an action in the background ex: - downloading content - conducting intensive calculations -

654 views • 11 slides
Rolling Window Functions with Pandas Manipulating Time Series Data in Python Window Functions in

Rolling Window Functions with Pandas Manipulating Time Series Data in Python Window Functions in

MANIPULATING TIME SERIES DATA IN PYTHON Rolling Window Functions with Pandas Manipulating Time Series Data in Python Window Functions in pandas Windows identify sub periods of your time series Calculate metrics for sub periods inside

525 views • 37 slides
D3 Tutorial Data Binding and Loading Edit by Jiayi Xu and Han-Wei Shen, The Ohio State University

D3 Tutorial Data Binding and Loading Edit by Jiayi Xu and Han-Wei Shen, The Ohio State University

D3 Tutorial Data Binding and Loading Edit by Jiayi Xu and Han-Wei Shen, The Ohio State University D3 - Data -Driven Documents D3 can map data to HTML/SVG elements We can construct the DOM from Data Each data value has a corresponding

612 views • 37 slides
LOADING &amp; HANDLING OF ROLLED CELLULOSE HOW DOES IT DIFFER FROM LOADING &amp; HANDLING OF

LOADING &amp; HANDLING OF ROLLED CELLULOSE HOW DOES IT DIFFER FROM LOADING &amp; HANDLING OF

LOADING &amp; HANDLING OF ROLLED CELLULOSE HOW DOES IT DIFFER FROM LOADING &amp; HANDLING OF PAPER ROLLS? JULY 10, 2019 BY SAM GAYLE TECHNICAL SERVICES MANAGER DAMAGE PREVENTION Rolled Cellulose from Coosa Pines, AL. Resolute Forest

448 views • 19 slides
Documentation Training Import Wizard and Loading Data Joo Oliveira, Jos Maria Lima, Snia

Documentation Training Import Wizard and Loading Data Joo Oliveira, Jos Maria Lima, Snia

GRIN-Global/GRIP Genetic Resources Information Platform - Documentation Training Import Wizard and Loading Data Joo Oliveira, Jos Maria Lima, Snia Dias Muscat 31 May 10 Jun 2015 Overview Preparing Data Main steps Error Handling

646 views • 21 slides
Manipulating Data Files in Python Learning Objectives Working with CSV files Reading

Manipulating Data Files in Python Learning Objectives Working with CSV files Reading

Manipulating Data Files in Python Learning Objectives Working with CSV files Reading and writing Moving into and out of data structures Accessing files in other folders JSON files Reading and writing Regular

519 views • 36 slides
Da Data Min a Minin ing What at i is it? Ch. 1 I-DM- 1 IRDM 15/16 What is Data Mining?

Da Data Min a Minin ing What at i is it? Ch. 1 I-DM- 1 IRDM 15/16 What is Data Mining?

Da Data Min a Minin ing What at i is it? Ch. 1 I-DM- 1 IRDM 15/16 What is Data Mining? Data mining is the process of extracting hidden patterns from data. An Unethical Econometric practice of massaging and manipulating the

475 views • 24 slides
Data-loading (for ML applications) using TDFs Stefan Wunsch stefan.wunsch@cern.ch 2018-02-22 1

Data-loading (for ML applications) using TDFs Stefan Wunsch stefan.wunsch@cern.ch 2018-02-22 1

Data-loading (for ML applications) using TDFs Stefan Wunsch stefan.wunsch@cern.ch 2018-02-22 1 Motivation Most of the data analysis of the high-level HEP analyses happens in the Python domain (frameworks of analysis groups on top of flat

218 views • 9 slides
Loading data on demand Thomas Lumley Dept of Biostatistics, University of Washington R Core

Loading data on demand Thomas Lumley Dept of Biostatistics, University of Washington R Core

Loading data on demand Thomas Lumley Dept of Biostatistics, University of Washington R Core Development Team useR Rennes 200979 Integrated database/statistics packages Charlton Heston brings SAS down from Mt Sinai Relational

290 views • 15 slides
Web Conferencing Loading Content Table of Contents Web Conferencing Loading Presentations

Web Conferencing Loading Content Table of Contents Web Conferencing Loading Presentations

Web-Conferencing\Media Support: 505.277.0857 Toll Free: 1.877.688.8817 Email: media@u nm.edu Web Conferencing Loading Content Table of Contents Web Conferencing Loading Presentations and Image Files

252 views • 12 slides
Chapter 5 2-D Transformational Geometry Much of computer graphics is built around manipulating

Chapter 5 2-D Transformational Geometry Much of computer graphics is built around manipulating

Chapter 5 2-D Transformational Geometry Much of computer graphics is built around manipulating geometric data. We have already seen that we can represent a 2-D shape as one or more polylines connecting vertices in 2-D. We can also represent a

332 views • 10 slides
Adding New Features to the CS 5625 Framework Pramook Khungurn Understanding the CS 5625

Adding New Features to the CS 5625 Framework Pramook Khungurn Understanding the CS 5625

Adding New Features to the CS 5625 Framework Pramook Khungurn Understanding the CS 5625 framework Features Lazy loading of data loads data only when needed Caching of data no loading same file twice GPU memory control

402 views • 36 slides
CS 5 4 3 : Com puter Graphics Lecture 9 ( Part I I I ) : Raster Graphics: Manipulating I m ages

CS 5 4 3 : Com puter Graphics Lecture 9 ( Part I I I ) : Raster Graphics: Manipulating I m ages

CS 5 4 3 : Com puter Graphics Lecture 9 ( Part I I I ) : Raster Graphics: Manipulating I m ages Emmanuel Agu Manipulating Pixm aps Pixmap = rectangular array of numerical values Pixmap copied to frame buffer = rendered Change frame

297 views • 12 slides

More recommend