GridGain vs Hadoop Why Elephants Cant Fly GridGain System 1065 - PowerPoint PPT Presentation

Mar 03, 2023 •209 likes •336 views

GridGain vs Hadoop Why Elephants Cant Fly GridGain System 1065 East Hillsdale Boulevard Suite 230 Foster City, CA 94404 www.gridgain.com GridGain In A Glance GridGain is Java based open source middleware for transactional real time big

GridGain vs Hadoop Why Elephants Can’t Fly GridGain System 1065 East Hillsdale Boulevard Suite 230 Foster City, CA 94404 www.gridgain.com
GridGain In A Glance GridGain is Java based open source middleware for transactional real time big data processing that scales up from one server to thousands of machines. Unlike complex, decade-old Hadoop MapReduce systems which use stale data for batch offline analytics, our platform allows companies to harness live data for smarter, faster real time processing. GridGain Real Time Big Data Slide 2
GridGain History > GridGain ¡Systems ¡founded ¡in ¡2005 > VC ¡funded > Headquarter ¡in ¡Foster ¡City, ¡California, ¡USA > 12 ¡product ¡releases: > GridGain 1.x , Jul 2007 > GridGain 2.x , Feb 2008 > GridGain 3.0 , Aug 2010 > Current ¡release ¡is ¡GridGain ¡ 3.6 3 GridGain Real Time Big Data Slide
GridGain Facts GridGain ¡starts ¡every ¡ 10 ¡seconds ¡around ¡the ¡globe Over ¡ 8,000,000 ¡starts ¡worldwide 1000 ¡unique ¡IP/month 400 ¡acIve ¡projects/month 4000 ¡forum ¡views/month GridGain Real Time Big Data Slide
GridGain Users GridGain Partners GridGain Real Time Big Data Slide
GridGain Technology > Fully integrated cloud middleware: Compute Grid + Data Grid > Real Time Transactional Big Data > Zero Deployment > Two editions: > Community Edition : License: GPLv3 + Basic Features > Enterprise Edition : Commercial License + Enterprise Features > Language support: > Java 1.6 > Scala 2.9.1 6 GridGain Real Time Big Data Slide
GridGain - Compute Grid > Direct support for MapReduce > Auto discovery > Checkpoints for long running tasks > Load Balancing > Affinity co-location with data grids > Automatic fault tolerance GridGain Real Time Big Data Slide 7
GridGain - Data Grid > Replication & Partitioning > Pessimistic & Optimistic Tx > Read-Through and Write-Through > Pluggable data overflow storage > Distributed Queries > Distributed Queues and Latches > Distributes Java Atomics 8 GridGain Real Time Big Data Slide
Hadoop Processing > Very large data sets, BUT... > Not Real Time > Mandatory data snapshots > HDFS instead of live databases > Analytics based on offline data 9 GridGain Real Time Big Data Slide
GridGain Processing > Large data sets > Near Real Time Processing > Online databases > In-memory data caching > Co-location of analytics and data > Business analytics on Live Data 10 GridGain Real Time Big Data Slide
Live Coding - Real Time Word Count Real time uploading of books into Cache > Real time updates of word counts > Real time SQL queries for popular words > Real time print-outs of most popular words > ... using Scala & GridGain > Cloud ¡CompuIng ¡with ¡ Scala ¡and ¡ GridGain Slide ¡ 11
Thank You! GridGain Real Time Big Data Slide 12

Recommend

SAS Data Loader for Hadoop Agenda Intro What is Hadoop? What do I get from Hadoop?

SAS Data Loader for Hadoop Agenda Intro What is Hadoop? What do I get from Hadoop? Hadoop components Why SAS Data Loader for Hadoop? SAS Data Loader for Hadoop overview Demo Introduction Doug Cutting, creator of Hadoop

285 views • 11 slides

BEYOND THE CLUSTER: WAN DATA REPLICATION WITH GRIDGAIN YAKOV ZHDANOV WHO? Yakov Zhdanov: -

BEYOND THE CLUSTER: WAN DATA REPLICATION WITH GRIDGAIN YAKOV ZHDANOV WHO? Yakov Zhdanov: - GridGains Product Development VP - With GridGain since 2010 - Apache Ignite committer and PMC - Passion for performance & scalability -

814 views • 47 slides

Elephants Without Borders (EWB, Inc.) Profile Elephants Without Borders is a non-profit,

Elephants Without Borders (EWB, Inc.) Profile Elephants Without Borders is a non-profit, tax-exempt, registered organization in the Republic of Botswana. Registered in the Deeds Office of Botswana, as the Somarela Trust under number MA 18/2004.

270 views • 4 slides

Getting Started With Apache Ignite SQL Denis Magda, GridGain Developer Relations Igor

Getting Started With Apache Ignite SQL Denis Magda, GridGain Developer Relations Igor Seliverstov, GridGain Architecture Group Topics Ignite SQL Basics: DML, DDL, connectivity, configuration Affinity Co-Location and Distributed JOINs

685 views • 40 slides

COMP9313: Big Data Management Hadoop and HDFS Hadoop Apache Hadoop is an open-source

COMP9313: Big Data Management Hadoop and HDFS Hadoop Apache Hadoop is an open-source software framework that Stores big data in a distributed manner Processes big data parallelly Builds on large clusters of commodity hardware.

2.93k views • 60 slides

Working With Hadoop Mostly based on Tom Whites book Hadoop: Now that we covered the

Working With Hadoop Mostly based on Tom Whites book Hadoop: Now that we covered the basics of The Definitive Guide, 3 rd edition MapReduce , lets look at some Hadoop specifics. Note: We will use the new

181 views • 6 slides

Elephants in SOFIA ZOO Hello, my name is Artaida, and today Im going to tell you about all

Elephants in SOFIA ZOO Hello, my name is Artaida, and today Im going to tell you about all of the elephants who have lived in the Sofia zoo. Aerial photo of Sofia Zoo The history of the Sofia zoo is inextricably bound up with the

1.02k views • 35 slides

Never Eat Shredded Wheat Richard Of York Gave Battle In Vain Big Elephants Can Always

Never Eat Shredded Wheat Richard Of York Gave Battle In Vain Big Elephants Can Always Understand Small Elephants Mnemonics Improving your memory In English PETER AFOREST ARTWARS https://www.youtube.com/watch?v=VoYOb2s

464 views • 7 slides

Using Distributed Tracing to Resolve Performance Issues in Apache Ignite Greg Stachnick, Director

Using Distributed Tracing to Resolve Performance Issues in Apache Ignite Greg Stachnick, Director of Product Management GridGain 10/28/2020 Agenda GridGain & Ignite Overview Why Tracing? Tracing in GridGain & Ignite

582 views • 21 slides

Web Annotations and Elephants Doug Schepers, W3C @shepazu Ivan Herman, W3C @ivan_herman The

Web Annotations and Elephants Doug Schepers, W3C @shepazu Ivan Herman, W3C @ivan_herman The Elephants Child I Keep six honest serving-men: (They taught me all I knew) Their names are What and Where and When And How and Why and Who.

387 views • 20 slides

Big Data with R and Hadoop Jamie F Olson June 11, 2015 ; R and Hadoop Review various tools

Big Data with R and Hadoop Jamie F Olson June 11, 2015 ; R and Hadoop Review various tools for leveraging Hadoop from R. MapReduce Spark Hive/Impala Revolution R . . . . . . . . . . . . . . . . . . . . . . . . . .

565 views • 52 slides

BY SRIJHA REDDY GANGIDI What is Hadoop ? Evolution of Hadoop Created by dough cutting, a part

BY SRIJHA REDDY GANGIDI What is Hadoop ? Evolution of Hadoop Created by dough cutting, a part of Apache project. Hadoop Architecture Ambari Ambari offers a Web-based GUI with wizard scripts for setting up clusters with most of the standard

436 views • 18 slides

Hadoop Jrg Mllenkamp Principal Field Technologist Sun Microsystems Agenda Introduction

Hadoop Jrg Mllenkamp Principal Field Technologist Sun Microsystems Agenda Introduction CMT+Hadoop Solaris+Hadoop Sun Grid Engine+Hadoop Introduction Im ... Jrg Mllenkamp better known as c0t0d0s0.org Sun Employee

1.37k views • 103 slides

Dancin ncing g with th th the e El Elephants hants or or wor orking ing with th Uti

Dancin ncing g with th th the e El Elephants hants or or wor orking ing with th Uti tilities lities to to d drive ive th the Energy rgy Re Revol olut ution ion 1 Ut Utility lity Disrupti sruption. on. 2 Agile

458 views • 21 slides

Hadoop on HPC: Integrating Hadoop and Pilot-based Dynamic Resource Management Andre Luckow,

Hadoop on HPC: Integrating Hadoop and Pilot-based Dynamic Resource Management Andre Luckow, Ioannis Paraskevakos, George Chantzialexiou and Shantenu Jha Hadoop on HPC: Integrating Hadoop and Pilot- based Dynamic Resource Management Overview

322 views • 17 slides

On the Energy (In)efficiency of Hadoop: Scale-down Efficiency Jacob Leverich and Christos

On the Energy (In)efficiency of Hadoop: Scale-down Efficiency Jacob Leverich and Christos Kozyrakis Stanford University The current design of Hadoop precludes scale-down of commodity clusters. 2 Outline Hadoop crash-course

724 views • 29 slides

Extension: Combiner Functions import org.apache.hadoop.io.IntWritable; import

10/6/2011 import java.io.IOException; import org.apache.hadoop.fs.Path; Extension: Combiner Functions import org.apache.hadoop.io.IntWritable; import org.apache.hadoop.io.Text; import org.apache.hadoop.mapred.FileInputFormat; import

177 views • 7 slides

Hadoop Security Design? Just Add Kerberos? Really? Andrew Becherer Black Hat USA 2010

Hadoop Security Design? Just Add Kerberos? Really? Andrew Becherer Black Hat USA 2010 https://www.isecpartners.com Agenda Conclusion What is Hadoop Old School Hadoop Risks The New Approach to Security Concerns

300 views • 29 slides

HDFS Under the Hood Sanjay Radia Sradia@yahoo-inc.com Grid Computing, Hadoop Yahoo Inc.

HDFS Under the Hood Sanjay Radia Sradia@yahoo-inc.com Grid Computing, Hadoop Yahoo Inc. Yahoo! Yahoo! 1 Outline Overview of Hadoop, an open source project Design of HDFS On going work Yahoo! 2 Hadoop Hadoop provides

295 views • 25 slides

The Evolution of Hadoop at Spotify Rafal Wojdyla (rav@spotify.com) Josh Baer (jbx@spotify.com)

The Evolution of Hadoop at Spotify Rafal Wojdyla (rav@spotify.com) Josh Baer (jbx@spotify.com) @l_phant @ravwojdyla Technical Product Owner Data Engineer Hadoop Squad Hadoop Squad Overview Growing Pains Gaining Focus The

774 views • 51 slides

Apache Hadoop 3.x State of The Union and Upgrade Guidance Wei-Chiu Chuang Wangda Tan

Apache Hadoop 3.x State of The Union and Upgrade Guidance Wei-Chiu Chuang Wangda Tan @Cloudera, Sr. Manager, Compute Platform Apache Hadoop PMC @Cloudera, Apache Hadoop PMC Agenda Hadoop Community Updates & Overview Updates

871 views • 47 slides

Large-Scale Data Engineering Hadoop MapReduce in more detail event.cwi.nl/lsde2015 How will I

Large-Scale Data Engineering Hadoop MapReduce in more detail event.cwi.nl/lsde2015 How will I actually learn Hadoop? This class session Hadoop: The Definitive Guide RTFM There is a lot of material out there There is also a lot

265 views • 26 slides

Hadoop Scheduling A Hadoop job consists of Map tasks and Reduce tasks Only one job in

Hadoop Scheduling A Hadoop job consists of Map tasks and Reduce tasks Only one job in entire cluster => it occupies cluster Multiple customers with multiple jobs Users/jobs = tenants Multi-tenant system

328 views • 11 slides

Huawei's story of leveraging GridGain as a distributed caching service on its public cloud

Huawei's story of leveraging GridGain as a distributed caching service on its public cloud environment Paul Chen Chief Architect, Cloud Services Research and Development, Huawei Technologies Canada Lab Agenda Huawei Public Cloud

343 views • 22 slides