Multi Mu ti-Di Dimensio mensional nal, In-GP GPU-Memor Memory Dat ataba abases ses: St Stre ream aming ing Co Condi dition tional al Ca Calculat culations ions in in Bi Big g Data a Se Sets Peter Strohm | GTC15 | San Jos é | 03/17/2015 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
2002 Jedox Founded in Freiburg, Germany SA App Today Offices in Freiburg, Frankfurt, Düsseldorf, Paris, Boston 120 Global Business Partners 125 Countries with Jedox Users 25 Language Versions Bus usiness Driven Intellig lligence, Analytics & Performance Management. 2 www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Big Data in real-time: Twitter Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Big Data in real-time: Twitter Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Twitter: Big Data in Real-time Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
In-GPU-Memory OLAP-Database In-Memory OLAP-Database 1 All data in GPU memory All data in main memory All regions Hierarchical structure of Europe 2 consolidated elements France Italy UK North America USA Year Canada Count TweetID Mexico Longitude Q1 Q2 Q3 Q4 May Mar Aug Nov Year Jan Feb Jun Sep Oct Dec Q3 Q4 Q1 Apr Q2 Jul Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
In-GPU-Memory OLAP-Database In-Memory OLAP-Database 3 Calculation “on -the- fly” All regions Europe 4 Store only non-zero values France Italy UK North America USA Canada Count TweetID Mexico i In-GPU-Memory & “on -the- fly” Longitude May Mar Aug Nov Year Jan Feb Jun Sep Oct Dec Q3 Q4 Q1 Apr Q2 Jul Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Jedox Social Analytics Workflow Update Streaming Adding trending with via php in Twitter data streaming filtering update . Web in ETL www Web+ETL Public Twitter Stream add Persistent ExcelPLUS Mobile Twitter Data analyzing in OLAP Web SA App Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Jedox Social Analytics with GPU System: 2 x K40 with 12 GB GPURAM 1 CPU with 128GB RAM Data sets with > 500 million entries 2 Calculating “on -the- fly” on al all data entries 3 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Jedox Social Analytics Showcase Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Jedox Social Analytics Showcase Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Social Media Analytics: HeatMap over 250.000 grid points over 500 Million database entries Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Social Media Analytics: Trending 1 Top 100 Trending Factor # current day ________________ # all previous days 2 ~ 28.000 dictionary words > 80 Million DB entries Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Social Media Analytics: Trending Assigning Trending Factor to vi virtual cell cells s (e.g. [TF] = [B] / [C]) 1 Trending Factor is calc lculated on on the fly fly 2 Conditional Calculation: IF IF-Rule le 3 IF IF ([count] >1000) TH THEN [count,currentDay] / [count,previousWeek] ELS ELSE 0 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rule with constants [TF] = IF ([B] > 1000) THEN [C] ELSE 0 Rule Processor > Matching Constant Processor Processor (0) Matching Constant Processor (1000) Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rule with constants [TF] = IF ([B] > 1000) THEN [C] ELSE 0 Rule Processor > Matching Constant 1 1 Processor (0) 0 1 0 … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rule with constants [TF] = IF ([B] > 1000) THEN [C] ELSE 0 Rule Processor T > Constant 1 A,1 A,2 1 (0) A,3 0 A,4 1 A,5 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rules with constants [TF] = IF ([B] > 1000) THEN [C] ELSE 0 Rule Processor T > T 1 A,1 A,2 1 A,3 0 A,4 1 A,5 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rules on GPU [TF] = IF ([B] > 1000) THEN [C] ELSE 0 FALSE Rule TRUE Processor T > T 1 A,1 A,2 1 A,3 0 A,6 1 A,8 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rules on GPU [TF] = IF ([B] > 1000) THEN [C] ELSE 0 FALSE Rule TRUE Processor T > T 1 A,1 A,2 1 A,3 0 A,6 1 A,8 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rules on GPU [TF] = IF ([B] > 1000) THEN [C] ELSE 0 FALSE Rule TRUE Processor T > T 1 A,1 A,2 1 complete A,3 0 A,6 1 set A,8 0 … … … … Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rules on GPU GPU MEMORY SPACE FOR CALCULATIONS Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Conditional Rule on GPU [TF] = IF ([B] > 1000) THEN [C] ELSE 1 Rule Processor Streaming Streaming Streaming > Matching Constant Processor Processor (1) Matching Constant Processor (1000) Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Streaming in Conditional Rules [TF] = IF ([B] > 1000) THEN [C] ELSE [D] Rule Processor > Matching Matching Part 1 Processor Processor Processor Total Part 2 Part 1 Matching Constant Processor (1000) Part 2 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Streaming in Conditional Rules [TF] = IF ([B] > 1000) THEN [C] ELSE [D] FALSE Rule TRUE Processor Part 1 Total Part 1 > Matching Matching Processor Processor Processor Part 2 Matching Constant Processor (1000) Part 2 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Streaming in Conditional Rules [TF] = IF ([B] > 1000) THEN [C] ELSE [D] Rule Processor > Matching Matching Processor Processor Processor Part 2 Sub- Part 1 Total Matching Constant Processor (1000) Part 2 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Streaming in Conditional Rules [TF] = IF ([B] > 1000) THEN [C] ELSE [D] Rule Processor > Matching Matching Processor Processor Processor Part 2 1 Matching Constant Processor (1000) Part 2 Bus usiness Driven Intellig lligence, Analytics & Performance Management. www.jedox.com - @JedoxAG - @PSJedox - #gtc15 - #s5481
Recommend
More recommend