Autonomic Configuration of HyperDex via Analytical Modelling SAC - PowerPoint PPT Presentation

Autonomic Configuration of HyperDex via Analytical Modelling SAC 2014 (DADS) Nuno Diegues , Muhammet Orazov, João Paiva, Luís Rodrigues, Paolo Romano

• Autonomic � • Configuration � • HyperDex � • Analytical Modelling

• Autonomic � • Configuration � • HyperDex � Distributed Multi-dimensional Key-Value Store • Analytical Modelling

• Autonomic � • Configuration � Non-trivial to tune for performance • HyperDex � Distributed Multi-dimensional Key-Value Store • Analytical Modelling

• Autonomic � Automatic Adaptation/Management • Configuration � Non-trivial to tune for performance • HyperDex � Distributed Multi-dimensional Key-Value Store • Analytical Modelling

• Autonomic � Automatic Adaptation/Management • Configuration � Non-trivial to tune for performance • HyperDex � Distributed Multi-dimensional Key-Value Store • Analytical Modelling White-box Approach

Why Key-Value Stores? Key-value stores: high performance elastic scalability

Why Key-Value Stores? Key-value stores: high performance elastic scalability restrictive API: • operations only given the primary key

Motivation: Key-Value Stores Large, Partitionable Data Space ID:$$$$$$$$alifparis1 ID:$$$$$$$$hiltonparis1 ID:$$$$$$$$ibisparis1 ID:$$$$$$$$sleazyparis1 ID:$$$$$$$$tivolilx1 Name:$$$$$$Hotel$Alif Name:$$$$$$Hotel$Hilton Name:$$$$$$Hotel$Ibis Name:$$$$$$Motel$Sleazy Nome:$$$$$$Hotel$Tivoli Price:$$$$$30€ Price:$$$$$250€ Price:$$$$$50€ Price:$$$$$10€ Preço:$$$$$90€ City:$$$$$$Lisbon City:$$$$$$Paris City:$$$$$$Paris City:$$$$$$Paris Cidade:$$$$Lisbon Stars:$$$$$4 Stars:$$$$$5 Stars:$$$$$3 Stars:$$$$$1 Estrelas:$$4 Phone:$$$$$35192900912 Phone:$$$$$87162801020 Phone:$$$$$87188190021 Phone:$$$$$871898283033 TLF:$$$$$$$351923821911 Animals:$$$No Animals:$$$No Animals:$$$No Animals:$$$Yes Animais:$$$No Postal:$$$$LisbonA1233 Postal:$$$$ParisA1291 Postal:$$$$ParisA1194 Postal:$$$$ParisA7723 Postal:$$$$LisbonA1000 Category:$$Hotel Category:$$Hotel Category:$$Hotel Category:$$Motel Categoria:$Hotel (…) (…) (…) (…) (…)

Motivation: Key-Value Stores Large, Partitionable Data Space E.g.: by primary key ID:$$$$$$$$alifparis1 ID:$$$$$$$$hiltonparis1 ID:$$$$$$$$ibisparis1 ID:$$$$$$$$sleazyparis1 ID:$$$$$$$$tivolilx1 Name:$$$$$$Hotel$Alif Name:$$$$$$Hotel$Hilton Name:$$$$$$Hotel$Ibis Name:$$$$$$Motel$Sleazy Nome:$$$$$$Hotel$Tivoli Price:$$$$$30€ Price:$$$$$250€ Price:$$$$$50€ Price:$$$$$10€ Preço:$$$$$90€ City:$$$$$$Lisbon City:$$$$$$Paris City:$$$$$$Paris City:$$$$$$Paris Cidade:$$$$Lisbon Stars:$$$$$4 Stars:$$$$$5 Stars:$$$$$3 Stars:$$$$$1 Estrelas:$$4 Phone:$$$$$35192900912 Phone:$$$$$87162801020 Phone:$$$$$87188190021 Phone:$$$$$871898283033 TLF:$$$$$$$351923821911 Animals:$$$No Animals:$$$No Animals:$$$No Animals:$$$Yes Animais:$$$No Postal:$$$$LisbonA1233 Postal:$$$$ParisA1291 Postal:$$$$ParisA1194 Postal:$$$$ParisA7723 Postal:$$$$LisbonA1000 Category:$$Hotel Category:$$Hotel Category:$$Hotel Category:$$Motel Categoria:$Hotel (…) (…) (…) (…) (…)

Motivation: Key-Value Stores Mappable to a space E.g.: by hashing the key A Z ID:$$$$$$$$alifparis1 ID:$$$$$$$$hiltonparis1 ID:$$$$$$$$ibisparis1 ID:$$$$$$$$sleazyparis1 ID:$$$$$$$$tivolilx1 Name:$$$$$$Hotel$Alif Name:$$$$$$Hotel$Hilton Name:$$$$$$Hotel$Ibis Name:$$$$$$Motel$Sleazy Nome:$$$$$$Hotel$Tivoli Price:$$$$$30€ Price:$$$$$250€ Price:$$$$$50€ Price:$$$$$10€ Preço:$$$$$90€ City:$$$$$$Lisbon City:$$$$$$Paris City:$$$$$$Paris City:$$$$$$Paris Cidade:$$$$Lisbon Stars:$$$$$4 Stars:$$$$$5 Stars:$$$$$3 Stars:$$$$$1 Estrelas:$$4 Phone:$$$$$35192900912 Phone:$$$$$87162801020 Phone:$$$$$87188190021 Phone:$$$$$871898283033 TLF:$$$$$$$351923821911 Animals:$$$No Animals:$$$No Animals:$$$No Animals:$$$Yes Animais:$$$No Postal:$$$$LisbonA1233 Postal:$$$$ParisA1291 Postal:$$$$ParisA1194 Postal:$$$$ParisA7723 Postal:$$$$LisbonA1000 Category:$$Hotel Category:$$Hotel Category:$$Hotel Category:$$Motel Categoria:$Hotel (…) (…) (…) (…) (…)

Motivation: Key-Value Stores Space 1 Space 2 Space … Space N A Z ID:$$$$$$$$alifparis1 ID:$$$$$$$$hiltonparis1 ID:$$$$$$$$ibisparis1 ID:$$$$$$$$sleazyparis1 ID:$$$$$$$$tivolilx1 Name:$$$$$$Hotel$Alif Name:$$$$$$Hotel$Hilton Name:$$$$$$Hotel$Ibis Name:$$$$$$Motel$Sleazy Nome:$$$$$$Hotel$Tivoli Price:$$$$$30€ Price:$$$$$250€ Price:$$$$$50€ Price:$$$$$10€ Preço:$$$$$90€ City:$$$$$$Lisbon City:$$$$$$Paris City:$$$$$$Paris City:$$$$$$Paris Cidade:$$$$Lisbon Stars:$$$$$4 Stars:$$$$$5 Stars:$$$$$3 Stars:$$$$$1 Estrelas:$$4 Phone:$$$$$35192900912 Phone:$$$$$87162801020 Phone:$$$$$87188190021 Phone:$$$$$871898283033 TLF:$$$$$$$351923821911 Animals:$$$No Animals:$$$No Animals:$$$No Animals:$$$Yes Animais:$$$No Postal:$$$$LisbonA1233 Postal:$$$$ParisA1291 Postal:$$$$ParisA1194 Postal:$$$$ParisA7723 Postal:$$$$LisbonA1000 Category:$$Hotel Category:$$Hotel Category:$$Hotel Category:$$Motel Categoria:$Hotel (…) (…) (…) (…) (…)

Motivation: Key-Value Stores Space 1 Space 2 Space … Space N A Z ID:$$$$$$$$alifparis1 ID:$$$$$$$$hiltonparis1 ID:$$$$$$$$ibisparis1 ID:$$$$$$$$sleazyparis1 ID:$$$$$$$$tivolilx1 Name:$$$$$$Hotel$Alif Name:$$$$$$Hotel$Hilton Name:$$$$$$Hotel$Ibis Name:$$$$$$Motel$Sleazy Nome:$$$$$$Hotel$Tivoli Price:$$$$$30€ Price:$$$$$250€ Price:$$$$$50€ Price:$$$$$10€ Preço:$$$$$90€ City:$$$$$$Lisbon City:$$$$$$Paris City:$$$$$$Paris City:$$$$$$Paris Cidade:$$$$Lisbon Stars:$$$$$4 Stars:$$$$$5 Stars:$$$$$3 Stars:$$$$$1 Estrelas:$$4 Phone:$$$$$35192900912 Phone:$$$$$87162801020 Phone:$$$$$87188190021 Phone:$$$$$871898283033 TLF:$$$$$$$351923821911 Animals:$$$No Animals:$$$No Animals:$$$No Animals:$$$Yes Animais:$$$No Postal:$$$$LisbonA1233 Postal:$$$$ParisA1291 Postal:$$$$ParisA1194 Postal:$$$$ParisA7723 Postal:$$$$LisbonA1000 Category:$$Hotel Category:$$Hotel Category:$$Hotel Category:$$Motel Categoria:$Hotel (…) (…) (…) (…) (…)

Motivation: Key-Value Stores A Z Operation on ID:$$$$$$$$sleazyparis1 a single item? Name:$$$$$$Motel$Sleazy Price:$$$$$10€ City:$$$$$$Paris Stars:$$$$$1 Phone:$$$$$871898283033 Animals:$$$Yes Postal:$$$$ParisC7723 Category:$$Motel (…)

Motivation: Key-Value Stores A Z Operation on ID:$$$$$$$$sleazyparis1 a single item? Name:$$$$$$Motel$Sleazy Price:$$$$$10€ City:$$$$$$Paris Stars:$$$$$1 Phone:$$$$$871898283033 use the primary key Animals:$$$Yes Postal:$$$$ParisC7723 Category:$$Motel (…)

Motivation: Key-Value Stores A Z Operation on ID:$$$$$$$$sleazyparis1 a single item? Name:$$$$$$Motel$Sleazy Price:$$$$$10€ City:$$$$$$Paris Stars:$$$$$1 Phone:$$$$$871898283033 use the primary key Animals:$$$Yes Postal:$$$$ParisC7723 Category:$$Motel (…)

Motivation: Key-Value Stores A Z ID:$$$$$$$$sleazyparis1 Name:$$$$$$Motel$Sleazy Price:$$$$$10€ City:$$$$$$Paris Efficient operation Stars:$$$$$1 Phone:$$$$$871898283033 Animals:$$$Yes Postal:$$$$ParisC7723 Category:$$Motel (…)

Motivation: Key-Value Stores A Z ID:$$$$$$$$sleazyparis1 Name:$$$$$$Motel$Sleazy Price:$$$$$10€ City:$$$$$$Paris Stars:$$$$$1 Phone:$$$$$871898283033 Animals:$$$Yes Search by price and city Postal:$$$$ParisC7723 Category:$$Motel (…)

Motivation: Key-Value Stores A Z ID:$$$$$$$$sleazyparis1 ? Name:$$$$$$Motel$Sleazy Price:$$$$$10€ City:$$$$$$Paris Stars:$$$$$1 Phone:$$$$$871898283033 Animals:$$$Yes Search by price and city Postal:$$$$ParisC7723 Category:$$Motel (…)

Motivation: Key-Value Stores A Z Inefficient ID:$$$$$$$$sleazyparis1 Name:$$$$$$Motel$Sleazy Price:$$$$$10€ City:$$$$$$Paris Stars:$$$$$1 Phone:$$$$$871898283033 Animals:$$$Yes Search by price and city Postal:$$$$ParisC7723 Category:$$Motel (…)

Motivation: Multi-Dimensional KVS e.g.: HyperDex [SIGCOMM12] Extended functionality and APIs � Support for operations with secondary keys Maintain high performance Preserve scalability

Motivation: Multi-Dimensional KVS e.g.: HyperDex [SIGCOMM12] Extended functionality and APIs � Support for operations with secondary keys Maintain high performance Preserve scalability Complex to configure properly

Motivation: Multi-Dimensional Systems How do they work? ID:$$$$$$$$alifparis1 ID:$$$$$$$$sleazyparis1 ID:$$$$$$$$ibisparis1 ID:$$$$$$$$tivolilx1 ID:$$$$$$$$hiltonparis1 Name:$$$$$$Hotel$Alif Name:$$$$$$Motel$Sleazy Name:$$$$$$Hotel$Ibis Name:$$$$$$Hotel$Tivoli Name:$$$$$$Hotel$Hilton Price:$$$$$30€ Price:$$$$$10€ Price:$$$$$50€ Price:$$$$$90€ Price:$$$$$250€ City:$$$$$$Lisbon City:$$$$$$Paris City:$$$$$$Paris City:$$$$$$Lisbon City:$$$$$$Paris Stars:$$$$$4 Stars:$$$$$1 Stars:$$$$$3 Stars:$$$$$4 Stars:$$$$$5 Phone:$$$$$35192900912 Phone:$$$$$871898283033 Phone:$$$$$87188190021 Phone:$$$$$351923821911 Phone:$$$$$87162801020 Animals:$$$No Animals:$$$Yes Animals:$$$No Animals:$$$No Animals:$$$No Postal:$$$$LisbonA1233 Postal:$$$$ParisA7723 Postal:$$$$ParisA1194 Postal:$$$$LisbonA1000 Postal:$$$$ParisA1291 Category:$$Hotel Category:$Motel Category:$$Hotel Category:$$Hotel Category:$$Hotel (…) (…) (…) (…) (…)