Flexible Data Distribution Policy Language and Gateway Architecture - PowerPoint PPT Presentation

Faculty of Computer Science | Institute of Systems Architecture | Chair of Computer Networks Flexible Data Distribution Policy Language and Gateway Architecture Josef Spillner, Alexander Schill mailto:josef.spillner@tu-dresden.de xmpp:josef.spillner@jabber.org 1st Latin American Conference on Cloud Computing and Communications November 26, 2012, Porto Alegre, Brazil

Background: Storage Services proprietary client backup/sync vs. storage institutional utility billing pricing: progressive/ 3 months limit; degressive web access tariff choice file size limit only LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 2 J. Spillner & A. Schill

Background: Storage Service Integration LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 3 J. Spillner & A. Schill

Background: Controller Configuration (1) LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 4 J. Spillner & A. Schill

Background: Controller Configuration (2) LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 5 J. Spillner & A. Schill

Background: Storage Service Gateways LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 6 J. Spillner & A. Schill

Deficiencies SecCSIE database entries Main shortcomings ● no interoperability between CREATE TABLE providers ( configuration approaches name varchar(50), ● no capturing of intended policies username varchar(50), and higher-level configuration ● no extensibility towards advanced ...); CREATE TABLE fragments ( storage processing outside of the encryption tinyint(1), controller/gateway scope ...); NubiSave configuration files Cloud Storage Engine (ClouSE) [parameter] [mysqld] (in my.cnf) clouse_cloud_data_url=\ server = 10.0.2.5 remotedir = /home/store s3://s3.amazonaws.com CREATE TABLE clouse_t ( [properties] object_name, object_id, redundancy = 49 ...); matchmakerURI = local:80 LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 7 J. Spillner & A. Schill

Introducing FlexDDPL Flexible Data Distribution Policy Language ● primarily targeting storage controllers, gateways and associated tools ● capturing higher-level policies ● mapping onto concrete configuration directives of processing components Language design ● separation of syntax and rule/scope vocabulary ● extensible through vocabulary and scope application ● declarative with imperative (verbial) elements Conf files components Processing Flex Flex Conf DDPL DDPL table grammar instance Flex Conf DDPL base vocabul. LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 8 J. Spillner & A. Schill

FlexDDPL Syntax FlexDDPL Syntax Elements+Vocabulary (full EBNF grammar: see paper) scopes → applied in contexts (e.g. user database) ~user !negation T:22:00-06:00 @group fragment mime:message/rfc822 rules → applied to targets (e.g. storage provider) store control adapt Observations FlexDDPL Syntax Example ● rules arguments entirely adapt scaleimage determined by targets ● scopes can be arbitrarily control redundancy 200% combined, re-ordering fragment { assumed to follow store region europe @developers { adapt compress } } LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 9 J. Spillner & A. Schill

FlexDDPL Vocabulary Rule targets (imperative/verbial) Scopes (declarative) store ~user, @group, T:*, mime:* ● cloud storage service selection ● sign-up, if present ● evaluated by suitable sensor ● matches on non-functional ● further candidates: privacy:* properties in descriptions and size:* control !negation ● client-side storage controller ● logically applicable to the above ● weighted dispersion, if present ● relies on boolean scopes ● redundancy and recovery fragment adapt ● can appear once or more ● data adaptation, if present ● relates to the dispersion ● dismissal as specialisation ● is boolean per fragment LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 10 J. Spillner & A. Schill

Storage Gateway with FlexDDPL LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 11 J. Spillner & A. Schill

Language Evaluation LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 12 J. Spillner & A. Schill

Gateway Evaluation: NubiSave Controller LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 13 J. Spillner & A. Schill

Gateway Evaluation: Integration Implementation and integration ● open source components around user-space file systems (FUSE) Configuration reload ● NubiSave has hot-pluggable configuration ● web server needs reload, other tools pick up changes on next invocation Online Service Sign-up Tool configuration Flex Custom parser DDPL and processor NubiSave configuration instance Apache WebDAV configuration <Directory /storage/scope%SCOPE%> Dav On require user %USER% AdaptiveSyncer configuration LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 14 J. Spillner & A. Schill

Gateway Evaluation: Measurements Experiment setup ● user database with 1000 entries, on Intel i5 quad-core notebook, 4 GB RAM Experiment execution ● FlexDDPL document with 1000 users, one NubiSave filesystem mount for each ● Measurements with shell commands: time & free LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 15 J. Spillner & A. Schill

Summary Results ● FlexDDPL: flexible policy language to capture cloud storage requirements ● Characteristics: rigid structure, portability, extensibility ● Storage gateway using the NubiSave controller and a FlexDDPL parser Open Issues and Next Steps ● standardisation of vocabulary ● reference parser and processor for FlexDDPL ● less resource-consuming reference implementation Further Material: nubisave.org ● NubiSave optimal cloud storage controller - web pages, git repository, ... flexcloud.eu ● EU/ESF-funded project: Flexible Service Architectures for Cloud Computing LatinCloud, 26.11.2012 Flexible Data Distribution Policy Language and Gateway Architecture # 16 J. Spillner & A. Schill