RDBMS for CDB ? RDBMS for CDB ? Vé éronique ronique Lef Lefé ébure bure V IT- -FIO/FS FIO/FS IT Brainstorming, March 8 th 2005 Brainstorming, March 8 th 2005
Outline Outline � CDB Requirements CDB Requirements � – Please read http://it http://it- -div div- -fio fio- - – Please read lcg.web.cern.ch/it%2Ddiv%2Dfio%2Dlcg/gcancio/cdb/cdb_requiremen lcg.web.cern.ch/it%2Ddiv%2Dfio%2Dlcg/gcancio/cdb/cdb_requiremen ts_usesases.htm before this presentation, if possible. before this presentation, if possible. ts_usesases.htm – Also doc about PAN at http://hep http://hep- -proj proj- -grid grid- -fabric fabric- - – Also doc about PAN at config.web.cern.ch/hep- -proj proj- -grid grid- -fabric fabric- -config/documents/pan config/documents/pan- -lisa.pdf lisa.pdf config.web.cern.ch/hep � An RDBMS to replace PAN ? An RDBMS to replace PAN ? � – Features of PAN – Features of PAN – – What exactly would be replaced ? What exactly would be replaced ? – – Motivations: Motivations: � Arguments in favour of PAN Arguments in favour of PAN � � Arguments in favour of an RDBMS Arguments in favour of an RDBMS � � A concrete example A concrete example � – the SW configuration: an RDBMS prototype – the SW configuration: an RDBMS prototype � Estimation of Manpower & Time needs Estimation of Manpower & Time needs � if we go for an RDBMS if we go for an RDBMS Informal workshop Informal workshop March 8th 2005 2 March 8th 2005 An RDBMS for CDB ? Vé An RDBMS for CDB ? V éronique Lef ronique Lefé ébure bure 2
CDB Requirements: Summary CDB Requirements: Summary (See http://it http://it- -div div- -fio fio- -lcg.web.cern.ch/it%2Ddiv%2Dfio%2Dlcg/gcancio/cdb/ lcg.web.cern.ch/it%2Ddiv%2Dfio%2Dlcg/gcancio/cdb/ (See cdb_requirements_usesases.htm ) ) cdb_requirements_usesases.htm 1. 1. Content scalability Content scalability A. A. Automated updating of configuration Automated updating of configuration 2. Grouping of data (for re- -use) use) information 2. Grouping of data (for re information 3. Hierarchy B. Data privacy 3. Hierarchy B. Data privacy 4. 4. Inheritance (for no duplication of data) Inheritance (for no duplication of data) C. C. Inventory Inventory 5. 5. Overwriting Overwriting 6. Data types (basic, compound, user- -defined) defined) 6. Data types (basic, compound, user 7. Validation 7. Validation 8. 8. Schema: evolution and fields optional/obligatory Schema: evolution and fields optional/obligatory 9. 9. Data transformation functions Data transformation functions 10. Extensibility (for schema, data types, functions) 10. Extensibility (for schema, data types, functions) 11. Consistency 11. Consistency 12. 12. Transactions Transactions 13. 13. Rollback Rollback 14. History 14. History 15. CDB user scalability 15. CDB user scalability 16. 16. Abstraction Abstraction 17. 17. Content portability (not a CERN requirement) Content portability (not a CERN requirement) 18. Data read access 18. Data read access 19. Adding of new (sub) structures 19. Adding of new (sub) structures 20. 20. Modification performance Modification performance 21. 21. Software availability and portability (not a CERN requirement) Software availability and portability (not a CERN requirement) 22. User interfaces 22. User interfaces Informal workshop Informal workshop March 8th 2005 3 March 8th 2005 An RDBMS for CDB ? Vé An RDBMS for CDB ? V éronique Lef ronique Lefé ébure bure 3
An RDBMS to replace PAN ? An RDBMS to replace PAN ? Current system: PAN � Current system: PAN � (Source: http://hep http://hep- -proj proj- -grid grid- -fabric fabric- -config.web.cern.ch/hep config.web.cern.ch/hep- -proj proj- -grid grid- -fabric fabric- - (Source: config/slides/lisa- -06112002/ 06112002/ Lionel Cons) Lionel Cons) config/slides/lisa – PAN = PAN = “ “high high- -level description language to level description language to – describe system configurations” ” describe system configurations – Why a new language? To fulfill requirements Why a new language? To fulfill requirements – and/or preferences: and/or preferences: � High High- -level description level description � � Avoid information duplication Avoid information duplication � � Declarative specification Declarative specification � � Distributed administration Distributed administration � � Powerful validation Powerful validation � � Domain neutral Domain neutral � Informal workshop Informal workshop March 8th 2005 4 March 8th 2005 An RDBMS for CDB ? Vé An RDBMS for CDB ? V éronique Lef ronique Lefé ébure bure 4
Configuration Database Configuration Database (Slide from http://gcancio.home.cern.ch/gcancio/grid/taipei/taipei http://gcancio.home.cern.ch/gcancio/grid/taipei/taipei- - (Slide from elfms.ppt by German) by German) elfms.ppt GUI CDB S Q LEAF, LEMON, others RDBMS L S CLI O A pan P H XML T Scripts T P Current system: • Definition of templates Node • Compilation + validation Cache Management • Creation of XML files Agents • Flat copy of XML data into RDBMS for CCM all data except software package (RPM’s) Node and Monitoring configuration Informal workshop Informal workshop March 8th 2005 5 March 8th 2005 An RDBMS for CDB ? Vé An RDBMS for CDB ? V éronique Lef ronique Lefé ébure bure 5
PAN Templates PAN Templates Template examples (see following slides) � Template examples (see following slides) � – To illustrate the features of PAN To illustrate the features of PAN – – For persons not familiar with PAN For persons not familiar with PAN – – In particular, to see how configuration data In particular, to see how configuration data – can be organised in hierarchy, with inheritance can be organised in hierarchy, with inheritance and specialisation (overwriting) and specialisation (overwriting) – How users can define new variables, functions, How users can define new variables, functions, – data types,… … data types, – How data can be validated before How data can be validated before “ “commit commit” ” – Informal workshop Informal workshop March 8th 2005 6 March 8th 2005 An RDBMS for CDB ? Vé An RDBMS for CDB ? V éronique Lef ronique Lefé ébure bure 6
PAN Templates (1) PAN Templates (1) � Example: configuration of node Example: configuration of node “ “tbed007d tbed007d” ” � object template profile_tbed007d ; object template profile_tbed007d ; include pro_declaration_profile_base; include pro_declaration_profile_base; include pro_hardware_fileserver_elonex_800_ez; include pro_hardware_fileserver_elonex_800_ez; include pro_type_fileserver_generic7; include pro_type_fileserver_generic7; include netinfo_tbed007d; include netinfo_tbed007d; include diskinfo_tbed007d; include diskinfo_tbed007d; "/hardware/serialnumber" = "CH435- -109 109- -13"; 13"; "/hardware/serialnumber" = "CH435 "/hardware/cards/nic/0/hwid" = "00- -02 02- -E3 E3- -00 00- -3B 3B- -16"; 16"; "/hardware/cards/nic/0/hwid" = "00 � Grouping of data, host Grouping of data, host- -independent, re independent, re- -used by all similar hosts used by all similar hosts � � Adding of host Adding of host- -dependent data dependent data � Informal workshop Informal workshop March 8th 2005 7 March 8th 2005 An RDBMS for CDB ? Vé An RDBMS for CDB ? V éronique Lef ronique Lefé ébure bure 7
PAN Templates (2) PAN Templates (2) template pro_hardware_fileserver_elonex_800_ez pro_hardware_fileserver_elonex_800_ez ; ; template "/hardware/model" = "ez"; "/hardware/model" = "ez"; [… …] ] [ "/hardware/disks/_3ware_escalade/_0/_0/serialnumber" = ""; "/hardware/disks/_3ware_escalade/_0/_0/serialnumber" = ""; "/hardware/disks/_3ware_escalade/_0/_0/model“ “ "/hardware/disks/_3ware_escalade/_0/_0/model ="QUANTUM FIREBALLP AS20.5"; ="QUANTUM FIREBALLP AS20.5"; "/hardware/disks/_3ware_escalade/_0/_0/capacity"=20.54*GB; "/hardware/disks/_3ware_escalade/_0/_0/capacity"=20.54*GB; "/hardware/disks/_3ware_escalade/_0/_0/manufacturer“ “ "/hardware/disks/_3ware_escalade/_0/_0/manufacturer ="QUANTUM"; ="QUANTUM"; [… …] ] [ "/hardware/disks/_3ware_escalade/_2/_7/serialnumber" = ""; "/hardware/disks/_3ware_escalade/_2/_7/serialnumber" = ""; [… …] ] [ "/hardware/disks/_3ware_escalade/_2/_7/manufacturer"="IBM” ”; ; "/hardware/disks/_3ware_escalade/_2/_7/manufacturer"="IBM � Pre Pre- -defined fields, overwriten later (i.e. down) defined fields, overwriten later (i.e. down) � � User User- -defined variables defined variables � Informal workshop Informal workshop March 8th 2005 8 March 8th 2005 An RDBMS for CDB ? Vé An RDBMS for CDB ? V éronique Lef ronique Lefé ébure bure 8
Recommend
More recommend
