SAHARA Project overview and update TELLES NOBREGA IRC: - PowerPoint PPT Presentation

May 2019 SAHARA Project overview and update TELLES NOBREGA IRC: TELLESNOBREGA EMAIL: TENOBREG@REDHAT.COM

What does Sahara do? • Data processing service • Provides a way to deploy data processing clusters with minimum effort from the user. • Provides the capability to manage the clusters and submit jobs to them.

Project background • First official release was Juno • 19 contributors for latest release • 3 ATC

Quick Overview ● Cluster ○ Node Group Templates ○ Cluster Templates ● Jobs - EDP (Elastic Data Processing) ○ Data Sources ○ Job Binary ○ Job Templates

Architecture

New features & enhancements in Stein ➡ RELEASE OF APIv2 AS STABLE • APIv2 is here. Finally made it and it opens up new possibilities. Clean up of APIv1 and can be improved with microversioning on the future. ➡ PYTHON 3 FIRST SUPPORT • Sahara now is able to run with python 3 ➡ SPLIT PLUGIN FROM SAHARA CORE • Plugins now live outside of the Sahara main code

Stein release themes for Sahara MINOR MAJOR NOT A NO MAJOR NOT A FOCUS FOCUS FOCUS FOCUS FOCUS FOCUS INFO FOCUS SCALABILITY RESILIENCY MANAGEABILITY MODULARITY NO NO NO MINOR MINOR MAJOR INFO INFO INFO FOCUS FOCUS FOCUS INTEROPERABILITY SECURITY USER EXPERIENCE

Possible features & enhancements for Train ➡ IPv6 SUPPORT • Aligned with community goal to full support IPv6 ➡ PYTHON SPARK EDP • We need to fix the running of Python Spark Jobs ➡ PYTHON 3 AS DEFAULT • Python 2 time is running out, we need to move to python 3 full support asap ➡ CASTELLAN INTEGRATION REVISIT • We have castellan integration, but not really.

Train release themes for Sahara MINOR MINOR MAJOR NOT A NO MAJOR NOT A FOCUS FOCUS FOCUS FOCUS FOCUS FOCUS INFO FOCUS SCALABILITY RESILIENCY MANAGEABILITY MODULARITY NO NO NO MINOR MAJOR FOCUS INFO INFO INFO FOCUS FOCUS INTEROPERABILITY SECURITY USER EXPERIENCE

We need your help! • QUESTION 1: What services would you like to see supported in Sahara? • QUESTION 2: What are the main issues that you have while using Sahara?

THANKS! Questions? openstack @OpenStack openstack OpenStackFoundation