analyzing pwned passwords with spark
play

Analyzing Pwned Passwords with Spark Kelley Robinson - PowerPoint PPT Presentation

Analyzing Pwned Passwords with Spark Kelley Robinson @kelleyrobinson Developer Evangelist + @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data Security BIG DATA & SECURITY


  1. Analyzing Pwned Passwords with Spark Kelley Robinson @kelleyrobinson Developer Evangelist

  2. +

  3. @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data ∩ Security

  4. BIG DATA & SECURITY @KELLEYROBINSON

  5. BIG DATA & SECURITY @KELLEYROBINSON Apache Spark Ecosystem

  6. @KELLEYROBINSON BIG DATA & SECURITY Spark Abstractions Then RDD (Resilient Distributed Dataset) DataFrames / Datasets Now

  7. @KELLEYROBINSON BIG DATA & SECURITY RDDs • Immutable & distributed collection • Unstructured data • Low-level transformation and control https://databricks.com/blog/2016/07/14/a-tale-of-three-apache-spark-apis-rdds-dataframes-and-datasets.html

  8. BIG DATA & SECURITY @KELLEYROBINSON https://databricks.gitbooks.io/databricks-spark-knowledge-base/content/best_practices/prefer_reducebykey_over_groupbykey.html

  9. @KELLEYROBINSON BIG DATA & SECURITY Datasets • Structured data • Strongly typed • Fast https://databricks.com/blog/2016/07/14/a-tale-of-three-apache-spark-apis-rdds-dataframes-and-datasets.html

  10. @KELLEYROBINSON BIG DATA & SECURITY Datasets • Structured data • Strongly typed • Fast • SQL DSLs

  11. BIG DATA & SECURITY @KELLEYROBINSON Apache Spark Ecosystem

  12. BIG DATA & SECURITY @KELLEYROBINSON Scala has the most robust language API

  13. BIG DATA & SECURITY @KELLEYROBINSON https://www.slideshare.net/databricks/composable-parallel-processing-in-apache-spark-and-weld

  14. BIG DATA & SECURITY @KELLEYROBINSON https://twitter.com/CamJo89/status/996497423621996544

  15. @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data ∩ Security

  16. @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data ∩ Security

  17. https://twitter.com/dog_rates/status/986762231290490881

  18. @KELLEYROBINSON BIG DATA & SECURITY Benefits Fast Flexible Good for exploration Proven for large systems

  19. @KELLEYROBINSON BIG DATA & SECURITY Challenges Opaque error messages Operationalizing Documentation http://heather.miller.am/blog/launching-a-spark-cluster-part-1.html

  20. BIG DATA & SECURITY @KELLEYROBINSON 👎💰 The missing Spark documentation https://jaceklaskowski.gitbooks.io/mastering-apache-spark/content/

  21. @KELLEYROBINSON BIG DATA & SECURITY Spark: then and now The state of passwords Spark in action Big Data ∩ Security

  22. BIG DATA & SECURITY @KELLEYROBINSON

  23. @KELLEYROBINSON

  24. BIG DATA & SECURITY

  25. THANK YOU! @kelleyrobinson

  26. BIG DATA & SECURITY @KELLEYROBINSON Spark Resources • Apache Spark • Jacek's Spark Documentation • Zeppelin • RDDs vs. Datasets • Running Spark on a Cluster Security Resources • Pwned Passwords • Reverse SHA1 hashes • LastPass and 1Password • 2FA Guides

Recommend


More recommend