machine learning heralds the end of selenium
play

Machine Learning Heralds the End of Selenium Presented by: Jason - PDF document

Oct 16, 2023 •293 likes •558 views

W10 Test Analytics, AI/ ML Wednesday, May 2nd, 2018 1:45 PM Machine Learning Heralds the End of Selenium Presented by: Jason Arbon Appdiff, Inc. Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 888 --- 268 --- 8770

  1. W10 Test Analytics, AI/ ML Wednesday, May 2nd, 2018 1:45 PM Machine Learning Heralds the End of Selenium Presented by: Jason Arbon Appdiff, Inc. Brought to you by: 350 Corporate Way, Suite 400, Orange Park, FL 32073 888 --- 268 --- 8770 ·· 904 --- 278 --- 0524 - info@techwell.com - http://www.stareast.techwell.com/

  2. Jason Arbon Appdiff, Inc. Jason Arbon is the CEO of Appdiff, which is redefining how enterprises develop, test, and ship mobile apps with zero code and zero setup required. He was formerly the director of engineering and product at Applause.com/uTest.com, where he led product strategy to deliver crowdsourced testing via more than 250,000 community members and created the app store data analytics service. Jason previously held engineering leadership roles at Google and Microsoft and coauthored How Google Tests Software and App Quality: Secrets for Agile App Teams.

  3. 4/25/18 Machine Learning Heralds the End of Selenium Jason Arbon #STAREAST #AI @jarbon @testdotai 1

  4. 4/25/18 #STAREAST #AI @jarbon @testdotai 2

  5. 4/25/18 so 2004 #STAREAST #AI @jarbon @testdotai 4 Big Problems with Selenium / Appium #STAREAST #AI @jarbon @testdotai 3

  6. 4/25/18 You Have To Code #STAREAST #AI @jarbon @testdotai Element Selection #STAREAST #AI @jarbon @testdotai 4

  7. 4/25/18 Hard-Coded Step Sequencing #STAREAST #AI @jarbon @testdotai Little Reuse #STAREAST #AI @jarbon @testdotai 5

  8. 4/25/18 Automation breaks just when you need it. #STAREAST #AI @jarbon @testdotai Why AI? #STAREAST #AI @jarbon @testdotai 6

  9. 4/25/18 People can deal with change and the unexpected. #STAREAST #AI @jarbon @testdotai Test code can’t. #STAREAST #AI @jarbon @testdotai 7

  10. 4/25/18 How does AI fix all this? #STAREAST #AI @jarbon @testdotai AI works like People #STAREAST #AI @jarbon @testdotai 8

  11. 4/25/18 You Have To Code #STAREAST #AI @jarbon @testdotai Approach #2 Approach #1 Use Machine Learning Use Machine Learning to directly instead of Selectors. smartly update/repair Selectors when they break. #STAREAST #AI @jarbon @testdotai 9

  12. 4/25/18 Approach #1 Element Identification Old / Past VS Selenium IDE Test.ai Pain Finding Identifiers Auto Labeled Quick Visual Custom Labeling Have to write code (brittle) 10

  13. 4/25/18 Element Selection #STAREAST #AI @jarbon @testdotai 11

  14. 4/25/18 12

  15. 4/25/18 Hard-Coded Step Sequencing #STAREAST #AI @jarbon @testdotai Step Sequencing Old / Past VS Selenium IDE Test.ai Have to code exact steps. Familiar Cucumber/Gherkin Brittle when app changes. Only list labels of interesting steps and verifications. Also, GUI Editor #STAREAST #AI @jarbon @testdotai 13

  16. 4/25/18 #STAREAST #AI @jarbon @testdotai Test Execution Old / Past VS #STAREAST #AI @jarbon @testdotai 14

  17. 4/25/18 Little Reuse #STAREAST #AI @jarbon @testdotai AIT - Open - Manual Too #STAREAST #AI @jarbon @testdotai 15

  18. 4/25/18 Write Once, Run Cross Platform #STAREAST #AI @jarbon @testdotai Game-Changer: Write Once, Run on All Similar Apps #STAREAST #AI @jarbon @testdotai 16

  19. 4/25/18 Many Companies Working on AI for Testing #STAREAST #AI @jarbon @testdotai Harnessing Collective Intelligence For Testing 17

  20. 4/25/18 Leverage AI #STAREAST #AI @jarbon @testdotai Approach #3 Approach #1 Record and look for Record and auto Anomalies repair selectors Approach #4 Approach #2 Drag and Drop test Visual Differencing Cross Platform creation. AI executes tests like a human. #STAREAST #AI @jarbon @testdotai 18

  21. 4/25/18 Approach #1 Approach #2 19

  22. 4/25/18 Approach #3 Approach #4 20

  23. 4/25/18 Approach #4 Test Reporting Old / Past VS Test.ai Selenium IDE Q-Learning test step generation Many tests flaky/break as app changes Element Classifiers at runtime Simple pass/fail See test steps Presentable #STAREAST #AI @jarbon @testdotai 21

  24. 4/25/18 #STAREAST #AI @jarbon @testdotai #STAREAST #AI @jarbon @testdotai 22

  25. 4/25/18 jason@test.ai @jarbon #STAREAST #AI @jarbon @testdotai 23

Recommend

Selenium Selenium Edward Cerullo www.thecamp.dk 2014 Selenium What is Selenium? What is

Selenium Selenium Edward Cerullo www.thecamp.dk 2014 Selenium What is Selenium? What is

Selenium Selenium Edward Cerullo www.thecamp.dk 2014 Selenium What is Selenium? What is Selenium? What is Selenium? What is Selenium? What is Selenium? Selenium is a non-metal with properties between Sulfur (S-above) and Tellurium

639 views • 60 slides
March 27, 2019 Experiences and Challenges with Selenium Treatment What is Selenium (Se)

March 27, 2019 Experiences and Challenges with Selenium Treatment What is Selenium (Se)

Morgantown, WV March 27, 2019 Experiences and Challenges with Selenium Treatment What is Selenium (Se) A semi metallic element On the Periodic Table near Sulfur and Arsenic It mimics the characteristics of each Usually

626 views • 45 slides
Selenium Tutorial What is Selenium? Javascript framework that runs in your web- browser

Selenium Tutorial What is Selenium? Javascript framework that runs in your web- browser

Selenium Tutorial What is Selenium? Javascript framework that runs in your web- browser Works anywhere Javascript is supported Hooks for many other languages Java, Ruby, Python Can simulate a user navigating through pages and

310 views • 17 slides
An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning

An Exercise in An Exercise in Machine Learning Machine Learning http://www.cs.iastate.edu/~cs573x/bbsilab.html Machine Learning Software Preparing Data Building Classifiers Interpreting Results Machine Learning Software

496 views • 26 slides
Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by

Machine Learning By Alex Scarlatos What is Machine Learning? Machine Learning is the process by which computers can be trained through observation, rather than being explicitly programmed. Basically, a program is given input and adjusts its

556 views • 17 slides
Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning: Study of algorithms that improve their performance P at some task T

Machine Learning 10-601 Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 12, 2015 Today: Readings: What is machine learning? The Discipline of ML Decision tree learning Mitchell, Chapter 3

872 views • 29 slides
Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides
Selenium Dynamics in Mining- Influenced Headwater Streams of Central Appalachia Kriddie Whitmore

Selenium Dynamics in Mining- Influenced Headwater Streams of Central Appalachia Kriddie Whitmore

Selenium Dynamics in Mining- Influenced Headwater Streams of Central Appalachia Kriddie Whitmore Selenium: Trace Element Selenium: Both a Nutrient and a Poison Essential to many life forms -from bacteria to humans Used in

632 views • 36 slides
CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine

1/22/19 CS 335 Machine Learning What is Machine Learning? Dan Sheldon Spring 2019 What is Machine Learning? A Simple Task: Recognize Obama How do you program a computer to Recognize faces? Recommend movies? Decide which web

581 views • 5 slides
Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their

Machine Learning Machine Learning: algorithms that use experience to improve their performance We use machine learning in situations where it is very challenging (or impossible) to define the rules by hand: e.g. face detection

1.04k views • 28 slides
Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 12 Outline 1 Nearest Neighbor Prediction 2 Complexity Considerations 3 The Voronoi Diagram 4 Overfitting

564 views • 12 slides
1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

What is Learning? Herbert Simon: Learning is any process by which a system improves performance from CS 391L: Machine Learning experience. Introduction What is the task? Classification Problem solving / planning /

603 views • 6 slides
MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING

JACOPO DI IORIO, MATTEO FONTANA, DANIELE OCCHIUTO, CLAUDIA VOLPETTI MACHINE LEARNING, STATISTICAL LEARNING AND PARALLEL COMPUTING INTRODUCTION VS MACHINE LEARNING STATISTICAL LEARNING Separate evolutions, but with shared methodologies MERGE

565 views • 55 slides
Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine

Apache PredictionIO End-to-End Machine Learning Server with Apache Spark What is Machine Learning? What is Machine Learning? Examples of machine learning applications: Facial recognition software E-mail spam detectors Automated

302 views • 17 slides
Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning

Machine Learning 11 AI Slides (6e) c Lin Zuoquan@PKU 1998-2020 11 1 11 Machine Learning 11.1 Learning agents 11.2 Inductive learning 11.3 Deep learning 11.4 Statistical learning 11.5 Reinforcement learning 11.6 Transfer learning

1.7k views • 159 slides
Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Deep Learning: Intro Juhan Nam Review of Traditional Machine Learning The traditional machine learning pipeline Temporal Frame-level Unsupervised Classifier Summary

613 views • 27 slides
Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine

Machine Learning for Auto Optimization What is Machine Learning? Definition: Machine learning refers to any system where the performance of a machine in performing a task improves by gaining more experience in performing that task .

394 views • 27 slides
MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How

MACHINE LEARNING 2012 MACHINE LEARNING MACHINE LEARNING kernels 1 MACHINE LEARNING 2012 MACHINE LEARNING Kernels: Intuition How to separate the red class from the grey class? x 2 360 r x 1 Polar coordinates Data

1.04k views • 44 slides
BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest

photo:@rewardyfahmi // Unsplash BBM406 Fundamentals of Machine Learning Lecture 2: Machine Learning by Examples, Nearest Neighbor Classifier Aykut Erdem // Hacettepe University // Fall 2019 When Do We Use Machine Learning? ML is

1.33k views • 110 slides
Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a

Machine Learning Modeling and Learning 15-110 Monday 4/13 Learning Goals Given a dataset, identify features which may help predict information about the data Identify common types of machine learning algorithms 2 Machine

553 views • 27 slides
Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in

Machine Learning @ Amazon Ralf Herbrich Amazon 6/29/17 1 Overview Machine Learning in Practise Probabilities Finite Resource Machine Learning @ Amazon Forecasting Machine Translation Visual Systems Conclusions

348 views • 34 slides
Selenium in OpenQA testing web pages and more Ondrej Holecek me@aaannz.eu OpenQA system

Selenium in OpenQA testing web pages and more Ondrej Holecek me@aaannz.eu OpenQA system

Selenium in OpenQA testing web pages and more Ondrej Holecek me@aaannz.eu OpenQA system Release management tool .. with included acceptance/integration testing 2 OpenQA tests UX focus Multi-Machine - parallel, serial, results

552 views • 14 slides
Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning?

CS6501: Deep Learning for Visual Recognition Softmax Classifier + SGD Todays Class Intro to Machine Learning What is Machine Learning? Supervised Learning: Classification with K-nearest neighbors Unsupervised Learning: Clustering with

1.36k views • 91 slides
Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton

Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton

Neural Networks for Machine Learning Lecture 1a Why do we need machine learning? Geoffrey Hinton with Nitish Srivastava Kevin Swersky What is Machine Learning? It is very hard to write programs that solve problems like recognizing a

514 views • 48 slides

More recommend