agustinus nalwan
play

Agustinus Nalwan Head of AI Carsales.com.au Carsales Car Buying - PowerPoint PPT Presentation

Mar 11, 2024 •519 likes •1.36k views

MYSTIQUE THE FIGHT AGAINST REGO PLATE CLONER Agustinus Nalwan Head of AI Carsales.com.au Carsales Car Buying & Selling Private and Dealer +230k cars 5000 new cars /day Bikes, boats, trucks, A LITTLE BIT ABOUT

  1. MYSTIQUE 
 THE FIGHT AGAINST REGO PLATE CLONER Agustinus Nalwan Head of AI Carsales.com.au

  2. Carsales • Car Buying & Selling • Private and Dealer • +230k cars • 5000 new cars /day • Bikes, boats, trucks, …

  3. A LITTLE BIT ABOUT MYSELF AI 4 YEARS

  4. WEEKENDS PROJECT

  5. WIFE’S QUESTION

  6. WHAT SHOULD I WEAR TODAY?

  7. WHAT SHOULD I WEAR TODAY?

  8. WHAT SHOULD I WEAR TODAY?

  9. MVP CLOTHES DAIRY MOBILE APP

  10. FIRST STEP AUTOMATIC OUTFIT CAPTURE

  13. CHALLENGES Mother In Law Problem

  15. Mother In Law Avoidance Subroutine SEVERAL WEEKENDS LATER

  17. MYSTIQUE 
 THE FIGHT AGAINST REGO PLATE CLONER

  18. AI PRIVACY

  19. MYSTIQUE PROTECT PRIVACY

  20. WHAT IS REGO CLONNING?

  21. GREG

  22. GREG’S CAR COAD133

  23. HIS CAR COAD133

  24. CRIMINAL ACTIVITIES

  25. HAPPENED TO MANY OTHERS PRIVATE AND DEALER

  26. “In 2017, a single dealer received more than $16,000 in fines as a result of a cloning incident”

  27. VICTORIA $20 million fuel theft / year

  28. SOLUTION

  29. MYSTIQUE DETECT AND BLUR REGO PLATES

  31. HOW DOES IT WORK

  32. HOW DO WE BUILD IT

  34. REGO DETECTION TECH

  35. AMAZON SAGEMAKER OBJECT DETECTION ALGORITHM

  36. AMAZON SAGEMAKER 1,500 images • 2 weeks dev • time 1.5 weeks data • preparation

  37. BLURRING API "bboxArea": { "x1": 497, "y1": 247, AND "x2": 536, "y2": 273 }

  38. ONE WEEK AFTER THE PILOT...

  40. FALSE POSITIVE

  41. FALSE POSITIVE

  42. BIAS TRAINING SET

  43. TRAINING SET

  44. Positive Sample

  45. Positive Sample Negative Sample

  46. AMAZON SAGEMAKER TRAINING

  47. MANDARIN COME TO THE RESCUE

  48. AMAZON SAGEMAKER Rego Plate (x1, y1, x2, y2)

  49. GENERATING NEGATIVE SAMPLES

  50. AMAZON SAGEMAKER Rego Plate (x1, y1, x2, y2) Mandarin (x1, y1, x2, y2)

  51. COMPARISON False Positive Rate 19% 0.5% Old Model New Model

  52. IMAGES

  56. IMAGE METADATA ● Orientation ● Color Profile

  57. OTHERS Formats (HEIC, PNG, GIF)

  58. GO LIVE!

  59. STATS ● 150,000 Photos / Day ● 8 Sec Response Time ● 0.5 % False Positive ● 3.0 % Miss Blurring

  60. MONITORING ● SumoLogic ● Prometheus ● Customer Service Feedback

  61. SUMOLOGIC MONITORING

  62. PROMETHEUS

  63. Cost CPU RAM

  64. CUSTOMER SERVICE FEEDBACK

  65. POSITIVE FEEDBACK “One of our plates were cloned online and racked up several red light tolls. Wasted 2 months and a lot of money on this. Now, at least I have a sense of security with Mystique ” - Dealer M

  66. UNEXPECTED FEEDBACK “Hi Team. My number plate has been cloned as confirmed by VIC police. Kindly blur my number plates for the car please. Thanks” - Seller A

  67. NEGATIVE FEEDBACK ● Some people do not want blurring

  68. NEGATIVE FEEDBACK ● Photos were wrongly blurred

  69. EXISTING FEEDBACK SYSTEM SLACK CHANNEL

  70. IMPROVEMENT

  72. NEW FEEDBACK SYSTEM Update & Retrain Reported Feedback and Fix MYSTIQUE Draw Bounding Box Wrongly Blurred Image

  73. NEW FEEDBACK SYSTEM

  74. FUTURE CAN WE DO BETTER?

  75. GENERATIVE ADVERSARIAL NETWORK

  77. PLATE REMOVAL

  80. TAKEOUT • AI vs Privacy • Monitoring Tools • Self Reporting

  81. THANK YOU

  82. QUESTION?

More recommend