Baid idu Clo loud In Industry ry Quali lity In Inspection Solu lution Baidu Inc. Lei Nie 2019.3.18
Highest Labor Cost in Complex Cosmetic Defect Inspections Previo vious us machine hine visio sion n automat mation ion soluti lution n still ll canno not t solv lve this s problem lem Target product(e.g.) The comp mple lexity ity and varia iabil ility ity of cosmet smetic ic defe fect ct The comp mple lexity ity and varia iabil ility ity of products’ surface Limit itatio tions ns of traditi itional nal rule le- base sed machine hine- visio sion n algorithm hms Human inspections industry current cycle time labor amount avg. labor cost Monthly inspection labor cost % of inspection labor # daily output from 20% to 40% in past 3 3C 2.3 million pcs 19 pcs/person/min 261 7800 RMB 2.03 million RMB yrs.
Unified Terminal-Cloud Quality Inspection Solution Baidu Industry Quality Inspection Platform （ Public Cloud) Image Model Model Model Data AI model Annotation Training Testing Downloading Uploading training Application Model Store closed Defection New Defection loop Intelligent Model Integration Synthesis Discovery Annotation Terminal- 3C Terminal Registration & Heterogeneous Model Cloud Model Synchronization Configuation Optimization Cooperativ e Control Data Uploading Model Downloads BIE runtime package Device Admittance Data Communication Quality Intelligent Industrial Inspection Application Quality Inspection Personal Human inspections Box Iron Integrated Machine Computer (Embedded Terminal) Etc.. Multiple Computation Powers
5 Key Features on Baidu Industry Quality Inspection Defection Intelligent Data New Defect Edge-Cloud Heterogeneous Synthesis for New Annotation Discovery Association Inference Engine Product Line Over 80% Data Best Fast Product Line Discovery Human inspections Labeling Time Performance-Cost Translation Unclassified Model and Data Reduced Balance Defect Cycle
Intelligent Data Annotation Annotation : Slow( usually > 50s per object) → Potential Defect Suggestion ( > 80% precision ) Coarse ( approximated polygon) → Automatically Segment Foreground (only 4 corners) Interactive Segmentation Input Image Predefined Defected Area
Intelligent Data Annotation- Interactive Segmentation Interactive Segmentation: class-agnostic semantic segmentation with global context heatmap to acquire high accuracy Deep Segmentation from Extreme Points
Heterogeneous Inference Engine Anakin- Baidu Heterogeneous Inference Engine 1 、 Multiple Deep Learning Framework 2 、 Graph Merging and memory re-using 3 、 Address Pre-Mapping 4 、 Heterogeneous Assembly Optimized
Intelligent Defection Synthesis New Product Line Cold Start: Transfer time-consuming labeled data collection (> 3 months) to 30 minutes Mono Defect-Free Sample Mono Defect Sample Poly Defect Synthesised Sample Decoding Encoding Transformation Poly Defect-Free Sample Decision [0,1] Discriminative Network
Intelligent Defection Synthesis Y F(Y) X G(X) F(G(X)) G(F(Y)
New Defection Discovery Maintenance : Discovery un-classified defect for model optimization Novel Defect discovery: discover un-predefined defect by modeling defect-free image Apple iWatch Charger Textured Anomaly Dataset
New Defection Discovery Network: ⚫ Reconstruction Network: Denoising/Variation AutoEncoder ⚫ Discrimination Network: Detect Anomaly Samples Loss Function: ⚫ Encoding Loss: latent variable loss ⚫ Content Loss: Ensure the reconstructed image ⚫ Adversarial Loss: Ensure the authenticity of samples generated DAE Normal samples DAE Anomaly samples
Edge Cloud Synchronization mqtt/https Cloud Baidu Intelligent Edge(BIE) Framework Management master Docker network:openedge Agent container mqtt 1 、 Hardware and Framework Transparency Openedge Remote mqtt （ iothub ） Reload mqtt container Engine 2 、 Edge-Cloud Association Openedge Hub (docker client) Developed in the cloud, Run on the edge mqtt container Results upload for a further Module analysis Openedge_Function Start/Stop 3 、 AI on the Edge Device Monitor, Config, Control instance Routing Rule pool http Api grpc container 4 、 Seamless Integration with Industrial Inspection function runtime instance
Baidu Cloud ABC Integrated Industrial Inspection Developed in the cloud, Run on the edge Results upload for a further analysis High-Performance Industry Inspection Device Monitor, Config, High Performance-Cost Industry Inspection Control Feature Basically Meet the AQL and FP Feature Strictly Meet AQL and FP for super-star Replace the Entire- workers(Verification Replace 100% labor + Computer Center + Scenario Scenario worker reserved) ， rapidly deployment Quality Tracing Center Rapid labor-saving for small incorporation Digital Industrial Inspection for large Customer with sailing and renting Customer company ( > 200+, 1 millon RMB per （ > 2000, renting for 10,000 per month) Machine)
Recommend
More recommend
