Reference: P18051713561 DMVC Robotics and Vision Prodrive ... · Slide 1 of [22] a passion for...
Transcript of Reference: P18051713561 DMVC Robotics and Vision Prodrive ... · Slide 1 of [22] a passion for...
Slide 1 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]a passion for technology
Date:
Reference:
Author(s):
Distribution:
Attendees marked with *
Template PN: 6001-1246-5509
Prodrive Robotics Solutions
P18051713561 – DMVC Robotics and Vision
Thomas Woudsma
-
2018-05-17
Machine vision for accurate detection and inspection in robotic factory automation
Slide 2 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
https://www.youtube.com/watch?v=fwNtFkFae84
Slide 3 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Slide 4 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Air quality sensorsSmart thermostatAsset management module
Linear actuators Component alignment sensor Automotive ECU
Slide 5 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Slide 6 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
PCB
PCB Assembly
Through-hole components
SMD components
Plastics
Final product
Also testing, inspection, packaging
Inbound Logistics
Component PickingProduct Assembly
AGV
Injection Moulding
Slide 7 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
- Component Detection:- Scattered components
- Ordered components
- Sealant Inspection
Slide 8 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
CONTROL CABINET
2B 1B
Filled trays
Empty trays
Components
1A
3B
ComponentFeeder
FOV
Q
Slide 9 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Automated Assembly Line
Slide 10 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
• Using Template Matching1. Crop template from image
2. Shift template over image
3. Calculate cross correlation
4. Apply threshold on cross correlations
• Speed optimization• Generate candidates
• Obstructions?• Background matching
• Chamfer matching
Slide 12 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Robot cell top view
Component tape reels
Slide 13 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Robustly detect position, size and height of 3D component tapes using a stereo camera.
Component tapes Point cloud from stereo camera Tape position, size and height
Slide 14 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Detect defects in sealant path (discontinuities/ misplacement)
Sealant Contour Sealant Width Sealant Path
Slide 15 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Sealant path from:
- Background subtraction, filtering & thresholding
- Watershed
Result:
- Segmentation + boundaries from CAD
Reference image Sealant image Segmentation
Boundaries (CAD)
Result
Slide 16 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
- Sub-pixel accurate component detection - Model-guided detections
- FOV 600mmx400mm
- Overcome perspectivedistortions
- Anomaly detection with Deep Learning
- Label inspection and verification
- Looking for People with Technology in their Veins!
Slide 18 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Slide 19 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
Generic Automation Solutions with MV for:
• Component detection for assembly and bin picking• Support for many scattered and ordered components
• 3D stereo vision for tape detection
• Sealant inspection• Model-driven, high sensitivity
• First big milestones towards Lights-Out Factory!• Automated assembly (MV detection & inspection)
• Injection Moulding + PCBA
• AGV
Slide 20 of [22]
Reference: [P18051713561 – DMVC Robotics and Vision]
a passion for technology
Prodrive Technologies
T +31 40 2676200
I www.prodrive-technologies.com