Key Takeaways
Here are the essential steps for building a successful strategic plan and implementing deep learning in your manufacturing processes.
- Form a cross-functional team to define goals and assess deep learning’s potential.
- Choose a “lighthouse” project with realistic goals to prove ROI.
- Deep learning excels where traditional systems fail, handling complex variations and defects.
- Train systems with labeled datasets to distinguish good parts from defects effectively.
Deep learning can help in such scenarios, but successful implementation and eventual results are dependent on taking the necessary steps up front. Typically, deep learning projects involve four steps: planning, data collection and ground truth labeling, optimization, and factory acceptance testing. Here we look at what goes into step 1, the planning phase.
Gather a team, identify goals
If a company decides to implement a deep learning solution, it must put together a team of different stakeholders to look at the current process, define new goals, and determine whether deep learning can help achieve these goals. This team should be comprised of factory management, automation, QA, and a system integrator/machine builder. Goals must be well-defined, consistent, and mutually agreed upon by everyone on the team. They might include reducing defective/unacceptable product escapes (underkill), controlling costs by reducing scrap (overkill) or defective/unacceptable products or parts, or providing additional defect classification capabilities beyond a good-versus-bad determination.
If the collaborative team decides to move forward, one step involves identifying a “lighthouse” project that can be used to justify the expenditure of resources to management. This project should not involve unrealistic goals. It should be a project that is not too easy or too difficult, and one that can produce solid returns to let management know that future deep learning deployments may be viable.
Picking a project, moving forward
For some manufacturers, an existing machine vision solution might have produced too many false negatives or false positives, or the system might have stopped working well due to too many product variations or environmental changes. In automotive electronics inspection, for instance, terminal spot welding applications can present problems for rules-based systems.
Terminal spot welding produces a wide variety of weld types — including hairpin, wire-to-pad, and wire-to-wire — and these create a slightly variable 3D metal projection with reflective surfaces. When a machine vision system captures terminal spot weld images, they often contain reflections, shadows, colored regions, and surface texture, even with optimal parts. These effects are often similar to actual defects, such as cracks, scratches, burns, and excessive or missing welds. These natural variations create problems in traditional machine vision systems due to their inability to reliably inspect welds and distinguish good parts from bad.
Deep learning-based inspection systems are trained on datasets that are evaluated and labeled by internal experts. This helps the software distinguish between good and bad parts and even identify the type of problem in a defective product. With such capabilities, deep learning software provides a viable alternative to manual inspection and electrical testing, and steps in where rules-based algorithms cannot perform.
In part 2 of this blog series, we will look at Data Collection and Ground Truth. Read part 3 to learn about Optimizing your Deep Learning Deployment and Part 4 Factory Acceptance Testing.