Home / Design / Augmented Reality: a predictive maintenance solution

Augmented Reality: a predictive maintenance solution

Most people in technical and assembly roles are good visual and practical learners, so being able to train, or be coached through a complex assembly or service task visually can be a great advantage. Source: Mitsubishi Electric Europe B.V.

The computer games generation was always a refence to teenagers … well it was in the ‘80s and ’90s (to save you looking it up, the ZX Spectrum was first launched in the UK in 1982).

It’s no surprise then that most engineers working now are comfortable with digital interface technology and that the latest developments in Augmented Reality have quickly been applied to making improvements on the factory floor.

Mitsubishi Electric is planning a commercial roll-out for this next generation of interface technology as a predictive maintenance solution for its more advanced factory automation equipment such as the MELFA series of industrial robots.



The system uses predictive maintenance models and simulations based on actual usage and wear characteristics to provide information on the robot’s condition and future maintenance requirements.

Direct communication between the smart device and the machine controller allows for useful information and controls to be displayed on a visual, easy to understand interface. Source: Mitsubishi Electric Europe B.V.

Guidance on the maintenance tasks to perform is then provided to the operator via Augmented Reality (AR), using smart glasses.

To add a further sci-fi style aspect to the solution, the actual data processing and intelligence is cloud-based, using live access to the IBM Watson Analytics AI platform to make accurate predictions and select a course of action.

Once the AR platform is enabled, smart glasses can provide visual status information at any time, plus recommendations on action to take and then the information you might need to carry out problem solving or service work.

Component visuals based on CAD drawings superimposed over the robot are possible, as is access to service manuals or even step-by-step instructions.

Tooling-up for the future

Robots aren’t the only option; machine tool operators can go a step further and use the AR interface for direct machine interaction and training.

Developed in partnership with the Fraunhofer Institute for Production Technology IPT, another application being demonstrated by Mitsubishi Electric uses smart tablets and smart glasses as a user-interface for a 5-axis CNC machine tool via the company’s CNC controller.

Direct communication between the smart device and the machine controller allows for useful information and controls to be displayed on a visual, easy to understand interface. By providing the operator with more real-time data analysis and evaluation within the information system, decisions can be made more quickly.

For monitoring, operators can display up-to-date production information, such as progress, remaining time, machine status or wider performance parameters such as overall equipment effectiveness (OEE).

Making a system like this work for direct control and not just predictive maintenance depends on a direct exchange between the machine control system and the smart device.

Communications must be close to real-time, as information is often time-critical, requiring immediate action or intervention. What it does is provide a higher level of real-time information transparency for the operator, as raw data is continually processed, visualised and automatically updated within the smart device.

Pre-defined error libraries and codes are translated into meaningful messages conveying possible causes and instructions for rectification. The result is that the reaction time to solve issues is reduced while production levels and OEE can be increased.

More options in a mixed virtual/real environment

Most people in technical and assembly roles are good visual and practical learners, so being able to train, or be coached through a complex assembly or service task visually can be a great advantage. It is easy to see how if an assembly worker or service engineer is made aware of what to do in a clearly presented sequence with actions and components overlaid over their vision using smart glasses for example, then they will be able to learn and ‘do’ at the same time. It also leaves both hands free to carry out the task in question.

The same technology is equally as beneficial in a pure training scenario, accessing a library of videos, PDFs or other training content that can then be displayed via the smart device.

Making use of smart devices in a practical industrial environment depends on the integration and linking of the device into the relevant system; be that for accessing data processing, input from artificial intelligence, a robot controller or a CNC controller. This has been one of the main reasons for the cooperation between Mitsubishi Electric and several of its technology partners, to develop useable solutions.

These innovations are designed to improve the practical everyday operation of plant systems and make industrial processes more cost-effective, as they lower production costs, increase production output from a smaller footprint, and provide more flexible and easily customisable production systems.

For all those who remember the feel of the rubber keys on an early games console, and all those who have since adapted to changes in the way we interface with technology, these latest solutions are not creating an alternate reality, more bridging the gap between people and machines as we move into the future.

Check Also

Inner or outer? Rotor position specification for miniature DC motors

To get the most from miniature motion technology, a key design specification is whether to …

Polycarbonate enclosures protect crane control architecture in corrosive atmospheres

Galvanising plants need heavy lifting capabilities, but these systems must be able to endure an …

Firmware enables faster drive-to-drive communication and more flexible exchange of CANopen process data

The COMBIVERT F6 and S6 drive controllers from KEB Automation are now available with new …