Skip to content

Integrating Augmented Reality within Digital Twins for Smart Robotic Manufacturing Systems

Notifications You must be signed in to change notification settings

testbedCIIRC/augmented-reality-integration-within-dt

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 

Repository files navigation

Integrating Augmented Reality within Digital Twins for Smart Robotic Manufacturing Systems

This repository contains files for the paper titled "Integrating Augmented Reality within Digital Twins for Smart Robotic Manufacturing Systems," with Tomáš Jochman as the main author. To get the source codes and project, please contact one of the authors tomas.jochman@cvut.cz or pavel.burget@cvut.cz.

Citation: T. Jochman et al., “Integrating augmented reality within digital twins for smart robotic manufacturing systems,” in 2024 29th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA). Padova, Italy: IEEE, 2024.

This paper explores integrating augmented reality into robotic manufacturing systems to enhance connectivity, real-time data processing, and interactive visual interfaces. Using Hololens 2 headsets with OPC UA clients, the system directly interfaces operators with digital and physical manufacturing components. The architecture leverages augmented reality for advanced operational control and visualization in tasks such as multi-axis additive manufacturing, robotic sanding, and screwing with integrated cameras. This integration advances manufacturing processes by enabling interactive operator engagement, optimizing workflows, and improving precision and efficiency in a smart factory setting.

Key Features

  • Augmented Reality Integration: The system leverages Hololens 2 headsets to create an immersive AR interface, enhancing operator interaction with digital twins in robotic manufacturing environments.
  • Real-time Process Monitoring: Advanced tools within the architecture provide real-time data analytics and monitoring capabilities, ensuring precise and efficient manufacturing operations.
  • Virtual Robot Controller and Operator Training: The virtual robot controller allows for safe and flexible manipulation outside the actual work cell, providing an effective platform for training future operators and testing new procedures without disrupting ongoing manufacturing processes.
  • Seamless Integration with Existing Systems: The architecture integrates with existing robotic controllers and OPC UA communication protocols, facilitating seamless interaction between digital and physical components in the manufacturing process.

Videos - Robotic Additive Manufacturing - Training and Operation

Watch the video Watch the video

Videos - Robotic Sanding with 3D Camera - Training and Operation

Watch the video Watch the video

Videos - Robotic Screwing with Camera - Training and Operation

Watch the video Watch the video

About

Integrating Augmented Reality within Digital Twins for Smart Robotic Manufacturing Systems

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published