혼합현실기반 비접촉식 협동로봇 조작 시스템

Abstract

Extended reality (XR), which encompasses Augmented reality (AR), Virtual reality (VR) and Mixed reality(MR) has been extending its value in various fields. Collaborative robot, also known as cobot, has become a major technical trend in manufacturing due to its productivity and efficiency. This study proposes an integrated system of MR and collaborative robot using vision-based camera pose estimation and Vuforia SDK. It utilizes the hand and gesture recognition of a MR device to ensure the intuitive manipulation. The proposed system is expected to be developed as a collision avoidance system using MR techniques in the future. And other types of robot which is available of vision technique can also be employed for intuitive manipulation system as well.