A Cognitive Digital Twins Framework for Human-Robot Collaboration
Yanjun Shi, Weiming Shen, Lihui Wang, Francesco Longo, Letizia Nicoletti, Antonio Padovano
Abstract
This paper proposes a cognitive digital twin framework for smart manufacturing, and especially for human-robot-collaboration cases. The proposed framework comprises three layers (field, edge, and cloud layers) based on the 5G communication network. In the field layer, the physical twin’s data from the physical machine and human operators are transmitted through the edge layer and then to the cloud layer to virtualize the digital twin. The cloud layer generates inference model generation by deep learning training and updates the inference model in the edge layer to make the field’s machine smart. Especially, human operators’ models are built based on the multimodal fusion in the cloud layer for cognitive function. Also, edge-cloud collaborative computing is presented to implement the proposed framework. Finally, the study is validated with a human-robot-collaboration case involving 5G edge computing.