Robot assisted interaction system and method thereof
Published in USPTO, 2018
Recommended citation: Ming-hsun Hsu, Cheng-Yan Guo, Yao-Tsung Chang, Chia-Hung Kuo https://github.com/GCY/GCY.github.io/blob/master/files/US20190240842A1.pdf
A robot assisted interactive system comprises: a mobile device having a display unit for displaying visual content, a touch control unit for receiving user input, a camera unit for obtaining user reaction information, a communication unit for transmitting the use reaction information to a backend server, and a processing unit for controlling the abovementioned units; a robot that includes a gesture module for generating gesture output according to the visual content, a speech module for generating speech output according to the visual content, a communication module for establishing connection with a backend server, and a control module for controlling the abovementioned modules; and a backend server configured to generate a feedback signal in accordance with the reaction information and send it to the mobile device; so as to update the visual content on the mobile device, and cause the robot to generate updated gesture output and speech output.