|
As shown in this picture.
The gesture artificial intelligence recognition results are obtained by capturing the operator's gestures through the camera. From the predefined observer angle, the recognized gestures, finger skeletons and other information can be rendering in the extended reality virtual space. The left side of the picture shows the perspective of the gesture operator. The left and right hands have been recognized and rendered by the MediaPipe hand recognition module as 3D virtual gestures and skeletons (purple line segments). The right side of the picture is the perspective facing the gesture operator. Hence, the virtual rendering result of the gesture appears in a shadow state (darker gray) instead of the reflection on the left (whiter and brighter). It shows that the 3D virtual gestures and skeletons drawn using the MediaPipe hand recognition module can be quickly integrated into the extended reality virtual environment. Users can be more intuitive and intuitive of manipulating virtual objects in extended reality.
|