Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VideoPose3D_Kinect_GUI run error #3

Open
KungZell opened this issue May 29, 2023 · 4 comments
Open

VideoPose3D_Kinect_GUI run error #3

KungZell opened this issue May 29, 2023 · 4 comments

Comments

@KungZell
Copy link

Hello,@spianmo ,Thank you very much for the great work you have made public.
In running the HealBone mediapipe project I encountered the error No module named 'widgets.CTitleBar' and the realtime human skeleton viewer has no content to display.
Also I would like to ask if the project can support more than one Kinect camera and how to use it, I look forward to your reply, thanks a lot!

@spianmo
Copy link
Owner

spianmo commented May 29, 2023

The main entrance of the program is HealBone_GaitStudio.py. VideoPose3D_Kinect_GUI is a temporary experiment for me to infer human body posture in 2D space to human body posture in 3D space. The z coordinate deduced by VideoPose3D is not enough to support the calculation of joint range of motion ROM, so I use Kinect TOF The spatial depth is read, and the depth read by Kinect is used for alignment, and then used as the spatial coordinate system z. In addition, this project is based on the monocular camera, the triangulation correction of the multi-camera, etc., because of time reasons, it has not been further completed.

@spianmo
Copy link
Owner

spianmo commented May 29, 2023

It is not recommended to use VideoPose3D to estimate the z-axis depth in the 3D coordinate system. It will be very inaccurate when calculating the angle of human joints. In addition, only using mediapipe to estimate the z-axis depth is also very inaccurate. After experimenting, I finally chose kinect instead of real sense. Kinect is quite accurate for depth measurement, but the depth image will be affected by light refraction and reflection, resulting in gaps and holes. Currently, I use some filters of opencv to complete the holes filling.

@spianmo
Copy link
Owner

spianmo commented May 29, 2023

Therefore, the current example is a combination of monocular Kinect and Mediapipe, which is used to visualize and measure the ROM of joint motion in real time, measure and calculate various sports medical indicators according to the preset calculation rules dsl of each part, and output medical tests Report

@spianmo
Copy link
Owner

spianmo commented May 29, 2023

from widgets.CTitleBar import CTitleBar
This line of import statement can be deleted, it is not actually used

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants