SCOPE icon indicating copy to clipboard operation
SCOPE copied to clipboard

Questions about 2d keypoints.

Open quqixun opened this issue 3 years ago • 3 comments

  1. Did you apply Halpe-FullBody to extract 2d keypoints?
  2. How to get keypoints thorax and chest ?

quqixun avatar Jul 14 '22 03:07 quqixun

  1. Did you apply Halpe-FullBody to extract 2d keypoints?
  2. How to get keypoints thorax and chest ?

Have you found any solution to get the preprocessed 2D keypoints? Applying the keypoints from Halpe-FullBody, SMPL parameters cannot be optimized properly.

mamicro-li avatar Jan 17 '23 05:01 mamicro-li

Hello, sorry for the late reply.

  1. Did you apply Halpe-FullBody to extract 2d keypoints?
  2. How to get keypoints thorax and chest ?

Have you found any solution to get the preprocessed 2D keypoints?

We train our 2d keypoint neural network with H36M, 3DHP and Halpe-FullBody, where thorax and chest are only from H36M and 3DHP.

Applying the keypoints from Halpe-FullBody, SMPL parameters cannot be optimized properly.

Can you elaborate this? Thanks!

fantaosha avatar Jan 17 '23 19:01 fantaosha

Can you elaborate this? Thanks!

Sorry, I realized that I didn't follow the preprocessing pipeline described in the paper. To make it easy, I didn't train the preprocessing models. Instead, I simply extract the 2D keypoints from the result of VideoPose3D, and apply a reasonable scale on it. However, it seems that the 2D keypioints applied by this method cannot match the scale of your 2D keypoints. In order to reproduce the result, I wonder could you please release the preprossing models or the code of training. Thanks!

mamicro-li avatar Jan 18 '23 03:01 mamicro-li