facebookresearch / facebookresearch/detectron2

Support available for the densepose?

Open
#4,117 3 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
34.7k
Forks
7.9k
PR merge metrics
No merged PRs in 30d

Description

Is there any kind of support available for this Densepose detectron2 if we want to use uv tensors to convert it in such a format that we can which body part represents what? So that we can have angles from various body parts. I am getting this output but not able to figure out what represents what.

Output:

Instances(num_instances=1, image_height=360, image_width=640, fields=[pred_boxes: Boxes(tensor([[174.3029, 160.0973, 250.2299, 295.8675]], device='cuda:0')), scores: tensor([0.9986], device='cuda:0'), pred_classes: tensor([0], device='cuda:0'), pred_densepose: DensePoseChartPredictorOutputWithConfidences(coarse_segm=tensor([[[[ 4.0519, 4.3701, 5.0065, ..., 4.8198, 4.2056, 3.8984],
[ 4.3418, 4.6392, 5.2339, ..., 4.9428, 4.3677, 4.0801],
[ 4.9217, 5.1774, 5.6887, ..., 5.1886, 4.6918, 4.4434],
...,
[ 0.2686, 0.1565, -0.0675, ..., 0.3559, 0.5386, 0.6299],
[ 0.5769, 0.5123, 0.3830, ..., 1.0534, 1.1381, 1.1805],
[ 0.7310, 0.6901, 0.6083, ..., 1.4021, 1.4379, 1.4558]],

[[-4.0222, -4.3280, -4.9397, ..., -4.7484, -4.1278, -3.8175],
[-4.3133, -4.5911, -5.1466, ..., -4.8924, -4.3168, -4.0289],
[-4.8956, -5.1172, -5.5603, ..., -5.1805, -4.6947, -4.4518],
...,
[-0.3419, -0.2096, 0.0551, ..., -0.3837, -0.5139, -0.5791],
[-0.5952, -0.4983, -0.3047, ..., -1.0973, -1.1349, -1.1537],
[-0.7218, -0.6427, -0.4845, ..., -1.4541, -1.4454, -1.4410]]]],
device='cuda:0'), fine_segm=tensor([[[[-1.4227e+00, -1.7031e+00, -2.2640e+00, ..., -2.3786e+00,
-1.8425e+00, -1.5744e+00],
[-1.7172e+00, -2.0607e+00, -2.7477e+00, ..., -2.8886e+00,
-2.2190e+00, -1.8843e+00],
[-2.3062e+00, -2.7759e+00, -3.7151e+00, ..., -3.9085e+00,
-2.9721e+00, -2.5039e+00],
...,
[-1.7628e+00, -2.1208e+00, -2.8369e+00, ..., -2.4908e+00,
-2.0061e+00, -1.7637e+00],
[-1.4566e+00, -1.7225e+00, -2.2545e+00, ..., -1.9667e+00,
-1.5737e+00, -1.3773e+00],
[-1.3035e+00, -1.5234e+00, -1.9632e+00, ..., -1.7046e+00,
-1.3576e+00, -1.1841e+00]],

[[ 1.0380e-02, 2.0468e-03, -1.4619e-02, ..., 6.5398e-02,
-1.9942e-02, -6.2612e-02],
[-6.6868e-03, -4.0405e-03, 1.2521e-03, ..., 9.9748e-02,
-8.7207e-04, -5.1182e-02],
[-4.0820e-02, -1.6215e-02, 3.2995e-02, ..., 1.6845e-01,
3.7267e-02, -2.8323e-02],
...,
[-1.2541e+00, -1.5559e+00, -2.1594e+00, ..., -2.1246e+00,
-1.7053e+00, -1.4957e+00],
[-9.7527e-01, -1.2033e+00, -1.6593e+00, ..., -1.5996e+00,
-1.2884e+00, -1.1327e+00],
[-8.3585e-01, -1.0270e+00, -1.4093e+00, ..., -1.3371e+00,
-1.0799e+00, -9.5126e-01]],

[[ 6.4124e-01, 7.1839e-01, 8.7269e-01, ..., 7.7776e-01,
5.5075e-01, 4.3725e-01],
[ 7.0028e-01, 8.0316e-01, 1.0089e+00, ..., 9.2524e-01,
6.2299e-01, 4.7186e-01],
[ 8.1836e-01, 9.7268e-01, 1.2813e+00, ..., 1.2202e+00,
7.6747e-01, 5.4109e-01],
...,
[-8.3572e-01, -1.0403e+00, -1.4495e+00, ..., -1.2773e+00,
-9.5419e-01, -7.9262e-01],
[-6.5655e-01, -8.4207e-01, -1.2131e+00, ..., -8.8055e-01,
-6.5648e-01, -5.4444e-01],
[-5.6697e-01, -7.4295e-01, -1.0949e+00, ..., -6.8216e-01,
-5.0763e-01, -4.2036e-01]],

...,

[[ 1.8897e-01, 2.6451e-01, 4.1559e-01, ..., 5.2814e-01,
3.9900e-01, 3.3442e-01],
[ 2.8568e-01, 3.8660e-01, 5.8843e-01, ..., 5.9318e-01,
4.3427e-01, 3.5481e-01],
[ 4.7910e-01, 6.3077e-01, 9.3410e-01, ..., 7.2324e-01,
5.0482e-01, 3.9560e-01],
...,
[-4.3453e-01, -5.0269e-01, -6.3901e-01, ..., -1.4688e+00,
-1.1905e+00, -1.0513e+00],
[-3.6840e-01, -4.1807e-01, -5.1743e-01, ..., -1.3236e+00,
-1.0288e+00, -8.8144e-01],
[-3.3533e-01, -3.7576e-01, -4.5664e-01, ..., -1.2510e+00,
-9.4801e-01, -7.9648e-01]],

[[ 6.4125e-01, 8.1700e-01, 1.1685e+00, ..., 1.8892e+00,
1.3947e+00, 1.1475e+00],
[ 6.6877e-01, 8.5327e-01, 1.2223e+00, ..., 2.1070e+00,
1.5591e+00, 1.2852e+00],
[ 7.2382e-01, 9.2579e-01, 1.3297e+00, ..., 2.5424e+00,
1.8879e+00, 1.5606e+00],
...,
[-2.3958e-01, -4.1794e-01, -7.7465e-01, ..., -1.2403e+00,
-7.7947e-01, -5.4906e-01],
[-1.3773e-01, -2.7037e-01, -5.3565e-01, ..., -8.3643e-01,
-5.1289e-01, -3.5111e-01],
[-8.6810e-02, -1.9659e-01, -4.1615e-01, ..., -6.3451e-01,
-3.7960e-01, -2.5214e-01]],

[[ 7.1885e-01, 9.0765e-01, 1.2852e+00, ..., 2.0344e+00,
1.4945e+00, 1.2246e+00],
[ 8.1060e-01, 9.9497e-01, 1.3637e+00, ..., 2.2682e+00,
1.6795e+00, 1.3852e+00],
[ 9.9409e-01, 1.1696e+00, 1.5207e+00, ..., 2.7357e+00,
2.0495e+00, 1.7064e+00],
...,
[-6.3937e-01, -9.1216e-01, -1.4577e+00, ..., -1.8607e+00,
-1.4066e+00, -1.1795e+00],
[-4.5193e-01, -6.5640e-01, -1.0653e+00, ..., -1.3695e+00,
-1.0149e+00, -8.3762e-01],
[-3.5820e-01, -5.2852e-01, -8.6915e-01, ..., -1.1239e+00,
-8.1909e-01, -6.6667e-01]]]], device='cuda:0'), u=tensor([[[[ 0.0242, 0.0072, -0.0269, ..., 0.0700, 0.0565, 0.0498],
[ 0.0442, 0.0147, -0.0442, ..., 0.0839, 0.0448, 0.0253],
[ 0.0841, 0.0297, -0.0790, ..., 0.1117, 0.0213, -0.0238],
...,
[ 0.0169, 0.0253, 0.0421, ..., 0.0023, 0.0152, 0.0217],
[ 0.0182, 0.0104, -0.0052, ..., 0.0210, -0.0016, -0.0128],
[ 0.0189, 0.0030, -0.0289, ..., 0.0304, -0.0099, -0.0301]],

[[ 0.4517, 0.4554, 0.4627, ..., 0.5077, 0.5149, 0.5184],
[ 0.4691, 0.4716, 0.4767, ..., 0.5128, 0.5235, 0.5289],
[ 0.5039, 0.5041, 0.5047, ..., 0.5228, 0.5407, 0.5497],
...,
[ 0.6866, 0.7182, 0.7816, ..., 0.8149, 0.7525, 0.7214],
[ 0.6738, 0.7004, 0.7536, ..., 0.7874, 0.7366, 0.7112],
[ 0.6674, 0.6914, 0.7396, ..., 0.7737, 0.7287, 0.7062]],

[[ 0.3750, 0.3653, 0.3461, ..., 0.3541, 0.3566, 0.3578],
[ 0.3757, 0.3724, 0.3658, ..., 0.3656, 0.3745, 0.3789],
[ 0.3771, 0.3865, 0.4052, ..., 0.3884, 0.4103, 0.4212],
...,
[ 0.5591, 0.5863, 0.6407, ..., 0.6375, 0.5766, 0.5462],
[ 0.5463, 0.5699, 0.6171, ..., 0.6271, 0.5695, 0.5406],
[ 0.5398, 0.5617, 0.6053, ..., 0.6219, 0.5659, 0.5379]],

...,

[[ 0.4948, 0.5026, 0.5183, ..., 0.5703, 0.5734, 0.5749],
[ 0.4789, 0.4837, 0.4934, ..., 0.5731, 0.5779, 0.5803],
[ 0.4470, 0.4459, 0.4437, ..., 0.5788, 0.5871, 0.5912],
...,
[ 0.5761, 0.5795, 0.5862, ..., 0.6246, 0.6635, 0.6830],
[ 0.5696, 0.5789, 0.5975, ..., 0.6238, 0.6378, 0.6448],
[ 0.5663, 0.5786, 0.6032, ..., 0.6234, 0.6249, 0.6257]],

[[ 0.6032, 0.5917, 0.5686, ..., 0.5442, 0.5291, 0.5216],
[ 0.6112, 0.6023, 0.5846, ..., 0.5491, 0.5466, 0.5453],
[ 0.6271, 0.6236, 0.6166, ..., 0.5589, 0.5815, 0.5927],
...,
[ 0.5655, 0.5634, 0.5592, ..., 0.6813, 0.6753, 0.6723],
[ 0.5803, 0.5633, 0.5293, ..., 0.6335, 0.6471, 0.6539],
[ 0.5876, 0.5632, 0.5143, ..., 0.6095, 0.6330, 0.6447]],

[[ 0.4280, 0.4561, 0.5123, ..., 0.4496, 0.4276, 0.4165],
[ 0.4313, 0.4496, 0.4864, ..., 0.4441, 0.4258, 0.4167],
[ 0.4377, 0.4366, 0.4344, ..., 0.4331, 0.4224, 0.4171],
...,
[ 0.4411, 0.4442, 0.4505, ..., 0.3126, 0.2783, 0.2612],
[ 0.4372, 0.4497, 0.4749, ..., 0.3644, 0.3299, 0.3126],
[ 0.4352, 0.4525, 0.4871, ..., 0.3903, 0.3557, 0.3383]]]],
device='cuda:0'), v=tensor([[[[ 4.7934e-02, 3.1010e-02, -2.8378e-03, ..., 1.1655e-02,
1.8340e-02, 2.1682e-02],
[ 4.5355e-02, 3.8207e-02, 2.3910e-02, ..., 1.1242e-02,
1.7644e-02, 2.0844e-02],
[ 4.0198e-02, 5.2601e-02, 7.7407e-02, ..., 1.0417e-02,
1.6251e-02, 1.9169e-02],
...,
[ 3.0494e-02, 2.4908e-02, 1.3736e-02, ..., -9.7860e-03,
7.4172e-03, 1.6019e-02],
[ 2.5468e-02, 4.0210e-02, 6.9694e-02, ..., -2.4965e-04,
4.5634e-02, 6.8576e-02],
[ 2.2955e-02, 4.7861e-02, 9.7673e-02, ..., 4.5185e-03,
6.4742e-02, 9.4854e-02]],

[[ 4.9649e-01, 5.0332e-01, 5.1698e-01, ..., 5.0363e-01,
4.4203e-01, 4.1123e-01],
[ 5.3872e-01, 5.3492e-01, 5.2732e-01, ..., 5.0149e-01,
4.4507e-01, 4.1686e-01],
[ 6.2318e-01, 5.9812e-01, 5.4800e-01, ..., 4.9721e-01,
4.5114e-01, 4.2811e-01],
...,
[ 5.8865e-01, 5.8374e-01, 5.7393e-01, ..., 4.0813e-01,
3.7594e-01, 3.5984e-01],
[ 5.6284e-01, 5.5150e-01, 5.2882e-01, ..., 4.1390e-01,
3.8803e-01, 3.7509e-01],
[ 5.4994e-01, 5.3538e-01, 5.0627e-01, ..., 4.1678e-01,
3.9407e-01, 3.8271e-01]],

[[ 5.3577e-01, 5.2004e-01, 4.8858e-01, ..., 4.8666e-01,
4.6559e-01, 4.5506e-01],
[ 5.3736e-01, 5.2579e-01, 5.0264e-01, ..., 4.7414e-01,
4.6129e-01, 4.5486e-01],
[ 5.4054e-01, 5.3728e-01, 5.3076e-01, ..., 4.4911e-01,
4.5269e-01, 4.5448e-01],
...,
[ 5.7609e-01, 5.8715e-01, 6.0927e-01, ..., 4.3618e-01,
4.3664e-01, 4.3687e-01],
[ 5.2751e-01, 5.3839e-01, 5.6017e-01, ..., 4.2282e-01,
4.1174e-01, 4.0620e-01],
[ 5.0322e-01, 5.1402e-01, 5.3562e-01, ..., 4.1614e-01,
3.9929e-01, 3.9086e-01]],

...,

[[ 3.8606e-01, 4.0636e-01, 4.4697e-01, ..., 4.0574e-01,
4.1452e-01, 4.1891e-01],
[ 4.0905e-01, 4.2648e-01, 4.6133e-01, ..., 4.1850e-01,
4.1973e-01, 4.2035e-01],
[ 4.5504e-01, 4.6671e-01, 4.9005e-01, ..., 4.4402e-01,
4.3015e-01, 4.2322e-01],
...,
[ 4.5884e-01, 4.6100e-01, 4.6532e-01, ..., 4.6919e-01,
4.7460e-01, 4.7730e-01],
[ 4.7009e-01, 4.6811e-01, 4.6416e-01, ..., 4.3424e-01,
4.4117e-01, 4.4463e-01],
[ 4.7571e-01, 4.7166e-01, 4.6358e-01, ..., 4.1677e-01,
4.2445e-01, 4.2829e-01]],

[[ 5.5569e-01, 5.7792e-01, 6.2239e-01, ..., 6.4704e-01,
6.0109e-01, 5.7811e-01],
[ 5.6818e-01, 5.8551e-01, 6.2016e-01, ..., 6.3082e-01,
5.9316e-01, 5.7433e-01],
[ 5.9317e-01, 6.0068e-01, 6.1569e-01, ..., 5.9836e-01,
5.7731e-01, 5.6678e-01],
...,
[ 6.3904e-01, 6.3114e-01, 6.1535e-01, ..., 5.8055e-01,
5.4528e-01, 5.2764e-01],
[ 5.5970e-01, 5.7042e-01, 5.9187e-01, ..., 5.0797e-01,
4.9923e-01, 4.9486e-01],
[ 5.2004e-01, 5.4007e-01, 5.8012e-01, ..., 4.7168e-01,
4.7621e-01, 4.7847e-01]],

[[ 5.8044e-01, 6.0571e-01, 6.5623e-01, ..., 5.9177e-01,
5.5206e-01, 5.3220e-01],
[ 5.8105e-01, 6.0242e-01, 6.4516e-01, ..., 5.8530e-01,
5.4565e-01, 5.2582e-01],
[ 5.8226e-01, 5.9584e-01, 6.2301e-01, ..., 5.7234e-01,
5.3283e-01, 5.1307e-01],
...,
[ 6.0014e-01, 6.0958e-01, 6.2846e-01, ..., 6.1714e-01,
5.9476e-01, 5.8358e-01],
[ 5.7270e-01, 5.7094e-01, 5.6743e-01, ..., 5.8336e-01,
5.4646e-01, 5.2801e-01],
[ 5.5898e-01, 5.5162e-01, 5.3692e-01, ..., 5.6647e-01,
5.2231e-01, 5.0023e-01]]]], device='cuda:0'), sigma_1=None, sigma_2=None, kappa_u=None, kappa_v=None, fine_segm_confidence=None, coarse_segm_confidence=None)])

Contributor guide

Open the contributing guide

Research direction

No file, test, or entry point is identified. Start by clarifying whether the request concerns interpreting the DensePose output fields or adding project documentation, then review the existing DensePose usage material and determine the expected body-part mapping and angle workflow. Done would require a specific, documented request rather than general support.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
computer-vision, machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.