facebookresearch / facebookresearch/detectron2
Support available for the densepose?
- Dominant language
- Python
- Stars
- 34.7k
- Forks
- 7.9k
- PR merge metrics
- No merged PRs in 30d
Description
Is there any kind of support available for this Densepose detectron2 if we want to use uv tensors to convert it in such a format that we can which body part represents what? So that we can have angles from various body parts. I am getting this output but not able to figure out what represents what.
Output:
Instances(num_instances=1, image_height=360, image_width=640, fields=[pred_boxes: Boxes(tensor([[174.3029, 160.0973, 250.2299, 295.8675]], device='cuda:0')), scores: tensor([0.9986], device='cuda:0'), pred_classes: tensor([0], device='cuda:0'), pred_densepose: DensePoseChartPredictorOutputWithConfidences(coarse_segm=tensor([[[[ 4.0519, 4.3701, 5.0065, ..., 4.8198, 4.2056, 3.8984],
[ 4.3418, 4.6392, 5.2339, ..., 4.9428, 4.3677, 4.0801],
[ 4.9217, 5.1774, 5.6887, ..., 5.1886, 4.6918, 4.4434],
...,
[ 0.2686, 0.1565, -0.0675, ..., 0.3559, 0.5386, 0.6299],
[ 0.5769, 0.5123, 0.3830, ..., 1.0534, 1.1381, 1.1805],
[ 0.7310, 0.6901, 0.6083, ..., 1.4021, 1.4379, 1.4558]],
[[-4.0222, -4.3280, -4.9397, ..., -4.7484, -4.1278, -3.8175],
[-4.3133, -4.5911, -5.1466, ..., -4.8924, -4.3168, -4.0289],
[-4.8956, -5.1172, -5.5603, ..., -5.1805, -4.6947, -4.4518],
...,
[-0.3419, -0.2096, 0.0551, ..., -0.3837, -0.5139, -0.5791],
[-0.5952, -0.4983, -0.3047, ..., -1.0973, -1.1349, -1.1537],
[-0.7218, -0.6427, -0.4845, ..., -1.4541, -1.4454, -1.4410]]]],
device='cuda:0'), fine_segm=tensor([[[[-1.4227e+00, -1.7031e+00, -2.2640e+00, ..., -2.3786e+00,
-1.8425e+00, -1.5744e+00],
[-1.7172e+00, -2.0607e+00, -2.7477e+00, ..., -2.8886e+00,
-2.2190e+00, -1.8843e+00],
[-2.3062e+00, -2.7759e+00, -3.7151e+00, ..., -3.9085e+00,
-2.9721e+00, -2.5039e+00],
...,
[-1.7628e+00, -2.1208e+00, -2.8369e+00, ..., -2.4908e+00,
-2.0061e+00, -1.7637e+00],
[-1.4566e+00, -1.7225e+00, -2.2545e+00, ..., -1.9667e+00,
-1.5737e+00, -1.3773e+00],
[-1.3035e+00, -1.5234e+00, -1.9632e+00, ..., -1.7046e+00,
-1.3576e+00, -1.1841e+00]],
[[ 1.0380e-02, 2.0468e-03, -1.4619e-02, ..., 6.5398e-02,
-1.9942e-02, -6.2612e-02],
[-6.6868e-03, -4.0405e-03, 1.2521e-03, ..., 9.9748e-02,
-8.7207e-04, -5.1182e-02],
[-4.0820e-02, -1.6215e-02, 3.2995e-02, ..., 1.6845e-01,
3.7267e-02, -2.8323e-02],
...,
[-1.2541e+00, -1.5559e+00, -2.1594e+00, ..., -2.1246e+00,
-1.7053e+00, -1.4957e+00],
[-9.7527e-01, -1.2033e+00, -1.6593e+00, ..., -1.5996e+00,
-1.2884e+00, -1.1327e+00],
[-8.3585e-01, -1.0270e+00, -1.4093e+00, ..., -1.3371e+00,
-1.0799e+00, -9.5126e-01]],
[[ 6.4124e-01, 7.1839e-01, 8.7269e-01, ..., 7.7776e-01,
5.5075e-01, 4.3725e-01],
[ 7.0028e-01, 8.0316e-01, 1.0089e+00, ..., 9.2524e-01,
6.2299e-01, 4.7186e-01],
[ 8.1836e-01, 9.7268e-01, 1.2813e+00, ..., 1.2202e+00,
7.6747e-01, 5.4109e-01],
...,
[-8.3572e-01, -1.0403e+00, -1.4495e+00, ..., -1.2773e+00,
-9.5419e-01, -7.9262e-01],
[-6.5655e-01, -8.4207e-01, -1.2131e+00, ..., -8.8055e-01,
-6.5648e-01, -5.4444e-01],
[-5.6697e-01, -7.4295e-01, -1.0949e+00, ..., -6.8216e-01,
-5.0763e-01, -4.2036e-01]],
...,
[[ 1.8897e-01, 2.6451e-01, 4.1559e-01, ..., 5.2814e-01,
3.9900e-01, 3.3442e-01],
[ 2.8568e-01, 3.8660e-01, 5.8843e-01, ..., 5.9318e-01,
4.3427e-01, 3.5481e-01],
[ 4.7910e-01, 6.3077e-01, 9.3410e-01, ..., 7.2324e-01,
5.0482e-01, 3.9560e-01],
...,
[-4.3453e-01, -5.0269e-01, -6.3901e-01, ..., -1.4688e+00,
-1.1905e+00, -1.0513e+00],
[-3.6840e-01, -4.1807e-01, -5.1743e-01, ..., -1.3236e+00,
-1.0288e+00, -8.8144e-01],
[-3.3533e-01, -3.7576e-01, -4.5664e-01, ..., -1.2510e+00,
-9.4801e-01, -7.9648e-01]],
[[ 6.4125e-01, 8.1700e-01, 1.1685e+00, ..., 1.8892e+00,
1.3947e+00, 1.1475e+00],
[ 6.6877e-01, 8.5327e-01, 1.2223e+00, ..., 2.1070e+00,
1.5591e+00, 1.2852e+00],
[ 7.2382e-01, 9.2579e-01, 1.3297e+00, ..., 2.5424e+00,
1.8879e+00, 1.5606e+00],
...,
[-2.3958e-01, -4.1794e-01, -7.7465e-01, ..., -1.2403e+00,
-7.7947e-01, -5.4906e-01],
[-1.3773e-01, -2.7037e-01, -5.3565e-01, ..., -8.3643e-01,
-5.1289e-01, -3.5111e-01],
[-8.6810e-02, -1.9659e-01, -4.1615e-01, ..., -6.3451e-01,
-3.7960e-01, -2.5214e-01]],
[[ 7.1885e-01, 9.0765e-01, 1.2852e+00, ..., 2.0344e+00,
1.4945e+00, 1.2246e+00],
[ 8.1060e-01, 9.9497e-01, 1.3637e+00, ..., 2.2682e+00,
1.6795e+00, 1.3852e+00],
[ 9.9409e-01, 1.1696e+00, 1.5207e+00, ..., 2.7357e+00,
2.0495e+00, 1.7064e+00],
...,
[-6.3937e-01, -9.1216e-01, -1.4577e+00, ..., -1.8607e+00,
-1.4066e+00, -1.1795e+00],
[-4.5193e-01, -6.5640e-01, -1.0653e+00, ..., -1.3695e+00,
-1.0149e+00, -8.3762e-01],
[-3.5820e-01, -5.2852e-01, -8.6915e-01, ..., -1.1239e+00,
-8.1909e-01, -6.6667e-01]]]], device='cuda:0'), u=tensor([[[[ 0.0242, 0.0072, -0.0269, ..., 0.0700, 0.0565, 0.0498],
[ 0.0442, 0.0147, -0.0442, ..., 0.0839, 0.0448, 0.0253],
[ 0.0841, 0.0297, -0.0790, ..., 0.1117, 0.0213, -0.0238],
...,
[ 0.0169, 0.0253, 0.0421, ..., 0.0023, 0.0152, 0.0217],
[ 0.0182, 0.0104, -0.0052, ..., 0.0210, -0.0016, -0.0128],
[ 0.0189, 0.0030, -0.0289, ..., 0.0304, -0.0099, -0.0301]],
[[ 0.4517, 0.4554, 0.4627, ..., 0.5077, 0.5149, 0.5184],
[ 0.4691, 0.4716, 0.4767, ..., 0.5128, 0.5235, 0.5289],
[ 0.5039, 0.5041, 0.5047, ..., 0.5228, 0.5407, 0.5497],
...,
[ 0.6866, 0.7182, 0.7816, ..., 0.8149, 0.7525, 0.7214],
[ 0.6738, 0.7004, 0.7536, ..., 0.7874, 0.7366, 0.7112],
[ 0.6674, 0.6914, 0.7396, ..., 0.7737, 0.7287, 0.7062]],
[[ 0.3750, 0.3653, 0.3461, ..., 0.3541, 0.3566, 0.3578],
[ 0.3757, 0.3724, 0.3658, ..., 0.3656, 0.3745, 0.3789],
[ 0.3771, 0.3865, 0.4052, ..., 0.3884, 0.4103, 0.4212],
...,
[ 0.5591, 0.5863, 0.6407, ..., 0.6375, 0.5766, 0.5462],
[ 0.5463, 0.5699, 0.6171, ..., 0.6271, 0.5695, 0.5406],
[ 0.5398, 0.5617, 0.6053, ..., 0.6219, 0.5659, 0.5379]],
...,
[[ 0.4948, 0.5026, 0.5183, ..., 0.5703, 0.5734, 0.5749],
[ 0.4789, 0.4837, 0.4934, ..., 0.5731, 0.5779, 0.5803],
[ 0.4470, 0.4459, 0.4437, ..., 0.5788, 0.5871, 0.5912],
...,
[ 0.5761, 0.5795, 0.5862, ..., 0.6246, 0.6635, 0.6830],
[ 0.5696, 0.5789, 0.5975, ..., 0.6238, 0.6378, 0.6448],
[ 0.5663, 0.5786, 0.6032, ..., 0.6234, 0.6249, 0.6257]],
[[ 0.6032, 0.5917, 0.5686, ..., 0.5442, 0.5291, 0.5216],
[ 0.6112, 0.6023, 0.5846, ..., 0.5491, 0.5466, 0.5453],
[ 0.6271, 0.6236, 0.6166, ..., 0.5589, 0.5815, 0.5927],
...,
[ 0.5655, 0.5634, 0.5592, ..., 0.6813, 0.6753, 0.6723],
[ 0.5803, 0.5633, 0.5293, ..., 0.6335, 0.6471, 0.6539],
[ 0.5876, 0.5632, 0.5143, ..., 0.6095, 0.6330, 0.6447]],
[[ 0.4280, 0.4561, 0.5123, ..., 0.4496, 0.4276, 0.4165],
[ 0.4313, 0.4496, 0.4864, ..., 0.4441, 0.4258, 0.4167],
[ 0.4377, 0.4366, 0.4344, ..., 0.4331, 0.4224, 0.4171],
...,
[ 0.4411, 0.4442, 0.4505, ..., 0.3126, 0.2783, 0.2612],
[ 0.4372, 0.4497, 0.4749, ..., 0.3644, 0.3299, 0.3126],
[ 0.4352, 0.4525, 0.4871, ..., 0.3903, 0.3557, 0.3383]]]],
device='cuda:0'), v=tensor([[[[ 4.7934e-02, 3.1010e-02, -2.8378e-03, ..., 1.1655e-02,
1.8340e-02, 2.1682e-02],
[ 4.5355e-02, 3.8207e-02, 2.3910e-02, ..., 1.1242e-02,
1.7644e-02, 2.0844e-02],
[ 4.0198e-02, 5.2601e-02, 7.7407e-02, ..., 1.0417e-02,
1.6251e-02, 1.9169e-02],
...,
[ 3.0494e-02, 2.4908e-02, 1.3736e-02, ..., -9.7860e-03,
7.4172e-03, 1.6019e-02],
[ 2.5468e-02, 4.0210e-02, 6.9694e-02, ..., -2.4965e-04,
4.5634e-02, 6.8576e-02],
[ 2.2955e-02, 4.7861e-02, 9.7673e-02, ..., 4.5185e-03,
6.4742e-02, 9.4854e-02]],
[[ 4.9649e-01, 5.0332e-01, 5.1698e-01, ..., 5.0363e-01,
4.4203e-01, 4.1123e-01],
[ 5.3872e-01, 5.3492e-01, 5.2732e-01, ..., 5.0149e-01,
4.4507e-01, 4.1686e-01],
[ 6.2318e-01, 5.9812e-01, 5.4800e-01, ..., 4.9721e-01,
4.5114e-01, 4.2811e-01],
...,
[ 5.8865e-01, 5.8374e-01, 5.7393e-01, ..., 4.0813e-01,
3.7594e-01, 3.5984e-01],
[ 5.6284e-01, 5.5150e-01, 5.2882e-01, ..., 4.1390e-01,
3.8803e-01, 3.7509e-01],
[ 5.4994e-01, 5.3538e-01, 5.0627e-01, ..., 4.1678e-01,
3.9407e-01, 3.8271e-01]],
[[ 5.3577e-01, 5.2004e-01, 4.8858e-01, ..., 4.8666e-01,
4.6559e-01, 4.5506e-01],
[ 5.3736e-01, 5.2579e-01, 5.0264e-01, ..., 4.7414e-01,
4.6129e-01, 4.5486e-01],
[ 5.4054e-01, 5.3728e-01, 5.3076e-01, ..., 4.4911e-01,
4.5269e-01, 4.5448e-01],
...,
[ 5.7609e-01, 5.8715e-01, 6.0927e-01, ..., 4.3618e-01,
4.3664e-01, 4.3687e-01],
[ 5.2751e-01, 5.3839e-01, 5.6017e-01, ..., 4.2282e-01,
4.1174e-01, 4.0620e-01],
[ 5.0322e-01, 5.1402e-01, 5.3562e-01, ..., 4.1614e-01,
3.9929e-01, 3.9086e-01]],
...,
[[ 3.8606e-01, 4.0636e-01, 4.4697e-01, ..., 4.0574e-01,
4.1452e-01, 4.1891e-01],
[ 4.0905e-01, 4.2648e-01, 4.6133e-01, ..., 4.1850e-01,
4.1973e-01, 4.2035e-01],
[ 4.5504e-01, 4.6671e-01, 4.9005e-01, ..., 4.4402e-01,
4.3015e-01, 4.2322e-01],
...,
[ 4.5884e-01, 4.6100e-01, 4.6532e-01, ..., 4.6919e-01,
4.7460e-01, 4.7730e-01],
[ 4.7009e-01, 4.6811e-01, 4.6416e-01, ..., 4.3424e-01,
4.4117e-01, 4.4463e-01],
[ 4.7571e-01, 4.7166e-01, 4.6358e-01, ..., 4.1677e-01,
4.2445e-01, 4.2829e-01]],
[[ 5.5569e-01, 5.7792e-01, 6.2239e-01, ..., 6.4704e-01,
6.0109e-01, 5.7811e-01],
[ 5.6818e-01, 5.8551e-01, 6.2016e-01, ..., 6.3082e-01,
5.9316e-01, 5.7433e-01],
[ 5.9317e-01, 6.0068e-01, 6.1569e-01, ..., 5.9836e-01,
5.7731e-01, 5.6678e-01],
...,
[ 6.3904e-01, 6.3114e-01, 6.1535e-01, ..., 5.8055e-01,
5.4528e-01, 5.2764e-01],
[ 5.5970e-01, 5.7042e-01, 5.9187e-01, ..., 5.0797e-01,
4.9923e-01, 4.9486e-01],
[ 5.2004e-01, 5.4007e-01, 5.8012e-01, ..., 4.7168e-01,
4.7621e-01, 4.7847e-01]],
[[ 5.8044e-01, 6.0571e-01, 6.5623e-01, ..., 5.9177e-01,
5.5206e-01, 5.3220e-01],
[ 5.8105e-01, 6.0242e-01, 6.4516e-01, ..., 5.8530e-01,
5.4565e-01, 5.2582e-01],
[ 5.8226e-01, 5.9584e-01, 6.2301e-01, ..., 5.7234e-01,
5.3283e-01, 5.1307e-01],
...,
[ 6.0014e-01, 6.0958e-01, 6.2846e-01, ..., 6.1714e-01,
5.9476e-01, 5.8358e-01],
[ 5.7270e-01, 5.7094e-01, 5.6743e-01, ..., 5.8336e-01,
5.4646e-01, 5.2801e-01],
[ 5.5898e-01, 5.5162e-01, 5.3692e-01, ..., 5.6647e-01,
5.2231e-01, 5.0023e-01]]]], device='cuda:0'), sigma_1=None, sigma_2=None, kappa_u=None, kappa_v=None, fine_segm_confidence=None, coarse_segm_confidence=None)])
Contributor guide
Research direction
No file, test, or entry point is identified. Start by clarifying whether the request concerns interpreting the DensePose output fields or adding project documentation, then review the existing DensePose usage material and determine the expected body-part mapping and angle workflow. Done would require a specific, documented request rather than general support.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- computer-vision, machine-learning
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100