joints_detectors/Alphapose/doc/output.md

AlphaPose - Output format

Contents

1. Output Format
   1. Keypoint Ordering
   2. Heatmap Ordering

Output Format

1. By default, we save the results for all images in one json file, which is similar to the results format used by COCO.
   1. keypoints contains the body part locations and detection confidence formatted as x1,y1,c1,x2,y2,c2,.... c is the confidence score in the range [0,1] for MPII dataset and range [0,6] for COCO dataset.
   2. score is the confidence score for the whole person, computed by our parametric pose NMS.

[
 // for person_1 in image_1
 {
    "image_id" : string, image_1_name, 
    "category_id" : int, 1 for person
    "keypoints" : [x1,y1,c1,...,xk,yk,ck], 
    "score" : float,
 },
 // for person_2 in image_1
 {
    "image_id" : string, image_1_name, 
    "category_id" : int, 1 for person
    "keypoints" : [x1,y1,c1,...,xk,yk,ck], 
    "score" : float,
 },
 ...
 // for persons in image_2
{
    "image_id" : string, image_2_name, 
    "category_id" : int, 1 for person
    "keypoints" : [x1,y1,c1,...,xk,yk,ck], 
    "score" : float,
 },
 ...
]

2. If the --format flag is set as 'cmu', we will save the results for each image in the format used by CMU-Pose.

{
    "version":0.1,
    "bodies":[
        {"joints":[x1,y1,c1,...,xk,yk,ck]},
        {"joints":[x1,y1,c1,...,xk,yk,ck]},
    ]
}

3. If the --format flag is set as 'open', we will save the results for each image in the format used by OpenPose.

{
    "version":0.1,
    "people":[
        {"pose_keypoints_2d":[x1,y1,c1,...,xk,yk,ck]},
        {"pose_keypoints_2d":[x1,y1,c1,...,xk,yk,ck]},
    ]
}

Keypoint Ordering

The default keypoint order is

// Result for COCO (17 body parts)
    {0,  "Nose"},
    {1,  "LEye"},
    {2,  "REye"},
    {3,  "LEar"},
    {4,  "REar"},
    {5,  "LShoulder"},
    {6,  "RShoulder"},
    {7,  "LElbow"},
    {8,  "RElbow"},
    {9,  "LWrist"},
    {10, "RWrist"},
    {11, "LHip"},
    {12, "RHip"},
    {13, "LKnee"},
    {14, "Rknee"},
    {15, "LAnkle"},
    {16, "RAnkle"},
// Result for MPII (16 body parts)
    {0,  "RAnkle"},
    {1,  "Rknee"},
    {2,  "RHip"},
    {3,  "LHip"},
    {4,  "LKnee"},
    {5,  "LAnkle"},
    {6,  "Pelv"},
    {7,  "Thrx"},
    {8,  "Neck"},
    {9,  "Head"},
    {10, "RWrist"},
    {11, "RElbow"},
    {12, "RShoulder"},
    {13, "LShoulder"},
    {14, "LElbow"},
    {15, "LWrist"},

If the --format flag is set to 'cmu' or 'open', the keypoint order is

//Result for COCO (18 body parts)
    {0,  "Nose"},
    {1,  "Neck"},
    {2,  "RShoulder"},
    {3,  "RElbow"},
    {4,  "RWrist"},
    {5,  "LShoulder"},
    {6,  "LElbow"},
    {7,  "LWrist"},
    {8,  "RHip"},
    {9,  "RKnee"},
    {10, "RAnkle"},
    {11, "LHip"},
    {12, "LKnee"},
    {13, "LAnkle"},
    {14, "REye"},
    {15, "LEye"},
    {16, "REar"},
    {17, "LEar"},
// Result for MPII (15 body parts)
    {0,  "Head"},
    {1,  "Neck"},
    {2,  "RShoulder"},
    {3,  "RElbow"},
    {4,  "RWrist"},
    {5,  "LShoulder"},
    {6,  "LElbow"},
    {7,  "LWrist"},
    {8,  "RHip"},
    {9,  "RKnee"},
    {10, "RAnkle"},
    {11, "LHip"},
    {12, "LKnee"},
    {13, "LAnkle"},
    {14, "Thrx"},