We use 28 classes for body-part segmentation along with the background class. You can checkout more details on the classes here.
0: Background
1: Apparel
2: Face_Neck
3: Hair
4: Left_Foot
5: Left_Hand
6: Left_Lower_Arm
7: Left_Lower_Leg
8: Left_Shoe
9: Left_Sock
10: Left_Upper_Arm
11: Left_Upper_Leg
12: Lower_Clothing
13: Right_Foot
14: Right_Hand
15: Right_Lower_Arm
16: Right_Lower_Leg
17: Right_Shoe
18: Right_Sock
19: Right_Upper_Arm
20: Right_Upper_Leg
21: Torso
22: Upper_Clothing
23: Lower_Lip
24: Upper_Lip
25: Lower_Teeth
26: Upper_Teeth
27: Tongue
The body-part segmentation model checkpoints are available at,
Model | Checkpoint Path |
---|---|
Sapiens-0.3B | $SAPIENS_CHECKPOINT_ROOT/seg/checkpoints/sapiens_0.3b/sapiens_0.3b_goliath_best_goliath_mIoU_7673_epoch_194.pth |
Sapiens-0.6B | $SAPIENS_CHECKPOINT_ROOT/seg/checkpoints/sapiens_0.6b/sapiens_0.6b_goliath_best_goliath_mIoU_7777_epoch_178.pth |
Sapiens-1B | $SAPIENS_CHECKPOINT_ROOT/seg/checkpoints/sapiens_1b/sapiens_1b_goliath_best_goliath_mIoU_7994_epoch_151.pth |
Sapiens-2B | $SAPIENS_CHECKPOINT_ROOT/seg/checkpoints/sapiens_2b/sapiens_2b_goliath_best_goliath_mIoU_8131_epoch_200.pth |
- Navigate to your script directory:
cd $SAPIENS_ROOT/seg/scripts/demo/local
- For part segmentation (uncomment your model config line):
./seg.sh
Define INPUT
for your image directory and OUTPUT
for results.
The predictions will be visualized as (.jpg or .png) files, the foreground boolean masks and segmentation probabilities will be stored as .npy files in OUTPUT
directory.
These .npy will be used in depth and surface normal visualization.
Adjust JOBS_PER_GPU
, TOTAL_GPUS
and VALID_GPU_IDS
for multi-GPU configurations.
We use 19 classes for face segmentation along with the background class. You can checkout more details on the training dataset here.
0: Background
1: Skin
2: Nose
3: Right_Eye
4: Left_Eye
5: Right_Brow
6: Left_Brow
7: Right_Ear
8: Left_Ear
9: Mouth_Interior
10: Top_Lip
11: Bottom_Lip
12: Neck
13: Hair
14: Beard
15: Clothing
16: Glasses
17: Headwear
18: Facewear
The face segmentation model checkpoints are available at,
Model | Checkpoint Path |
---|---|
Sapiens-1B | $SAPIENS_CHECKPOINT_ROOT/seg/checkpoints/sapiens_1b/sapiens_1b_seg_face_epoch_200.pth |
- Navigate to your script directory:
cd $SAPIENS_ROOT/seg/scripts/demo/local
- For part segmentation (uncomment your model config line):
./seg_face.sh
Define INPUT
for your image directory and OUTPUT
for results.
The predictions will be visualized as (.jpg or .png) files, the foreground boolean masks and segmentation probabilities will be stored as .npy files in OUTPUT
directory.
Adjust JOBS_PER_GPU
, TOTAL_GPUS
and VALID_GPU_IDS
for multi-GPU configurations.