How to get subpart/part/whole-level segmentation like SAM？

[chenkangjie1123]

Hello, I would like to know: the original SAM model can output segmentation results at three levels: whole, part, and subpart. Does your method now support such output? Because I tried to modify the two parameters --suppress_small_objects --SAM_PRED_IOU_THRESHOLD and found that The result is only that there is a difference in the range of the segmented areas, but it seems that no difference in scales such as subpart, part, and whole is seen?

[hkchengrex]

You can modify the segment selection process of SAM in this class:

Tracking-Anything-with-DEVA/deva/ext/SAM/automatic_mask_generator.py

Line 41 in 752d2f5

class SamAutomaticMaskGenerator:

We do find these granularities to be temporally highly unstable.

[chenkangjie1123]

Indeed, I have modified this part of the code and found that when deva performs mask matching on the whole scale, some frame images may completely lose the mask, while the subpart and part scale results are okay.