SAM segmentation mask as condition for image generation.

Thanks for the great work. We have trained a [ControlNet based on the SAM segmentation mask](https://github.com/sail-sg/EditAnything) for fine-grained image generation.
This model can help to use SAM for image generation and editing. We hope this side project can help to give SAM more applications. Looking for contributions and suggestions!
https://github.com/sail-sg/EditAnything

Start by reviewing the linked EditAnything project to understand the proposed SAM segmentation-mask and ControlNet integration. This issue names no file, test, entry point, or acceptance criteria in the segment-anything repository, so the scope and definition of done need to be established before implementation can begin.

Written by the indexing model from the issue text.