|
|
--- |
|
|
library_name: diffusers |
|
|
license: apache-2.0 |
|
|
--- |
|
|
|
|
|
# CoCoGold: Object Segmentation with Marigold |
|
|
|
|
|
This is a model trained with a [repurposed version of Marigold](https://github.com/pcuenca/Marigold/tree/cocogold) that can do text-grounded object segmentation, i.e., you provide the name of the object you want to segment and the model will draw a segmentation mask on it. |
|
|
|
|
|
The model was trained on the [COCO dataset](https://huggingface.co/datasets/ariG23498/coco2017) using [this library](https://github.com/pcuenca/cocogold) to extract random crops and segmentation masks. |
|
|
|
|
|
For more details, please refer to [the post](https://huggingface.co/blog/pcuenq/cocogold). |
|
|
|
|
|
## Checkpoints |
|
|
|
|
|
- The `main` branch of the repo contains a diffusers pipeline with a UNet trained after ~18,000 steps. |
|
|
- [This branch](https://huggingface.co/pcuenq/marigold-coco-segmentation/tree/refs%2Fpr%2F1/checkpoint) contains intermediate checkpoints saved during the training run. |
