Image Segmentation Using Text and Image Prompts
Paper β’ 2112.10003 β’ Published β’ 1
# Load model directly
from transformers import AutoProcessor, CLIPSegForImageSegmentation
processor = AutoProcessor.from_pretrained("CIDAS/clipseg-rd64-refined")
model = CLIPSegForImageSegmentation.from_pretrained("CIDAS/clipseg-rd64-refined")CLIPSeg model with reduce dimension 64, refined (using a more complex convolution). It was introduced in the paper Image Segmentation Using Text and Image Prompts by LΓΌddecke et al. and first released in this repository.
This model is intended for zero-shot and one-shot image segmentation.
Refer to the documentation.
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-segmentation", model="CIDAS/clipseg-rd64-refined")