Spaces:
Running on Zero
Running on Zero
GPU Spaces
#1
by jujutechnology - opened
Hi. The Space works great. Do you know if there's a way to run it on regular GPU Spaces? I run into OOM errors on all the GPUs, even the A100.
is it A100 40GB or 80GB?
Nvidia A100 large
12 vCPU
路
142 GB RAM
路
80 GB VRAM
the heaviest parts of the code are the text_encoder and the pipeline._transformer so you can put them on the cpu and in the start put the text_encoder on cuda then when embedding is done put it on the cpu again and then the opposite for pipeline._transformer