Spaces:
Running on A100
Running on A100
Do We Really Need an A100? Cost and Alternative GPU Options
#1
by csukuangfj - opened
This space runs on an A100 GPU with 80 GB of RAM at a cost of $2.50 per hour, which is relatively expensive.
Does that mean an A100 is the minimum requirement? Would it also work with ZeroGPU (H200 with 70 GB RAM)?
The A100 is not the minimum requirement. We only selected this GPU as a precaution. In fact, when the model is loaded in FP16 precision, it only consumes roughly more than ten gigabytes of VRAM.