Can I run this model on 2x H20 141GB?
#1
by CHNtentes - opened
Or do I need vram of 8x H200?
No you don't need 8x ----- Just 2 should be totally fine.
No you don't need 8x ----- Just 2 should be totally fine.
Thanks for your reply. Another question: You mentioned SM120 GPUs need a specific vllm build to run this model. Do hopper cards also need it?
Yes