Multi GPU Setup
#52
by Ayush8120 - opened
Can I inference this using multi GPU setup ? Also, can we expect Mistral support on lmsys soon?
@Ayush8120 It is available now at https://chat.lmsys.org/?single under both the single model tab and arena tab.
It is also supported by our https://github.com/lm-sys/FastChat with multi-GPU support.
Ayush8120 changed discussion status to closed