Minimum config required to run this model?
#2
by ritzchavanpatil - opened
I want to know the minimum system configuration required to run this model.
At which precision? Unquant and at BF16 precision you probably can use a single RTX5090 with low ctx size.