the Q4KM file can't load with LMStudio

#1
by Nynnse - opened
This comment has been hidden (marked as Resolved)

same problem with the non-i1 Q4KM version.

The error clearly states that your LMStudio is too old to support any Seed OSS based model. Check if there is a newer version aviable that supports it and otherwise use latest llama.cpp instead. I can confirm that latest llama.cpp supports Seed OSS.

mradermacher changed discussion status to closed

Sign up or log in to comment