Are there any plans regarding Holo3-9B?
The 35B-A3B is not very user-friendly on personal PCs, and even if it can barely run, it basically occupies full memory and video memory, making it difficult to obtain enough memory for the agent tasks that need to be performed.
In contrast, the dense 9B version can easily run with lower quantization on a dedicated graphics card with 8GB of memory, which allows for more widespread use of end side agents.
Yeah, I would love to use this model but I have a 5070 mobile. No way that is going to fit at all. I am really hoping they release a 9B.
Looking into it
Looking into it
Does "Looking into it" refer to looking to check if your team will do it, or looking into actually doing it?
Does "Looking into it" refer to looking to check if your team will do it, or looking into actually doing it?
Gradients are flowing, stay tuned!