Failed to initialize Kimi-K2.5 Eagle model
#4
by Xiaoctw - opened
sglang 0.5.8: not support kimi k2.5; 0.5.9: can not found set_eagle3_layers_to_capture; When I use the latest SGLang main branch, it crashes after handling large requests. would you please clarify what was updated in the code?
lightseek changed discussion status to closed