inclusionAI
/

Ling-2.6-flash-fp8

Model card Files Files and versions

Update README.md

#4

by zheyishine - opened 9 days ago

base: refs/heads/main

←

from: refs/pr/4

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -121,7 +121,7 @@ python -m sglang.launch_server \
     --dp-size 1 \
     --mamba-scheduler-strategy extra_buffer \
     --speculative-algorithm NEXTN \
-    --speculative-num-steps 1 \
     --speculative-eagle-topk 1 \
     --speculative-num-draft-tokens 4 \
     --mem-fraction-static 0.75 \

     --dp-size 1 \
     --mamba-scheduler-strategy extra_buffer \
     --speculative-algorithm NEXTN \
+    --speculative-num-steps 3 \
     --speculative-eagle-topk 1 \
     --speculative-num-draft-tokens 4 \
     --mem-fraction-static 0.75 \