inclusionAI
/

Ling-2.6-flash

Text Generation

Model card Files Files and versions

zheyishine commited on 9 days ago

Commit

b62a2f5

·

verified ·

1 Parent(s): 5059a36

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -113,6 +113,7 @@ python -m sglang.launch_server \
     --pp-size 1 \
     --dp-size 1 \
     --context-length 262144 \
     --speculative-algorithm NEXTN \
     --speculative-num-steps 3 \
     --speculative-eagle-topk 1 \

     --pp-size 1 \
     --dp-size 1 \
     --context-length 262144 \
+    --mamba-scheduler-strategy extra_buffer \
     --speculative-algorithm NEXTN \
     --speculative-num-steps 3 \
     --speculative-eagle-topk 1 \