Logan Olson

jloganolson's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mistralai/Voxtral-Mini-4B-Realtime-2602 2 months ago

Reducing time-to-first-token below 1s for conversational use?

3

#11 opened 2 months ago by

jloganolson

vLLM's blog on streaming input link

2

#4 opened 2 months ago by

jloganolson

New activity in LayerDiffusion/layerdiffusion-v1 almost 2 years ago

Running with diffusers?

3

#4 opened about 2 years ago by

jloganolson

New activity in HuggingFaceH4/starchat-alpha almost 3 years ago

General tips around inference speed?

👍 1

6

#3 opened almost 3 years ago by

jloganolson

Model doesn't end/terminate generation: Need to modify EOS token

❤️ 2

9

#2 opened almost 3 years ago by

eugenesiow