Shahnawaz Ahmed's picture

1 2

Shahnawaz Ahmed

swaze

·

AI & ML interests

None yet

Recent Activity

upvoted a collection about 1 month ago

reacted to JonnaMat's post with 👀 about 1 month ago

🚀 FlashHead: Efficient Drop-In Replacement for the Classification Head in Language Model Inference 🔎 Check out our latest FlashHead-enabled model: https://huggingface.co/embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead 🧩 Seamless integration with vllm: ``` docker run --rm -it \ --network host \ --shm-size=8g \ --ulimit memlock=-1 \ --ulimit stack=67108864 \ --runtime=nvidia \ --name=vllm-serve \ -e HF_TOKEN=hf_*** \ -e HF_HOME=/root/.cache/huggingface \ embedl/vllm:latest-jetson-orin-flashhead \ vllm serve "embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead" \ --max-model-len 8192 \ --gpu-memory-utilization 0.75 \ --max-num-seqs 2 \ --trust-remote-code ```

liked a Space about 1 month ago

jane-street/droppedaneuralnet

View all activity

Organizations

liked a Space about 1 month ago

droppedaneuralnet

Check if your neural net permutation solution is correct

liked a model 4 months ago

embedl/Llama-3.2-1B-Instruct-FlashHead-W4A16

2B • Updated 4 days ago • 69 • 6