From doctest to runnable Markdown
•
3
AI & ML interests
The AI community building the future.
Recent Activity
View all activity
Papers
Qualixar OS: A Universal Operating System for AI Agent Orchestration
FineVision: Open Data Is All You Need
Articles
nielsr
updated a
Space 40 minutes ago
lightx2v/Wan2.1-I2V-14B-720P-StepDistill-CfgDistill-Lightx2v
#5192 opened 6 months ago
by 
Grtfr134567
alvarobartt
updated a
dataset about 16 hours ago
sayakpaul
updated a
dataset 1 day ago
Upload feetech-reset-offset.png
1
#604 opened 2 days ago
by 
maximellerbach
[FEEDBACK] Daily Papers
🔥❤️ 21
193
#32 opened almost 2 years ago
by 
kramp
Unordered questions and remarks
4
#1 opened 2 months ago
by 
qgallouedec
Post
772
The experimental MCP
hub_query tool now supports Paper Searching and Details as well as Daily Papers. 
Post
248
🌐 I've just published Sentence Transformers v5.4 to make the project fully multimodal for embeddings and reranking. The release also includes a modular CrossEncoder, and automatic Flash Attention 2 input flattening. Details:
You can now use SentenceTransformer and CrossEncoder with text, images, audio, and video, with the same familiar API. That means you can compute embeddings for an image and a text query using model.encode(), compare them with model.similarity(), and it just works. Models like Qwen3-VL-Embedding-2B and jinaai/jina-reranker-m0 are supported out of the box.
Beyond multimodal, I also fully modularized the CrossEncoder class. It's now a torch.nn.Sequential of composable modules, just like SentenceTransformer has been. This unlocked support for generative rerankers (CausalLM-based models like mxbai-rerank-v2 and the Qwen3 rerankers) via a new LogitScore module, which wasn't possible before without custom code.
Also, Flash Attention 2 now automatically skips padding for text-only inputs. If your batch has a mix of short and long texts, this gives you a nice speedup and lower VRAM usage for free.
I wrote a blog post walking through the multimodal features with practical examples. Check it out if you want to get started, or just point your Agent to the URL: https://huggingface.co/blog/multimodal-sentence-transformers
This release has set up the groundwork for more easily introducing late-interaction models (both text-only and multimodal) into Sentence Transformers in the next major release. I'm looking forward to it!
You can now use SentenceTransformer and CrossEncoder with text, images, audio, and video, with the same familiar API. That means you can compute embeddings for an image and a text query using model.encode(), compare them with model.similarity(), and it just works. Models like Qwen3-VL-Embedding-2B and jinaai/jina-reranker-m0 are supported out of the box.
Beyond multimodal, I also fully modularized the CrossEncoder class. It's now a torch.nn.Sequential of composable modules, just like SentenceTransformer has been. This unlocked support for generative rerankers (CausalLM-based models like mxbai-rerank-v2 and the Qwen3 rerankers) via a new LogitScore module, which wasn't possible before without custom code.
Also, Flash Attention 2 now automatically skips padding for text-only inputs. If your batch has a mix of short and long texts, this gives you a nice speedup and lower VRAM usage for free.
I wrote a blog post walking through the multimodal features with practical examples. Check it out if you want to get started, or just point your Agent to the URL: https://huggingface.co/blog/multimodal-sentence-transformers
This release has set up the groundwork for more easily introducing late-interaction models (both text-only and multimodal) into Sentence Transformers in the next major release. I'm looking forward to it!
nielsr
submitted a
paper to Daily Papers 3 days ago
akhaliq
submitted a
paper to Daily Papers 9 days ago
nielsr
submitted a
paper to Daily Papers 9 days ago
qgallouedec
posted an update 12 days ago
Post
2217
TRL v1.0 is out!
Hugging Face's TRL library is downloaded 3 million times a month. Over 130k models trained with it are public on the Hub, and major projects like @unsloth and @axolotl-ai-co build directly on top of it. v1.0 is the moment we acknowledged that responsibility explicitly, with a real stability contract.
The field hasn't settled. Building stable software in a domain that keeps invalidating its own assumptions is the actual problem we're solving. The answer is a design that can absorb the next shift without breaking what people rely on.
What's in v1.0:
Deep Hugging Face integration, low infrastructure burden
What's next: asynchronous GRPO, better scaling support, and making training legible enough that agents can inspect and steer it.
Read more: hf.co/blog/trl-v1
Hugging Face's TRL library is downloaded 3 million times a month. Over 130k models trained with it are public on the Hub, and major projects like @unsloth and @axolotl-ai-co build directly on top of it. v1.0 is the moment we acknowledged that responsibility explicitly, with a real stability contract.
The field hasn't settled. Building stable software in a domain that keeps invalidating its own assumptions is the actual problem we're solving. The answer is a design that can absorb the next shift without breaking what people rely on.
What's in v1.0:
Deep Hugging Face integration, low infrastructure burden
What's next: asynchronous GRPO, better scaling support, and making training legible enough that agents can inspect and steer it.
pip install --upgrade trlRead more: hf.co/blog/trl-v1
akhaliq
submitted a
paper to Daily Papers 16 days ago
nielsr
submitted a
paper to Daily Papers 20 days ago
nielsr
submitted a
paper to Daily Papers 24 days ago
akhaliq
submitted a
paper to Daily Papers 25 days ago
nielsr
submitted a
paper to Daily Papers 25 days ago
akhaliq
submitted a
paper to Daily Papers 28 days ago