Multimodal Embedding & Reranker Models with Sentence Transformers

Multimodal Embedding & Reranker Models with Sentence Transformers Multimodal Embedding & Reranker Models with Sentence Transformers Published April 9, 2026 Update on GitHub Upvote 75 Tom Aarsen tomaarsen Sentence Transformers is a Python library for using and training embedding and reranker models for applications like retrieval augmented generation, semantic search, and more. With the v5.4 update, you can now encode and compare texts, images, audio, and videos using the same familiar API.

This ProductUpdate is relevant to the technology intelligence record because it involves GitHub, Google, NVIDIA, Meta. The source article should remain the factual reference for follow-up coverage.

• Multimodal Embedding & Reranker Models with Sentence Transformers Published April 9, 2026 Update on GitHub Upvote 75 Tom Aarsen tomaarsen Sentence Transformers is a Python library for using and training embedding and reranker models for applications like retrieval augmented generation, semantic search, and more.
• With the v5.4 update, you can now encode and compare texts, images, audio, and videos using the same familiar API.
• In this blogpost, I'll show you how to use these new multimodal capabilities for both embedding and reranking.
• Multimodal embedding models map inputs from different modalities into a shared embedding space, while multimodal reranker models score the relevance of mixed-modality pairs.
• This opens up use cases like visual document retrieval, cross-modal search, and multimodal RAG pipelines.
• If you want to train your own multimodal models, check out the companion blogpost: Training and Finetuning Multimodal Embedding & Reranker Models with Sentence Transformers .