Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers

Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers Published August 26, 2026 Update on GitHub Upvote 144 Tom Aarsen tomaarsen Sentence Transformers is a Python library for using and training embedding and reranker models for a wide range of applications, such as retrieval augmented generation, semantic search, semantic textual similarity, and more. Its v6.0 update introduces a fourth model type: MultiVectorEncoder , for ColBERT-style late interaction retrieval, alongside a complete training approach for it.

This OpenSourceRelease is relevant to the technology intelligence record because it involves GitHub, Hugging Face. The source article should remain the factual reference for follow-up coverage.

• Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers Published August 26, 2026 Update on GitHub Upvote 144 Tom Aarsen tomaarsen Sentence Transformers is a Python library for using and training embedding and reranker models for a wide range of applications, such as retrieval augmented generation, semantic search, semantic textual similarity, and more.
• Its v6.0 update introduces a fourth model type: MultiVectorEncoder , for ColBERT-style late interaction retrieval, alongside a complete training approach for it.
• In this blogpost, I'll show you how to use it to finetune a multi-vector model that outperforms general-purpose retrievers on your data.
• This method can also train strong new multi-vector models from scratch.
• Everything below runs on pip install -U "sentence-transformers[train]" .
• Finetuning multi-vector models involves several components: the model itself, datasets, loss functions, training arguments, evaluators, and the trainer class.