← Back to models
MS MARCO MiniLM
reranker
Rerank English search results with a small cross-encoder trained on MS MARCO passage ranking.
antfly inference pull cross-encoder/ms-marco-MiniLM-L6-v2Technical Specs
- Architecture
- MiniLM-L6 cross-encoder
- Parameters
- 23M
English
Usage
Pull the model
antfly inference pull cross-encoder/ms-marco-MiniLM-L6-v2Start Antfly Inference
# With Antfly standalone (Antfly Inference enabled by default)
antfly standalone
# Or run Antfly Inference on its own, listening on 127.0.0.1:8090
antfly inference runUse in configuration
{
"rerankers": {
"local": {
"provider": "antfly",
"model": "cross-encoder/ms-marco-MiniLM-L6-v2"
}
}
}