← Back to models

MS MARCO MiniLM

reranker

Rerank English search results with a small cross-encoder trained on MS MARCO passage ranking.

antfly inference pull cross-encoder/ms-marco-MiniLM-L6-v2
By cross-encoderLicense: apache-2.0Hugging Face source

Technical Specs

Architecture
MiniLM-L6 cross-encoder
Parameters
23M
English

Usage

Pull the model

antfly inference pull cross-encoder/ms-marco-MiniLM-L6-v2

Start Antfly Inference

# With Antfly standalone (Antfly Inference enabled by default)
antfly standalone

# Or run Antfly Inference on its own, listening on 127.0.0.1:8090
antfly inference run

Use in configuration

{
  "rerankers": {
    "local": {
      "provider": "antfly",
      "model": "cross-encoder/ms-marco-MiniLM-L6-v2"
    }
  }
}