← Back to models

MiniLM

embedder

Embed English sentences and short passages with a 22M-parameter model that runs comfortably on CPU.

antfly inference pull sentence-transformers/all-MiniLM-L6-v2
By sentence-transformersLicense: apache-2.0Hugging Face source

Technical Specs

Architecture
MiniLM-L6
Parameters
22M
Dimensions
384
English

Usage

Pull the model

antfly inference pull sentence-transformers/all-MiniLM-L6-v2

Start Antfly Inference

# With Antfly standalone (Antfly Inference enabled by default)
antfly standalone

# Or run Antfly Inference on its own, listening on 127.0.0.1:8090
antfly inference run

Use in configuration

{
  "embedders": {
    "local": {
      "provider": "antfly",
      "model": "sentence-transformers/all-MiniLM-L6-v2"
    }
  }
}