← Back to models
Qwen3 Embedding
embedder
Embed text for semantic search with a compact multilingual model. The pull command selects the official Q8_0 GGUF bundle.
antfly inference pull Qwen/Qwen3-Embedding-0.6B-GGUF:q8-0-bundle-v1Technical Specs
- Architecture
- Qwen3
- Parameters
- 0.6B
- Dimensions
- 1024
Q8_0GGUFmultilingual
Usage
Pull the model
antfly inference pull Qwen/Qwen3-Embedding-0.6B-GGUF:q8-0-bundle-v1Start Antfly Inference
# With Antfly standalone (Antfly Inference enabled by default)
antfly standalone
# Or run Antfly Inference on its own, listening on 127.0.0.1:8090
antfly inference runUse in configuration
{
"embedders": {
"local": {
"provider": "antfly",
"model": "Qwen/Qwen3-Embedding-0.6B-GGUF:q8-0-bundle-v1"
}
}
}