← Back to models

Qwen3

generatorAnswers

Generate answers and text with a 1.7B dense Qwen3 model small enough for a laptop.

antfly inference pull unsloth/Qwen3-1.7B-GGUF:gguf:Q4_K_M
By QwenLicense: apache-2.0Hugging Face source

Technical Specs

Architecture
Qwen3
Parameters
1.7B
Q4_K_MGGUFmultilingual

Usage

Pull the model

antfly inference pull unsloth/Qwen3-1.7B-GGUF:gguf:Q4_K_M

Start Antfly Inference

# With Antfly standalone (Antfly Inference enabled by default)
antfly standalone

# Or run Antfly Inference on its own, listening on 127.0.0.1:8090
antfly inference run

Use in configuration

{
  "generators": {
    "local": {
      "provider": "antfly",
      "model": "unsloth/Qwen3-1.7B-GGUF:gguf:Q4_K_M"
    }
  }
}