Model guide

Qwen3.8 27B on Mac: choose between two profiles

Choose the profile by the window your chat needs. Keep native context separate from the window Bridge1 admits, and read memory labels beside each profile.

A narrow orange window frame and a wide frame stand before the same solid dark block.
Native model window 262,144 tokens
MLX admitted window 131,072 tokens
GGUF admitted window 262,144 tokens

Key facts

Reference Mac: Apple M1 Max · 32-core GPU · 64 GB. Decode is engine-reported tokens per second; other Macs are not measured.

4-bit

Qwen3.8 27B

Engine
MLX
Download
16.1 GB
Admitted window
131,072 tokens
Memory: measured or estimated
55.4 GB · estimated
Measured depth and window estimate
Measured to 82,541 tokens (39.1 GB peak, M1 Max 64 GB). The 131,072-token window is estimated at 55.4 GB.
Short decode
20.0–20.7 tok/sconditions not recorded
Decode at depth
20.8 tok/sconditions not recorded
SWE-bench Verified (base weights)
not measured
Catalog date
2026-10-09

GGUF UD-Q4_K_S

Qwen3.8 27B

Engine
GGUF / llama.cpp
Download
15.4 GB
Admitted window
262,144 tokens
Memory: measured or estimated
41.8 GB · estimated
Short decode
not measured
Decode at depth
not measured
SWE-bench Verified (base weights)
not measured
Catalog date
2026-10-09

Compare profiles in the model catalog

Native context is not the window on your Mac

Qwen describes this as a dense 27B model and lists a native context of 262,144 tokens. Its extension instructions describe a larger window, but they do not establish what Bridge1 admits for either profile.

Bridge1’s MLX 4-bit row admits 131,072 tokens on the reference Mac, half the native window. The GGUF UD-Q4_K_S row admits 262,144. Read the selected profile’s window in Bridge1; the upstream limit alone is not a memory budget.

Choose something else when your Mac cannot leave room for these profiles alongside your working apps. If your priority is the catalog’s coding default rather than this dense model, check Ornith’s profiles in the model catalog next.

Common scale: 0–262,144 tokens

One Qwen3.8 model, with native and admitted windows on a common token scale.The native context is 262,144 tokens. The MLX profile admits 131,072 tokens; the GGUF profile admits 262,144 on the reference Mac. All three bars share one scale, so the MLX bar is half the length of the native and GGUF bars.Native model window262,144 tokensMLX admitted window131,072 tokensGGUF admitted window262,144 tokens

Native model window: 262,144 tokens; MLX admitted window: 131,072 tokens; GGUF admitted window: 262,144 tokens.

Figure 1. One model, different admitted windows: MLX uses half the native window here; GGUF uses the full native window.

Compare fit before comparing output

Measured to 82,541 tokens (39.1 GB peak, M1 Max 64 GB). The 131,072-token window is estimated at 55.4 GB.

The MLX download is 16.1 GB. The catalog’s reference Apple M1 Max has a 32-core GPU, and its figures are dated 2026-10-09; they are not predictions for another Mac.

GGUF has a 15.4 GB download and a 41.8 GB memory estimate at 262,144 tokens. That longer window with a smaller estimated footprint is a reason to investigate the profile, not proof that the two builds have equal memory behavior or coding quality.

GGUF speed is not measured; its short and depth cells remain empty of rates. MLX’s recorded decode figures are output-generation rates, with conditions not recorded, and do not measure the wait to read your prompt or finish a task.

Common scale: 0–60 GB

Qwen3.8 27B

4-bit · MLX

Download size
16.1 GB
Catalog memory estimate
55.4 GB estimated
Measured peak at this window
not measured
Admitted window
131,072 tokens

Catalog date:

Qwen3.8 27B

GGUF UD-Q4_K_S · GGUF / llama.cpp

Download size
15.4 GB
Catalog memory estimate
41.8 GB estimated
Measured peak at this window
not measured
Admitted window
262,144 tokens

Catalog date:

MLX has a 16.1 GB download and 55.4 GB estimated memory at 131,072 tokens. GGUF has a 15.4 GB download and 41.8 GB estimated memory at 262,144 tokens.

Figure 2. Keep the windows beside the memory figures; these are different profiles, not a controlled memory comparison. Reference Mac: Apple M1 Max, 32-core GPU, 64 GB; catalog dated 2026-10-09. Solid bars mark measured peaks, hatching marks estimates, and dashed outlines mark peaks not measured.

Use the admitted window and the evidence for this profile when deciding what fits your work.

Figure 3. A model choice still needs a memory budget and a task check.

When the GGUF window suits your chat

The Qwen3.8 27B GGUF UD-Q4_K_S profile runs through llama.cpp. The catalog estimates 41.8 GB at a 262,144-token window on the reference Apple M1 Max, 32-core GPU, 64 GB. Its download is 15.4 GB. These figures do not establish the window available on another Mac.

Memory at conversation depth: not measured. Decode, both short and at depth: not measured. Time to first reply: not measured. Loading a model with this context limit does not establish a conversation reaching that depth. MLX timings do not predict GGUF speed.

Vision is listed as Yes for this exact catalog profile. That capability does not establish an image or coding-task result in every client. Choose the GGUF row before copying Gateway settings, then check the window Bridge1 offers on your Mac.

Select the row whose window you need

In Bridge1, select Qwen3.8 27B and check whether the row says MLX 4-bit or GGUF UD-Q4_K_S. Keep that choice fixed while copying Gateway settings. Route1 follows the model selected in Bridge1, so a later selection changes what the alias targets.

The two row images identify the profiles and the app’s context controls. Use the chart’s measured and estimated labels when budgeting memory, rather than a cold-start estimate printed in the app.

Qwen3.8-27B MLX 4bit showing an automatic 131,072-token window out of 262,144, approximate start memory of 19 GB and growth of 2.5 GB per 10K tokens, with Dense, image-input and reasoning badges.

Swipe to see the whole row

Read the automatic context limit and approximate memory pill separately from the estimated 55.4 GB at the window in the chart above.

Figure 4. Apple M1 Max, 64 GB. The MLX row shows “Context 131,072 of 262,144 · automatic” and approximate memory of about 19 GB to start, plus 2.5 GB per 10K tokens. “Very Slow”, “est. 8m 34s cold start at 36K” and “Reasoning: medium · your setting” are the app’s own labels and estimate for the capture machine, not Bridge1 measurements. · v0.7.5 ·
Qwen3.8-27B GGUF UD-Q4_K_S showing a full 262,144-token window and the pill “41.8 GB at 262,144 tokens · est.”, with Dense, image-input and reasoning badges.

Swipe to see the whole row

The GGUF memory pill says “est.”; it is an estimate at the displayed window, not a measured peak.

Figure 5. Apple M1 Max, 64 GB. The GGUF row shows “Full context · 262,144” and “41.8 GB at 262,144 tokens · est.”; “est.” means estimated memory. “est. 6m 56s cold start at 36K” is the app’s own estimate for the capture machine, not a Bridge1 measurement. · v0.7.5 ·

The reference result has a narrow job

As of 2026-09-26, Bridge1’s published evaluation records 39 of 40 small-repository coding tasks for Qwen3.8 27B, the reference model. The tasks ran through Claude Code on small Python repositories with hidden tests.

Use that result to decide whether a small, testable coding change is worth trying. It does not establish a separate pass rate for MLX and GGUF, or the same outcome through every client. Test the behavior you need before moving a large project onto it.

The original Qwen page, MLX Community 4-bit conversion and Unsloth GGUF page each declare Apache-2.0. Their links below were accessed 2026-10-19; the declarations apply to the respective pages.

Connect after choosing the profile

On macOS, bridge1 launch starts Claude Code, Codex, OpenCode or Pi with Bridge1, subject to the installed client version, model availability and loading settings; the manual steps still work. Open Gateway’s OpenCode setup and merge the generated provider entry into your configuration. Keep the model name, attachment and modalities values supplied for this profile. The example below shows the guide’s connection values with a placeholder key.

Review the OpenCode guide’s compaction and prompt-reread limits before a long chat. The other client guides follow in the same order as Bridge1’s client list; changing clients does not increase the admitted model window.

// Add this "bridge1" entry to the "provider" object in ~/.config/opencode/opencode.jsonc,
// and set "model" to "bridge1/route1"
"bridge1": {
  "npm": "@ai-sdk/openai-compatible",
  "name": "Bridge1",
  "options": {
    "baseURL": "http://127.0.0.1:54321/v1",
    "apiKey": "YOUR-GATEWAY-KEY"
  },
  "models": {
    "route1": {
      "name": "route1",
      "attachment": true,
      "modalities": {
        "input": [
          "text",
          "image"
        ],
        "output": [
          "text"
        ]
      },
      "limit": {
        "context": 262144,
        "output": 32768
      }
    },
    "mtp-qwen3.6-35b-a3b-gguf": {
      "name": "mtp-qwen3.6-35b-a3b-gguf",
      "attachment": true,
      "modalities": {
        "input": [
          "text",
          "image"
        ],
        "output": [
          "text"
        ]
      },
      "limit": {
        "context": 262144,
        "output": 32768
      }
    }
  }
}

These OpenCode connection values use a placeholder key. Merge the complete provider entry from Gateway into your OpenCode configuration; keep its generated model and context fields.

Figure 6. OpenCode connection values. Replace YOUR-GATEWAY-KEY with your own gateway key; the base URL ends in /v1.

Connect your client

OpenCode setup

  1. Select this model in Bridge1. Merge Gateway’s generated bridge1 provider entry into your OpenCode configuration and select bridge1/route1 or its supplied plain model id.
  2. Keep attachment and modalities fields when supplied. Check compaction and prompt-reread limits in the OpenCode guide before a long chat.

Pi.dev setup

  1. Copy Gateway’s custom-provider JSON for the chosen model and verify the model selection before use.
  2. Keep input, contextWindow and maxTokens when supplied. Early support covers one short smoke-test turn; follow the Pi.dev guide for the current setup.

Codex setup

  1. Save Gateway’s generated provider configuration with wire_api set to responses and a base URL ending in /v1.
  2. Use route1 or the plain model id supplied by Gateway. For Codex Desktop, use the same configuration, then quit and reopen the app.

Hermes Agent setup

  1. Add a custom endpoint with Gateway’s URL, your non-blank key and route1 or the supplied plain model id. Use Test, then Save.
  2. Preserve generated vision and context values, including supports_vision when supplied. Early support covers a single smoke-test turn.

Claude Code setup

  1. Copy the Claude Code launch command from Gateway and run it in your project folder with your own gateway key.
  2. Keep claude-route1, timeout values and any extra context setting generated for the selected window. Use the guide to review Auto mode limits.

Claude Desktop setup

  1. Download config.json from Gateway, enable Developer Mode and open Configure Third-Party Inference; choose New → Import in the configurations switcher and select the file.
  2. Select the Bridge1 configuration, restart Claude Desktop and use Test connection. Review Code tab timeouts before a long prompt.

Limits

Check client support and known limits

Questions

Why do the Qwen3.8 profiles show different context windows?

The native model limit and the admitted profile window answer different questions. Bridge1 admits a window for the selected profile and memory budget. Read that window in the catalog and on your Mac before deciding how much conversation to keep.

Read Qwen3.8 profile windows

Is the Qwen3.8 GGUF memory figure a measured peak?

No. The GGUF figure is an estimate at its admitted window. MLX has a recorded peak at a shorter depth on the reference Mac, while its admitted-window figure is also estimated. Those labels do not establish equal memory behavior or task quality between the profiles.

Understand memory fit

Sources

  1. Qwen3.8 original model: dense architecture, native context, Apache-2.0 · Accessed
  2. MLX Community 4-bit — Apache-2.0 declared · Accessed
  3. Unsloth GGUF — Apache-2.0 declared · Accessed
  4. Bridge1 model catalog: profiles and reference Mac · Accessed
  5. Bridge1 coding evaluation: conditions and limits · Accessed

Make room for local coding

Check your Mac.
Choose your model.