← Dashboard
Model Slots
Which LLM serves each BigBoy slot
Architecture: All text categories share one model (Qwen3-8B-AWQ) — the system prompt differentiates behavior.
Vision uses a separate model (Qwen3-VL-8B). Both run on a single g5.2xlarge (24GB VRAM).
Active Slots (Fast Tier)
| Slot |
Category |
Underlying Model |
Quant |
Port |
VRAM |
Status |
| bigboy-coding-fast |
Coding |
Qwen/Qwen3-8B-AWQ |
AWQ 4-bit |
8000 |
40% |
Active |
| bigboy-math-fast |
Math |
Qwen/Qwen3-8B-AWQ |
AWQ 4-bit |
8000 |
40% |
Active |
| bigboy-science-fast |
Science |
Qwen/Qwen3-8B-AWQ |
AWQ 4-bit |
8000 |
40% |
Active |
| bigboy-reasoning-fast |
Reasoning |
Qwen/Qwen3-8B-AWQ |
AWQ 4-bit |
8000 |
40% |
Active |
| bigboy-image_recognition-fast |
Vision |
cyankiwi/Qwen3-VL-8B-Instruct-AWQ-4bit |
AWQ 4-bit |
8001 |
50% |
Active |
Planned Slots (Medium Tier — not yet deployed)
| Slot | Category | Planned Model | GPU Needed | Status |
|---|
| bigboy-coding-medium | Coding | Qwen3-Coder-Next (80B MoE, 3B active) | p4d.24xlarge | Planned |
| bigboy-math-medium | Math | MiMo-V2-Flash (309B MoE, 15B active) | p5.48xlarge | Planned |
| bigboy-science-medium | Science | Qwen3.5-397B-A17B | p5.48xlarge | Planned |
| bigboy-reasoning-medium | Reasoning | Qwen3-235B-A22B-Instruct | p4d.24xlarge | Planned |
| bigboy-image_recognition-medium | Vision | InternVL3-78B | p4d.24xlarge | Planned |
Planned Slots (Thinking Tier — not yet deployed)
| Slot | Category | Planned Model | GPU Needed | Status |
|---|
| bigboy-coding-thinking | Coding | Qwen3-Coder-480B-A35B-Instruct | p5.48xlarge | Planned |
| bigboy-math-thinking | Math | Qwen3-235B-A22B-Thinking | p4d.24xlarge | Planned |
| bigboy-science-thinking | Science | Qwen3-235B-A22B-Thinking | p4d.24xlarge | Planned |
| bigboy-reasoning-thinking | Reasoning | DeepSeek-V3.2-Speciale (685B MoE) | p5.48xlarge | Planned |
| bigboy-image_recognition-thinking | Vision | Qwen3-VL-235B | p5.48xlarge | Planned |
Parked (Audio/Video/Image Gen/3D — different inference stack)
| Slot | Category | Planned Model | Status |
|---|
| bigboy-image_generation-* | Image Gen | Z-Image-Turbo / SD 3.5 / FLUX.2 klein | Parked |
| bigboy-video_generation-* | Video Gen | Wan 2.2 / HunyuanVideo / LTXVideo | Parked |
| bigboy-3d_generation-* | 3D Gen | Hunyuan3D 2.5 / InstantMesh / TripoSR | Parked |
| bigboy-audio_tts-* | Audio TTS | Chatterbox / Dia / Kokoro | Parked |
| bigboy-audio_stt-* | Audio STT | Canary Qwen 2.5B / Whisper V3 / Parakeet | Parked |