Running GGUF-quantized ComfyUI models on consumer hardware
A local image generation pipeline built on ComfyUI, running GGUF-quantized diffusion models from City96. Designed to fit on a single consumer GPU (GTX 1080 Ti 11GB VRAM) — no cloud APIs, no data leaving the machine.
| GPU | GTX 1080 Ti (11GB VRAM) |
| CPU | Ryzen 9 7900X |
| RAM | 96 GB |
| PyTorch | 2.6.0+cu124 |
Most AI image gen assumes you have an A100 or will pay for API calls. This setup proves quality generation is possible on aging consumer hardware — just requires smart quantization and careful memory management. The models are gated on HuggingFace, so you need a token, but once downloaded, everything runs offline.