Quantization for the impatient – why int4 doesn’t speed up image generation on GPU
Long time no post… on image generation. Recently I sat down with an old codebase and put together a quantization pipeline for diffusion models out of curiosity – SDXL, …
AI