This looks clean. I appreciate the pkg decoupling.
Regarding the server mode (swatchify serve): Does the decoding step have a hard memory limit or dimension cap? Since image.Decode expands compressed files into full bitmaps, I am wondering if a large resolution upload (like a 4k print asset) could OOM-kill the container before the downscaler kicks in.
