There's definitely some level of gamma/color correction funtionality at the DRM level already in the kernel [1]. So my desires may already be largely fulfilled, and maybe userspace just needs to get its act together.
[1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/lin...