The big current issue that prevents me from using my boards is lack of GPU drivers. Armbian has instructions on how to use the panfork fork, but even those are not good. The panfrost team definitely do good work, so I have high hopes for future drivers. Especially with desktop OpenGL support that the rPis never got.
So I do have a rPi 5 ordered because they've advertised full upstreamed mesa Vulkan support on release. Maybe desktop OpenGL via Zink on top of Vulkan will be good enough.