You can script it with Kotlin these days, there is a hosted cloud version, they've redesigned the entire UI (though the old version did not look like a two year old's sketchbook), it understands test output just fine and can zap you to the right place in the log (and that's always worked for me, maybe it doesn't understand your test framework output or something).
But eh, different strokes for different folks. I hate YAML and much prefer having a GUI to help me set things up.