Using Rust and Rustler turned out to be way easier and it also now works across Elixir versions 1.14 to 1.18.
And it now runs on everything, across more Elixir and Erlang/OTP versions than before!