That sort of stuff is easy to do with Truffle (which, ironically, lets you define a language using what they call the "truffle dsl").
The SimpleLanguage tutorial language has a bigint style number scheme with efficient optimization:
https://github.com/graalvm/simplelanguage/blob/master/langua...