That’s an interesting use case, we thought of a composition of expert router with specialized models like code-generation models to handle coding tasks. Currently we encourage Users to experiment with their own data, and we're happy to help. If you're interested in applying this to smaller LLMs and specialized adapters, let's connect!