sagemath is such a distribution, but also a rather thick layer of algorithms on top of that. many of them are actually written in cython, to make them fast and to have a good binding with those libraries, etc.