Have you by chance seen any of the work Facebook has been doing related to the 2d to 3d conversions?
https://github.com/facebookresearch/pifuhd
In an ideal world (for me) the output would be an .fbx file that could be uploaded directly into blender or unreal engine.