You should abstract these concepts in some way. For example, when you are moving an object in 3D you don't need to spend time projecting 3D objects into a 2D display using linear algebra. You just set the x,y,z coordinates and the engine does the hard work.