Slightly deeper and there's drag from the floor as their arms barely miss it. That effect persists until it doesn't .. now it's deep enough.
It needs to be deep enough that vortex's created by swimmers have disapated by the time they reach bottom and reflect back to the surface so as to not interfere with following swimmers or swimmers returning.