Agreed.
Prior to Newton's conception of gravity as objects attracting one another, the primary model used was the Aristotelian one, in which things tended to go to the "zone" where they belong. Things composed of earth (like a rock) tended to sink towards the center of the earth, while things composed of fire or air tended to rise towards the sky.