The only people who are notable hundreds or thousands of years after their death are those who wrote something, or those who said something that someone else wrote down. In the long term no one is remembered for their actions.
I can think of two quick examples that disprove your point: Atila and Genghis Khan. They are most certainly remembered for their actions, not their thoughts or writings.
