I wouldn't say its the only way we know, rather its the only politically feasible move. Increasing taxes on the wealthy would arguably be a more effective way to take money out of the economy and wouldn't hurt non-wealthy people as bad, but good luck getting that through congress.
The only party that can act right now is the Fed, and the only move the Fed has in increasing interest rates.