After you pay back the 2% interest to the original lender, you're left with 4% as profit.
This usually happens when one government pushes banks for lower interest rates (to stimulate the domestic economy).
It creates a large volume of trades buying USD with JPY, and by doing so causes the JPY currency to become less valuable relative to USD.