Turning over the leaseholder has a cost all by itself. But more importantly, there is also the reputation damage you'd sustain by doing this.
Consider, any perspective leaseholder who googles the property could find that out that you're kicking out the tenant to increase the rent. That would drastically reduce the potential demand from people looking for the security of a long-term occupancy.
So, yes, it might be possible for a landlord to do that. But if he does it twice, he will earn a reputation and only attract short-term tenants.
This means, it is an option only for the most short-sighted and stupid landlords.