Supply and demand determine the price (or interest rate). Businesses get loans the same say any other business transaction happens. A buyer and seller hash out an agreement. This already happens all the time, even in the US (see investment banking).
If the lender, such as a bank, is any good at their job of underwriting, then they won’t need the federal government’s assurance to bail them out and they will still be able to attract funds from people seeking returns (and risk).