I can't speak for the places that you contacted, but I know where I work there was a large amount of work for a staff that hadn't ramped up to meet the demand. There were people who coordinated closings that were working 80+ hours a week for almost a year in order to barely keep up with demand.
"There must be some pretty large moats in this industry because most shops are clearly not competing on competence or customer service."
There is. It is a capital intensive business that has licensing requirements for every state that you do business in. There are mortgage companies that will loan you the money and then turn around and sell that loan to an investor who would then service the loan. There are also mortgage companies that will loan you the money and also service the loan for its entire lifetime. In the case of the former, you can make your money back relatively quickly as you should be trying to sell the loan to an investor around the time of closing but there is risk in doing so. If you haven't done your due diligence about the borrower and something negative about the borrower comes to light (such as borrower lying about income) then the company that is buying the loan can pull out and now you are on the hook for a large loan that you issued to somebody who may not be qualified. With the latter, your income is going to be slow at first since you would only be making money from monthly payments.