I've heard this theory a lot too, but it doesn't match with physics. A warm house loses more energy than a cold house, due to a higher temperature difference allowing easier heat transfer. So in most homes, with radiators and high temperature CV, it's way more efficient to just turn it off when you gone.
One exception is when you have a very well insulated house, combined with floor heating and a very efficient, low temperature heat pump. In this case, it takes a lot of time for temperature to move in the house and it's already incredibly efficient.