In the UK and here in Australia, when I set up a utility account I get a message saying "why not set up a direct debit?", which means that a transfer goes straight from my account to theirs at the alotted time each month, for the amount of the bill.

You get your usual bill usually a week or two before the debit goes out so you can make sure it's OK well before the transfer, and the debit process is guaranteed to return the money to you in case of a dispute. You can go into your online banking app and cancel any/all direct debit authorisations whenever you like.