When we want people to be on time and don't want to assume that they will be late, we usually say a little more or give a reason (like we made reservations etc).