“Family” includes all members of the family, including the parents. If he wanted to refer to just his children he would’ve said “children”.