In some countries for some age-groups it is implied that only children play with toys. Equating the use of it, to be someone who is a child.

While you can't control interpretation of the word, you're now aware of its connotations in certain cultures and how you can be interpreted. The burden of its possible misuse is now on you.