> Entropy is a well defined concept in information theory (and can be connected to the physical concept). More entropy means more information, not less.
More entropy means more missing information.
https://iopscience.iop.org/book/mono/978-0-7503-3931-5/chapt...