It can be both, like the annoying coworker who won't shut up about how much sex he had over the weekend, or the guy who raves about his favorite scotch at an AA meeting.
A correct observation does not shield it from being inappropriate or in poor taste.