For functions like strcmp, I think they must be signal safe, to be POSIX compliant.
https://man7.org/linux/man-pages/man7/signal-safety.7.html
If it's on this list I generally trust it is safe.
I guess my point is, that if it's not, even a simple function may appear safe, but could do surprising things.