I believe the "Librarian" Chrome extension - https://fermatslibrary.com/librarian - from Fermat's Library should do that, but I'm not certain if the comments are shared across users.
This is an interesting idea. I think the problem with such an app is that reviewers and publishers have sort of a monopoly on papers, which makes it hard from a business perspective
