Scanning and accessing a photo library is extremely random I/O and has nothing to do with the peak sequential throughput. Hard drives are awful at random I/O.
If Apple kept proper indexes and thumbnails somewhere (especially somewhere fast, like on an SSD), maybe it would be fine, but I have heard some bad things about Apple Photos on hard drives, so they might not be doing things optimally.