The upsides are obvious and concrete, the downsides are mostly hypotheticals.
People already carry around a device with a GPS, camera, and microphone that has access to most of their intimate and personal communications and finances. Adding AI capabilities doesn't seem like a bridge too far, that's for sure.