It's pretty simple to do, as long as your USB drive is quick to come online.
I have an RPi running on one of those tiny USB thumb drives that only protrude a few mm and it's running a data capture suite I wrote to monitor my internet connection which writes to a PostgreSQL database on the Pi.
