And to add to this, i learned to not use the 'bluetooth' icon to manage the AirPods, instead use the 'triangle with broadcast signal'-icon found next to the volume in the control centre or on many other different locations on your ipad, iphone or apple tv.

Just turn off the auto-connect feature and start using that icon, all the mentioned 'annoyances' will go away :)