Yes, it's mainly avoiding pesticide residue that's the health benefit for organic foods. That's why it helps to know which foods have the worst residue issues (e.g. the dirty dozen), buy organic for those ones while buying normal produce for foods that don't have bad residue issues.

I will say though that an underappreciated benefit of organic foods is their probiotic content. Organic fruits and vegetables contain many more species of bacteria than the those grown with pesticides. So Organic produce is actually a great underappreciated probiotic source, especially considering the diversity of probiotics is superior to any store-bought probiotic (provided you have a diet of diverse fruits and vegetables).