My recommendation is always accessible by default. If the default theme is not accessible, it may be difficult for the user to switch to one that is.
It's so easy to make a site that is accessible - a blank HTML document with no CSS essentially is. It takes work to make a site that isn't.