Since the aggregator will process sensitive data, you need a lot of audits etc.
If you'd like to use the API to access your own account using open source software, good luck (unless you find an aggregator that is certified and allows you to access your own account through them).