LLMGateway helps with this -- you can set spend caps on api keys basically, and monitor usage in real time