Hey there @aaronjones welcome to the community!
Unfortunately, without knowing the audience prior to auth the user will need to re-auth one way or another to obtain an access token containing the correct audience.
Can you help me better understand the need for each Org to have a separate API? The more details you can provide about your use case in general the better!