Hi @martin.bjerge,
It looks like the token you are passing is the ID Token, not an Access Token. That would explain why it contains an audience claim with your client ID.
Our Vue Quickstart shows how to retrieve an Access Token.
Please let me know if you have any questions.